Test Report: Docker_Linux_docker_arm64 16969

                    
                      e754f159ea363f9e33ad2331b33fc10ae6e501a8:2023-07-31:30375
                    
                

Test fail (3/319)

Order failed test Duration
25 TestAddons/parallel/Ingress 39.29
143 TestFunctional/parallel/MountCmd/specific-port 15.44
162 TestIngressAddonLegacy/serial/ValidateIngressAddons 53.12
x
+
TestAddons/parallel/Ingress (39.29s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:183: (dbg) Run:  kubectl --context addons-766873 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:208: (dbg) Run:  kubectl --context addons-766873 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:221: (dbg) Run:  kubectl --context addons-766873 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:226: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [a99cfa31-c932-40bb-ab41-04eaa08042f8] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [a99cfa31-c932-40bb-ab41-04eaa08042f8] Running
addons_test.go:226: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 10.019291047s
addons_test.go:238: (dbg) Run:  out/minikube-linux-arm64 -p addons-766873 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Run:  kubectl --context addons-766873 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:267: (dbg) Run:  out/minikube-linux-arm64 -p addons-766873 ip
addons_test.go:273: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:273: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.056131468s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:275: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:279: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p addons-766873 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p addons-766873 addons disable ingress-dns --alsologtostderr -v=1: (1.517353609s)
addons_test.go:287: (dbg) Run:  out/minikube-linux-arm64 -p addons-766873 addons disable ingress --alsologtostderr -v=1
addons_test.go:287: (dbg) Done: out/minikube-linux-arm64 -p addons-766873 addons disable ingress --alsologtostderr -v=1: (8.033174571s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/Ingress]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-766873
helpers_test.go:235: (dbg) docker inspect addons-766873:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "6b78088901d330e5d0e46da26b3d2c03b40d62cfaadcf5782eef5a7cbb1ba02e",
	        "Created": "2023-07-31T10:36:24.071452046Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 454550,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-07-31T10:36:24.427960636Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:f52519afe5f6d6f3ce84cbd7f651b1292638d32ca98ee43d88f2d69e113e44de",
	        "ResolvConfPath": "/var/lib/docker/containers/6b78088901d330e5d0e46da26b3d2c03b40d62cfaadcf5782eef5a7cbb1ba02e/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/6b78088901d330e5d0e46da26b3d2c03b40d62cfaadcf5782eef5a7cbb1ba02e/hostname",
	        "HostsPath": "/var/lib/docker/containers/6b78088901d330e5d0e46da26b3d2c03b40d62cfaadcf5782eef5a7cbb1ba02e/hosts",
	        "LogPath": "/var/lib/docker/containers/6b78088901d330e5d0e46da26b3d2c03b40d62cfaadcf5782eef5a7cbb1ba02e/6b78088901d330e5d0e46da26b3d2c03b40d62cfaadcf5782eef5a7cbb1ba02e-json.log",
	        "Name": "/addons-766873",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "addons-766873:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "addons-766873",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/14e1992b2822d3bf0f189c228e4697a9013974dc325e25f9bc844db80d3287b9-init/diff:/var/lib/docker/overlay2/c7d366fb81dd6a1be1719c87c3423d9dc1e707c6cd39391e90a6318caabf95b7/diff",
	                "MergedDir": "/var/lib/docker/overlay2/14e1992b2822d3bf0f189c228e4697a9013974dc325e25f9bc844db80d3287b9/merged",
	                "UpperDir": "/var/lib/docker/overlay2/14e1992b2822d3bf0f189c228e4697a9013974dc325e25f9bc844db80d3287b9/diff",
	                "WorkDir": "/var/lib/docker/overlay2/14e1992b2822d3bf0f189c228e4697a9013974dc325e25f9bc844db80d3287b9/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "addons-766873",
	                "Source": "/var/lib/docker/volumes/addons-766873/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-766873",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-766873",
	                "name.minikube.sigs.k8s.io": "addons-766873",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "1312b50a6034d8f0b5323ef9185f977554c87408f7d40e367713f3414465bf87",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "35510"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "35509"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "35506"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "35508"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "35507"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/1312b50a6034",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-766873": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "6b78088901d3",
	                        "addons-766873"
	                    ],
	                    "NetworkID": "565beb8f39b03f62f0d13c2deb6f36809b4b17a9d4cdc0adec37b69232431bab",
	                    "EndpointID": "c34ee40ce60243bf096bf5842dd2707dd5884b3d6c65e0f5ea197846e73b9178",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-766873 -n addons-766873
helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-766873 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-766873 logs -n 25: (1.22153264s)
helpers_test.go:252: TestAddons/parallel/Ingress logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-930262   | jenkins | v1.31.1 | 31 Jul 23 10:35 UTC |                     |
	|         | -p download-only-930262        |                        |         |         |                     |                     |
	|         | --force --alsologtostderr      |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0   |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	| start   | -o=json --download-only        | download-only-930262   | jenkins | v1.31.1 | 31 Jul 23 10:35 UTC |                     |
	|         | -p download-only-930262        |                        |         |         |                     |                     |
	|         | --force --alsologtostderr      |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.27.3   |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	| delete  | --all                          | minikube               | jenkins | v1.31.1 | 31 Jul 23 10:35 UTC | 31 Jul 23 10:35 UTC |
	| delete  | -p download-only-930262        | download-only-930262   | jenkins | v1.31.1 | 31 Jul 23 10:35 UTC | 31 Jul 23 10:35 UTC |
	| delete  | -p download-only-930262        | download-only-930262   | jenkins | v1.31.1 | 31 Jul 23 10:35 UTC | 31 Jul 23 10:35 UTC |
	| start   | --download-only -p             | download-docker-761807 | jenkins | v1.31.1 | 31 Jul 23 10:35 UTC |                     |
	|         | download-docker-761807         |                        |         |         |                     |                     |
	|         | --alsologtostderr              |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	| delete  | -p download-docker-761807      | download-docker-761807 | jenkins | v1.31.1 | 31 Jul 23 10:35 UTC | 31 Jul 23 10:35 UTC |
	| start   | --download-only -p             | binary-mirror-243601   | jenkins | v1.31.1 | 31 Jul 23 10:35 UTC |                     |
	|         | binary-mirror-243601           |                        |         |         |                     |                     |
	|         | --alsologtostderr              |                        |         |         |                     |                     |
	|         | --binary-mirror                |                        |         |         |                     |                     |
	|         | http://127.0.0.1:42265         |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	| delete  | -p binary-mirror-243601        | binary-mirror-243601   | jenkins | v1.31.1 | 31 Jul 23 10:35 UTC | 31 Jul 23 10:36 UTC |
	| start   | -p addons-766873               | addons-766873          | jenkins | v1.31.1 | 31 Jul 23 10:36 UTC | 31 Jul 23 10:38 UTC |
	|         | --wait=true --memory=4000      |                        |         |         |                     |                     |
	|         | --alsologtostderr              |                        |         |         |                     |                     |
	|         | --addons=registry              |                        |         |         |                     |                     |
	|         | --addons=metrics-server        |                        |         |         |                     |                     |
	|         | --addons=volumesnapshots       |                        |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver   |                        |         |         |                     |                     |
	|         | --addons=gcp-auth              |                        |         |         |                     |                     |
	|         | --addons=cloud-spanner         |                        |         |         |                     |                     |
	|         | --addons=inspektor-gadget      |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=docker     |                        |         |         |                     |                     |
	|         | --addons=ingress               |                        |         |         |                     |                     |
	|         | --addons=ingress-dns           |                        |         |         |                     |                     |
	| addons  | disable cloud-spanner -p       | addons-766873          | jenkins | v1.31.1 | 31 Jul 23 10:38 UTC | 31 Jul 23 10:38 UTC |
	|         | addons-766873                  |                        |         |         |                     |                     |
	| addons  | enable headlamp                | addons-766873          | jenkins | v1.31.1 | 31 Jul 23 10:38 UTC | 31 Jul 23 10:38 UTC |
	|         | -p addons-766873               |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	| ip      | addons-766873 ip               | addons-766873          | jenkins | v1.31.1 | 31 Jul 23 10:38 UTC | 31 Jul 23 10:38 UTC |
	| addons  | addons-766873 addons disable   | addons-766873          | jenkins | v1.31.1 | 31 Jul 23 10:38 UTC | 31 Jul 23 10:38 UTC |
	|         | registry --alsologtostderr     |                        |         |         |                     |                     |
	|         | -v=1                           |                        |         |         |                     |                     |
	| addons  | addons-766873 addons           | addons-766873          | jenkins | v1.31.1 | 31 Jul 23 10:38 UTC | 31 Jul 23 10:38 UTC |
	|         | disable metrics-server         |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	| addons  | disable inspektor-gadget -p    | addons-766873          | jenkins | v1.31.1 | 31 Jul 23 10:38 UTC | 31 Jul 23 10:39 UTC |
	|         | addons-766873                  |                        |         |         |                     |                     |
	| ssh     | addons-766873 ssh curl -s      | addons-766873          | jenkins | v1.31.1 | 31 Jul 23 10:39 UTC | 31 Jul 23 10:39 UTC |
	|         | http://127.0.0.1/ -H 'Host:    |                        |         |         |                     |                     |
	|         | nginx.example.com'             |                        |         |         |                     |                     |
	| ip      | addons-766873 ip               | addons-766873          | jenkins | v1.31.1 | 31 Jul 23 10:39 UTC | 31 Jul 23 10:39 UTC |
	| addons  | addons-766873 addons disable   | addons-766873          | jenkins | v1.31.1 | 31 Jul 23 10:39 UTC | 31 Jul 23 10:39 UTC |
	|         | ingress-dns --alsologtostderr  |                        |         |         |                     |                     |
	|         | -v=1                           |                        |         |         |                     |                     |
	| addons  | addons-766873 addons           | addons-766873          | jenkins | v1.31.1 | 31 Jul 23 10:39 UTC | 31 Jul 23 10:39 UTC |
	|         | disable csi-hostpath-driver    |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	| addons  | addons-766873 addons disable   | addons-766873          | jenkins | v1.31.1 | 31 Jul 23 10:39 UTC | 31 Jul 23 10:39 UTC |
	|         | ingress --alsologtostderr -v=1 |                        |         |         |                     |                     |
	| addons  | addons-766873 addons           | addons-766873          | jenkins | v1.31.1 | 31 Jul 23 10:39 UTC | 31 Jul 23 10:39 UTC |
	|         | disable volumesnapshots        |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	|---------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/31 10:36:00
	Running on machine: ip-172-31-29-130
	Binary: Built with gc go1.20.6 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0731 10:36:00.317470  454090 out.go:296] Setting OutFile to fd 1 ...
	I0731 10:36:00.317850  454090 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0731 10:36:00.317886  454090 out.go:309] Setting ErrFile to fd 2...
	I0731 10:36:00.317910  454090 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0731 10:36:00.318723  454090 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16969-448039/.minikube/bin
	I0731 10:36:00.319407  454090 out.go:303] Setting JSON to false
	I0731 10:36:00.320611  454090 start.go:128] hostinfo: {"hostname":"ip-172-31-29-130","uptime":65908,"bootTime":1690733853,"procs":194,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0731 10:36:00.320705  454090 start.go:138] virtualization:  
	I0731 10:36:00.323684  454090 out.go:177] * [addons-766873] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	I0731 10:36:00.325781  454090 out.go:177]   - MINIKUBE_LOCATION=16969
	I0731 10:36:00.328345  454090 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0731 10:36:00.325958  454090 notify.go:220] Checking for updates...
	I0731 10:36:00.332909  454090 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16969-448039/kubeconfig
	I0731 10:36:00.335170  454090 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16969-448039/.minikube
	I0731 10:36:00.337818  454090 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0731 10:36:00.340055  454090 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0731 10:36:00.342992  454090 driver.go:373] Setting default libvirt URI to qemu:///system
	I0731 10:36:00.372314  454090 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0731 10:36:00.372537  454090 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0731 10:36:00.464341  454090 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:40 SystemTime:2023-07-31 10:36:00.453099837 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0731 10:36:00.464450  454090 docker.go:294] overlay module found
	I0731 10:36:00.466376  454090 out.go:177] * Using the docker driver based on user configuration
	I0731 10:36:00.467982  454090 start.go:298] selected driver: docker
	I0731 10:36:00.468003  454090 start.go:898] validating driver "docker" against <nil>
	I0731 10:36:00.468017  454090 start.go:909] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0731 10:36:00.468906  454090 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0731 10:36:00.543288  454090 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:40 SystemTime:2023-07-31 10:36:00.533210261 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0731 10:36:00.543465  454090 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0731 10:36:00.543701  454090 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0731 10:36:00.545509  454090 out.go:177] * Using Docker driver with root privileges
	I0731 10:36:00.547243  454090 cni.go:84] Creating CNI manager for ""
	I0731 10:36:00.547278  454090 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0731 10:36:00.547291  454090 start_flags.go:314] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0731 10:36:00.547307  454090 start_flags.go:319] config:
	{Name:addons-766873 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:addons-766873 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:
cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0731 10:36:00.549384  454090 out.go:177] * Starting control plane node addons-766873 in cluster addons-766873
	I0731 10:36:00.551291  454090 cache.go:122] Beginning downloading kic base image for docker with docker
	I0731 10:36:00.553016  454090 out.go:177] * Pulling base image ...
	I0731 10:36:00.554717  454090 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0731 10:36:00.554800  454090 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0731 10:36:00.554851  454090 preload.go:148] Found local preload: /home/jenkins/minikube-integration/16969-448039/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4
	I0731 10:36:00.554882  454090 cache.go:57] Caching tarball of preloaded images
	I0731 10:36:00.554964  454090 preload.go:174] Found /home/jenkins/minikube-integration/16969-448039/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4 in cache, skipping download
	I0731 10:36:00.554974  454090 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.3 on docker
	I0731 10:36:00.555308  454090 profile.go:148] Saving config to /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/config.json ...
	I0731 10:36:00.555330  454090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/config.json: {Name:mk99303ca45360095e332ed940f2ba35929ae460 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:36:00.571634  454090 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 to local cache
	I0731 10:36:00.571768  454090 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory
	I0731 10:36:00.571796  454090 image.go:66] Found gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory, skipping pull
	I0731 10:36:00.571802  454090 image.go:105] gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 exists in cache, skipping pull
	I0731 10:36:00.571810  454090 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 as a tarball
	I0731 10:36:00.571818  454090 cache.go:163] Loading gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 from local cache
	I0731 10:36:16.524885  454090 cache.go:165] successfully loaded and using gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 from cached tarball
	I0731 10:36:16.524922  454090 cache.go:195] Successfully downloaded all kic artifacts
	I0731 10:36:16.524985  454090 start.go:365] acquiring machines lock for addons-766873: {Name:mkafa7b89ffb74844f85d7ddf7d5e9fb9ff7ce1f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0731 10:36:16.525121  454090 start.go:369] acquired machines lock for "addons-766873" in 112.746µs
	I0731 10:36:16.525149  454090 start.go:93] Provisioning new machine with config: &{Name:addons-766873 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:addons-766873 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServ
erIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custo
mQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0} &{Name: IP: Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0731 10:36:16.525238  454090 start.go:125] createHost starting for "" (driver="docker")
	I0731 10:36:16.527448  454090 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I0731 10:36:16.527693  454090 start.go:159] libmachine.API.Create for "addons-766873" (driver="docker")
	I0731 10:36:16.527729  454090 client.go:168] LocalClient.Create starting
	I0731 10:36:16.527877  454090 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca.pem
	I0731 10:36:17.655466  454090 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/cert.pem
	I0731 10:36:18.106702  454090 cli_runner.go:164] Run: docker network inspect addons-766873 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0731 10:36:18.127132  454090 cli_runner.go:211] docker network inspect addons-766873 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0731 10:36:18.127227  454090 network_create.go:281] running [docker network inspect addons-766873] to gather additional debugging logs...
	I0731 10:36:18.127249  454090 cli_runner.go:164] Run: docker network inspect addons-766873
	W0731 10:36:18.149645  454090 cli_runner.go:211] docker network inspect addons-766873 returned with exit code 1
	I0731 10:36:18.149685  454090 network_create.go:284] error running [docker network inspect addons-766873]: docker network inspect addons-766873: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-766873 not found
	I0731 10:36:18.149697  454090 network_create.go:286] output of [docker network inspect addons-766873]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-766873 not found
	
	** /stderr **
	I0731 10:36:18.149760  454090 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0731 10:36:18.168233  454090 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x400092ea10}
	I0731 10:36:18.168273  454090 network_create.go:123] attempt to create docker network addons-766873 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0731 10:36:18.168333  454090 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-766873 addons-766873
	I0731 10:36:18.244249  454090 network_create.go:107] docker network addons-766873 192.168.49.0/24 created
	I0731 10:36:18.244279  454090 kic.go:117] calculated static IP "192.168.49.2" for the "addons-766873" container
	I0731 10:36:18.244361  454090 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0731 10:36:18.261617  454090 cli_runner.go:164] Run: docker volume create addons-766873 --label name.minikube.sigs.k8s.io=addons-766873 --label created_by.minikube.sigs.k8s.io=true
	I0731 10:36:18.280264  454090 oci.go:103] Successfully created a docker volume addons-766873
	I0731 10:36:18.280355  454090 cli_runner.go:164] Run: docker run --rm --name addons-766873-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-766873 --entrypoint /usr/bin/test -v addons-766873:/var gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -d /var/lib
	I0731 10:36:20.123842  454090 cli_runner.go:217] Completed: docker run --rm --name addons-766873-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-766873 --entrypoint /usr/bin/test -v addons-766873:/var gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -d /var/lib: (1.84342774s)
	I0731 10:36:20.123878  454090 oci.go:107] Successfully prepared a docker volume addons-766873
	I0731 10:36:20.123898  454090 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0731 10:36:20.123924  454090 kic.go:190] Starting extracting preloaded images to volume ...
	I0731 10:36:20.124022  454090 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16969-448039/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-766873:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -I lz4 -xf /preloaded.tar -C /extractDir
	I0731 10:36:23.978742  454090 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16969-448039/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-766873:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -I lz4 -xf /preloaded.tar -C /extractDir: (3.854639099s)
	I0731 10:36:23.978790  454090 kic.go:199] duration metric: took 3.854861 seconds to extract preloaded images to volume
	W0731 10:36:23.978986  454090 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0731 10:36:23.979116  454090 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0731 10:36:24.054618  454090 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-766873 --name addons-766873 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-766873 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-766873 --network addons-766873 --ip 192.168.49.2 --volume addons-766873:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631
	I0731 10:36:24.438757  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Running}}
	I0731 10:36:24.465416  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Status}}
	I0731 10:36:24.497217  454090 cli_runner.go:164] Run: docker exec addons-766873 stat /var/lib/dpkg/alternatives/iptables
	I0731 10:36:24.576760  454090 oci.go:144] the created container "addons-766873" has a running status.
	I0731 10:36:24.576786  454090 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa...
	I0731 10:36:25.039971  454090 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0731 10:36:25.067457  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Status}}
	I0731 10:36:25.127303  454090 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0731 10:36:25.127322  454090 kic_runner.go:114] Args: [docker exec --privileged addons-766873 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0731 10:36:25.241493  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Status}}
	I0731 10:36:25.264003  454090 machine.go:88] provisioning docker machine ...
	I0731 10:36:25.264034  454090 ubuntu.go:169] provisioning hostname "addons-766873"
	I0731 10:36:25.264099  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:36:25.292263  454090 main.go:141] libmachine: Using SSH client type: native
	I0731 10:36:25.292816  454090 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 35510 <nil> <nil>}
	I0731 10:36:25.292844  454090 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-766873 && echo "addons-766873" | sudo tee /etc/hostname
	I0731 10:36:25.524852  454090 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-766873
	
	I0731 10:36:25.524935  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:36:25.556442  454090 main.go:141] libmachine: Using SSH client type: native
	I0731 10:36:25.556868  454090 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 35510 <nil> <nil>}
	I0731 10:36:25.556886  454090 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-766873' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-766873/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-766873' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0731 10:36:25.697649  454090 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0731 10:36:25.697742  454090 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/16969-448039/.minikube CaCertPath:/home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/16969-448039/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/16969-448039/.minikube}
	I0731 10:36:25.697783  454090 ubuntu.go:177] setting up certificates
	I0731 10:36:25.697824  454090 provision.go:83] configureAuth start
	I0731 10:36:25.697938  454090 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-766873
	I0731 10:36:25.723148  454090 provision.go:138] copyHostCerts
	I0731 10:36:25.723228  454090 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/16969-448039/.minikube/ca.pem (1078 bytes)
	I0731 10:36:25.723343  454090 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/16969-448039/.minikube/cert.pem (1123 bytes)
	I0731 10:36:25.723417  454090 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/16969-448039/.minikube/key.pem (1679 bytes)
	I0731 10:36:25.723468  454090 provision.go:112] generating server cert: /home/jenkins/minikube-integration/16969-448039/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca-key.pem org=jenkins.addons-766873 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube addons-766873]
	I0731 10:36:25.926735  454090 provision.go:172] copyRemoteCerts
	I0731 10:36:25.926873  454090 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0731 10:36:25.926940  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:36:25.946041  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:36:26.043045  454090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0731 10:36:26.073261  454090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
	I0731 10:36:26.105037  454090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0731 10:36:26.134930  454090 provision.go:86] duration metric: configureAuth took 437.074006ms
	I0731 10:36:26.134957  454090 ubuntu.go:193] setting minikube options for container-runtime
	I0731 10:36:26.135152  454090 config.go:182] Loaded profile config "addons-766873": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0731 10:36:26.135209  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:36:26.153935  454090 main.go:141] libmachine: Using SSH client type: native
	I0731 10:36:26.154372  454090 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 35510 <nil> <nil>}
	I0731 10:36:26.154389  454090 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I0731 10:36:26.286017  454090 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
	
	I0731 10:36:26.286038  454090 ubuntu.go:71] root file system type: overlay
	I0731 10:36:26.286152  454090 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
	I0731 10:36:26.286220  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:36:26.305500  454090 main.go:141] libmachine: Using SSH client type: native
	I0731 10:36:26.305934  454090 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 35510 <nil> <nil>}
	I0731 10:36:26.306019  454090 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I0731 10:36:26.448155  454090 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I0731 10:36:26.448311  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:36:26.466830  454090 main.go:141] libmachine: Using SSH client type: native
	I0731 10:36:26.467275  454090 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 35510 <nil> <nil>}
	I0731 10:36:26.467294  454090 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I0731 10:36:27.305675  454090 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2023-07-07 14:51:01.000000000 +0000
	+++ /lib/systemd/system/docker.service.new	2023-07-31 10:36:26.442025058 +0000
	@@ -1,30 +1,32 @@
	 [Unit]
	 Description=Docker Application Container Engine
	 Documentation=https://docs.docker.com
	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
	-Wants=network-online.target containerd.service
	+BindsTo=containerd.service
	+After=network-online.target firewalld.service containerd.service
	+Wants=network-online.target
	 Requires=docker.socket
	+StartLimitBurst=3
	+StartLimitIntervalSec=60
	 
	 [Service]
	 Type=notify
	-# the default is not to use systemd for cgroups because the delegate issues still
	-# exists and systemd currently does not support the cgroup feature set required
	-# for containers run by docker
	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
	-ExecReload=/bin/kill -s HUP $MAINPID
	-TimeoutStartSec=0
	-RestartSec=2
	-Restart=always
	+Restart=on-failure
	 
	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
	-# to make them work for either version of systemd.
	-StartLimitBurst=3
	 
	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
	-# this option work for either version of systemd.
	-StartLimitInterval=60s
	+
	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	+# The base configuration already specifies an 'ExecStart=...' command. The first directive
	+# here is to clear out that command inherited from the base configuration. Without this,
	+# the command from the base configuration and the command specified here are treated as
	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	+# will catch this invalid input and refuse to start the service with an error like:
	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	+
	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	+ExecStart=
	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	+ExecReload=/bin/kill -s HUP $MAINPID
	 
	 # Having non-zero Limit*s causes performance problems due to accounting overhead
	 # in the kernel. We recommend using cgroups to do container-local accounting.
	@@ -32,16 +34,16 @@
	 LimitNPROC=infinity
	 LimitCORE=infinity
	 
	-# Comment TasksMax if your systemd version does not support it.
	-# Only systemd 226 and above support this option.
	+# Uncomment TasksMax if your systemd version supports it.
	+# Only systemd 226 and above support this version.
	 TasksMax=infinity
	+TimeoutStartSec=0
	 
	 # set delegate yes so that systemd does not reset the cgroups of docker containers
	 Delegate=yes
	 
	 # kill only the docker process, not all processes in the cgroup
	 KillMode=process
	-OOMScoreAdjust=-500
	 
	 [Install]
	 WantedBy=multi-user.target
	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install enable docker
	
	I0731 10:36:27.305714  454090 machine.go:91] provisioned docker machine in 2.041689063s
	I0731 10:36:27.305724  454090 client.go:171] LocalClient.Create took 10.77798975s
	I0731 10:36:27.305736  454090 start.go:167] duration metric: libmachine.API.Create for "addons-766873" took 10.778044856s
	I0731 10:36:27.305744  454090 start.go:300] post-start starting for "addons-766873" (driver="docker")
	I0731 10:36:27.305757  454090 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0731 10:36:27.305833  454090 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0731 10:36:27.305879  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:36:27.324966  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:36:27.423435  454090 ssh_runner.go:195] Run: cat /etc/os-release
	I0731 10:36:27.427770  454090 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0731 10:36:27.427810  454090 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0731 10:36:27.427822  454090 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0731 10:36:27.427828  454090 info.go:137] Remote host: Ubuntu 22.04.2 LTS
	I0731 10:36:27.427855  454090 filesync.go:126] Scanning /home/jenkins/minikube-integration/16969-448039/.minikube/addons for local assets ...
	I0731 10:36:27.427930  454090 filesync.go:126] Scanning /home/jenkins/minikube-integration/16969-448039/.minikube/files for local assets ...
	I0731 10:36:27.427959  454090 start.go:303] post-start completed in 122.204884ms
	I0731 10:36:27.428320  454090 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-766873
	I0731 10:36:27.450145  454090 profile.go:148] Saving config to /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/config.json ...
	I0731 10:36:27.450441  454090 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0731 10:36:27.450492  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:36:27.470204  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:36:27.562491  454090 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0731 10:36:27.568508  454090 start.go:128] duration metric: createHost completed in 11.04324848s
	I0731 10:36:27.568537  454090 start.go:83] releasing machines lock for "addons-766873", held for 11.043406306s
	I0731 10:36:27.568615  454090 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-766873
	I0731 10:36:27.586378  454090 ssh_runner.go:195] Run: cat /version.json
	I0731 10:36:27.586392  454090 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0731 10:36:27.586431  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:36:27.586464  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:36:27.606555  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:36:27.615962  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:36:27.696821  454090 ssh_runner.go:195] Run: systemctl --version
	I0731 10:36:27.835356  454090 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0731 10:36:27.841392  454090 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0731 10:36:27.872861  454090 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0731 10:36:27.872960  454090 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0731 10:36:27.908032  454090 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0731 10:36:27.908065  454090 start.go:466] detecting cgroup driver to use...
	I0731 10:36:27.908100  454090 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0731 10:36:27.908271  454090 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0731 10:36:27.928918  454090 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I0731 10:36:27.941312  454090 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0731 10:36:27.953632  454090 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0731 10:36:27.953703  454090 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0731 10:36:27.966439  454090 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0731 10:36:27.978899  454090 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0731 10:36:27.991207  454090 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0731 10:36:28.005046  454090 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0731 10:36:28.017833  454090 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0731 10:36:28.031689  454090 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0731 10:36:28.042980  454090 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0731 10:36:28.054291  454090 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0731 10:36:28.148570  454090 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0731 10:36:28.249392  454090 start.go:466] detecting cgroup driver to use...
	I0731 10:36:28.249505  454090 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0731 10:36:28.249600  454090 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I0731 10:36:28.270377  454090 cruntime.go:276] skipping containerd shutdown because we are bound to it
	I0731 10:36:28.270454  454090 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0731 10:36:28.286075  454090 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0731 10:36:28.313550  454090 ssh_runner.go:195] Run: which cri-dockerd
	I0731 10:36:28.321030  454090 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I0731 10:36:28.333585  454090 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I0731 10:36:28.355929  454090 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I0731 10:36:28.462490  454090 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I0731 10:36:28.582023  454090 docker.go:535] configuring docker to use "cgroupfs" as cgroup driver...
	I0731 10:36:28.582102  454090 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
	I0731 10:36:28.605769  454090 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0731 10:36:28.706808  454090 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0731 10:36:28.975114  454090 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I0731 10:36:29.085155  454090 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
	I0731 10:36:29.184923  454090 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
	I0731 10:36:29.307940  454090 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0731 10:36:29.400415  454090 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
	I0731 10:36:29.417790  454090 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0731 10:36:29.511494  454090 ssh_runner.go:195] Run: sudo systemctl restart cri-docker
	I0731 10:36:29.604920  454090 start.go:513] Will wait 60s for socket path /var/run/cri-dockerd.sock
	I0731 10:36:29.605080  454090 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
	I0731 10:36:29.610532  454090 start.go:534] Will wait 60s for crictl version
	I0731 10:36:29.610651  454090 ssh_runner.go:195] Run: which crictl
	I0731 10:36:29.616448  454090 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0731 10:36:29.676826  454090 start.go:550] Version:  0.1.0
	RuntimeName:  docker
	RuntimeVersion:  24.0.4
	RuntimeApiVersion:  v1
	I0731 10:36:29.676977  454090 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0731 10:36:29.707615  454090 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0731 10:36:29.738233  454090 out.go:204] * Preparing Kubernetes v1.27.3 on Docker 24.0.4 ...
	I0731 10:36:29.738369  454090 cli_runner.go:164] Run: docker network inspect addons-766873 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0731 10:36:29.755317  454090 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0731 10:36:29.760634  454090 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0731 10:36:29.775476  454090 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0731 10:36:29.775543  454090 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0731 10:36:29.797007  454090 docker.go:636] Got preloaded images: -- stdout --
	registry.k8s.io/kube-apiserver:v1.27.3
	registry.k8s.io/kube-proxy:v1.27.3
	registry.k8s.io/kube-controller-manager:v1.27.3
	registry.k8s.io/kube-scheduler:v1.27.3
	registry.k8s.io/coredns/coredns:v1.10.1
	registry.k8s.io/etcd:3.5.7-0
	registry.k8s.io/pause:3.9
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I0731 10:36:29.797033  454090 docker.go:566] Images already preloaded, skipping extraction
	I0731 10:36:29.797100  454090 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0731 10:36:29.818832  454090 docker.go:636] Got preloaded images: -- stdout --
	registry.k8s.io/kube-apiserver:v1.27.3
	registry.k8s.io/kube-scheduler:v1.27.3
	registry.k8s.io/kube-proxy:v1.27.3
	registry.k8s.io/kube-controller-manager:v1.27.3
	registry.k8s.io/coredns/coredns:v1.10.1
	registry.k8s.io/etcd:3.5.7-0
	registry.k8s.io/pause:3.9
	gcr.io/k8s-minikube/storage-provisioner:v5
	
	-- /stdout --
	I0731 10:36:29.818855  454090 cache_images.go:84] Images are preloaded, skipping loading
	I0731 10:36:29.818952  454090 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I0731 10:36:29.886353  454090 cni.go:84] Creating CNI manager for ""
	I0731 10:36:29.886429  454090 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0731 10:36:29.886451  454090 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0731 10:36:29.886472  454090 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.27.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-766873 NodeName:addons-766873 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuber
netes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0731 10:36:29.886648  454090 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/cri-dockerd.sock
	  name: "addons-766873"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.27.3
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0731 10:36:29.886723  454090 kubeadm.go:976] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.27.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/cri-dockerd.sock --hostname-override=addons-766873 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.27.3 ClusterName:addons-766873 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0731 10:36:29.886792  454090 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.27.3
	I0731 10:36:29.897934  454090 binaries.go:44] Found k8s binaries, skipping transfer
	I0731 10:36:29.898064  454090 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0731 10:36:29.909200  454090 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (374 bytes)
	I0731 10:36:29.930648  454090 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0731 10:36:29.952046  454090 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2096 bytes)
	I0731 10:36:29.973928  454090 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0731 10:36:29.978554  454090 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0731 10:36:29.992381  454090 certs.go:56] Setting up /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873 for IP: 192.168.49.2
	I0731 10:36:29.992416  454090 certs.go:190] acquiring lock for shared ca certs: {Name:mk0b581020d66126e84a8fcc9d64f9f01083a80e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:36:29.993106  454090 certs.go:204] generating minikubeCA CA: /home/jenkins/minikube-integration/16969-448039/.minikube/ca.key
	I0731 10:36:30.708793  454090 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16969-448039/.minikube/ca.crt ...
	I0731 10:36:30.708835  454090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/ca.crt: {Name:mk60e822e5bbd3b517a3544705cd7d262433de43 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:36:30.709148  454090 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16969-448039/.minikube/ca.key ...
	I0731 10:36:30.709165  454090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/ca.key: {Name:mk372b41ba7265534b66ca54798953230f5b3204 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:36:30.709309  454090 certs.go:204] generating proxyClientCA CA: /home/jenkins/minikube-integration/16969-448039/.minikube/proxy-client-ca.key
	I0731 10:36:31.636455  454090 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16969-448039/.minikube/proxy-client-ca.crt ...
	I0731 10:36:31.636488  454090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/proxy-client-ca.crt: {Name:mk9bca85f3aa2d9574df4609c38550e06113e268 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:36:31.636691  454090 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16969-448039/.minikube/proxy-client-ca.key ...
	I0731 10:36:31.636705  454090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/proxy-client-ca.key: {Name:mk7b8c4766a166fc6d0b4490464895ca5ed10999 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:36:31.636826  454090 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.key
	I0731 10:36:31.636843  454090 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt with IP's: []
	I0731 10:36:32.055882  454090 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt ...
	I0731 10:36:32.055916  454090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: {Name:mk4bfbe859b21cce96de4bbcad069aa39da171c9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:36:32.056105  454090 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.key ...
	I0731 10:36:32.056132  454090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.key: {Name:mk232e04a911a2971961a05b09e0e49cfc0ba9a1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:36:32.056627  454090 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/apiserver.key.dd3b5fb2
	I0731 10:36:32.056650  454090 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0731 10:36:32.896928  454090 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/apiserver.crt.dd3b5fb2 ...
	I0731 10:36:32.896962  454090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/apiserver.crt.dd3b5fb2: {Name:mkec5b9e4d9ef5ac1d61198aa458997a2afc8897 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:36:32.897155  454090 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/apiserver.key.dd3b5fb2 ...
	I0731 10:36:32.897168  454090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/apiserver.key.dd3b5fb2: {Name:mkc5ba38b8efd0d3d14a740fb3ecc7e1aa0e45f2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:36:32.897258  454090 certs.go:337] copying /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/apiserver.crt
	I0731 10:36:32.897330  454090 certs.go:341] copying /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/apiserver.key
	I0731 10:36:32.897384  454090 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/proxy-client.key
	I0731 10:36:32.897405  454090 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/proxy-client.crt with IP's: []
	I0731 10:36:33.635731  454090 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/proxy-client.crt ...
	I0731 10:36:33.635764  454090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/proxy-client.crt: {Name:mk01318b2aeba168de80aa618e4d6bb5f68f6411 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:36:33.635955  454090 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/proxy-client.key ...
	I0731 10:36:33.635967  454090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/proxy-client.key: {Name:mk233480642cbb483d14b1605daad443e880ffae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:36:33.636583  454090 certs.go:437] found cert: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca-key.pem (1679 bytes)
	I0731 10:36:33.636632  454090 certs.go:437] found cert: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca.pem (1078 bytes)
	I0731 10:36:33.636661  454090 certs.go:437] found cert: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/home/jenkins/minikube-integration/16969-448039/.minikube/certs/cert.pem (1123 bytes)
	I0731 10:36:33.636690  454090 certs.go:437] found cert: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/home/jenkins/minikube-integration/16969-448039/.minikube/certs/key.pem (1679 bytes)
	I0731 10:36:33.637291  454090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0731 10:36:33.668915  454090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0731 10:36:33.698746  454090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0731 10:36:33.728763  454090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0731 10:36:33.758263  454090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0731 10:36:33.787521  454090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0731 10:36:33.816270  454090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0731 10:36:33.846877  454090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0731 10:36:33.876249  454090 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0731 10:36:33.905048  454090 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0731 10:36:33.925980  454090 ssh_runner.go:195] Run: openssl version
	I0731 10:36:33.933089  454090 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0731 10:36:33.944662  454090 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0731 10:36:33.949311  454090 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Jul 31 10:36 /usr/share/ca-certificates/minikubeCA.pem
	I0731 10:36:33.949395  454090 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0731 10:36:33.958014  454090 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0731 10:36:33.970029  454090 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0731 10:36:33.974476  454090 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0731 10:36:33.974526  454090 kubeadm.go:404] StartCluster: {Name:addons-766873 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:addons-766873 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clu
ster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmw
arePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0731 10:36:33.974658  454090 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I0731 10:36:33.995418  454090 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0731 10:36:34.007771  454090 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0731 10:36:34.019311  454090 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0731 10:36:34.019471  454090 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0731 10:36:34.031333  454090 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0731 10:36:34.031379  454090 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0731 10:36:34.085306  454090 kubeadm.go:322] [init] Using Kubernetes version: v1.27.3
	I0731 10:36:34.085526  454090 kubeadm.go:322] [preflight] Running pre-flight checks
	I0731 10:36:34.149530  454090 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0731 10:36:34.149601  454090 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1040-aws
	I0731 10:36:34.149640  454090 kubeadm.go:322] OS: Linux
	I0731 10:36:34.149688  454090 kubeadm.go:322] CGROUPS_CPU: enabled
	I0731 10:36:34.149737  454090 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0731 10:36:34.149784  454090 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0731 10:36:34.149833  454090 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0731 10:36:34.149881  454090 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0731 10:36:34.149934  454090 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0731 10:36:34.149980  454090 kubeadm.go:322] CGROUPS_PIDS: enabled
	I0731 10:36:34.150028  454090 kubeadm.go:322] CGROUPS_HUGETLB: enabled
	I0731 10:36:34.150074  454090 kubeadm.go:322] CGROUPS_BLKIO: enabled
	I0731 10:36:34.235523  454090 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0731 10:36:34.235632  454090 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0731 10:36:34.235723  454090 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0731 10:36:34.576327  454090 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0731 10:36:34.579354  454090 out.go:204]   - Generating certificates and keys ...
	I0731 10:36:34.579520  454090 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0731 10:36:34.579617  454090 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0731 10:36:35.186382  454090 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0731 10:36:35.418910  454090 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0731 10:36:35.702333  454090 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0731 10:36:36.122127  454090 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0731 10:36:36.504411  454090 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0731 10:36:36.504721  454090 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-766873 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0731 10:36:36.748619  454090 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0731 10:36:36.749078  454090 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-766873 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0731 10:36:37.135920  454090 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0731 10:36:37.392268  454090 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0731 10:36:37.743686  454090 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0731 10:36:37.744208  454090 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0731 10:36:38.154960  454090 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0731 10:36:38.323844  454090 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0731 10:36:38.662574  454090 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0731 10:36:39.075044  454090 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0731 10:36:39.089690  454090 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0731 10:36:39.091320  454090 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0731 10:36:39.091796  454090 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0731 10:36:39.208528  454090 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0731 10:36:39.210512  454090 out.go:204]   - Booting up control plane ...
	I0731 10:36:39.210625  454090 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0731 10:36:39.210701  454090 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0731 10:36:39.211323  454090 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0731 10:36:39.218806  454090 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0731 10:36:39.222006  454090 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0731 10:36:47.225319  454090 kubeadm.go:322] [apiclient] All control plane components are healthy after 8.003192 seconds
	I0731 10:36:47.225437  454090 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0731 10:36:47.242340  454090 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0731 10:36:47.767360  454090 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0731 10:36:47.767565  454090 kubeadm.go:322] [mark-control-plane] Marking the node addons-766873 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0731 10:36:48.279223  454090 kubeadm.go:322] [bootstrap-token] Using token: 6e20hj.yyn30sj1pe8ypk1g
	I0731 10:36:48.281103  454090 out.go:204]   - Configuring RBAC rules ...
	I0731 10:36:48.281217  454090 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0731 10:36:48.288363  454090 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0731 10:36:48.298489  454090 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0731 10:36:48.302669  454090 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0731 10:36:48.306738  454090 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0731 10:36:48.310569  454090 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0731 10:36:48.324547  454090 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0731 10:36:48.580863  454090 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0731 10:36:48.700087  454090 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0731 10:36:48.702149  454090 kubeadm.go:322] 
	I0731 10:36:48.702219  454090 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0731 10:36:48.702243  454090 kubeadm.go:322] 
	I0731 10:36:48.702338  454090 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0731 10:36:48.702348  454090 kubeadm.go:322] 
	I0731 10:36:48.702373  454090 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0731 10:36:48.702517  454090 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0731 10:36:48.702575  454090 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0731 10:36:48.702585  454090 kubeadm.go:322] 
	I0731 10:36:48.702636  454090 kubeadm.go:322] Alternatively, if you are the root user, you can run:
	I0731 10:36:48.702644  454090 kubeadm.go:322] 
	I0731 10:36:48.702689  454090 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0731 10:36:48.702699  454090 kubeadm.go:322] 
	I0731 10:36:48.702749  454090 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0731 10:36:48.702828  454090 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0731 10:36:48.702908  454090 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0731 10:36:48.702918  454090 kubeadm.go:322] 
	I0731 10:36:48.703012  454090 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0731 10:36:48.703101  454090 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0731 10:36:48.703110  454090 kubeadm.go:322] 
	I0731 10:36:48.703597  454090 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 6e20hj.yyn30sj1pe8ypk1g \
	I0731 10:36:48.703748  454090 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:794743d7f04bd4593179b1fa8a4b2ac7637bc5da56bbcead87c371ae0b0f7ff1 \
	I0731 10:36:48.703862  454090 kubeadm.go:322] 	--control-plane 
	I0731 10:36:48.703873  454090 kubeadm.go:322] 
	I0731 10:36:48.703974  454090 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0731 10:36:48.703983  454090 kubeadm.go:322] 
	I0731 10:36:48.704063  454090 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 6e20hj.yyn30sj1pe8ypk1g \
	I0731 10:36:48.704503  454090 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:794743d7f04bd4593179b1fa8a4b2ac7637bc5da56bbcead87c371ae0b0f7ff1 
	I0731 10:36:48.710145  454090 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1040-aws\n", err: exit status 1
	I0731 10:36:48.710262  454090 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0731 10:36:48.710283  454090 cni.go:84] Creating CNI manager for ""
	I0731 10:36:48.710302  454090 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0731 10:36:48.712289  454090 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
	I0731 10:36:48.714170  454090 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
	I0731 10:36:48.739037  454090 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (457 bytes)
	I0731 10:36:48.782333  454090 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0731 10:36:48.782432  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:48.782453  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl label nodes minikube.k8s.io/version=v1.31.1 minikube.k8s.io/commit=a7848ba25aaaad8ebb50e721c0d343e471188fc7 minikube.k8s.io/name=addons-766873 minikube.k8s.io/updated_at=2023_07_31T10_36_48_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:49.120845  454090 ops.go:34] apiserver oom_adj: -16
	I0731 10:36:49.120929  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:49.217079  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:49.819788  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:50.320392  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:50.820025  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:51.319802  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:51.819940  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:52.320271  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:52.819910  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:53.320259  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:53.820156  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:54.319960  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:54.820247  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:55.319539  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:55.819686  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:56.320153  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:56.819688  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:57.319537  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:57.820251  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:58.319573  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:58.820427  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:59.319806  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:36:59.819452  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:37:00.319458  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:37:00.820313  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:37:01.319510  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:37:01.819573  454090 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:37:01.962470  454090 kubeadm.go:1081] duration metric: took 13.180098873s to wait for elevateKubeSystemPrivileges.
	I0731 10:37:01.962498  454090 kubeadm.go:406] StartCluster complete in 27.987975387s
	I0731 10:37:01.962513  454090 settings.go:142] acquiring lock: {Name:mk0f9ad5297a989e72fcdcfe2e2075f0d847e09b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:37:01.963134  454090 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/16969-448039/kubeconfig
	I0731 10:37:01.963524  454090 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/kubeconfig: {Name:mk557d9a030d80845f93c6390b12cc56ba83b453 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:37:01.963765  454090 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0731 10:37:01.964074  454090 config.go:182] Loaded profile config "addons-766873": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0731 10:37:01.964172  454090 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:true]
	I0731 10:37:01.964227  454090 addons.go:69] Setting volumesnapshots=true in profile "addons-766873"
	I0731 10:37:01.964250  454090 addons.go:231] Setting addon volumesnapshots=true in "addons-766873"
	I0731 10:37:01.964285  454090 host.go:66] Checking if "addons-766873" exists ...
	I0731 10:37:01.964727  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Status}}
	I0731 10:37:01.965255  454090 addons.go:69] Setting cloud-spanner=true in profile "addons-766873"
	I0731 10:37:01.965275  454090 addons.go:231] Setting addon cloud-spanner=true in "addons-766873"
	I0731 10:37:01.965307  454090 host.go:66] Checking if "addons-766873" exists ...
	I0731 10:37:01.965697  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Status}}
	I0731 10:37:01.965834  454090 addons.go:69] Setting inspektor-gadget=true in profile "addons-766873"
	I0731 10:37:01.965850  454090 addons.go:231] Setting addon inspektor-gadget=true in "addons-766873"
	I0731 10:37:01.965881  454090 host.go:66] Checking if "addons-766873" exists ...
	I0731 10:37:01.966277  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Status}}
	I0731 10:37:01.966371  454090 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-766873"
	I0731 10:37:01.966419  454090 addons.go:231] Setting addon csi-hostpath-driver=true in "addons-766873"
	I0731 10:37:01.966456  454090 host.go:66] Checking if "addons-766873" exists ...
	I0731 10:37:01.966814  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Status}}
	I0731 10:37:01.966934  454090 addons.go:69] Setting default-storageclass=true in profile "addons-766873"
	I0731 10:37:01.966950  454090 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-766873"
	I0731 10:37:01.967189  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Status}}
	I0731 10:37:01.967267  454090 addons.go:69] Setting gcp-auth=true in profile "addons-766873"
	I0731 10:37:01.967291  454090 mustload.go:65] Loading cluster: addons-766873
	I0731 10:37:01.967454  454090 config.go:182] Loaded profile config "addons-766873": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0731 10:37:01.967672  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Status}}
	I0731 10:37:01.967738  454090 addons.go:69] Setting ingress=true in profile "addons-766873"
	I0731 10:37:01.967753  454090 addons.go:231] Setting addon ingress=true in "addons-766873"
	I0731 10:37:01.967790  454090 host.go:66] Checking if "addons-766873" exists ...
	I0731 10:37:01.968332  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Status}}
	I0731 10:37:01.968492  454090 addons.go:69] Setting metrics-server=true in profile "addons-766873"
	I0731 10:37:01.968518  454090 addons.go:231] Setting addon metrics-server=true in "addons-766873"
	I0731 10:37:01.968565  454090 host.go:66] Checking if "addons-766873" exists ...
	I0731 10:37:01.968983  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Status}}
	I0731 10:37:01.969053  454090 addons.go:69] Setting registry=true in profile "addons-766873"
	I0731 10:37:01.969063  454090 addons.go:231] Setting addon registry=true in "addons-766873"
	I0731 10:37:01.969087  454090 host.go:66] Checking if "addons-766873" exists ...
	I0731 10:37:01.969414  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Status}}
	I0731 10:37:01.969469  454090 addons.go:69] Setting storage-provisioner=true in profile "addons-766873"
	I0731 10:37:01.969477  454090 addons.go:231] Setting addon storage-provisioner=true in "addons-766873"
	I0731 10:37:01.969499  454090 host.go:66] Checking if "addons-766873" exists ...
	I0731 10:37:01.969820  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Status}}
	I0731 10:37:01.988243  454090 addons.go:69] Setting ingress-dns=true in profile "addons-766873"
	I0731 10:37:01.988300  454090 addons.go:231] Setting addon ingress-dns=true in "addons-766873"
	I0731 10:37:01.988389  454090 host.go:66] Checking if "addons-766873" exists ...
	I0731 10:37:01.998704  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Status}}
	I0731 10:37:02.062510  454090 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.8.1
	I0731 10:37:02.076443  454090 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0731 10:37:02.080772  454090 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0731 10:37:02.085155  454090 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.7
	I0731 10:37:02.086779  454090 addons.go:423] installing /etc/kubernetes/addons/deployment.yaml
	I0731 10:37:02.086803  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1003 bytes)
	I0731 10:37:02.086871  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:37:02.087145  454090 addons.go:423] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I0731 10:37:02.087153  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16083 bytes)
	I0731 10:37:02.087184  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:37:02.087243  454090 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I0731 10:37:02.096810  454090 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I0731 10:37:02.096835  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I0731 10:37:02.096918  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:37:02.130317  454090 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-766873" context rescaled to 1 replicas
	I0731 10:37:02.130357  454090 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0731 10:37:02.145141  454090 out.go:177] * Verifying Kubernetes components...
	I0731 10:37:02.155465  454090 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0731 10:37:02.187586  454090 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I0731 10:37:02.191309  454090 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I0731 10:37:02.193281  454090 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I0731 10:37:02.195091  454090 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I0731 10:37:02.196937  454090 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I0731 10:37:02.198944  454090 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I0731 10:37:02.201961  454090 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I0731 10:37:02.205523  454090 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I0731 10:37:02.207326  454090 addons.go:423] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I0731 10:37:02.207355  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I0731 10:37:02.207431  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:37:02.231022  454090 addons.go:231] Setting addon default-storageclass=true in "addons-766873"
	I0731 10:37:02.231074  454090 host.go:66] Checking if "addons-766873" exists ...
	I0731 10:37:02.231522  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Status}}
	I0731 10:37:02.238017  454090 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.18.1
	I0731 10:37:02.240644  454090 addons.go:423] installing /etc/kubernetes/addons/ig-namespace.yaml
	I0731 10:37:02.240666  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I0731 10:37:02.240733  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:37:02.277198  454090 out.go:177]   - Using image docker.io/registry:2.8.1
	I0731 10:37:02.279431  454090 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.5
	I0731 10:37:02.278313  454090 host.go:66] Checking if "addons-766873" exists ...
	I0731 10:37:02.286342  454090 addons.go:423] installing /etc/kubernetes/addons/registry-rc.yaml
	I0731 10:37:02.286482  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)
	I0731 10:37:02.286624  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:37:02.328027  454090 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.6.4
	I0731 10:37:02.336249  454090 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0731 10:37:02.336320  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0731 10:37:02.336430  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:37:02.394475  454090 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0731 10:37:02.396082  454090 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0731 10:37:02.396102  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0731 10:37:02.396214  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:37:02.397919  454090 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2
	I0731 10:37:02.399652  454090 addons.go:423] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0731 10:37:02.399672  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I0731 10:37:02.399751  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:37:02.412205  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:37:02.413117  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:37:02.424832  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:37:02.443429  454090 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I0731 10:37:02.443454  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0731 10:37:02.443514  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:37:02.456712  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:37:02.468847  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:37:02.474683  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:37:02.486849  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:37:02.536167  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:37:02.559036  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:37:02.578953  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:37:02.656518  454090 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I0731 10:37:02.656539  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I0731 10:37:02.920813  454090 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I0731 10:37:02.920838  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I0731 10:37:02.960500  454090 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0731 10:37:02.961500  454090 node_ready.go:35] waiting up to 6m0s for node "addons-766873" to be "Ready" ...
	I0731 10:37:02.966118  454090 node_ready.go:49] node "addons-766873" has status "Ready":"True"
	I0731 10:37:02.966146  454090 node_ready.go:38] duration metric: took 4.610897ms waiting for node "addons-766873" to be "Ready" ...
	I0731 10:37:02.966160  454090 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0731 10:37:02.975289  454090 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5d78c9869d-55prt" in "kube-system" namespace to be "Ready" ...
	I0731 10:37:03.147657  454090 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0731 10:37:03.147678  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I0731 10:37:03.221385  454090 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I0731 10:37:03.221458  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I0731 10:37:03.297150  454090 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I0731 10:37:03.362541  454090 addons.go:423] installing /etc/kubernetes/addons/registry-svc.yaml
	I0731 10:37:03.362610  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I0731 10:37:03.370927  454090 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0731 10:37:03.380037  454090 addons.go:423] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I0731 10:37:03.380064  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I0731 10:37:03.499051  454090 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0731 10:37:03.499112  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0731 10:37:03.514077  454090 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0731 10:37:03.627327  454090 addons.go:423] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I0731 10:37:03.627406  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I0731 10:37:03.650612  454090 addons.go:423] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I0731 10:37:03.650634  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I0731 10:37:03.662830  454090 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I0731 10:37:03.693443  454090 addons.go:423] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I0731 10:37:03.693470  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I0731 10:37:03.727830  454090 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0731 10:37:03.842370  454090 addons.go:423] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0731 10:37:03.842394  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I0731 10:37:03.844990  454090 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0731 10:37:03.845012  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0731 10:37:03.859010  454090 addons.go:423] installing /etc/kubernetes/addons/registry-proxy.yaml
	I0731 10:37:03.859034  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I0731 10:37:03.899183  454090 addons.go:423] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I0731 10:37:03.899207  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I0731 10:37:03.980365  454090 addons.go:423] installing /etc/kubernetes/addons/ig-role.yaml
	I0731 10:37:03.980388  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I0731 10:37:04.124651  454090 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I0731 10:37:04.162791  454090 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0731 10:37:04.180870  454090 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0731 10:37:04.375414  454090 addons.go:423] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I0731 10:37:04.375443  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I0731 10:37:04.442273  454090 addons.go:423] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I0731 10:37:04.442300  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I0731 10:37:04.513352  454090 pod_ready.go:92] pod "coredns-5d78c9869d-55prt" in "kube-system" namespace has status "Ready":"True"
	I0731 10:37:04.513380  454090 pod_ready.go:81] duration metric: took 1.538057775s waiting for pod "coredns-5d78c9869d-55prt" in "kube-system" namespace to be "Ready" ...
	I0731 10:37:04.513393  454090 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5d78c9869d-x9smg" in "kube-system" namespace to be "Ready" ...
	I0731 10:37:04.778549  454090 addons.go:423] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I0731 10:37:04.778574  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I0731 10:37:04.941974  454090 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I0731 10:37:04.942001  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I0731 10:37:05.133939  454090 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I0731 10:37:05.133964  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I0731 10:37:05.272048  454090 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I0731 10:37:05.272074  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I0731 10:37:05.423378  454090 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I0731 10:37:05.423404  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I0731 10:37:05.619498  454090 addons.go:423] installing /etc/kubernetes/addons/ig-crd.yaml
	I0731 10:37:05.619526  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I0731 10:37:05.643860  454090 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I0731 10:37:05.643886  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I0731 10:37:05.751690  454090 addons.go:423] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I0731 10:37:05.751712  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7741 bytes)
	I0731 10:37:05.807337  454090 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I0731 10:37:05.807360  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I0731 10:37:05.900389  454090 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I0731 10:37:05.971736  454090 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (3.011195593s)
	I0731 10:37:05.971769  454090 start.go:901] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0731 10:37:06.100332  454090 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0731 10:37:06.100363  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I0731 10:37:06.126705  454090 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (2.829469439s)
	I0731 10:37:06.253826  454090 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0731 10:37:06.546134  454090 pod_ready.go:102] pod "coredns-5d78c9869d-x9smg" in "kube-system" namespace has status "Ready":"False"
	I0731 10:37:06.799670  454090 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.428646391s)
	I0731 10:37:06.799736  454090 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (3.285599247s)
	I0731 10:37:08.591038  454090 pod_ready.go:102] pod "coredns-5d78c9869d-x9smg" in "kube-system" namespace has status "Ready":"False"
	I0731 10:37:08.896316  454090 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I0731 10:37:08.896403  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:37:08.931715  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:37:09.484083  454090 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I0731 10:37:09.782759  454090 addons.go:231] Setting addon gcp-auth=true in "addons-766873"
	I0731 10:37:09.782813  454090 host.go:66] Checking if "addons-766873" exists ...
	I0731 10:37:09.783316  454090 cli_runner.go:164] Run: docker container inspect addons-766873 --format={{.State.Status}}
	I0731 10:37:09.819623  454090 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I0731 10:37:09.819692  454090 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-766873
	I0731 10:37:09.846966  454090 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35510 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/addons-766873/id_rsa Username:docker}
	I0731 10:37:11.076808  454090 pod_ready.go:102] pod "coredns-5d78c9869d-x9smg" in "kube-system" namespace has status "Ready":"False"
	I0731 10:37:11.575969  454090 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (7.913098975s)
	I0731 10:37:11.576003  454090 addons.go:467] Verifying addon ingress=true in "addons-766873"
	I0731 10:37:11.577874  454090 out.go:177] * Verifying ingress addon...
	I0731 10:37:11.576181  454090 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (7.84832514s)
	I0731 10:37:11.576214  454090 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (7.451535603s)
	I0731 10:37:11.576360  454090 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.413539945s)
	I0731 10:37:11.576430  454090 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.395532505s)
	I0731 10:37:11.576503  454090 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (5.676085598s)
	I0731 10:37:11.579559  454090 addons.go:467] Verifying addon registry=true in "addons-766873"
	I0731 10:37:11.582061  454090 out.go:177] * Verifying registry addon...
	W0731 10:37:11.579742  454090 addons.go:449] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0731 10:37:11.579755  454090 addons.go:467] Verifying addon metrics-server=true in "addons-766873"
	I0731 10:37:11.580677  454090 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I0731 10:37:11.585274  454090 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I0731 10:37:11.585389  454090 retry.go:31] will retry after 156.370906ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0731 10:37:11.592653  454090 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I0731 10:37:11.592677  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:11.593293  454090 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I0731 10:37:11.593300  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:11.599722  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:11.600289  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:11.742604  454090 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0731 10:37:12.106989  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:12.107793  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:12.623818  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:12.624835  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:13.077078  454090 pod_ready.go:102] pod "coredns-5d78c9869d-x9smg" in "kube-system" namespace has status "Ready":"False"
	I0731 10:37:13.111088  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:13.111909  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:13.338327  454090 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (7.084448123s)
	I0731 10:37:13.338369  454090 addons.go:467] Verifying addon csi-hostpath-driver=true in "addons-766873"
	I0731 10:37:13.340776  454090 out.go:177] * Verifying csi-hostpath-driver addon...
	I0731 10:37:13.338560  454090 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.518913707s)
	I0731 10:37:13.345069  454090 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0731 10:37:13.343692  454090 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I0731 10:37:13.349874  454090 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0
	I0731 10:37:13.351571  454090 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I0731 10:37:13.351597  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I0731 10:37:13.354785  454090 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0731 10:37:13.354835  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:13.360406  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:13.403717  454090 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I0731 10:37:13.403781  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I0731 10:37:13.500718  454090 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0731 10:37:13.500745  454090 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5412 bytes)
	I0731 10:37:13.583966  454090 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0731 10:37:13.606971  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:13.608374  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:13.867108  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:14.124058  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:14.125205  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:14.367820  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:14.370228  454090 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.627540298s)
	I0731 10:37:14.548724  454090 pod_ready.go:97] pod "coredns-5d78c9869d-x9smg" in "kube-system" namespace has status phase "Succeeded" (skipping!): {Phase:Succeeded Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-07-31 10:37:01 +0000 UTC Reason:PodCompleted Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-07-31 10:37:01 +0000 UTC Reason:PodCompleted Message:} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-07-31 10:37:01 +0000 UTC Reason:PodCompleted Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-07-31 10:37:01 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:192.168.49.2 PodIP: PodIPs:[] StartTime:2023-07-31 10:37:01 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminate
d{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2023-07-31 10:37:03 +0000 UTC,FinishedAt:2023-07-31 10:37:13 +0000 UTC,ContainerID:docker://db209836b8e1ae3a93eaee8cf8580998a0738af33709b50e816b2b9957e09820,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.10.1 ImageID:docker-pullable://registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e ContainerID:docker://db209836b8e1ae3a93eaee8cf8580998a0738af33709b50e816b2b9957e09820 Started:0x400115c1a0 AllocatedResources:map[] Resources:nil}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize:}
	I0731 10:37:14.548765  454090 pod_ready.go:81] duration metric: took 10.035365076s waiting for pod "coredns-5d78c9869d-x9smg" in "kube-system" namespace to be "Ready" ...
	E0731 10:37:14.548776  454090 pod_ready.go:66] WaitExtra: waitPodCondition: pod "coredns-5d78c9869d-x9smg" in "kube-system" namespace has status phase "Succeeded" (skipping!): {Phase:Succeeded Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-07-31 10:37:01 +0000 UTC Reason:PodCompleted Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-07-31 10:37:01 +0000 UTC Reason:PodCompleted Message:} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-07-31 10:37:01 +0000 UTC Reason:PodCompleted Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-07-31 10:37:01 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:192.168.49.2 PodIP: PodIPs:[] StartTime:2023-07-31 10:37:01 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Termin
ated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2023-07-31 10:37:03 +0000 UTC,FinishedAt:2023-07-31 10:37:13 +0000 UTC,ContainerID:docker://db209836b8e1ae3a93eaee8cf8580998a0738af33709b50e816b2b9957e09820,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.10.1 ImageID:docker-pullable://registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e ContainerID:docker://db209836b8e1ae3a93eaee8cf8580998a0738af33709b50e816b2b9957e09820 Started:0x400115c1a0 AllocatedResources:map[] Resources:nil}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize:}
	I0731 10:37:14.548799  454090 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-766873" in "kube-system" namespace to be "Ready" ...
	I0731 10:37:14.557267  454090 pod_ready.go:92] pod "etcd-addons-766873" in "kube-system" namespace has status "Ready":"True"
	I0731 10:37:14.557293  454090 pod_ready.go:81] duration metric: took 8.487275ms waiting for pod "etcd-addons-766873" in "kube-system" namespace to be "Ready" ...
	I0731 10:37:14.557313  454090 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-766873" in "kube-system" namespace to be "Ready" ...
	I0731 10:37:14.566603  454090 pod_ready.go:92] pod "kube-apiserver-addons-766873" in "kube-system" namespace has status "Ready":"True"
	I0731 10:37:14.566642  454090 pod_ready.go:81] duration metric: took 9.319428ms waiting for pod "kube-apiserver-addons-766873" in "kube-system" namespace to be "Ready" ...
	I0731 10:37:14.566657  454090 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-766873" in "kube-system" namespace to be "Ready" ...
	I0731 10:37:14.585014  454090 pod_ready.go:92] pod "kube-controller-manager-addons-766873" in "kube-system" namespace has status "Ready":"True"
	I0731 10:37:14.585041  454090 pod_ready.go:81] duration metric: took 18.373954ms waiting for pod "kube-controller-manager-addons-766873" in "kube-system" namespace to be "Ready" ...
	I0731 10:37:14.585063  454090 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-5v5t9" in "kube-system" namespace to be "Ready" ...
	I0731 10:37:14.597947  454090 pod_ready.go:92] pod "kube-proxy-5v5t9" in "kube-system" namespace has status "Ready":"True"
	I0731 10:37:14.597973  454090 pod_ready.go:81] duration metric: took 12.902301ms waiting for pod "kube-proxy-5v5t9" in "kube-system" namespace to be "Ready" ...
	I0731 10:37:14.597985  454090 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-766873" in "kube-system" namespace to be "Ready" ...
	I0731 10:37:14.611006  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:14.611150  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:14.867197  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:14.951689  454090 pod_ready.go:92] pod "kube-scheduler-addons-766873" in "kube-system" namespace has status "Ready":"True"
	I0731 10:37:14.951724  454090 pod_ready.go:81] duration metric: took 353.731724ms waiting for pod "kube-scheduler-addons-766873" in "kube-system" namespace to be "Ready" ...
	I0731 10:37:14.951734  454090 pod_ready.go:38] duration metric: took 11.985563071s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0731 10:37:14.951752  454090 api_server.go:52] waiting for apiserver process to appear ...
	I0731 10:37:14.951822  454090 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0731 10:37:15.114763  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:15.115828  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:15.229983  454090 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.645968116s)
	I0731 10:37:15.230354  454090 api_server.go:72] duration metric: took 13.09996964s to wait for apiserver process to appear ...
	I0731 10:37:15.230372  454090 api_server.go:88] waiting for apiserver healthz status ...
	I0731 10:37:15.230393  454090 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0731 10:37:15.232498  454090 addons.go:467] Verifying addon gcp-auth=true in "addons-766873"
	I0731 10:37:15.235750  454090 out.go:177] * Verifying gcp-auth addon...
	I0731 10:37:15.238530  454090 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I0731 10:37:15.247508  454090 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0731 10:37:15.247537  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:15.254377  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:15.255522  454090 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0731 10:37:15.257017  454090 api_server.go:141] control plane version: v1.27.3
	I0731 10:37:15.257046  454090 api_server.go:131] duration metric: took 26.666391ms to wait for apiserver health ...
	I0731 10:37:15.257055  454090 system_pods.go:43] waiting for kube-system pods to appear ...
	I0731 10:37:15.268347  454090 system_pods.go:59] 16 kube-system pods found
	I0731 10:37:15.268383  454090 system_pods.go:61] "coredns-5d78c9869d-55prt" [b0d5edd5-6dc9-4fac-899f-a5a41e51f85b] Running
	I0731 10:37:15.268393  454090 system_pods.go:61] "csi-hostpath-attacher-0" [149cfe1a-602a-45da-a489-9e8385f66d3b] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0731 10:37:15.268436  454090 system_pods.go:61] "csi-hostpath-resizer-0" [348a5794-2c97-4948-9776-d1157ec299c2] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0731 10:37:15.268448  454090 system_pods.go:61] "csi-hostpathplugin-srstq" [7f51eb1a-7788-4dba-8d52-96cb21a2b9d9] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0731 10:37:15.268460  454090 system_pods.go:61] "etcd-addons-766873" [4321bfb3-0a89-460e-b335-23f79ac0c7df] Running
	I0731 10:37:15.268466  454090 system_pods.go:61] "kube-apiserver-addons-766873" [3ddcb08a-e7ba-4e43-8f2c-4bbe30351dbd] Running
	I0731 10:37:15.268472  454090 system_pods.go:61] "kube-controller-manager-addons-766873" [4c67fab2-20a9-4d4d-9244-097a72e30cf8] Running
	I0731 10:37:15.268525  454090 system_pods.go:61] "kube-ingress-dns-minikube" [cebd0ea8-17df-4e98-adb1-d3db701be3ea] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0731 10:37:15.268535  454090 system_pods.go:61] "kube-proxy-5v5t9" [1b48bc82-24a5-40cc-939a-2a6a949275f9] Running
	I0731 10:37:15.268541  454090 system_pods.go:61] "kube-scheduler-addons-766873" [49219d01-8237-4e5f-a528-e3ae1652d537] Running
	I0731 10:37:15.268551  454090 system_pods.go:61] "metrics-server-7746886d4f-4t6xb" [97ba39a7-b1cb-468d-9fd3-799cc25fed1e] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0731 10:37:15.268565  454090 system_pods.go:61] "registry-5zr9x" [de5bd8ed-f81e-44f2-98b6-2c8acc08a2eb] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0731 10:37:15.268574  454090 system_pods.go:61] "registry-proxy-8nwth" [9b58b346-25fc-45b9-87df-8faeed904794] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0731 10:37:15.268585  454090 system_pods.go:61] "snapshot-controller-75bbb956b9-md9dv" [45ddbe75-698a-4e06-bc70-c7f3485195c6] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0731 10:37:15.268594  454090 system_pods.go:61] "snapshot-controller-75bbb956b9-r9dqq" [127acda9-b418-4237-8c22-01c87c9d209e] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0731 10:37:15.268602  454090 system_pods.go:61] "storage-provisioner" [e701e3b2-041e-4399-a50e-ffe4e1a1d85d] Running
	I0731 10:37:15.268608  454090 system_pods.go:74] duration metric: took 11.548049ms to wait for pod list to return data ...
	I0731 10:37:15.268621  454090 default_sa.go:34] waiting for default service account to be created ...
	I0731 10:37:15.349660  454090 default_sa.go:45] found service account: "default"
	I0731 10:37:15.349683  454090 default_sa.go:55] duration metric: took 81.056186ms for default service account to be created ...
	I0731 10:37:15.349693  454090 system_pods.go:116] waiting for k8s-apps to be running ...
	I0731 10:37:15.366586  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:15.549357  454090 system_pods.go:86] 16 kube-system pods found
	I0731 10:37:15.549396  454090 system_pods.go:89] "coredns-5d78c9869d-55prt" [b0d5edd5-6dc9-4fac-899f-a5a41e51f85b] Running
	I0731 10:37:15.549408  454090 system_pods.go:89] "csi-hostpath-attacher-0" [149cfe1a-602a-45da-a489-9e8385f66d3b] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0731 10:37:15.549439  454090 system_pods.go:89] "csi-hostpath-resizer-0" [348a5794-2c97-4948-9776-d1157ec299c2] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0731 10:37:15.549455  454090 system_pods.go:89] "csi-hostpathplugin-srstq" [7f51eb1a-7788-4dba-8d52-96cb21a2b9d9] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0731 10:37:15.549462  454090 system_pods.go:89] "etcd-addons-766873" [4321bfb3-0a89-460e-b335-23f79ac0c7df] Running
	I0731 10:37:15.549468  454090 system_pods.go:89] "kube-apiserver-addons-766873" [3ddcb08a-e7ba-4e43-8f2c-4bbe30351dbd] Running
	I0731 10:37:15.549474  454090 system_pods.go:89] "kube-controller-manager-addons-766873" [4c67fab2-20a9-4d4d-9244-097a72e30cf8] Running
	I0731 10:37:15.549484  454090 system_pods.go:89] "kube-ingress-dns-minikube" [cebd0ea8-17df-4e98-adb1-d3db701be3ea] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0731 10:37:15.549490  454090 system_pods.go:89] "kube-proxy-5v5t9" [1b48bc82-24a5-40cc-939a-2a6a949275f9] Running
	I0731 10:37:15.549501  454090 system_pods.go:89] "kube-scheduler-addons-766873" [49219d01-8237-4e5f-a528-e3ae1652d537] Running
	I0731 10:37:15.549528  454090 system_pods.go:89] "metrics-server-7746886d4f-4t6xb" [97ba39a7-b1cb-468d-9fd3-799cc25fed1e] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0731 10:37:15.549550  454090 system_pods.go:89] "registry-5zr9x" [de5bd8ed-f81e-44f2-98b6-2c8acc08a2eb] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0731 10:37:15.549575  454090 system_pods.go:89] "registry-proxy-8nwth" [9b58b346-25fc-45b9-87df-8faeed904794] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0731 10:37:15.549589  454090 system_pods.go:89] "snapshot-controller-75bbb956b9-md9dv" [45ddbe75-698a-4e06-bc70-c7f3485195c6] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0731 10:37:15.549597  454090 system_pods.go:89] "snapshot-controller-75bbb956b9-r9dqq" [127acda9-b418-4237-8c22-01c87c9d209e] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0731 10:37:15.549607  454090 system_pods.go:89] "storage-provisioner" [e701e3b2-041e-4399-a50e-ffe4e1a1d85d] Running
	I0731 10:37:15.549631  454090 system_pods.go:126] duration metric: took 199.931933ms to wait for k8s-apps to be running ...
	I0731 10:37:15.549651  454090 system_svc.go:44] waiting for kubelet service to be running ....
	I0731 10:37:15.549748  454090 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0731 10:37:15.589740  454090 system_svc.go:56] duration metric: took 40.08005ms WaitForService to wait for kubelet.
	I0731 10:37:15.589765  454090 kubeadm.go:581] duration metric: took 13.459382979s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0731 10:37:15.589814  454090 node_conditions.go:102] verifying NodePressure condition ...
	I0731 10:37:15.609056  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:15.609761  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:15.743502  454090 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0731 10:37:15.743537  454090 node_conditions.go:123] node cpu capacity is 2
	I0731 10:37:15.743550  454090 node_conditions.go:105] duration metric: took 153.729072ms to run NodePressure ...
	I0731 10:37:15.743585  454090 start.go:228] waiting for startup goroutines ...
	I0731 10:37:15.758350  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:15.872408  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:16.107274  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:16.109009  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:16.259558  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:16.367514  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:16.608283  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:16.608841  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:16.758960  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:16.867852  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:17.114799  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:17.115395  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:17.258993  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:17.366663  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:17.607857  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:17.609520  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:17.759157  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:17.867144  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:18.110435  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:18.115273  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:18.258021  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:18.367245  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:18.606644  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:18.606930  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:18.758436  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:18.866229  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:19.106877  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:19.107163  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:19.258479  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:19.365999  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:19.610591  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:19.611305  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:19.758242  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:19.867140  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:20.107361  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:20.107887  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:20.258752  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:20.366493  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:20.606174  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:20.607271  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:20.757833  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:20.866286  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:21.105634  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:21.106735  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:21.258493  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:21.367008  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:21.606501  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:21.607221  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:21.758237  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:21.866743  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:22.106348  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:22.106629  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:22.263284  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:22.367377  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:22.606601  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:22.607446  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:22.758153  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:22.868514  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:23.105824  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:23.107152  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:23.259174  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:23.367130  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:23.608270  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:23.609234  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:23.759131  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:23.866218  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:24.110138  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:24.119707  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:24.259892  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:24.366548  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:24.606558  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:24.609082  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:24.761072  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:24.867086  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:25.109667  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:25.113467  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:25.259224  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:25.367486  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:25.606481  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:25.609019  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:25.758718  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:25.866316  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:26.112488  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:26.113401  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:26.258121  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:26.366798  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:26.610443  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:26.613254  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:26.759440  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:26.867433  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:27.106649  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:27.108505  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:27.259477  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:27.366700  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:27.606325  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:27.607769  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:27.758752  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:27.867092  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:28.105543  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:28.106618  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0731 10:37:28.258360  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:28.366343  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:28.606061  454090 kapi.go:107] duration metric: took 17.020788007s to wait for kubernetes.io/minikube-addons=registry ...
	I0731 10:37:28.607167  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:28.758134  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:28.866920  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:29.105835  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:29.261659  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:29.366103  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:29.605377  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:29.758378  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:29.866513  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:30.115207  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:30.261322  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:30.371315  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:30.623368  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:30.759289  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:30.868174  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:31.104953  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:31.258419  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:31.380690  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:31.605848  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:31.759055  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:31.866875  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:32.105593  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:32.260299  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:32.367654  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:32.606961  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:32.759738  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:32.882041  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:33.109228  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:33.258985  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:33.367193  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:33.605677  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:33.758751  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:33.866714  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:34.106076  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:34.259227  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:34.366090  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:34.605527  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:34.759737  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:34.867880  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:35.106117  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:35.258938  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:35.366715  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:35.605796  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:35.758749  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:35.866832  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:36.105978  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:36.259281  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:36.366716  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:36.605280  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:36.758234  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:36.869340  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:37.106966  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:37.258928  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:37.373234  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:37.605497  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:37.758542  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:37.867162  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:38.112959  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:38.258867  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:38.366816  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:38.605696  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:38.758699  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:38.867241  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:39.105678  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:39.258806  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:39.374356  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:39.605174  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:39.759078  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:39.867134  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:40.105373  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:40.258731  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:40.366843  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:40.605631  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:40.760530  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:40.868037  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:41.105510  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:41.258669  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:41.366807  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:41.605618  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:41.759090  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:41.867546  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:42.134468  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:42.259035  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:42.366454  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:42.606003  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:42.760720  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:42.874047  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:43.105312  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:43.258608  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:43.365764  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:43.606575  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:43.758592  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:43.866397  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:44.105013  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:44.259069  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:44.366626  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:44.606312  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:44.757982  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:44.866836  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:45.107323  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:45.285546  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:45.369154  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:45.604685  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:45.759300  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:45.891259  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:46.110194  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:46.258094  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:46.367048  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:46.605426  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:46.759558  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:46.867770  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:47.105742  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:47.259762  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:47.368894  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:47.606540  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:47.758960  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:47.866152  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:48.105011  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:48.259323  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:48.366957  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:48.606448  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:48.758262  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:48.868747  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:49.105670  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:49.259057  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:49.367106  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:49.604696  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:49.758933  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:49.868196  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:50.106868  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:50.262838  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:50.367164  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:50.606171  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:50.760270  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:50.870322  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:51.109968  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:51.260854  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:51.366438  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:51.605305  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:51.761270  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:51.867416  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:52.107986  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:52.259052  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:52.371894  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:52.605185  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:52.758001  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:52.866794  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:53.105271  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:53.258633  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:53.367070  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:53.606090  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:53.759282  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:53.866321  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:54.106109  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:54.259209  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:54.366702  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:54.604939  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:54.763142  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:54.867439  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:55.132073  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:55.260215  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:55.367111  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:55.606558  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:55.758601  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:55.867175  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:56.104776  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:56.271976  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:56.366075  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:56.605286  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:56.759013  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:56.868041  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:57.106500  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:57.261569  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:57.366712  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:57.604853  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:57.759293  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:57.866402  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:58.105236  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:58.258139  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:58.366911  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:58.605648  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:58.758473  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:58.866862  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:59.105898  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:59.258650  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:59.367174  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0731 10:37:59.606158  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:37:59.758796  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:37:59.867539  454090 kapi.go:107] duration metric: took 46.523853467s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I0731 10:38:00.133029  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:00.258891  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:00.605171  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:00.759117  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:01.105645  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:01.258726  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:01.610108  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:01.759039  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:02.104664  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:02.258415  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:02.605438  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:02.758189  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:03.105060  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:03.259015  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:03.605564  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:03.758760  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:04.105003  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:04.258779  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:04.605534  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:04.758467  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:05.106567  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:05.258564  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:05.605087  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:05.759206  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:06.105287  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:06.261664  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:06.605046  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:06.758911  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:07.106107  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:07.258667  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:07.604652  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:07.759228  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:08.105490  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:08.260080  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:08.605728  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:08.758778  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:09.105444  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:09.258333  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:09.605552  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:09.758353  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:10.105847  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:10.258954  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:10.605059  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:10.758853  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:11.105398  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:11.258034  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:11.605672  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:11.759102  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:12.105750  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:12.258627  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:12.605569  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:12.759554  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:13.105686  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:13.258536  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:13.605273  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:13.757982  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:14.105636  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:14.258347  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:14.605967  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:14.758730  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:15.106438  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:15.258350  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:15.604770  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:15.758818  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:16.105459  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:16.258649  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:16.604551  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:16.760274  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:17.111435  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:17.258375  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:17.607564  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:17.761072  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:18.105684  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:18.258369  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:18.612200  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:18.758073  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:19.104763  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:19.258495  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:19.610296  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:19.758717  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:20.107924  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:20.259274  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:20.605459  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:20.758660  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:21.106759  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:21.258752  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:21.605789  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:21.760018  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:22.106071  454090 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0731 10:38:22.258913  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:22.605960  454090 kapi.go:107] duration metric: took 1m11.025277002s to wait for app.kubernetes.io/name=ingress-nginx ...
	I0731 10:38:22.759075  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:23.258370  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:23.758481  454090 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0731 10:38:24.258047  454090 kapi.go:107] duration metric: took 1m9.019517309s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I0731 10:38:24.260066  454090 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-766873 cluster.
	I0731 10:38:24.261869  454090 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I0731 10:38:24.263580  454090 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I0731 10:38:24.266503  454090 out.go:177] * Enabled addons: cloud-spanner, storage-provisioner, default-storageclass, inspektor-gadget, ingress-dns, metrics-server, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
	I0731 10:38:24.268550  454090 addons.go:502] enable addons completed in 1m22.304368762s: enabled=[cloud-spanner storage-provisioner default-storageclass inspektor-gadget ingress-dns metrics-server volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
	I0731 10:38:24.268602  454090 start.go:233] waiting for cluster config update ...
	I0731 10:38:24.268621  454090 start.go:242] writing updated cluster config ...
	I0731 10:38:24.268995  454090 ssh_runner.go:195] Run: rm -f paused
	I0731 10:38:24.560514  454090 start.go:596] kubectl: 1.27.4, cluster: 1.27.3 (minor skew: 0)
	I0731 10:38:24.562395  454090 out.go:177] * Done! kubectl is now configured to use "addons-766873" cluster and "default" namespace by default
	
	* 
	* ==> Docker <==
	* Jul 31 10:39:21 addons-766873 cri-dockerd[1305]: time="2023-07-31T10:39:21Z" level=info msg="Stop pulling image docker.io/nginx:latest: Status: Image is up to date for nginx:latest"
	Jul 31 10:39:27 addons-766873 dockerd[1094]: time="2023-07-31T10:39:27.887160631Z" level=info msg="ignoring event" container=32604cf83ea75947169dc6f00192189811366cd9cadc5cba7ab9a3364608b8d3 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:27 addons-766873 dockerd[1094]: time="2023-07-31T10:39:27.995703113Z" level=info msg="ignoring event" container=37a1284692d9ffbcd400d74c21bb4c65431b31912e35b673737c9502cc3704fe module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:29 addons-766873 dockerd[1094]: time="2023-07-31T10:39:29.086116900Z" level=info msg="ignoring event" container=bf988660a14ddf261274951c0808635f4f4b4075298ae9cfb10eaaf7d2ed9af4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:30 addons-766873 dockerd[1094]: time="2023-07-31T10:39:30.252046278Z" level=info msg="ignoring event" container=56c8d300a7b387983645042b1d74299fb256ab631f053d808327c4dabfdd8421 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:30 addons-766873 dockerd[1094]: time="2023-07-31T10:39:30.448013630Z" level=info msg="ignoring event" container=4af7f2e964436b2e8b90c34cd334d5b093e08d6c5edf894073373b6a3733cea7 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:30 addons-766873 dockerd[1094]: time="2023-07-31T10:39:30.509819699Z" level=info msg="ignoring event" container=5e7d53ac35ecfece90f9f10ddd394dcb18cb78f60e3440f57bf7415640c4e646 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:30 addons-766873 dockerd[1094]: time="2023-07-31T10:39:30.528564240Z" level=info msg="ignoring event" container=db78f2a7edb7f74a177efda64482e0d17c4d6e8a9c9bf7e5c89f98898e4ceb61 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:30 addons-766873 dockerd[1094]: time="2023-07-31T10:39:30.574711593Z" level=info msg="ignoring event" container=c34712f0e4d4939c1c07b32e8a56ac5c3fafbf0db1b6c2ebbbf168fc2496d141 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:30 addons-766873 dockerd[1094]: time="2023-07-31T10:39:30.579671988Z" level=info msg="ignoring event" container=223a57561091da0edf3a64e3842c8cfd60bfa025791e4031b55512a6e3dc2e2d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:30 addons-766873 dockerd[1094]: time="2023-07-31T10:39:30.599803913Z" level=info msg="ignoring event" container=08476683d7ef1047f738970f66edb37df4ee9111d439c602a65cbc957de19ff7 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:30 addons-766873 dockerd[1094]: time="2023-07-31T10:39:30.609285845Z" level=info msg="ignoring event" container=906718321afa360f8749ce29476efea712167b229e7900a8d1ebcbf2b41101bf module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:30 addons-766873 dockerd[1094]: time="2023-07-31T10:39:30.668909012Z" level=info msg="ignoring event" container=4a4271b15618f8d4ce2ba58e8be60791f4b6de99e9841cf56983398e1fa3e952 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:30 addons-766873 dockerd[1094]: time="2023-07-31T10:39:30.981244964Z" level=info msg="ignoring event" container=6dec31f7c0fc1aab6967e4088cf9697a21cd9e661e15d5769e54310458da14ec module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:31 addons-766873 cri-dockerd[1305]: time="2023-07-31T10:39:31Z" level=info msg="Failed to read pod IP from plugin/docker: networkPlugin cni failed on the status hook for pod \"csi-hostpathplugin-srstq_kube-system\": unexpected command output nsenter: cannot open /proc/4634/ns/net: No such file or directory\n with error: exit status 1"
	Jul 31 10:39:31 addons-766873 dockerd[1094]: time="2023-07-31T10:39:31.177068793Z" level=info msg="ignoring event" container=17a0e74e98d7434f2f36c04f8070a9e9a3844b1cd01279eab8a6c6a42b7a1ef0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:32 addons-766873 dockerd[1094]: time="2023-07-31T10:39:32.140748165Z" level=info msg="Container failed to exit within 1s of signal 15 - using the force" container=01d1feb4e8e0db8d22d64911d132690e4d7fefa8e6827dba9c89342cbd955953
	Jul 31 10:39:32 addons-766873 dockerd[1094]: time="2023-07-31T10:39:32.226526247Z" level=info msg="ignoring event" container=01d1feb4e8e0db8d22d64911d132690e4d7fefa8e6827dba9c89342cbd955953 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:32 addons-766873 cri-dockerd[1305]: time="2023-07-31T10:39:32Z" level=info msg="Failed to read pod IP from plugin/docker: networkPlugin cni failed on the status hook for pod \"ingress-nginx-controller-7799c6795f-bpxsv_ingress-nginx\": unexpected command output nsenter: cannot open /proc/8167/ns/net: No such file or directory\n with error: exit status 1"
	Jul 31 10:39:32 addons-766873 dockerd[1094]: time="2023-07-31T10:39:32.435129384Z" level=info msg="ignoring event" container=ea1a4402f4bf2eb261ccfe9d30fc44f808ec03d50ce476c88ba78544e3ec3fd2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:32 addons-766873 dockerd[1094]: time="2023-07-31T10:39:32.973932041Z" level=info msg="ignoring event" container=5466d9e337df6743e3e9f8394cf032b6bfa99c811cae677b8250030dfd00a048 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:36 addons-766873 dockerd[1094]: time="2023-07-31T10:39:36.958096161Z" level=info msg="ignoring event" container=9c6f5b64960a8f70d69df67e35ef37b3fdff8115a15ee2363d859674a89e2eeb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:37 addons-766873 dockerd[1094]: time="2023-07-31T10:39:37.009858742Z" level=info msg="ignoring event" container=c32f06142acdf91de574ae6d0e5ca00e4359a535345533c1f1a23d740daf85ef module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:37 addons-766873 dockerd[1094]: time="2023-07-31T10:39:37.106570533Z" level=info msg="ignoring event" container=1ea8d6e681ce4ee66deb1f8afa316c501502520ea5f50d607f3b0bd19aea4088 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:39:37 addons-766873 dockerd[1094]: time="2023-07-31T10:39:37.166618430Z" level=info msg="ignoring event" container=6bb09c45765dd3906541a2828d8723b6242475ac3b6b4245c39ff8f718306f36 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE                                                                                                                        CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	5466d9e337df6       13753a81eccfd                                                                                                                7 seconds ago        Exited              hello-world-app           2                   b68132a9f59fb       hello-world-app-65bdb79f98-jcb2h
	6be0a73666a47       nginx@sha256:2d194184b067db3598771b4cf326cfe6ad5051937ba1132b8b7d4b0184e0d0a6                                                35 seconds ago       Running             nginx                     0                   e8c5bae969757       nginx
	66db46b21aac0       ghcr.io/headlamp-k8s/headlamp@sha256:67ba87b88218563eec9684525904936609713b02dcbcf4390cd055766217ed45                        About a minute ago   Running             headlamp                  0                   55a5e51e1bb92       headlamp-66f6498c69-892vh
	2ee8af18ef9ca       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:d730651bb6584f969d95d8279a754cf9d8d31b5055c43dbdb8d7363a8c6371cf                 About a minute ago   Running             gcp-auth                  0                   7a65990659c5d       gcp-auth-58478865f7-spttv
	39a16dc3de1b2       8f2588812ab29                                                                                                                About a minute ago   Exited              patch                     1                   bb9434f800be4       ingress-nginx-admission-patch-g4nrb
	ed0a26818e98b       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:543c40fd093964bc9ab509d3e791f9989963021f1e9e4c9c7b6700b02bfb227b   About a minute ago   Exited              create                    0                   be9830b56a4b8       ingress-nginx-admission-create-qff5j
	3ab8afb8fca12       ba04bb24b9575                                                                                                                2 minutes ago        Running             storage-provisioner       0                   5ae450a19e46f       storage-provisioner
	b09a0064d2c9c       97e04611ad434                                                                                                                2 minutes ago        Running             coredns                   0                   5c042482b5416       coredns-5d78c9869d-55prt
	33afd3a978834       fb73e92641fd5                                                                                                                2 minutes ago        Running             kube-proxy                0                   08f763da60080       kube-proxy-5v5t9
	435fc3f1f1b32       bcb9e554eaab6                                                                                                                2 minutes ago        Running             kube-scheduler            0                   0f57e5eb42e3b       kube-scheduler-addons-766873
	51ae0f1018c59       ab3683b584ae5                                                                                                                2 minutes ago        Running             kube-controller-manager   0                   6bae5d690dd1b       kube-controller-manager-addons-766873
	8cd616b78fbd6       39dfb036b0986                                                                                                                2 minutes ago        Running             kube-apiserver            0                   c28391b34aed9       kube-apiserver-addons-766873
	9f35f344b5e09       24bc64e911039                                                                                                                2 minutes ago        Running             etcd                      0                   e39be2c35eb94       etcd-addons-766873
	
	* 
	* ==> coredns [b09a0064d2c9] <==
	* [INFO] 10.244.0.17:35007 - 58959 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000207515s
	[INFO] 10.244.0.17:47777 - 8546 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000117891s
	[INFO] 10.244.0.17:47777 - 6110 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000077128s
	[INFO] 10.244.0.17:47777 - 26494 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000048369s
	[INFO] 10.244.0.17:47777 - 22000 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001156107s
	[INFO] 10.244.0.17:47777 - 30262 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001005592s
	[INFO] 10.244.0.17:47777 - 15266 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000051585s
	[INFO] 10.244.0.17:40788 - 19258 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.00014605s
	[INFO] 10.244.0.17:45144 - 11172 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000111138s
	[INFO] 10.244.0.17:45144 - 57703 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.0001066s
	[INFO] 10.244.0.17:40788 - 41883 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000051832s
	[INFO] 10.244.0.17:45144 - 8501 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000059954s
	[INFO] 10.244.0.17:40788 - 34553 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000059618s
	[INFO] 10.244.0.17:45144 - 35668 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000059872s
	[INFO] 10.244.0.17:40788 - 12950 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000057435s
	[INFO] 10.244.0.17:45144 - 61042 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000042995s
	[INFO] 10.244.0.17:45144 - 53050 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000047261s
	[INFO] 10.244.0.17:40788 - 36858 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000034716s
	[INFO] 10.244.0.17:40788 - 37673 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000081755s
	[INFO] 10.244.0.17:45144 - 19006 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001350437s
	[INFO] 10.244.0.17:40788 - 745 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.000957847s
	[INFO] 10.244.0.17:45144 - 39816 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001405223s
	[INFO] 10.244.0.17:45144 - 50929 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000064254s
	[INFO] 10.244.0.17:40788 - 38107 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001060591s
	[INFO] 10.244.0.17:40788 - 51655 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000073715s
	
	* 
	* ==> describe nodes <==
	* Name:               addons-766873
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=addons-766873
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=a7848ba25aaaad8ebb50e721c0d343e471188fc7
	                    minikube.k8s.io/name=addons-766873
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_07_31T10_36_48_0700
	                    minikube.k8s.io/version=v1.31.1
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-766873
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 31 Jul 2023 10:36:45 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-766873
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 31 Jul 2023 10:39:32 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 31 Jul 2023 10:39:22 +0000   Mon, 31 Jul 2023 10:36:41 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 31 Jul 2023 10:39:22 +0000   Mon, 31 Jul 2023 10:36:41 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 31 Jul 2023 10:39:22 +0000   Mon, 31 Jul 2023 10:36:41 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 31 Jul 2023 10:39:22 +0000   Mon, 31 Jul 2023 10:36:48 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-766873
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022628Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022628Ki
	  pods:               110
	System Info:
	  Machine ID:                 bb4d67d413094fa2bdbe0f431d091036
	  System UUID:                6d0a27c2-e1df-49f8-bb89-b76b58c54b43
	  Boot ID:                    3709f028-2d57-4df1-ae3d-22c113dc2eeb
	  Kernel Version:             5.15.0-1040-aws
	  OS Image:                   Ubuntu 22.04.2 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://24.0.4
	  Kubelet Version:            v1.27.3
	  Kube-Proxy Version:         v1.27.3
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (11 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-65bdb79f98-jcb2h         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27s
	  default                     nginx                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         37s
	  gcp-auth                    gcp-auth-58478865f7-spttv                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m24s
	  headlamp                    headlamp-66f6498c69-892vh                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         67s
	  kube-system                 coredns-5d78c9869d-55prt                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     2m38s
	  kube-system                 etcd-addons-766873                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         2m50s
	  kube-system                 kube-apiserver-addons-766873             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m50s
	  kube-system                 kube-controller-manager-addons-766873    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m51s
	  kube-system                 kube-proxy-5v5t9                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m38s
	  kube-system                 kube-scheduler-addons-766873             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m50s
	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m33s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (37%!)(MISSING)  0 (0%!)(MISSING)
	  memory             170Mi (2%!)(MISSING)  170Mi (2%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                    From             Message
	  ----    ------                   ----                   ----             -------
	  Normal  Starting                 2m35s                  kube-proxy       
	  Normal  Starting                 2m59s                  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  2m59s (x8 over 2m59s)  kubelet          Node addons-766873 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m59s (x8 over 2m59s)  kubelet          Node addons-766873 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     2m59s (x7 over 2m59s)  kubelet          Node addons-766873 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  2m59s                  kubelet          Updated Node Allocatable limit across pods
	  Normal  Starting                 2m51s                  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  2m51s                  kubelet          Node addons-766873 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m51s                  kubelet          Node addons-766873 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     2m51s                  kubelet          Node addons-766873 status is now: NodeHasSufficientPID
	  Normal  NodeNotReady             2m51s                  kubelet          Node addons-766873 status is now: NodeNotReady
	  Normal  NodeAllocatableEnforced  2m51s                  kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeReady                2m51s                  kubelet          Node addons-766873 status is now: NodeReady
	  Normal  RegisteredNode           2m39s                  node-controller  Node addons-766873 event: Registered Node addons-766873 in Controller
	
	* 
	* ==> dmesg <==
	* [Jul31 08:42] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	[ +41.047159] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	[Jul31 08:43] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	[Jul31 08:49] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	[Jul31 09:25] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	[  +0.016003] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	[ +20.763785] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	[Jul31 09:28] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	[Jul31 09:30] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	[Jul31 09:32] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	[Jul31 09:57] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	[Jul31 10:00] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	[Jul31 10:04] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	[Jul31 10:20] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	[Jul31 10:32] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	
	* 
	* ==> etcd [9f35f344b5e0] <==
	* {"level":"info","ts":"2023-07-31T10:36:41.096Z","caller":"embed/etcd.go:558","msg":"cmux::serve","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-07-31T10:36:41.097Z","caller":"etcdserver/server.go:738","msg":"started as single-node; fast-forwarding election ticks","local-member-id":"aec36adc501070cc","forward-ticks":9,"forward-duration":"900ms","election-ticks":10,"election-timeout":"1s"}
	{"level":"info","ts":"2023-07-31T10:36:41.098Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap.db","max":5,"interval":"30s"}
	{"level":"info","ts":"2023-07-31T10:36:41.100Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"}
	{"level":"info","ts":"2023-07-31T10:36:41.100Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}
	{"level":"info","ts":"2023-07-31T10:36:41.100Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}
	{"level":"info","ts":"2023-07-31T10:36:41.101Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
	{"level":"info","ts":"2023-07-31T10:36:41.149Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
	{"level":"info","ts":"2023-07-31T10:36:41.149Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
	{"level":"info","ts":"2023-07-31T10:36:41.149Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
	{"level":"info","ts":"2023-07-31T10:36:41.149Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
	{"level":"info","ts":"2023-07-31T10:36:41.149Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-07-31T10:36:41.149Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
	{"level":"info","ts":"2023-07-31T10:36:41.149Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-07-31T10:36:41.153Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-766873 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
	{"level":"info","ts":"2023-07-31T10:36:41.153Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-07-31T10:36:41.155Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"192.168.49.2:2379"}
	{"level":"info","ts":"2023-07-31T10:36:41.155Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2023-07-31T10:36:41.156Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
	{"level":"info","ts":"2023-07-31T10:36:41.156Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2023-07-31T10:36:41.156Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2023-07-31T10:36:41.157Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-07-31T10:36:41.158Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2023-07-31T10:36:41.204Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2023-07-31T10:36:41.204Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	
	* 
	* ==> gcp-auth [2ee8af18ef9c] <==
	* 2023/07/31 10:38:23 GCP Auth Webhook started!
	2023/07/31 10:38:32 Ready to marshal response ...
	2023/07/31 10:38:32 Ready to write response ...
	2023/07/31 10:38:32 Ready to marshal response ...
	2023/07/31 10:38:32 Ready to write response ...
	2023/07/31 10:38:32 Ready to marshal response ...
	2023/07/31 10:38:32 Ready to write response ...
	2023/07/31 10:38:34 Ready to marshal response ...
	2023/07/31 10:38:34 Ready to write response ...
	2023/07/31 10:38:45 Ready to marshal response ...
	2023/07/31 10:38:45 Ready to write response ...
	2023/07/31 10:39:02 Ready to marshal response ...
	2023/07/31 10:39:02 Ready to write response ...
	2023/07/31 10:39:12 Ready to marshal response ...
	2023/07/31 10:39:12 Ready to write response ...
	2023/07/31 10:39:20 Ready to marshal response ...
	2023/07/31 10:39:20 Ready to write response ...
	
	* 
	* ==> kernel <==
	*  10:39:39 up 18:22,  0 users,  load average: 4.08, 3.47, 3.43
	Linux addons-766873 5.15.0-1040-aws #45~20.04.1-Ubuntu SMP Tue Jul 11 19:11:12 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.2 LTS"
	
	* 
	* ==> kube-apiserver [8cd616b78fbd] <==
	* I0731 10:39:36.685091       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0731 10:39:36.685143       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0731 10:39:36.705112       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0731 10:39:36.705179       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0731 10:39:36.716742       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0731 10:39:36.716796       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0731 10:39:36.743255       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0731 10:39:36.743318       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0731 10:39:36.752684       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0731 10:39:36.752921       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0731 10:39:36.761952       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0731 10:39:36.762012       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0731 10:39:36.777303       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0731 10:39:36.777562       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0731 10:39:36.784802       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0731 10:39:36.785089       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	W0731 10:39:37.754136       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
	W0731 10:39:37.778565       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
	W0731 10:39:37.818042       1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
	E0731 10:39:39.147787       1 handler_proxy.go:144] error resolving kube-system/metrics-server: service "metrics-server" not found
	W0731 10:39:39.147813       1 handler_proxy.go:100] no RequestInfo found in the context
	E0731 10:39:39.147848       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0731 10:39:39.147859       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0731 10:39:39.166258       1 controller.go:132] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).
	
	* 
	* ==> kube-controller-manager [51ae0f1018c5] <==
	* I0731 10:39:01.943405       1 event.go:307] "Event occurred" object="default/hpvc-restore" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	W0731 10:39:04.553616       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0731 10:39:04.553652       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0731 10:39:05.893230       1 namespace_controller.go:182] "Namespace has been deleted" namespace="gadget"
	W0731 10:39:12.341723       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0731 10:39:12.341853       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0731 10:39:12.851017       1 event.go:307] "Event occurred" object="default/hello-world-app" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set hello-world-app-65bdb79f98 to 1"
	I0731 10:39:12.903764       1 event.go:307] "Event occurred" object="default/hello-world-app-65bdb79f98" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: hello-world-app-65bdb79f98-jcb2h"
	I0731 10:39:15.739106       1 event.go:307] "Event occurred" object="default/hpvc-restore" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	I0731 10:39:19.993576       1 event.go:307] "Event occurred" object="default/hpvc-restore" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	W0731 10:39:28.703828       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0731 10:39:28.703879       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0731 10:39:30.132684       1 stateful_set.go:458] "StatefulSet has been deleted" key="kube-system/csi-hostpath-attacher"
	I0731 10:39:30.261679       1 stateful_set.go:458] "StatefulSet has been deleted" key="kube-system/csi-hostpath-resizer"
	I0731 10:39:30.990456       1 job_controller.go:523] enqueueing job ingress-nginx/ingress-nginx-admission-create
	I0731 10:39:31.011716       1 job_controller.go:523] enqueueing job ingress-nginx/ingress-nginx-admission-patch
	E0731 10:39:37.756671       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: the server could not find the requested resource
	E0731 10:39:37.780947       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: the server could not find the requested resource
	E0731 10:39:37.820879       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: the server could not find the requested resource
	W0731 10:39:38.821958       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0731 10:39:38.821995       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0731 10:39:39.008240       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0731 10:39:39.008277       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0731 10:39:39.045210       1 reflector.go:533] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0731 10:39:39.045246       1 reflector.go:148] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	
	* 
	* ==> kube-proxy [33afd3a97883] <==
	* I0731 10:37:03.258824       1 node.go:141] Successfully retrieved node IP: 192.168.49.2
	I0731 10:37:03.258951       1 server_others.go:110] "Detected node IP" address="192.168.49.2"
	I0731 10:37:03.258977       1 server_others.go:554] "Using iptables proxy"
	I0731 10:37:03.410295       1 server_others.go:192] "Using iptables Proxier"
	I0731 10:37:03.410339       1 server_others.go:199] "kube-proxy running in dual-stack mode" ipFamily=IPv4
	I0731 10:37:03.410348       1 server_others.go:200] "Creating dualStackProxier for iptables"
	I0731 10:37:03.410362       1 server_others.go:484] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, defaulting to no-op detect-local for IPv6"
	I0731 10:37:03.410427       1 proxier.go:253] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I0731 10:37:03.411054       1 server.go:658] "Version info" version="v1.27.3"
	I0731 10:37:03.411068       1 server.go:660] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0731 10:37:03.414174       1 config.go:188] "Starting service config controller"
	I0731 10:37:03.414220       1 shared_informer.go:311] Waiting for caches to sync for service config
	I0731 10:37:03.414247       1 config.go:97] "Starting endpoint slice config controller"
	I0731 10:37:03.414251       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
	I0731 10:37:03.422178       1 config.go:315] "Starting node config controller"
	I0731 10:37:03.422202       1 shared_informer.go:311] Waiting for caches to sync for node config
	I0731 10:37:03.521128       1 shared_informer.go:318] Caches are synced for endpoint slice config
	I0731 10:37:03.521212       1 shared_informer.go:318] Caches are synced for service config
	I0731 10:37:03.525641       1 shared_informer.go:318] Caches are synced for node config
	
	* 
	* ==> kube-scheduler [435fc3f1f1b3] <==
	* W0731 10:36:45.689410       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0731 10:36:45.690235       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W0731 10:36:45.689459       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0731 10:36:45.690266       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	W0731 10:36:45.689522       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0731 10:36:45.690378       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	W0731 10:36:45.689677       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0731 10:36:45.690472       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0731 10:36:45.689747       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0731 10:36:45.690493       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0731 10:36:45.689800       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0731 10:36:45.690596       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0731 10:36:45.689840       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0731 10:36:45.690622       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0731 10:36:45.689893       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0731 10:36:45.690722       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0731 10:36:45.694739       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0731 10:36:45.694778       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0731 10:36:45.695008       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0731 10:36:45.695030       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0731 10:36:45.695098       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0731 10:36:45.695160       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0731 10:36:46.560428       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0731 10:36:46.560686       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	I0731 10:36:47.283153       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* Jul 31 10:39:32 addons-766873 kubelet[2296]: I0731 10:39:32.835102    2296 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=149cfe1a-602a-45da-a489-9e8385f66d3b path="/var/lib/kubelet/pods/149cfe1a-602a-45da-a489-9e8385f66d3b/volumes"
	Jul 31 10:39:32 addons-766873 kubelet[2296]: I0731 10:39:32.835503    2296 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=348a5794-2c97-4948-9776-d1157ec299c2 path="/var/lib/kubelet/pods/348a5794-2c97-4948-9776-d1157ec299c2/volumes"
	Jul 31 10:39:32 addons-766873 kubelet[2296]: I0731 10:39:32.835848    2296 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=7f51eb1a-7788-4dba-8d52-96cb21a2b9d9 path="/var/lib/kubelet/pods/7f51eb1a-7788-4dba-8d52-96cb21a2b9d9/volumes"
	Jul 31 10:39:32 addons-766873 kubelet[2296]: I0731 10:39:32.836603    2296 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=9a566697-644a-4144-8e3d-970e5bdc142f path="/var/lib/kubelet/pods/9a566697-644a-4144-8e3d-970e5bdc142f/volumes"
	Jul 31 10:39:32 addons-766873 kubelet[2296]: I0731 10:39:32.836964    2296 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=c83af2ea-1a73-4e32-8591-b9c4dee7952f path="/var/lib/kubelet/pods/c83af2ea-1a73-4e32-8591-b9c4dee7952f/volumes"
	Jul 31 10:39:33 addons-766873 kubelet[2296]: I0731 10:39:33.455853    2296 scope.go:115] "RemoveContainer" containerID="98abfed8cabb989486abbf05b532ce3353a39d30d70a9981aa41de7aa68dc518"
	Jul 31 10:39:33 addons-766873 kubelet[2296]: I0731 10:39:33.456209    2296 scope.go:115] "RemoveContainer" containerID="5466d9e337df6743e3e9f8394cf032b6bfa99c811cae677b8250030dfd00a048"
	Jul 31 10:39:33 addons-766873 kubelet[2296]: E0731 10:39:33.459552    2296 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"hello-world-app\" with CrashLoopBackOff: \"back-off 20s restarting failed container=hello-world-app pod=hello-world-app-65bdb79f98-jcb2h_default(6a54974a-0a87-4362-8953-c8417963b6e6)\"" pod="default/hello-world-app-65bdb79f98-jcb2h" podUID=6a54974a-0a87-4362-8953-c8417963b6e6
	Jul 31 10:39:33 addons-766873 kubelet[2296]: I0731 10:39:33.505167    2296 scope.go:115] "RemoveContainer" containerID="01d1feb4e8e0db8d22d64911d132690e4d7fefa8e6827dba9c89342cbd955953"
	Jul 31 10:39:37 addons-766873 kubelet[2296]: I0731 10:39:37.308041    2296 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ktkh\" (UniqueName: \"kubernetes.io/projected/45ddbe75-698a-4e06-bc70-c7f3485195c6-kube-api-access-9ktkh\") pod \"45ddbe75-698a-4e06-bc70-c7f3485195c6\" (UID: \"45ddbe75-698a-4e06-bc70-c7f3485195c6\") "
	Jul 31 10:39:37 addons-766873 kubelet[2296]: I0731 10:39:37.308490    2296 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s5rb\" (UniqueName: \"kubernetes.io/projected/127acda9-b418-4237-8c22-01c87c9d209e-kube-api-access-7s5rb\") pod \"127acda9-b418-4237-8c22-01c87c9d209e\" (UID: \"127acda9-b418-4237-8c22-01c87c9d209e\") "
	Jul 31 10:39:37 addons-766873 kubelet[2296]: I0731 10:39:37.310826    2296 operation_generator.go:878] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45ddbe75-698a-4e06-bc70-c7f3485195c6-kube-api-access-9ktkh" (OuterVolumeSpecName: "kube-api-access-9ktkh") pod "45ddbe75-698a-4e06-bc70-c7f3485195c6" (UID: "45ddbe75-698a-4e06-bc70-c7f3485195c6"). InnerVolumeSpecName "kube-api-access-9ktkh". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Jul 31 10:39:37 addons-766873 kubelet[2296]: I0731 10:39:37.311453    2296 operation_generator.go:878] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/127acda9-b418-4237-8c22-01c87c9d209e-kube-api-access-7s5rb" (OuterVolumeSpecName: "kube-api-access-7s5rb") pod "127acda9-b418-4237-8c22-01c87c9d209e" (UID: "127acda9-b418-4237-8c22-01c87c9d209e"). InnerVolumeSpecName "kube-api-access-7s5rb". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Jul 31 10:39:37 addons-766873 kubelet[2296]: I0731 10:39:37.408856    2296 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-7s5rb\" (UniqueName: \"kubernetes.io/projected/127acda9-b418-4237-8c22-01c87c9d209e-kube-api-access-7s5rb\") on node \"addons-766873\" DevicePath \"\""
	Jul 31 10:39:37 addons-766873 kubelet[2296]: I0731 10:39:37.408902    2296 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-9ktkh\" (UniqueName: \"kubernetes.io/projected/45ddbe75-698a-4e06-bc70-c7f3485195c6-kube-api-access-9ktkh\") on node \"addons-766873\" DevicePath \"\""
	Jul 31 10:39:37 addons-766873 kubelet[2296]: I0731 10:39:37.562858    2296 scope.go:115] "RemoveContainer" containerID="9c6f5b64960a8f70d69df67e35ef37b3fdff8115a15ee2363d859674a89e2eeb"
	Jul 31 10:39:37 addons-766873 kubelet[2296]: I0731 10:39:37.599734    2296 scope.go:115] "RemoveContainer" containerID="9c6f5b64960a8f70d69df67e35ef37b3fdff8115a15ee2363d859674a89e2eeb"
	Jul 31 10:39:37 addons-766873 kubelet[2296]: E0731 10:39:37.603800    2296 remote_runtime.go:415] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 9c6f5b64960a8f70d69df67e35ef37b3fdff8115a15ee2363d859674a89e2eeb" containerID="9c6f5b64960a8f70d69df67e35ef37b3fdff8115a15ee2363d859674a89e2eeb"
	Jul 31 10:39:37 addons-766873 kubelet[2296]: I0731 10:39:37.604238    2296 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={Type:docker ID:9c6f5b64960a8f70d69df67e35ef37b3fdff8115a15ee2363d859674a89e2eeb} err="failed to get container status \"9c6f5b64960a8f70d69df67e35ef37b3fdff8115a15ee2363d859674a89e2eeb\": rpc error: code = Unknown desc = Error response from daemon: No such container: 9c6f5b64960a8f70d69df67e35ef37b3fdff8115a15ee2363d859674a89e2eeb"
	Jul 31 10:39:37 addons-766873 kubelet[2296]: I0731 10:39:37.604271    2296 scope.go:115] "RemoveContainer" containerID="c32f06142acdf91de574ae6d0e5ca00e4359a535345533c1f1a23d740daf85ef"
	Jul 31 10:39:37 addons-766873 kubelet[2296]: I0731 10:39:37.631495    2296 scope.go:115] "RemoveContainer" containerID="c32f06142acdf91de574ae6d0e5ca00e4359a535345533c1f1a23d740daf85ef"
	Jul 31 10:39:37 addons-766873 kubelet[2296]: E0731 10:39:37.632592    2296 remote_runtime.go:415] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: c32f06142acdf91de574ae6d0e5ca00e4359a535345533c1f1a23d740daf85ef" containerID="c32f06142acdf91de574ae6d0e5ca00e4359a535345533c1f1a23d740daf85ef"
	Jul 31 10:39:37 addons-766873 kubelet[2296]: I0731 10:39:37.632650    2296 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={Type:docker ID:c32f06142acdf91de574ae6d0e5ca00e4359a535345533c1f1a23d740daf85ef} err="failed to get container status \"c32f06142acdf91de574ae6d0e5ca00e4359a535345533c1f1a23d740daf85ef\": rpc error: code = Unknown desc = Error response from daemon: No such container: c32f06142acdf91de574ae6d0e5ca00e4359a535345533c1f1a23d740daf85ef"
	Jul 31 10:39:38 addons-766873 kubelet[2296]: I0731 10:39:38.832158    2296 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=127acda9-b418-4237-8c22-01c87c9d209e path="/var/lib/kubelet/pods/127acda9-b418-4237-8c22-01c87c9d209e/volumes"
	Jul 31 10:39:38 addons-766873 kubelet[2296]: I0731 10:39:38.833521    2296 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=45ddbe75-698a-4e06-bc70-c7f3485195c6 path="/var/lib/kubelet/pods/45ddbe75-698a-4e06-bc70-c7f3485195c6/volumes"
	
	* 
	* ==> storage-provisioner [3ab8afb8fca1] <==
	* I0731 10:37:08.639009       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0731 10:37:08.672523       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0731 10:37:08.672600       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0731 10:37:08.716024       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0731 10:37:08.716679       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"db928b88-c983-4adf-9184-c8dd429c3d5b", APIVersion:"v1", ResourceVersion:"571", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-766873_892fdbbc-e0f0-4e13-aa84-dda3df357523 became leader
	I0731 10:37:08.716805       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-766873_892fdbbc-e0f0-4e13-aa84-dda3df357523!
	I0731 10:37:08.816959       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-766873_892fdbbc-e0f0-4e13-aa84-dda3df357523!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-766873 -n addons-766873
helpers_test.go:261: (dbg) Run:  kubectl --context addons-766873 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestAddons/parallel/Ingress FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/Ingress (39.29s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (15.44s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-034793 /tmp/TestFunctionalparallelMountCmdspecific-port3577149485/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (360.378971ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (271.060841ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (295.550512ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (393.667952ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (418.657354ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (364.358374ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (368.104169ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
2023/07/31 10:44:31 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (366.204894ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:253: /mount-9p did not appear within 14.507376035s: exit status 1
functional_test_mount_test.go:220: "TestFunctional/parallel/MountCmd/specific-port" failed, getting debug info...
functional_test_mount_test.go:221: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "mount | grep 9p; ls -la /mount-9p; cat /mount-9p/pod-dates"
functional_test_mount_test.go:221: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 ssh "mount | grep 9p; ls -la /mount-9p; cat /mount-9p/pod-dates": exit status 1 (409.068904ms)

                                                
                                                
-- stdout --
	total 8
	drwxr-xr-x 2 root root 4096 Jul 31 10:44 .
	drwxr-xr-x 1 root root 4096 Jul 31 10:44 ..
	cat: /mount-9p/pod-dates: No such file or directory

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:223: debugging command "out/minikube-linux-arm64 -p functional-034793 ssh \"mount | grep 9p; ls -la /mount-9p; cat /mount-9p/pod-dates\"" failed : exit status 1
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 ssh "sudo umount -f /mount-9p": exit status 1 (414.436117ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-arm64 -p functional-034793 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-034793 /tmp/TestFunctionalparallelMountCmdspecific-port3577149485/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:234: (dbg) [out/minikube-linux-arm64 mount -p functional-034793 /tmp/TestFunctionalparallelMountCmdspecific-port3577149485/001:/mount-9p --alsologtostderr -v=1 --port 46464] stdout:

                                                
                                                

                                                
                                                
functional_test_mount_test.go:234: (dbg) [out/minikube-linux-arm64 mount -p functional-034793 /tmp/TestFunctionalparallelMountCmdspecific-port3577149485/001:/mount-9p --alsologtostderr -v=1 --port 46464] stderr:
I0731 10:44:17.705527  492061 out.go:296] Setting OutFile to fd 1 ...
I0731 10:44:17.705767  492061 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0731 10:44:17.705790  492061 out.go:309] Setting ErrFile to fd 2...
I0731 10:44:17.705806  492061 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0731 10:44:17.706109  492061 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16969-448039/.minikube/bin
I0731 10:44:17.706465  492061 mustload.go:65] Loading cluster: functional-034793
I0731 10:44:17.706842  492061 config.go:182] Loaded profile config "functional-034793": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0731 10:44:17.707331  492061 cli_runner.go:164] Run: docker container inspect functional-034793 --format={{.State.Status}}
I0731 10:44:17.735360  492061 host.go:66] Checking if "functional-034793" exists ...
I0731 10:44:17.735666  492061 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0731 10:44:17.902408  492061 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:47 SystemTime:2023-07-31 10:44:17.886306407 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archit
ecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
I0731 10:44:17.902769  492061 cli_runner.go:164] Run: docker network inspect functional-034793 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0731 10:44:17.937441  492061 out.go:177] 
W0731 10:44:17.939522  492061 out.go:239] X Exiting due to IF_MOUNT_PORT: Error finding port for mount: Error accessing port 46464
X Exiting due to IF_MOUNT_PORT: Error finding port for mount: Error accessing port 46464
W0731 10:44:17.939544  492061 out.go:239] * 
* 
W0731 10:44:17.950962  492061 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                             │
│    * If the above advice does not help, please let us know:                                 │
│      https://github.com/kubernetes/minikube/issues/new/choose                               │
│                                                                                             │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
│    * Please also attach the following file to the GitHub issue:                             │
│    * - /tmp/minikube_mount_4082b1ce989adb0c371951daac1891e4d769da05_0.log                   │
│                                                                                             │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                             │
│    * If the above advice does not help, please let us know:                                 │
│      https://github.com/kubernetes/minikube/issues/new/choose                               │
│                                                                                             │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
│    * Please also attach the following file to the GitHub issue:                             │
│    * - /tmp/minikube_mount_4082b1ce989adb0c371951daac1891e4d769da05_0.log                   │
│                                                                                             │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯
I0731 10:44:17.953028  492061 out.go:177] 
--- FAIL: TestFunctional/parallel/MountCmd/specific-port (15.44s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddons (53.12s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons
addons_test.go:183: (dbg) Run:  kubectl --context ingress-addon-legacy-192573 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:183: (dbg) Done: kubectl --context ingress-addon-legacy-192573 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: (12.410378535s)
addons_test.go:208: (dbg) Run:  kubectl --context ingress-addon-legacy-192573 replace --force -f testdata/nginx-ingress-v1beta1.yaml
addons_test.go:221: (dbg) Run:  kubectl --context ingress-addon-legacy-192573 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:226: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [f2f7b1ca-2d75-4659-8f19-7f5a245faebd] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [f2f7b1ca-2d75-4659-8f19-7f5a245faebd] Running
addons_test.go:226: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: run=nginx healthy within 11.015492059s
addons_test.go:238: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-192573 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Run:  kubectl --context ingress-addon-legacy-192573 replace --force -f testdata/ingress-dns-example-v1beta1.yaml
addons_test.go:267: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-192573 ip
addons_test.go:273: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:273: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.034829868s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:275: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:279: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-192573 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-192573 addons disable ingress-dns --alsologtostderr -v=1: (3.741356264s)
addons_test.go:287: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-192573 addons disable ingress --alsologtostderr -v=1
addons_test.go:287: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-192573 addons disable ingress --alsologtostderr -v=1: (7.492223867s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect ingress-addon-legacy-192573
helpers_test.go:235: (dbg) docker inspect ingress-addon-legacy-192573:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "9075807a2c3fa23705f2106469a05d51f607cefcebed5a5150345500f317fb0a",
	        "Created": "2023-07-31T10:45:35.293566222Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 499695,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-07-31T10:45:35.623656991Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:f52519afe5f6d6f3ce84cbd7f651b1292638d32ca98ee43d88f2d69e113e44de",
	        "ResolvConfPath": "/var/lib/docker/containers/9075807a2c3fa23705f2106469a05d51f607cefcebed5a5150345500f317fb0a/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/9075807a2c3fa23705f2106469a05d51f607cefcebed5a5150345500f317fb0a/hostname",
	        "HostsPath": "/var/lib/docker/containers/9075807a2c3fa23705f2106469a05d51f607cefcebed5a5150345500f317fb0a/hosts",
	        "LogPath": "/var/lib/docker/containers/9075807a2c3fa23705f2106469a05d51f607cefcebed5a5150345500f317fb0a/9075807a2c3fa23705f2106469a05d51f607cefcebed5a5150345500f317fb0a-json.log",
	        "Name": "/ingress-addon-legacy-192573",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ingress-addon-legacy-192573:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "ingress-addon-legacy-192573",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4294967296,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8589934592,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/eaaae7728d1e3bbae508daeb72ae87bd400fdee4b5f3499139d342389efda045-init/diff:/var/lib/docker/overlay2/c7d366fb81dd6a1be1719c87c3423d9dc1e707c6cd39391e90a6318caabf95b7/diff",
	                "MergedDir": "/var/lib/docker/overlay2/eaaae7728d1e3bbae508daeb72ae87bd400fdee4b5f3499139d342389efda045/merged",
	                "UpperDir": "/var/lib/docker/overlay2/eaaae7728d1e3bbae508daeb72ae87bd400fdee4b5f3499139d342389efda045/diff",
	                "WorkDir": "/var/lib/docker/overlay2/eaaae7728d1e3bbae508daeb72ae87bd400fdee4b5f3499139d342389efda045/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "ingress-addon-legacy-192573",
	                "Source": "/var/lib/docker/volumes/ingress-addon-legacy-192573/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "ingress-addon-legacy-192573",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ingress-addon-legacy-192573",
	                "name.minikube.sigs.k8s.io": "ingress-addon-legacy-192573",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "8a42ab67f4a74c1d5a09b96690414f5fd273a8c807d346aa9a8db56b8e70ea4f",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "35530"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "35529"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "35526"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "35528"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "35527"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/8a42ab67f4a7",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ingress-addon-legacy-192573": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "9075807a2c3f",
	                        "ingress-addon-legacy-192573"
	                    ],
	                    "NetworkID": "c4caf11b05f399eb147f4a64108a40e86707c7884e5fce1ce69977b92f6a328e",
	                    "EndpointID": "6c3d358f0df4ebf43479196a963bf279eb4d2cc343f301a66a7bdd40c355786e",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p ingress-addon-legacy-192573 -n ingress-addon-legacy-192573
helpers_test.go:244: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-192573 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-192573 logs -n 25: (1.003637376s)
helpers_test.go:252: TestIngressAddonLegacy/serial/ValidateIngressAddons logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|------------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	| Command |                                  Args                                  |           Profile           |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	| mount   | -p functional-034793                                                   | functional-034793           | jenkins | v1.31.1 | 31 Jul 23 10:44 UTC |                     |
	|         | /tmp/TestFunctionalparallelMountCmdVerifyCleanup2687081926/001:/mount1 |                             |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	| ssh     | functional-034793 ssh findmnt                                          | functional-034793           | jenkins | v1.31.1 | 31 Jul 23 10:44 UTC |                     |
	|         | -T /mount1                                                             |                             |         |         |                     |                     |
	| ssh     | functional-034793 ssh pgrep                                            | functional-034793           | jenkins | v1.31.1 | 31 Jul 23 10:44 UTC |                     |
	|         | buildkitd                                                              |                             |         |         |                     |                     |
	| image   | functional-034793 image build -t                                       | functional-034793           | jenkins | v1.31.1 | 31 Jul 23 10:44 UTC | 31 Jul 23 10:44 UTC |
	|         | localhost/my-image:functional-034793                                   |                             |         |         |                     |                     |
	|         | testdata/build --alsologtostderr                                       |                             |         |         |                     |                     |
	| ssh     | functional-034793 ssh findmnt                                          | functional-034793           | jenkins | v1.31.1 | 31 Jul 23 10:44 UTC | 31 Jul 23 10:44 UTC |
	|         | -T /mount1                                                             |                             |         |         |                     |                     |
	| ssh     | functional-034793 ssh findmnt                                          | functional-034793           | jenkins | v1.31.1 | 31 Jul 23 10:44 UTC | 31 Jul 23 10:44 UTC |
	|         | -T /mount2                                                             |                             |         |         |                     |                     |
	| ssh     | functional-034793 ssh findmnt                                          | functional-034793           | jenkins | v1.31.1 | 31 Jul 23 10:44 UTC | 31 Jul 23 10:44 UTC |
	|         | -T /mount3                                                             |                             |         |         |                     |                     |
	| mount   | -p functional-034793                                                   | functional-034793           | jenkins | v1.31.1 | 31 Jul 23 10:44 UTC |                     |
	|         | --kill=true                                                            |                             |         |         |                     |                     |
	| image   | functional-034793                                                      | functional-034793           | jenkins | v1.31.1 | 31 Jul 23 10:44 UTC | 31 Jul 23 10:44 UTC |
	|         | image ls --format json                                                 |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                      |                             |         |         |                     |                     |
	| image   | functional-034793                                                      | functional-034793           | jenkins | v1.31.1 | 31 Jul 23 10:44 UTC | 31 Jul 23 10:44 UTC |
	|         | image ls --format table                                                |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                      |                             |         |         |                     |                     |
	| image   | functional-034793 image ls                                             | functional-034793           | jenkins | v1.31.1 | 31 Jul 23 10:44 UTC | 31 Jul 23 10:44 UTC |
	| delete  | -p functional-034793                                                   | functional-034793           | jenkins | v1.31.1 | 31 Jul 23 10:44 UTC | 31 Jul 23 10:44 UTC |
	| start   | -p image-550283                                                        | image-550283                | jenkins | v1.31.1 | 31 Jul 23 10:44 UTC | 31 Jul 23 10:45 UTC |
	|         | --driver=docker                                                        |                             |         |         |                     |                     |
	|         | --container-runtime=docker                                             |                             |         |         |                     |                     |
	| image   | build -t aaa:latest                                                    | image-550283                | jenkins | v1.31.1 | 31 Jul 23 10:45 UTC | 31 Jul 23 10:45 UTC |
	|         | ./testdata/image-build/test-normal                                     |                             |         |         |                     |                     |
	|         | -p image-550283                                                        |                             |         |         |                     |                     |
	| image   | build -t aaa:latest                                                    | image-550283                | jenkins | v1.31.1 | 31 Jul 23 10:45 UTC | 31 Jul 23 10:45 UTC |
	|         | --build-opt=build-arg=ENV_A=test_env_str                               |                             |         |         |                     |                     |
	|         | --build-opt=no-cache                                                   |                             |         |         |                     |                     |
	|         | ./testdata/image-build/test-arg -p                                     |                             |         |         |                     |                     |
	|         | image-550283                                                           |                             |         |         |                     |                     |
	| image   | build -t aaa:latest                                                    | image-550283                | jenkins | v1.31.1 | 31 Jul 23 10:45 UTC | 31 Jul 23 10:45 UTC |
	|         | ./testdata/image-build/test-normal                                     |                             |         |         |                     |                     |
	|         | --build-opt=no-cache -p                                                |                             |         |         |                     |                     |
	|         | image-550283                                                           |                             |         |         |                     |                     |
	| image   | build -t aaa:latest                                                    | image-550283                | jenkins | v1.31.1 | 31 Jul 23 10:45 UTC | 31 Jul 23 10:45 UTC |
	|         | -f inner/Dockerfile                                                    |                             |         |         |                     |                     |
	|         | ./testdata/image-build/test-f                                          |                             |         |         |                     |                     |
	|         | -p image-550283                                                        |                             |         |         |                     |                     |
	| delete  | -p image-550283                                                        | image-550283                | jenkins | v1.31.1 | 31 Jul 23 10:45 UTC | 31 Jul 23 10:45 UTC |
	| start   | -p ingress-addon-legacy-192573                                         | ingress-addon-legacy-192573 | jenkins | v1.31.1 | 31 Jul 23 10:45 UTC | 31 Jul 23 10:46 UTC |
	|         | --kubernetes-version=v1.18.20                                          |                             |         |         |                     |                     |
	|         | --memory=4096 --wait=true                                              |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                      |                             |         |         |                     |                     |
	|         | -v=5 --driver=docker                                                   |                             |         |         |                     |                     |
	|         | --container-runtime=docker                                             |                             |         |         |                     |                     |
	| addons  | ingress-addon-legacy-192573                                            | ingress-addon-legacy-192573 | jenkins | v1.31.1 | 31 Jul 23 10:46 UTC | 31 Jul 23 10:46 UTC |
	|         | addons enable ingress                                                  |                             |         |         |                     |                     |
	|         | --alsologtostderr -v=5                                                 |                             |         |         |                     |                     |
	| addons  | ingress-addon-legacy-192573                                            | ingress-addon-legacy-192573 | jenkins | v1.31.1 | 31 Jul 23 10:46 UTC | 31 Jul 23 10:46 UTC |
	|         | addons enable ingress-dns                                              |                             |         |         |                     |                     |
	|         | --alsologtostderr -v=5                                                 |                             |         |         |                     |                     |
	| ssh     | ingress-addon-legacy-192573                                            | ingress-addon-legacy-192573 | jenkins | v1.31.1 | 31 Jul 23 10:47 UTC | 31 Jul 23 10:47 UTC |
	|         | ssh curl -s http://127.0.0.1/                                          |                             |         |         |                     |                     |
	|         | -H 'Host: nginx.example.com'                                           |                             |         |         |                     |                     |
	| ip      | ingress-addon-legacy-192573 ip                                         | ingress-addon-legacy-192573 | jenkins | v1.31.1 | 31 Jul 23 10:47 UTC | 31 Jul 23 10:47 UTC |
	| addons  | ingress-addon-legacy-192573                                            | ingress-addon-legacy-192573 | jenkins | v1.31.1 | 31 Jul 23 10:47 UTC | 31 Jul 23 10:47 UTC |
	|         | addons disable ingress-dns                                             |                             |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	| addons  | ingress-addon-legacy-192573                                            | ingress-addon-legacy-192573 | jenkins | v1.31.1 | 31 Jul 23 10:47 UTC | 31 Jul 23 10:47 UTC |
	|         | addons disable ingress                                                 |                             |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	|---------|------------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/31 10:45:20
	Running on machine: ip-172-31-29-130
	Binary: Built with gc go1.20.6 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0731 10:45:20.418392  499239 out.go:296] Setting OutFile to fd 1 ...
	I0731 10:45:20.418567  499239 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0731 10:45:20.418576  499239 out.go:309] Setting ErrFile to fd 2...
	I0731 10:45:20.418582  499239 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0731 10:45:20.418874  499239 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16969-448039/.minikube/bin
	I0731 10:45:20.419341  499239 out.go:303] Setting JSON to false
	I0731 10:45:20.420341  499239 start.go:128] hostinfo: {"hostname":"ip-172-31-29-130","uptime":66468,"bootTime":1690733853,"procs":259,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0731 10:45:20.420412  499239 start.go:138] virtualization:  
	I0731 10:45:20.423069  499239 out.go:177] * [ingress-addon-legacy-192573] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	I0731 10:45:20.425470  499239 out.go:177]   - MINIKUBE_LOCATION=16969
	I0731 10:45:20.427149  499239 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0731 10:45:20.425675  499239 notify.go:220] Checking for updates...
	I0731 10:45:20.430428  499239 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16969-448039/kubeconfig
	I0731 10:45:20.431992  499239 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16969-448039/.minikube
	I0731 10:45:20.433947  499239 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0731 10:45:20.435959  499239 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0731 10:45:20.437958  499239 driver.go:373] Setting default libvirt URI to qemu:///system
	I0731 10:45:20.462661  499239 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0731 10:45:20.462775  499239 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0731 10:45:20.559937  499239 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:24 OomKillDisable:true NGoroutines:35 SystemTime:2023-07-31 10:45:20.549889685 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0731 10:45:20.560039  499239 docker.go:294] overlay module found
	I0731 10:45:20.562950  499239 out.go:177] * Using the docker driver based on user configuration
	I0731 10:45:20.564878  499239 start.go:298] selected driver: docker
	I0731 10:45:20.564909  499239 start.go:898] validating driver "docker" against <nil>
	I0731 10:45:20.564924  499239 start.go:909] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0731 10:45:20.565652  499239 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0731 10:45:20.643952  499239 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:24 OomKillDisable:true NGoroutines:35 SystemTime:2023-07-31 10:45:20.63341192 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archit
ecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0731 10:45:20.644593  499239 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0731 10:45:20.644836  499239 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0731 10:45:20.646785  499239 out.go:177] * Using Docker driver with root privileges
	I0731 10:45:20.649605  499239 cni.go:84] Creating CNI manager for ""
	I0731 10:45:20.649639  499239 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0731 10:45:20.649651  499239 start_flags.go:319] config:
	{Name:ingress-addon-legacy-192573 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-192573 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:doc
ker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0731 10:45:20.651711  499239 out.go:177] * Starting control plane node ingress-addon-legacy-192573 in cluster ingress-addon-legacy-192573
	I0731 10:45:20.653491  499239 cache.go:122] Beginning downloading kic base image for docker with docker
	I0731 10:45:20.655058  499239 out.go:177] * Pulling base image ...
	I0731 10:45:20.656764  499239 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I0731 10:45:20.656832  499239 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0731 10:45:20.674063  499239 image.go:83] Found gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon, skipping pull
	I0731 10:45:20.674121  499239 cache.go:145] gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 exists in daemon, skipping load
	I0731 10:45:20.724621  499239 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4
	I0731 10:45:20.724648  499239 cache.go:57] Caching tarball of preloaded images
	I0731 10:45:20.724801  499239 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I0731 10:45:20.727037  499239 out.go:177] * Downloading Kubernetes v1.18.20 preload ...
	I0731 10:45:20.728917  499239 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I0731 10:45:20.854488  499239 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4?checksum=md5:c8c260b886393123ce9d312d8ac2379e -> /home/jenkins/minikube-integration/16969-448039/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4
	I0731 10:45:27.903702  499239 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I0731 10:45:27.903813  499239 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/16969-448039/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 ...
	I0731 10:45:28.991863  499239 cache.go:60] Finished verifying existence of preloaded tar for  v1.18.20 on docker
	I0731 10:45:28.992259  499239 profile.go:148] Saving config to /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/config.json ...
	I0731 10:45:28.992293  499239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/config.json: {Name:mk542c558197a99410271459be0f015982ef4fff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:45:28.992479  499239 cache.go:195] Successfully downloaded all kic artifacts
	I0731 10:45:28.992539  499239 start.go:365] acquiring machines lock for ingress-addon-legacy-192573: {Name:mk67ac8c0065c67510346f2b5e03b05418bbc929 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0731 10:45:28.992598  499239 start.go:369] acquired machines lock for "ingress-addon-legacy-192573" in 44.628µs
	I0731 10:45:28.992622  499239 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-192573 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-192573 Namespace:default APIServerName:minikub
eCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false
DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0731 10:45:28.992689  499239 start.go:125] createHost starting for "" (driver="docker")
	I0731 10:45:28.996067  499239 out.go:204] * Creating docker container (CPUs=2, Memory=4096MB) ...
	I0731 10:45:28.996356  499239 start.go:159] libmachine.API.Create for "ingress-addon-legacy-192573" (driver="docker")
	I0731 10:45:28.996388  499239 client.go:168] LocalClient.Create starting
	I0731 10:45:28.996495  499239 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca.pem
	I0731 10:45:28.996534  499239 main.go:141] libmachine: Decoding PEM data...
	I0731 10:45:28.996554  499239 main.go:141] libmachine: Parsing certificate...
	I0731 10:45:28.996613  499239 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/16969-448039/.minikube/certs/cert.pem
	I0731 10:45:28.996636  499239 main.go:141] libmachine: Decoding PEM data...
	I0731 10:45:28.996650  499239 main.go:141] libmachine: Parsing certificate...
	I0731 10:45:28.997004  499239 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-192573 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0731 10:45:29.017862  499239 cli_runner.go:211] docker network inspect ingress-addon-legacy-192573 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0731 10:45:29.017950  499239 network_create.go:281] running [docker network inspect ingress-addon-legacy-192573] to gather additional debugging logs...
	I0731 10:45:29.017973  499239 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-192573
	W0731 10:45:29.035168  499239 cli_runner.go:211] docker network inspect ingress-addon-legacy-192573 returned with exit code 1
	I0731 10:45:29.035213  499239 network_create.go:284] error running [docker network inspect ingress-addon-legacy-192573]: docker network inspect ingress-addon-legacy-192573: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network ingress-addon-legacy-192573 not found
	I0731 10:45:29.035231  499239 network_create.go:286] output of [docker network inspect ingress-addon-legacy-192573]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network ingress-addon-legacy-192573 not found
	
	** /stderr **
	I0731 10:45:29.035300  499239 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0731 10:45:29.053319  499239 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4000bf92e0}
	I0731 10:45:29.053358  499239 network_create.go:123] attempt to create docker network ingress-addon-legacy-192573 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0731 10:45:29.053417  499239 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=ingress-addon-legacy-192573 ingress-addon-legacy-192573
	I0731 10:45:29.122498  499239 network_create.go:107] docker network ingress-addon-legacy-192573 192.168.49.0/24 created
	I0731 10:45:29.122529  499239 kic.go:117] calculated static IP "192.168.49.2" for the "ingress-addon-legacy-192573" container
	I0731 10:45:29.122607  499239 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0731 10:45:29.139176  499239 cli_runner.go:164] Run: docker volume create ingress-addon-legacy-192573 --label name.minikube.sigs.k8s.io=ingress-addon-legacy-192573 --label created_by.minikube.sigs.k8s.io=true
	I0731 10:45:29.157714  499239 oci.go:103] Successfully created a docker volume ingress-addon-legacy-192573
	I0731 10:45:29.157808  499239 cli_runner.go:164] Run: docker run --rm --name ingress-addon-legacy-192573-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-192573 --entrypoint /usr/bin/test -v ingress-addon-legacy-192573:/var gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -d /var/lib
	I0731 10:45:30.545053  499239 cli_runner.go:217] Completed: docker run --rm --name ingress-addon-legacy-192573-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-192573 --entrypoint /usr/bin/test -v ingress-addon-legacy-192573:/var gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -d /var/lib: (1.387192906s)
	I0731 10:45:30.545082  499239 oci.go:107] Successfully prepared a docker volume ingress-addon-legacy-192573
	I0731 10:45:30.545102  499239 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I0731 10:45:30.545122  499239 kic.go:190] Starting extracting preloaded images to volume ...
	I0731 10:45:30.545208  499239 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16969-448039/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-192573:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -I lz4 -xf /preloaded.tar -C /extractDir
	I0731 10:45:35.195672  499239 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16969-448039/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-192573:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -I lz4 -xf /preloaded.tar -C /extractDir: (4.650412065s)
	I0731 10:45:35.195704  499239 kic.go:199] duration metric: took 4.650579 seconds to extract preloaded images to volume
	W0731 10:45:35.195849  499239 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0731 10:45:35.195954  499239 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0731 10:45:35.276915  499239 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ingress-addon-legacy-192573 --name ingress-addon-legacy-192573 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-192573 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ingress-addon-legacy-192573 --network ingress-addon-legacy-192573 --ip 192.168.49.2 --volume ingress-addon-legacy-192573:/var --security-opt apparmor=unconfined --memory=4096mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631
	I0731 10:45:35.631534  499239 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-192573 --format={{.State.Running}}
	I0731 10:45:35.653484  499239 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-192573 --format={{.State.Status}}
	I0731 10:45:35.676170  499239 cli_runner.go:164] Run: docker exec ingress-addon-legacy-192573 stat /var/lib/dpkg/alternatives/iptables
	I0731 10:45:35.771983  499239 oci.go:144] the created container "ingress-addon-legacy-192573" has a running status.
	I0731 10:45:35.772015  499239 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/16969-448039/.minikube/machines/ingress-addon-legacy-192573/id_rsa...
	I0731 10:45:36.001256  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/machines/ingress-addon-legacy-192573/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0731 10:45:36.001358  499239 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/16969-448039/.minikube/machines/ingress-addon-legacy-192573/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0731 10:45:36.034041  499239 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-192573 --format={{.State.Status}}
	I0731 10:45:36.069455  499239 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0731 10:45:36.069476  499239 kic_runner.go:114] Args: [docker exec --privileged ingress-addon-legacy-192573 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0731 10:45:36.151489  499239 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-192573 --format={{.State.Status}}
	I0731 10:45:36.174579  499239 machine.go:88] provisioning docker machine ...
	I0731 10:45:36.174608  499239 ubuntu.go:169] provisioning hostname "ingress-addon-legacy-192573"
	I0731 10:45:36.174676  499239 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-192573
	I0731 10:45:36.211888  499239 main.go:141] libmachine: Using SSH client type: native
	I0731 10:45:36.212369  499239 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 35530 <nil> <nil>}
	I0731 10:45:36.212385  499239 main.go:141] libmachine: About to run SSH command:
	sudo hostname ingress-addon-legacy-192573 && echo "ingress-addon-legacy-192573" | sudo tee /etc/hostname
	I0731 10:45:36.212995  499239 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0731 10:45:39.358861  499239 main.go:141] libmachine: SSH cmd err, output: <nil>: ingress-addon-legacy-192573
	
	I0731 10:45:39.358947  499239 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-192573
	I0731 10:45:39.377397  499239 main.go:141] libmachine: Using SSH client type: native
	I0731 10:45:39.377836  499239 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 35530 <nil> <nil>}
	I0731 10:45:39.377861  499239 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\singress-addon-legacy-192573' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ingress-addon-legacy-192573/g' /etc/hosts;
				else 
					echo '127.0.1.1 ingress-addon-legacy-192573' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0731 10:45:39.505658  499239 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0731 10:45:39.505686  499239 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/16969-448039/.minikube CaCertPath:/home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/16969-448039/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/16969-448039/.minikube}
	I0731 10:45:39.505707  499239 ubuntu.go:177] setting up certificates
	I0731 10:45:39.505722  499239 provision.go:83] configureAuth start
	I0731 10:45:39.505784  499239 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-192573
	I0731 10:45:39.525400  499239 provision.go:138] copyHostCerts
	I0731 10:45:39.525449  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/16969-448039/.minikube/ca.pem
	I0731 10:45:39.525482  499239 exec_runner.go:144] found /home/jenkins/minikube-integration/16969-448039/.minikube/ca.pem, removing ...
	I0731 10:45:39.525493  499239 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16969-448039/.minikube/ca.pem
	I0731 10:45:39.525573  499239 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/16969-448039/.minikube/ca.pem (1078 bytes)
	I0731 10:45:39.525653  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/16969-448039/.minikube/cert.pem
	I0731 10:45:39.525674  499239 exec_runner.go:144] found /home/jenkins/minikube-integration/16969-448039/.minikube/cert.pem, removing ...
	I0731 10:45:39.525683  499239 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16969-448039/.minikube/cert.pem
	I0731 10:45:39.525710  499239 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/16969-448039/.minikube/cert.pem (1123 bytes)
	I0731 10:45:39.525753  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/16969-448039/.minikube/key.pem
	I0731 10:45:39.525772  499239 exec_runner.go:144] found /home/jenkins/minikube-integration/16969-448039/.minikube/key.pem, removing ...
	I0731 10:45:39.525780  499239 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16969-448039/.minikube/key.pem
	I0731 10:45:39.525804  499239 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/16969-448039/.minikube/key.pem (1679 bytes)
	I0731 10:45:39.525850  499239 provision.go:112] generating server cert: /home/jenkins/minikube-integration/16969-448039/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca-key.pem org=jenkins.ingress-addon-legacy-192573 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube ingress-addon-legacy-192573]
	I0731 10:45:40.214351  499239 provision.go:172] copyRemoteCerts
	I0731 10:45:40.214446  499239 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0731 10:45:40.214496  499239 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-192573
	I0731 10:45:40.232366  499239 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35530 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/ingress-addon-legacy-192573/id_rsa Username:docker}
	I0731 10:45:40.326767  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0731 10:45:40.326824  499239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0731 10:45:40.355415  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0731 10:45:40.355484  499239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/machines/server.pem --> /etc/docker/server.pem (1253 bytes)
	I0731 10:45:40.384441  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0731 10:45:40.384557  499239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0731 10:45:40.412966  499239 provision.go:86] duration metric: configureAuth took 907.229603ms
	I0731 10:45:40.412994  499239 ubuntu.go:193] setting minikube options for container-runtime
	I0731 10:45:40.413181  499239 config.go:182] Loaded profile config "ingress-addon-legacy-192573": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I0731 10:45:40.413241  499239 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-192573
	I0731 10:45:40.430894  499239 main.go:141] libmachine: Using SSH client type: native
	I0731 10:45:40.431407  499239 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 35530 <nil> <nil>}
	I0731 10:45:40.431421  499239 main.go:141] libmachine: About to run SSH command:
	df --output=fstype / | tail -n 1
	I0731 10:45:40.562227  499239 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
	
	I0731 10:45:40.562244  499239 ubuntu.go:71] root file system type: overlay
	I0731 10:45:40.562354  499239 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...
	I0731 10:45:40.562437  499239 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-192573
	I0731 10:45:40.582365  499239 main.go:141] libmachine: Using SSH client type: native
	I0731 10:45:40.582811  499239 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 35530 <nil> <nil>}
	I0731 10:45:40.582897  499239 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP \$MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	" | sudo tee /lib/systemd/system/docker.service.new
	I0731 10:45:40.729631  499239 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
	Description=Docker Application Container Engine
	Documentation=https://docs.docker.com
	BindsTo=containerd.service
	After=network-online.target firewalld.service containerd.service
	Wants=network-online.target
	Requires=docker.socket
	StartLimitBurst=3
	StartLimitIntervalSec=60
	
	[Service]
	Type=notify
	Restart=on-failure
	
	
	
	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	# The base configuration already specifies an 'ExecStart=...' command. The first directive
	# here is to clear out that command inherited from the base configuration. Without this,
	# the command from the base configuration and the command specified here are treated as
	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	# will catch this invalid input and refuse to start the service with an error like:
	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	
	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	ExecStart=
	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	ExecReload=/bin/kill -s HUP $MAINPID
	
	# Having non-zero Limit*s causes performance problems due to accounting overhead
	# in the kernel. We recommend using cgroups to do container-local accounting.
	LimitNOFILE=infinity
	LimitNPROC=infinity
	LimitCORE=infinity
	
	# Uncomment TasksMax if your systemd version supports it.
	# Only systemd 226 and above support this version.
	TasksMax=infinity
	TimeoutStartSec=0
	
	# set delegate yes so that systemd does not reset the cgroups of docker containers
	Delegate=yes
	
	# kill only the docker process, not all processes in the cgroup
	KillMode=process
	
	[Install]
	WantedBy=multi-user.target
	
	I0731 10:45:40.729722  499239 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-192573
	I0731 10:45:40.749208  499239 main.go:141] libmachine: Using SSH client type: native
	I0731 10:45:40.749658  499239 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f5b0] 0x3a1f40 <nil>  [] 0s} 127.0.0.1 35530 <nil> <nil>}
	I0731 10:45:40.749683  499239 main.go:141] libmachine: About to run SSH command:
	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
	I0731 10:45:41.579095  499239 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2023-07-07 14:51:01.000000000 +0000
	+++ /lib/systemd/system/docker.service.new	2023-07-31 10:45:40.720349504 +0000
	@@ -1,30 +1,32 @@
	 [Unit]
	 Description=Docker Application Container Engine
	 Documentation=https://docs.docker.com
	-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
	-Wants=network-online.target containerd.service
	+BindsTo=containerd.service
	+After=network-online.target firewalld.service containerd.service
	+Wants=network-online.target
	 Requires=docker.socket
	+StartLimitBurst=3
	+StartLimitIntervalSec=60
	 
	 [Service]
	 Type=notify
	-# the default is not to use systemd for cgroups because the delegate issues still
	-# exists and systemd currently does not support the cgroup feature set required
	-# for containers run by docker
	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
	-ExecReload=/bin/kill -s HUP $MAINPID
	-TimeoutStartSec=0
	-RestartSec=2
	-Restart=always
	+Restart=on-failure
	 
	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
	-# to make them work for either version of systemd.
	-StartLimitBurst=3
	 
	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
	-# this option work for either version of systemd.
	-StartLimitInterval=60s
	+
	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
	+# The base configuration already specifies an 'ExecStart=...' command. The first directive
	+# here is to clear out that command inherited from the base configuration. Without this,
	+# the command from the base configuration and the command specified here are treated as
	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
	+# will catch this invalid input and refuse to start the service with an error like:
	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
	+
	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
	+ExecStart=
	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 
	+ExecReload=/bin/kill -s HUP $MAINPID
	 
	 # Having non-zero Limit*s causes performance problems due to accounting overhead
	 # in the kernel. We recommend using cgroups to do container-local accounting.
	@@ -32,16 +34,16 @@
	 LimitNPROC=infinity
	 LimitCORE=infinity
	 
	-# Comment TasksMax if your systemd version does not support it.
	-# Only systemd 226 and above support this option.
	+# Uncomment TasksMax if your systemd version supports it.
	+# Only systemd 226 and above support this version.
	 TasksMax=infinity
	+TimeoutStartSec=0
	 
	 # set delegate yes so that systemd does not reset the cgroups of docker containers
	 Delegate=yes
	 
	 # kill only the docker process, not all processes in the cgroup
	 KillMode=process
	-OOMScoreAdjust=-500
	 
	 [Install]
	 WantedBy=multi-user.target
	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
	Executing: /lib/systemd/systemd-sysv-install enable docker
	
	I0731 10:45:41.579149  499239 machine.go:91] provisioned docker machine in 5.404529628s
	I0731 10:45:41.579161  499239 client.go:171] LocalClient.Create took 12.582766066s
	I0731 10:45:41.579184  499239 start.go:167] duration metric: libmachine.API.Create for "ingress-addon-legacy-192573" took 12.582829163s
	I0731 10:45:41.579195  499239 start.go:300] post-start starting for "ingress-addon-legacy-192573" (driver="docker")
	I0731 10:45:41.579204  499239 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0731 10:45:41.579288  499239 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0731 10:45:41.579336  499239 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-192573
	I0731 10:45:41.599096  499239 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35530 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/ingress-addon-legacy-192573/id_rsa Username:docker}
	I0731 10:45:41.696157  499239 ssh_runner.go:195] Run: cat /etc/os-release
	I0731 10:45:41.700776  499239 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0731 10:45:41.700813  499239 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0731 10:45:41.700827  499239 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0731 10:45:41.700835  499239 info.go:137] Remote host: Ubuntu 22.04.2 LTS
	I0731 10:45:41.700847  499239 filesync.go:126] Scanning /home/jenkins/minikube-integration/16969-448039/.minikube/addons for local assets ...
	I0731 10:45:41.700949  499239 filesync.go:126] Scanning /home/jenkins/minikube-integration/16969-448039/.minikube/files for local assets ...
	I0731 10:45:41.701034  499239 filesync.go:149] local asset: /home/jenkins/minikube-integration/16969-448039/.minikube/files/etc/ssl/certs/4535942.pem -> 4535942.pem in /etc/ssl/certs
	I0731 10:45:41.701049  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/files/etc/ssl/certs/4535942.pem -> /etc/ssl/certs/4535942.pem
	I0731 10:45:41.701157  499239 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0731 10:45:41.712663  499239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/files/etc/ssl/certs/4535942.pem --> /etc/ssl/certs/4535942.pem (1708 bytes)
	I0731 10:45:41.743021  499239 start.go:303] post-start completed in 163.811998ms
	I0731 10:45:41.743447  499239 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-192573
	I0731 10:45:41.761883  499239 profile.go:148] Saving config to /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/config.json ...
	I0731 10:45:41.762173  499239 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0731 10:45:41.762225  499239 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-192573
	I0731 10:45:41.779640  499239 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35530 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/ingress-addon-legacy-192573/id_rsa Username:docker}
	I0731 10:45:41.870589  499239 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0731 10:45:41.876414  499239 start.go:128] duration metric: createHost completed in 12.883708232s
	I0731 10:45:41.876439  499239 start.go:83] releasing machines lock for "ingress-addon-legacy-192573", held for 12.883828832s
	I0731 10:45:41.876508  499239 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-192573
	I0731 10:45:41.896249  499239 ssh_runner.go:195] Run: cat /version.json
	I0731 10:45:41.896308  499239 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-192573
	I0731 10:45:41.896548  499239 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0731 10:45:41.896606  499239 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-192573
	I0731 10:45:41.914694  499239 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35530 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/ingress-addon-legacy-192573/id_rsa Username:docker}
	I0731 10:45:41.925651  499239 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35530 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/ingress-addon-legacy-192573/id_rsa Username:docker}
	I0731 10:45:42.013707  499239 ssh_runner.go:195] Run: systemctl --version
	I0731 10:45:42.158760  499239 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0731 10:45:42.165941  499239 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0731 10:45:42.205262  499239 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0731 10:45:42.205412  499239 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *bridge* -not -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e '/"dst": ".*:.*"/d' -e 's|^(.*)"dst": (.*)[,*]$|\1"dst": \2|g' -e '/"subnet": ".*:.*"/d' -e 's|^(.*)"subnet": ".*"(.*)[,*]$|\1"subnet": "10.244.0.0/16"\2|g' {}" ;
	I0731 10:45:42.230152  499239 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *podman* -not -name *.mk_disabled -printf "%!p(MISSING), " -exec sh -c "sudo sed -i -r -e 's|^(.*)"subnet": ".*"(.*)$|\1"subnet": "10.244.0.0/16"\2|g' -e 's|^(.*)"gateway": ".*"(.*)$|\1"gateway": "10.244.0.1"\2|g' {}" ;
	I0731 10:45:42.255834  499239 cni.go:308] configured [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I0731 10:45:42.255891  499239 start.go:466] detecting cgroup driver to use...
	I0731 10:45:42.255978  499239 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0731 10:45:42.256209  499239 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0731 10:45:42.284289  499239 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
	I0731 10:45:42.300999  499239 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0731 10:45:42.314977  499239 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0731 10:45:42.315117  499239 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0731 10:45:42.329478  499239 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0731 10:45:42.343646  499239 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0731 10:45:42.356711  499239 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0731 10:45:42.369723  499239 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0731 10:45:42.382308  499239 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0731 10:45:42.395370  499239 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0731 10:45:42.406308  499239 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0731 10:45:42.417283  499239 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0731 10:45:42.510990  499239 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0731 10:45:42.611012  499239 start.go:466] detecting cgroup driver to use...
	I0731 10:45:42.611070  499239 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0731 10:45:42.611173  499239 ssh_runner.go:195] Run: sudo systemctl cat docker.service
	I0731 10:45:42.628786  499239 cruntime.go:276] skipping containerd shutdown because we are bound to it
	I0731 10:45:42.628899  499239 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0731 10:45:42.645983  499239 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock
	" | sudo tee /etc/crictl.yaml"
	I0731 10:45:42.669790  499239 ssh_runner.go:195] Run: which cri-dockerd
	I0731 10:45:42.674948  499239 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
	I0731 10:45:42.688617  499239 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)
	I0731 10:45:42.718606  499239 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
	I0731 10:45:42.828301  499239 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
	I0731 10:45:42.937461  499239 docker.go:535] configuring docker to use "cgroupfs" as cgroup driver...
	I0731 10:45:42.937538  499239 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (144 bytes)
	I0731 10:45:42.972178  499239 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0731 10:45:43.083535  499239 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0731 10:45:43.350961  499239 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0731 10:45:43.378982  499239 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
	I0731 10:45:43.410288  499239 out.go:204] * Preparing Kubernetes v1.18.20 on Docker 24.0.4 ...
	I0731 10:45:43.410415  499239 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-192573 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0731 10:45:43.428132  499239 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0731 10:45:43.432955  499239 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0731 10:45:43.446795  499239 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime docker
	I0731 10:45:43.446868  499239 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0731 10:45:43.468577  499239 docker.go:636] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-proxy:v1.18.20
	k8s.gcr.io/kube-controller-manager:v1.18.20
	k8s.gcr.io/kube-apiserver:v1.18.20
	k8s.gcr.io/kube-scheduler:v1.18.20
	gcr.io/k8s-minikube/storage-provisioner:v5
	k8s.gcr.io/pause:3.2
	k8s.gcr.io/coredns:1.6.7
	k8s.gcr.io/etcd:3.4.3-0
	
	-- /stdout --
	I0731 10:45:43.468596  499239 docker.go:642] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded
	I0731 10:45:43.468651  499239 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I0731 10:45:43.479426  499239 ssh_runner.go:195] Run: which lz4
	I0731 10:45:43.483818  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 -> /preloaded.tar.lz4
	I0731 10:45:43.483921  499239 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
	I0731 10:45:43.488291  499239 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I0731 10:45:43.488328  499239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-docker-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (459739018 bytes)
	I0731 10:45:45.754381  499239 docker.go:600] Took 2.270496 seconds to copy over tarball
	I0731 10:45:45.754449  499239 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
	I0731 10:45:48.244667  499239 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (2.490191884s)
	I0731 10:45:48.244699  499239 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I0731 10:45:48.319994  499239 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json
	I0731 10:45:48.330938  499239 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2502 bytes)
	I0731 10:45:48.351985  499239 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0731 10:45:48.452498  499239 ssh_runner.go:195] Run: sudo systemctl restart docker
	I0731 10:45:51.095957  499239 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.643421342s)
	I0731 10:45:51.096055  499239 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
	I0731 10:45:51.119542  499239 docker.go:636] Got preloaded images: -- stdout --
	k8s.gcr.io/kube-proxy:v1.18.20
	k8s.gcr.io/kube-apiserver:v1.18.20
	k8s.gcr.io/kube-controller-manager:v1.18.20
	k8s.gcr.io/kube-scheduler:v1.18.20
	gcr.io/k8s-minikube/storage-provisioner:v5
	k8s.gcr.io/pause:3.2
	k8s.gcr.io/coredns:1.6.7
	k8s.gcr.io/etcd:3.4.3-0
	
	-- /stdout --
	I0731 10:45:51.119571  499239 docker.go:642] registry.k8s.io/kube-apiserver:v1.18.20 wasn't preloaded
	I0731 10:45:51.119580  499239 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.18.20 registry.k8s.io/kube-controller-manager:v1.18.20 registry.k8s.io/kube-scheduler:v1.18.20 registry.k8s.io/kube-proxy:v1.18.20 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.3-0 registry.k8s.io/coredns:1.6.7 gcr.io/k8s-minikube/storage-provisioner:v5]
	I0731 10:45:51.121549  499239 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0731 10:45:51.121699  499239 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.3-0
	I0731 10:45:51.121950  499239 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.18.20
	I0731 10:45:51.122044  499239 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.7
	I0731 10:45:51.122113  499239 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0731 10:45:51.122333  499239 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.18.20
	I0731 10:45:51.122426  499239 image.go:134] retrieving image: registry.k8s.io/pause:3.2
	I0731 10:45:51.122557  499239 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.18.20
	I0731 10:45:51.123562  499239 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.7: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.7
	I0731 10:45:51.124079  499239 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
	I0731 10:45:51.124600  499239 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.3-0
	I0731 10:45:51.125062  499239 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.18.20
	I0731 10:45:51.125348  499239 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0731 10:45:51.125612  499239 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.18.20
	I0731 10:45:51.126151  499239 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.18.20
	I0731 10:45:51.127212  499239 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0731 10:45:51.524357  499239 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/pause:3.2
	W0731 10:45:51.544935  499239 image.go:265] image registry.k8s.io/kube-scheduler:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0731 10:45:51.545156  499239 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.18.20
	I0731 10:45:51.548580  499239 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c" in container runtime
	I0731 10:45:51.548620  499239 docker.go:316] Removing image: registry.k8s.io/pause:3.2
	I0731 10:45:51.548664  499239 ssh_runner.go:195] Run: docker rmi registry.k8s.io/pause:3.2
	W0731 10:45:51.552438  499239 image.go:265] image registry.k8s.io/kube-proxy:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0731 10:45:51.552698  499239 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.18.20
	I0731 10:45:51.571910  499239 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.18.20" needs transfer: "registry.k8s.io/kube-scheduler:v1.18.20" does not exist at hash "177548d745cb87f773d02f41d453af2f2a1479dbe3c32e749cf6d8145c005e79" in container runtime
	I0731 10:45:51.572005  499239 docker.go:316] Removing image: registry.k8s.io/kube-scheduler:v1.18.20
	I0731 10:45:51.572073  499239 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-scheduler:v1.18.20
	W0731 10:45:51.573939  499239 image.go:265] image registry.k8s.io/kube-controller-manager:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0731 10:45:51.574157  499239 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.18.20
	I0731 10:45:51.584437  499239 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16969-448039/.minikube/cache/images/arm64/registry.k8s.io/pause_3.2
	W0731 10:45:51.585257  499239 image.go:265] image registry.k8s.io/etcd:3.4.3-0 arch mismatch: want arm64 got amd64. fixing
	I0731 10:45:51.585496  499239 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.3-0
	W0731 10:45:51.590076  499239 image.go:265] image registry.k8s.io/coredns:1.6.7 arch mismatch: want arm64 got amd64. fixing
	I0731 10:45:51.590310  499239 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.7
	W0731 10:45:51.612840  499239 image.go:265] image registry.k8s.io/kube-apiserver:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0731 10:45:51.613068  499239 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.18.20
	I0731 10:45:51.618361  499239 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.18.20" needs transfer: "registry.k8s.io/kube-proxy:v1.18.20" does not exist at hash "b11cdc97ac6ac4ef2b3b0662edbe16597084b17cbc8e3d61fcaf4ef827a7ed18" in container runtime
	I0731 10:45:51.618431  499239 docker.go:316] Removing image: registry.k8s.io/kube-proxy:v1.18.20
	I0731 10:45:51.618510  499239 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-proxy:v1.18.20
	I0731 10:45:51.623680  499239 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16969-448039/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.18.20
	I0731 10:45:51.641202  499239 cache_images.go:116] "registry.k8s.io/etcd:3.4.3-0" needs transfer: "registry.k8s.io/etcd:3.4.3-0" does not exist at hash "29dd247b2572efbe28fcaea3fef1c5d72593da59f7350e3f6d2e6618983f9c03" in container runtime
	I0731 10:45:51.641279  499239 docker.go:316] Removing image: registry.k8s.io/etcd:3.4.3-0
	I0731 10:45:51.641349  499239 ssh_runner.go:195] Run: docker rmi registry.k8s.io/etcd:3.4.3-0
	I0731 10:45:51.642711  499239 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.18.20" needs transfer: "registry.k8s.io/kube-controller-manager:v1.18.20" does not exist at hash "297c79afbdb81ceb4cf857e0c54a0de7b6ce7ebe01e6cab68fc8baf342be3ea7" in container runtime
	I0731 10:45:51.642774  499239 docker.go:316] Removing image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0731 10:45:51.642835  499239 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-controller-manager:v1.18.20
	I0731 10:45:51.666788  499239 cache_images.go:116] "registry.k8s.io/coredns:1.6.7" needs transfer: "registry.k8s.io/coredns:1.6.7" does not exist at hash "ff3af22d8878afc6985d3fec3e066d00ef431aa166c3a01ac58f1990adc92a2c" in container runtime
	I0731 10:45:51.666877  499239 docker.go:316] Removing image: registry.k8s.io/coredns:1.6.7
	I0731 10:45:51.666953  499239 ssh_runner.go:195] Run: docker rmi registry.k8s.io/coredns:1.6.7
	I0731 10:45:51.685217  499239 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.18.20" needs transfer: "registry.k8s.io/kube-apiserver:v1.18.20" does not exist at hash "d353007847ec85700463981309a5846c8d9c93fbcd1323104266212926d68257" in container runtime
	I0731 10:45:51.685307  499239 docker.go:316] Removing image: registry.k8s.io/kube-apiserver:v1.18.20
	I0731 10:45:51.685393  499239 ssh_runner.go:195] Run: docker rmi registry.k8s.io/kube-apiserver:v1.18.20
	I0731 10:45:51.727219  499239 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16969-448039/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.18.20
	I0731 10:45:51.727283  499239 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16969-448039/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.4.3-0
	I0731 10:45:51.727316  499239 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16969-448039/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.18.20
	I0731 10:45:51.727350  499239 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16969-448039/.minikube/cache/images/arm64/registry.k8s.io/coredns_1.6.7
	I0731 10:45:51.727382  499239 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16969-448039/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.18.20
	W0731 10:45:51.734071  499239 image.go:265] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I0731 10:45:51.734257  499239 ssh_runner.go:195] Run: docker image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
	I0731 10:45:51.758294  499239 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime
	I0731 10:45:51.758339  499239 docker.go:316] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0731 10:45:51.758390  499239 ssh_runner.go:195] Run: docker rmi gcr.io/k8s-minikube/storage-provisioner:v5
	I0731 10:45:51.792039  499239 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16969-448039/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
	I0731 10:45:51.792132  499239 cache_images.go:92] LoadImages completed in 672.539269ms
	W0731 10:45:51.792195  499239 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/16969-448039/.minikube/cache/images/arm64/registry.k8s.io/pause_3.2: no such file or directory
	I0731 10:45:51.792257  499239 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
	I0731 10:45:51.856047  499239 cni.go:84] Creating CNI manager for ""
	I0731 10:45:51.856077  499239 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0731 10:45:51.856086  499239 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0731 10:45:51.856104  499239 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.18.20 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ingress-addon-legacy-192573 NodeName:ingress-addon-legacy-192573 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.
crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
	I0731 10:45:51.856289  499239 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /var/run/dockershim.sock
	  name: "ingress-addon-legacy-192573"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.18.20
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0731 10:45:51.856375  499239 kubeadm.go:976] kubelet [Unit]
	Wants=docker.socket
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.18.20/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=ingress-addon-legacy-192573 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-192573 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0731 10:45:51.856442  499239 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.18.20
	I0731 10:45:51.867626  499239 binaries.go:44] Found k8s binaries, skipping transfer
	I0731 10:45:51.867699  499239 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0731 10:45:51.878847  499239 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (354 bytes)
	I0731 10:45:51.900268  499239 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (353 bytes)
	I0731 10:45:51.921494  499239 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2124 bytes)
	I0731 10:45:51.942751  499239 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0731 10:45:51.947109  499239 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0731 10:45:51.960480  499239 certs.go:56] Setting up /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573 for IP: 192.168.49.2
	I0731 10:45:51.960541  499239 certs.go:190] acquiring lock for shared ca certs: {Name:mk0b581020d66126e84a8fcc9d64f9f01083a80e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:45:51.960730  499239 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/16969-448039/.minikube/ca.key
	I0731 10:45:51.960795  499239 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/16969-448039/.minikube/proxy-client-ca.key
	I0731 10:45:51.960855  499239 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.key
	I0731 10:45:51.960869  499239 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt with IP's: []
	I0731 10:45:52.246848  499239 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt ...
	I0731 10:45:52.246879  499239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: {Name:mkc0f1edc2256e3cbf2a371294ebdb6fb1097568 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:45:52.247078  499239 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.key ...
	I0731 10:45:52.247098  499239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.key: {Name:mk24c1ccff320e6e101584a15c4e2ea222d03486 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:45:52.247192  499239 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/apiserver.key.dd3b5fb2
	I0731 10:45:52.247207  499239 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0731 10:45:52.486667  499239 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/apiserver.crt.dd3b5fb2 ...
	I0731 10:45:52.486699  499239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/apiserver.crt.dd3b5fb2: {Name:mk1d09e7030c5428fc2e473c5070a57dcb3901d9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:45:52.486878  499239 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/apiserver.key.dd3b5fb2 ...
	I0731 10:45:52.486890  499239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/apiserver.key.dd3b5fb2: {Name:mk947b02c9af5926a7953d9be781af839c6a44a3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:45:52.486977  499239 certs.go:337] copying /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/apiserver.crt
	I0731 10:45:52.487049  499239 certs.go:341] copying /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/apiserver.key
	I0731 10:45:52.487113  499239 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/proxy-client.key
	I0731 10:45:52.487128  499239 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/proxy-client.crt with IP's: []
	I0731 10:45:53.072179  499239 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/proxy-client.crt ...
	I0731 10:45:53.072209  499239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/proxy-client.crt: {Name:mkdb965f6ab56a83acfe2e8c1ea18e16b3947588 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:45:53.072401  499239 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/proxy-client.key ...
	I0731 10:45:53.072414  499239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/proxy-client.key: {Name:mk395d9c8e78f2e74009d5308c941a458d446d23 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:45:53.072499  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0731 10:45:53.072529  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0731 10:45:53.072544  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0731 10:45:53.072559  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0731 10:45:53.072573  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0731 10:45:53.072588  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0731 10:45:53.072602  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0731 10:45:53.072613  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0731 10:45:53.072668  499239 certs.go:437] found cert: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/home/jenkins/minikube-integration/16969-448039/.minikube/certs/453594.pem (1338 bytes)
	W0731 10:45:53.072710  499239 certs.go:433] ignoring /home/jenkins/minikube-integration/16969-448039/.minikube/certs/home/jenkins/minikube-integration/16969-448039/.minikube/certs/453594_empty.pem, impossibly tiny 0 bytes
	I0731 10:45:53.072725  499239 certs.go:437] found cert: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca-key.pem (1679 bytes)
	I0731 10:45:53.072751  499239 certs.go:437] found cert: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/home/jenkins/minikube-integration/16969-448039/.minikube/certs/ca.pem (1078 bytes)
	I0731 10:45:53.072779  499239 certs.go:437] found cert: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/home/jenkins/minikube-integration/16969-448039/.minikube/certs/cert.pem (1123 bytes)
	I0731 10:45:53.072809  499239 certs.go:437] found cert: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/home/jenkins/minikube-integration/16969-448039/.minikube/certs/key.pem (1679 bytes)
	I0731 10:45:53.072854  499239 certs.go:437] found cert: /home/jenkins/minikube-integration/16969-448039/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/16969-448039/.minikube/files/etc/ssl/certs/4535942.pem (1708 bytes)
	I0731 10:45:53.072888  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/files/etc/ssl/certs/4535942.pem -> /usr/share/ca-certificates/4535942.pem
	I0731 10:45:53.072907  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0731 10:45:53.072919  499239 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16969-448039/.minikube/certs/453594.pem -> /usr/share/ca-certificates/453594.pem
	I0731 10:45:53.073479  499239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0731 10:45:53.102382  499239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0731 10:45:53.129922  499239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0731 10:45:53.158050  499239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0731 10:45:53.186528  499239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0731 10:45:53.215416  499239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0731 10:45:53.245226  499239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0731 10:45:53.275283  499239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0731 10:45:53.305027  499239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/files/etc/ssl/certs/4535942.pem --> /usr/share/ca-certificates/4535942.pem (1708 bytes)
	I0731 10:45:53.334746  499239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0731 10:45:53.364874  499239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16969-448039/.minikube/certs/453594.pem --> /usr/share/ca-certificates/453594.pem (1338 bytes)
	I0731 10:45:53.395714  499239 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0731 10:45:53.418211  499239 ssh_runner.go:195] Run: openssl version
	I0731 10:45:53.425728  499239 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4535942.pem && ln -fs /usr/share/ca-certificates/4535942.pem /etc/ssl/certs/4535942.pem"
	I0731 10:45:53.437964  499239 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/4535942.pem
	I0731 10:45:53.442871  499239 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Jul 31 10:40 /usr/share/ca-certificates/4535942.pem
	I0731 10:45:53.442943  499239 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4535942.pem
	I0731 10:45:53.452129  499239 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/4535942.pem /etc/ssl/certs/3ec20f2e.0"
	I0731 10:45:53.464382  499239 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0731 10:45:53.476498  499239 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0731 10:45:53.481256  499239 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Jul 31 10:36 /usr/share/ca-certificates/minikubeCA.pem
	I0731 10:45:53.481377  499239 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0731 10:45:53.490259  499239 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0731 10:45:53.502291  499239 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/453594.pem && ln -fs /usr/share/ca-certificates/453594.pem /etc/ssl/certs/453594.pem"
	I0731 10:45:53.514162  499239 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/453594.pem
	I0731 10:45:53.519313  499239 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Jul 31 10:40 /usr/share/ca-certificates/453594.pem
	I0731 10:45:53.519415  499239 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/453594.pem
	I0731 10:45:53.528098  499239 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/453594.pem /etc/ssl/certs/51391683.0"
	I0731 10:45:53.539985  499239 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0731 10:45:53.544689  499239 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0731 10:45:53.544745  499239 kubeadm.go:404] StartCluster: {Name:ingress-addon-legacy-192573 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-192573 Namespace:default APIServerName:minikubeCA APIServerNames:[]
APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMe
trics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0731 10:45:53.544877  499239 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
	I0731 10:45:53.565714  499239 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0731 10:45:53.576907  499239 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0731 10:45:53.588149  499239 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0731 10:45:53.588270  499239 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0731 10:45:53.599225  499239 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0731 10:45:53.599271  499239 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0731 10:45:53.654893  499239 kubeadm.go:322] [init] Using Kubernetes version: v1.18.20
	I0731 10:45:53.655242  499239 kubeadm.go:322] [preflight] Running pre-flight checks
	I0731 10:45:53.882520  499239 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0731 10:45:53.882591  499239 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1040-aws
	I0731 10:45:53.882652  499239 kubeadm.go:322] DOCKER_VERSION: 24.0.4
	I0731 10:45:53.882688  499239 kubeadm.go:322] OS: Linux
	I0731 10:45:53.882734  499239 kubeadm.go:322] CGROUPS_CPU: enabled
	I0731 10:45:53.882783  499239 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0731 10:45:53.882830  499239 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0731 10:45:53.882878  499239 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0731 10:45:53.882926  499239 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0731 10:45:53.882975  499239 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0731 10:45:53.973155  499239 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0731 10:45:53.973339  499239 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0731 10:45:53.973445  499239 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0731 10:45:54.195416  499239 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0731 10:45:54.196848  499239 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0731 10:45:54.197149  499239 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0731 10:45:54.312519  499239 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0731 10:45:54.316718  499239 out.go:204]   - Generating certificates and keys ...
	I0731 10:45:54.316943  499239 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0731 10:45:54.317075  499239 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0731 10:45:54.662156  499239 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0731 10:45:54.972001  499239 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0731 10:45:55.660843  499239 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0731 10:45:56.064757  499239 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0731 10:45:56.493589  499239 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0731 10:45:56.494273  499239 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-192573 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0731 10:45:56.831174  499239 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0731 10:45:56.831597  499239 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-192573 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0731 10:45:57.181146  499239 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0731 10:45:57.472085  499239 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0731 10:45:57.701917  499239 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0731 10:45:57.702235  499239 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0731 10:45:58.127979  499239 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0731 10:45:58.912022  499239 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0731 10:45:59.246131  499239 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0731 10:46:00.009955  499239 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0731 10:46:00.010214  499239 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0731 10:46:00.020103  499239 out.go:204]   - Booting up control plane ...
	I0731 10:46:00.020236  499239 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0731 10:46:00.035442  499239 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0731 10:46:00.045290  499239 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0731 10:46:00.049147  499239 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0731 10:46:00.081028  499239 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0731 10:46:13.583923  499239 kubeadm.go:322] [apiclient] All control plane components are healthy after 13.524730 seconds
	I0731 10:46:13.584053  499239 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0731 10:46:13.600251  499239 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config-1.18" in namespace kube-system with the configuration for the kubelets in the cluster
	I0731 10:46:14.123228  499239 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0731 10:46:14.123377  499239 kubeadm.go:322] [mark-control-plane] Marking the node ingress-addon-legacy-192573 as control-plane by adding the label "node-role.kubernetes.io/master=''"
	I0731 10:46:14.632891  499239 kubeadm.go:322] [bootstrap-token] Using token: k5lvex.gddw6v4uhgwbx68u
	I0731 10:46:14.634426  499239 out.go:204]   - Configuring RBAC rules ...
	I0731 10:46:14.634546  499239 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0731 10:46:14.640751  499239 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0731 10:46:14.650423  499239 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0731 10:46:14.653969  499239 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0731 10:46:14.657543  499239 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0731 10:46:14.661597  499239 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0731 10:46:14.671592  499239 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0731 10:46:14.946229  499239 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0731 10:46:15.070088  499239 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0731 10:46:15.074008  499239 kubeadm.go:322] 
	I0731 10:46:15.074094  499239 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0731 10:46:15.074109  499239 kubeadm.go:322] 
	I0731 10:46:15.074182  499239 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0731 10:46:15.074204  499239 kubeadm.go:322] 
	I0731 10:46:15.074235  499239 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0731 10:46:15.075184  499239 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0731 10:46:15.075270  499239 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0731 10:46:15.075285  499239 kubeadm.go:322] 
	I0731 10:46:15.075355  499239 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0731 10:46:15.075450  499239 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0731 10:46:15.075523  499239 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0731 10:46:15.075529  499239 kubeadm.go:322] 
	I0731 10:46:15.075870  499239 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0731 10:46:15.075968  499239 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0731 10:46:15.075977  499239 kubeadm.go:322] 
	I0731 10:46:15.076376  499239 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token k5lvex.gddw6v4uhgwbx68u \
	I0731 10:46:15.076486  499239 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:794743d7f04bd4593179b1fa8a4b2ac7637bc5da56bbcead87c371ae0b0f7ff1 \
	I0731 10:46:15.076719  499239 kubeadm.go:322]     --control-plane 
	I0731 10:46:15.076733  499239 kubeadm.go:322] 
	I0731 10:46:15.076814  499239 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0731 10:46:15.076820  499239 kubeadm.go:322] 
	I0731 10:46:15.076897  499239 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token k5lvex.gddw6v4uhgwbx68u \
	I0731 10:46:15.076995  499239 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:794743d7f04bd4593179b1fa8a4b2ac7637bc5da56bbcead87c371ae0b0f7ff1 
	I0731 10:46:15.082114  499239 kubeadm.go:322] W0731 10:45:53.654003    1665 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]
	I0731 10:46:15.082300  499239 kubeadm.go:322] 	[WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
	I0731 10:46:15.082422  499239 kubeadm.go:322] 	[WARNING SystemVerification]: this Docker version is not on the list of validated versions: 24.0.4. Latest validated version: 19.03
	I0731 10:46:15.082618  499239 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1040-aws\n", err: exit status 1
	I0731 10:46:15.082719  499239 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0731 10:46:15.082837  499239 kubeadm.go:322] W0731 10:46:00.034172    1665 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I0731 10:46:15.082964  499239 kubeadm.go:322] W0731 10:46:00.042090    1665 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I0731 10:46:15.082980  499239 cni.go:84] Creating CNI manager for ""
	I0731 10:46:15.083029  499239 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0731 10:46:15.083049  499239 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0731 10:46:15.083209  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:15.083285  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl label nodes minikube.k8s.io/version=v1.31.1 minikube.k8s.io/commit=a7848ba25aaaad8ebb50e721c0d343e471188fc7 minikube.k8s.io/name=ingress-addon-legacy-192573 minikube.k8s.io/updated_at=2023_07_31T10_46_15_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:15.119832  499239 ops.go:34] apiserver oom_adj: -16
	I0731 10:46:15.505359  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:15.717826  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:16.316294  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:16.815802  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:17.316270  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:17.816530  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:18.316532  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:18.816203  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:19.316096  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:19.815844  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:20.316690  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:20.816266  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:21.315865  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:21.815958  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:22.316515  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:22.816402  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:23.316077  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:23.816061  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:24.316247  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:24.815697  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:25.316067  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:25.816181  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:26.316362  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:26.815942  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:27.316285  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:27.816597  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:28.316303  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:28.816695  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:29.316534  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:29.815729  499239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0731 10:46:30.053670  499239 kubeadm.go:1081] duration metric: took 14.970518936s to wait for elevateKubeSystemPrivileges.
	I0731 10:46:30.053702  499239 kubeadm.go:406] StartCluster complete in 36.508960353s
	I0731 10:46:30.053722  499239 settings.go:142] acquiring lock: {Name:mk0f9ad5297a989e72fcdcfe2e2075f0d847e09b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:46:30.053806  499239 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/16969-448039/kubeconfig
	I0731 10:46:30.054572  499239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16969-448039/kubeconfig: {Name:mk557d9a030d80845f93c6390b12cc56ba83b453 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0731 10:46:30.055507  499239 kapi.go:59] client config for ingress-addon-legacy-192573: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt", KeyFile:"/home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.key", CAFile:"/home/jenkins/minikube-integration/16969-448039/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]ui
nt8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x13e64f0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0731 10:46:30.056234  499239 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0731 10:46:30.056567  499239 config.go:182] Loaded profile config "ingress-addon-legacy-192573": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.20
	I0731 10:46:30.056675  499239 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]
	I0731 10:46:30.056749  499239 addons.go:69] Setting storage-provisioner=true in profile "ingress-addon-legacy-192573"
	I0731 10:46:30.056766  499239 addons.go:231] Setting addon storage-provisioner=true in "ingress-addon-legacy-192573"
	I0731 10:46:30.056813  499239 host.go:66] Checking if "ingress-addon-legacy-192573" exists ...
	I0731 10:46:30.057291  499239 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-192573 --format={{.State.Status}}
	I0731 10:46:30.057800  499239 addons.go:69] Setting default-storageclass=true in profile "ingress-addon-legacy-192573"
	I0731 10:46:30.057827  499239 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ingress-addon-legacy-192573"
	I0731 10:46:30.058137  499239 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-192573 --format={{.State.Status}}
	I0731 10:46:30.058317  499239 cert_rotation.go:137] Starting client certificate rotation controller
	I0731 10:46:30.106831  499239 kapi.go:248] "coredns" deployment in "kube-system" namespace and "ingress-addon-legacy-192573" context rescaled to 1 replicas
	I0731 10:46:30.106874  499239 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0731 10:46:30.109045  499239 out.go:177] * Verifying Kubernetes components...
	I0731 10:46:30.110763  499239 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0731 10:46:30.125716  499239 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0731 10:46:30.127533  499239 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0731 10:46:30.127560  499239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0731 10:46:30.127632  499239 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-192573
	I0731 10:46:30.136056  499239 kapi.go:59] client config for ingress-addon-legacy-192573: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt", KeyFile:"/home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.key", CAFile:"/home/jenkins/minikube-integration/16969-448039/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]ui
nt8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x13e64f0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0731 10:46:30.145498  499239 addons.go:231] Setting addon default-storageclass=true in "ingress-addon-legacy-192573"
	I0731 10:46:30.145558  499239 host.go:66] Checking if "ingress-addon-legacy-192573" exists ...
	I0731 10:46:30.146030  499239 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-192573 --format={{.State.Status}}
	I0731 10:46:30.168796  499239 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35530 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/ingress-addon-legacy-192573/id_rsa Username:docker}
	I0731 10:46:30.190254  499239 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I0731 10:46:30.190294  499239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0731 10:46:30.190370  499239 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-192573
	I0731 10:46:30.234400  499239 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35530 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/ingress-addon-legacy-192573/id_rsa Username:docker}
	I0731 10:46:30.315921  499239 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0731 10:46:30.316605  499239 kapi.go:59] client config for ingress-addon-legacy-192573: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt", KeyFile:"/home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.key", CAFile:"/home/jenkins/minikube-integration/16969-448039/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]ui
nt8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x13e64f0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0731 10:46:30.316893  499239 node_ready.go:35] waiting up to 6m0s for node "ingress-addon-legacy-192573" to be "Ready" ...
	I0731 10:46:30.328243  499239 node_ready.go:49] node "ingress-addon-legacy-192573" has status "Ready":"True"
	I0731 10:46:30.328269  499239 node_ready.go:38] duration metric: took 11.354332ms waiting for node "ingress-addon-legacy-192573" to be "Ready" ...
	I0731 10:46:30.328280  499239 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0731 10:46:30.348356  499239 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ingress-addon-legacy-192573" in "kube-system" namespace to be "Ready" ...
	I0731 10:46:30.356073  499239 pod_ready.go:92] pod "etcd-ingress-addon-legacy-192573" in "kube-system" namespace has status "Ready":"True"
	I0731 10:46:30.356099  499239 pod_ready.go:81] duration metric: took 7.711856ms waiting for pod "etcd-ingress-addon-legacy-192573" in "kube-system" namespace to be "Ready" ...
	I0731 10:46:30.356152  499239 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ingress-addon-legacy-192573" in "kube-system" namespace to be "Ready" ...
	I0731 10:46:30.365794  499239 pod_ready.go:92] pod "kube-apiserver-ingress-addon-legacy-192573" in "kube-system" namespace has status "Ready":"True"
	I0731 10:46:30.365824  499239 pod_ready.go:81] duration metric: took 9.663858ms waiting for pod "kube-apiserver-ingress-addon-legacy-192573" in "kube-system" namespace to be "Ready" ...
	I0731 10:46:30.365840  499239 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ingress-addon-legacy-192573" in "kube-system" namespace to be "Ready" ...
	I0731 10:46:30.371480  499239 pod_ready.go:92] pod "kube-controller-manager-ingress-addon-legacy-192573" in "kube-system" namespace has status "Ready":"True"
	I0731 10:46:30.371558  499239 pod_ready.go:81] duration metric: took 5.696764ms waiting for pod "kube-controller-manager-ingress-addon-legacy-192573" in "kube-system" namespace to be "Ready" ...
	I0731 10:46:30.371584  499239 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-ct6sv" in "kube-system" namespace to be "Ready" ...
	I0731 10:46:30.401143  499239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0731 10:46:30.505702  499239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0731 10:46:30.517891  499239 request.go:628] Waited for 141.240027ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ct6sv
	I0731 10:46:30.717711  499239 request.go:628] Waited for 185.307015ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes/ingress-addon-legacy-192573
	I0731 10:46:31.165724  499239 start.go:901] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0731 10:46:31.406595  499239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.005374111s)
	I0731 10:46:31.422688  499239 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0731 10:46:31.425635  499239 addons.go:502] enable addons completed in 1.368949154s: enabled=[storage-provisioner default-storageclass]
	I0731 10:46:32.227396  499239 pod_ready.go:92] pod "kube-proxy-ct6sv" in "kube-system" namespace has status "Ready":"True"
	I0731 10:46:32.227425  499239 pod_ready.go:81] duration metric: took 1.855821037s waiting for pod "kube-proxy-ct6sv" in "kube-system" namespace to be "Ready" ...
	I0731 10:46:32.227436  499239 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ingress-addon-legacy-192573" in "kube-system" namespace to be "Ready" ...
	I0731 10:46:32.317304  499239 request.go:628] Waited for 87.271947ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes/ingress-addon-legacy-192573
	I0731 10:46:32.320060  499239 pod_ready.go:92] pod "kube-scheduler-ingress-addon-legacy-192573" in "kube-system" namespace has status "Ready":"True"
	I0731 10:46:32.320086  499239 pod_ready.go:81] duration metric: took 92.641335ms waiting for pod "kube-scheduler-ingress-addon-legacy-192573" in "kube-system" namespace to be "Ready" ...
	I0731 10:46:32.320096  499239 pod_ready.go:38] duration metric: took 1.991806129s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0731 10:46:32.320166  499239 api_server.go:52] waiting for apiserver process to appear ...
	I0731 10:46:32.320252  499239 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0731 10:46:32.334254  499239 api_server.go:72] duration metric: took 2.227343504s to wait for apiserver process to appear ...
	I0731 10:46:32.334323  499239 api_server.go:88] waiting for apiserver healthz status ...
	I0731 10:46:32.334357  499239 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0731 10:46:32.343734  499239 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0731 10:46:32.344745  499239 api_server.go:141] control plane version: v1.18.20
	I0731 10:46:32.344768  499239 api_server.go:131] duration metric: took 10.423889ms to wait for apiserver health ...
	I0731 10:46:32.344797  499239 system_pods.go:43] waiting for kube-system pods to appear ...
	I0731 10:46:32.517093  499239 request.go:628] Waited for 172.224024ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I0731 10:46:32.523428  499239 system_pods.go:59] 7 kube-system pods found
	I0731 10:46:32.523474  499239 system_pods.go:61] "coredns-66bff467f8-8rg49" [22dfb590-e7b7-4060-8be9-c3909d244bc6] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0731 10:46:32.523483  499239 system_pods.go:61] "etcd-ingress-addon-legacy-192573" [46910614-3a9c-4f47-be7e-edf7bce7c851] Running
	I0731 10:46:32.523489  499239 system_pods.go:61] "kube-apiserver-ingress-addon-legacy-192573" [acf78733-55b6-4f80-b7f3-ee6e895afe2f] Running
	I0731 10:46:32.523496  499239 system_pods.go:61] "kube-controller-manager-ingress-addon-legacy-192573" [8f9f2c7a-41ee-47f4-bfb3-7e231beadce1] Running
	I0731 10:46:32.523503  499239 system_pods.go:61] "kube-proxy-ct6sv" [a37e4883-43fd-48a8-b414-efbb31ad6030] Running
	I0731 10:46:32.523508  499239 system_pods.go:61] "kube-scheduler-ingress-addon-legacy-192573" [950cb3ce-1aad-4ce5-b8ca-02924ca0bd86] Running
	I0731 10:46:32.523516  499239 system_pods.go:61] "storage-provisioner" [f1ea275a-c49a-4656-a272-33b6992e72fa] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
	I0731 10:46:32.523522  499239 system_pods.go:74] duration metric: took 178.711292ms to wait for pod list to return data ...
	I0731 10:46:32.523539  499239 default_sa.go:34] waiting for default service account to be created ...
	I0731 10:46:32.717883  499239 request.go:628] Waited for 194.26576ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/default/serviceaccounts
	I0731 10:46:32.720509  499239 default_sa.go:45] found service account: "default"
	I0731 10:46:32.720539  499239 default_sa.go:55] duration metric: took 196.992653ms for default service account to be created ...
	I0731 10:46:32.720551  499239 system_pods.go:116] waiting for k8s-apps to be running ...
	I0731 10:46:32.918019  499239 request.go:628] Waited for 197.371958ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I0731 10:46:32.923933  499239 system_pods.go:86] 7 kube-system pods found
	I0731 10:46:32.923969  499239 system_pods.go:89] "coredns-66bff467f8-8rg49" [22dfb590-e7b7-4060-8be9-c3909d244bc6] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0731 10:46:32.923980  499239 system_pods.go:89] "etcd-ingress-addon-legacy-192573" [46910614-3a9c-4f47-be7e-edf7bce7c851] Running
	I0731 10:46:32.923986  499239 system_pods.go:89] "kube-apiserver-ingress-addon-legacy-192573" [acf78733-55b6-4f80-b7f3-ee6e895afe2f] Running
	I0731 10:46:32.923992  499239 system_pods.go:89] "kube-controller-manager-ingress-addon-legacy-192573" [8f9f2c7a-41ee-47f4-bfb3-7e231beadce1] Running
	I0731 10:46:32.924000  499239 system_pods.go:89] "kube-proxy-ct6sv" [a37e4883-43fd-48a8-b414-efbb31ad6030] Running
	I0731 10:46:32.924008  499239 system_pods.go:89] "kube-scheduler-ingress-addon-legacy-192573" [950cb3ce-1aad-4ce5-b8ca-02924ca0bd86] Running
	I0731 10:46:32.924020  499239 system_pods.go:89] "storage-provisioner" [f1ea275a-c49a-4656-a272-33b6992e72fa] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
	I0731 10:46:32.924031  499239 system_pods.go:126] duration metric: took 203.475384ms to wait for k8s-apps to be running ...
	I0731 10:46:32.924040  499239 system_svc.go:44] waiting for kubelet service to be running ....
	I0731 10:46:32.924100  499239 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0731 10:46:32.938705  499239 system_svc.go:56] duration metric: took 14.654212ms WaitForService to wait for kubelet.
	I0731 10:46:32.938734  499239 kubeadm.go:581] duration metric: took 2.83183052s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0731 10:46:32.938775  499239 node_conditions.go:102] verifying NodePressure condition ...
	I0731 10:46:33.117130  499239 request.go:628] Waited for 178.271572ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes
	I0731 10:46:33.120618  499239 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0731 10:46:33.120701  499239 node_conditions.go:123] node cpu capacity is 2
	I0731 10:46:33.120728  499239 node_conditions.go:105] duration metric: took 181.939977ms to run NodePressure ...
	I0731 10:46:33.120751  499239 start.go:228] waiting for startup goroutines ...
	I0731 10:46:33.120784  499239 start.go:233] waiting for cluster config update ...
	I0731 10:46:33.120812  499239 start.go:242] writing updated cluster config ...
	I0731 10:46:33.121209  499239 ssh_runner.go:195] Run: rm -f paused
	I0731 10:46:33.204756  499239 start.go:596] kubectl: 1.27.4, cluster: 1.18.20 (minor skew: 9)
	I0731 10:46:33.207069  499239 out.go:177] 
	W0731 10:46:33.208711  499239 out.go:239] ! /usr/local/bin/kubectl is version 1.27.4, which may have incompatibilities with Kubernetes 1.18.20.
	I0731 10:46:33.210470  499239 out.go:177]   - Want kubectl v1.18.20? Try 'minikube kubectl -- get pods -A'
	I0731 10:46:33.212461  499239 out.go:177] * Done! kubectl is now configured to use "ingress-addon-legacy-192573" cluster and "default" namespace by default
	
	* 
	* ==> Docker <==
	* Jul 31 10:45:51 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:45:51.066610570Z" level=info msg="Docker daemon" commit=4ffc614 graphdriver=overlay2 version=24.0.4
	Jul 31 10:45:51 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:45:51.066683825Z" level=info msg="Daemon has completed initialization"
	Jul 31 10:45:51 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:45:51.093585313Z" level=info msg="API listen on [::]:2376"
	Jul 31 10:45:51 ingress-addon-legacy-192573 systemd[1]: Started Docker Application Container Engine.
	Jul 31 10:45:51 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:45:51.093874034Z" level=info msg="API listen on /var/run/docker.sock"
	Jul 31 10:46:34 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:46:34.910545746Z" level=warning msg="reference for unknown type: " digest="sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7" remote="docker.io/jettech/kube-webhook-certgen@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7"
	Jul 31 10:46:36 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:46:36.510255618Z" level=info msg="ignoring event" container=90d72827664b612af539b82e0b35b697514321c23e1aadbfc3ced8ef4ff01af2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:46:36 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:46:36.605916974Z" level=info msg="ignoring event" container=d3c0e13b05a9fff6c244855fc986afb0680c7ba0bf668248428647076d504a6f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:46:37 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:46:37.098137012Z" level=info msg="ignoring event" container=28ffef6c1720decb9e79928d77f2e8044dc8ec5bb0390598a50d5f9cd2c487a4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:46:37 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:46:37.130219442Z" level=info msg="ignoring event" container=97953bc11b293834d9953d54d0f419c742df7b361efa536f7be8306f4cb6708e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:46:38 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:46:38.452542810Z" level=warning msg="reference for unknown type: " digest="sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324" remote="registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324"
	Jul 31 10:46:45 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:46:45.400846401Z" level=warning msg="Published ports are discarded when using host network mode"
	Jul 31 10:46:45 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:46:45.429225687Z" level=warning msg="Published ports are discarded when using host network mode"
	Jul 31 10:46:45 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:46:45.599736823Z" level=warning msg="reference for unknown type: " digest="sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab" remote="docker.io/cryptexlabs/minikube-ingress-dns@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab"
	Jul 31 10:46:51 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:46:51.893187911Z" level=info msg="ignoring event" container=158f48604b722c6646ae5968b84c6d97ea63f26a6fb72c24e7e5be6355e0fec2 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:46:52 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:46:52.351440989Z" level=info msg="ignoring event" container=8a7ea645a01c523135ad379376f2dd2fb313475e5e34f3b44bd52bb7f40e5d21 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:47:05 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:47:05.821487635Z" level=info msg="ignoring event" container=91a3d5b181df901d6b0749157c72c26bff5f7d5121d01148f7ce8ec3d3f4e099 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:47:12 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:47:12.218356460Z" level=info msg="ignoring event" container=265136e65f3cb73286ace67861fc927e5903922536f0a4fd7c7a05b512583a23 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:47:12 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:47:12.609208867Z" level=info msg="ignoring event" container=bda4b13e273e2db78b47d63a09927a79dd36719922a5885feea30e2b11bdc811 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:47:26 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:47:26.750702026Z" level=info msg="ignoring event" container=dd03734cfac2f8f6b077eeb95974075d545800f2be79a8cd295cc97989ef7226 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:47:26 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:47:26.829035547Z" level=info msg="ignoring event" container=df6bc8d99e84c81cd445ae57ea53bccfc2f4067879a22b05b43cb66e01463f76 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:47:31 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:47:31.567461009Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=f37d9c1f15ce790438a507eed6db9c009ae7f69c8d0e9788db1de384571dccba
	Jul 31 10:47:31 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:47:31.596396577Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=f37d9c1f15ce790438a507eed6db9c009ae7f69c8d0e9788db1de384571dccba
	Jul 31 10:47:31 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:47:31.658267817Z" level=info msg="ignoring event" container=f37d9c1f15ce790438a507eed6db9c009ae7f69c8d0e9788db1de384571dccba module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	Jul 31 10:47:31 ingress-addon-legacy-192573 dockerd[1303]: time="2023-07-31T10:47:31.733308112Z" level=info msg="ignoring event" container=4a19280df90b75bf827f677491c12630046d99acbbfe8d9c38cabf6f19ea95d9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE                                                                                                              CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	df6bc8d99e84c       13753a81eccfd                                                                                                      11 seconds ago       Exited              hello-world-app           2                   672d216bc3d22       hello-world-app-5f5d8b66bb-nk2hb
	d4834404e66b1       nginx@sha256:2d194184b067db3598771b4cf326cfe6ad5051937ba1132b8b7d4b0184e0d0a6                                      36 seconds ago       Running             nginx                     0                   57d211f6f43a5       nginx
	f37d9c1f15ce7       registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324   54 seconds ago       Exited              controller                0                   4a19280df90b7       ingress-nginx-controller-7fcf777cb7-z6rkm
	d3c0e13b05a9f       jettech/kube-webhook-certgen@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7               About a minute ago   Exited              patch                     0                   97953bc11b293       ingress-nginx-admission-patch-wq5xs
	90d72827664b6       jettech/kube-webhook-certgen@sha256:950833e19ade18cd389d647efb88992a7cc077abedef343fa59e012d376d79b7               About a minute ago   Exited              create                    0                   28ffef6c1720d       ingress-nginx-admission-create-rhjm5
	6be00d1f25972       gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944    About a minute ago   Running             storage-provisioner       0                   24dd578516273       storage-provisioner
	3b32360c94603       6e17ba78cf3eb                                                                                                      About a minute ago   Running             coredns                   0                   7cc66dbf4b1d6       coredns-66bff467f8-8rg49
	c548e564d1cc9       565297bc6f7d4                                                                                                      About a minute ago   Running             kube-proxy                0                   b193b94cb8b68       kube-proxy-ct6sv
	0abd26d6f8396       ab707b0a0ea33                                                                                                      About a minute ago   Running             etcd                      0                   e0028b5bc0798       etcd-ingress-addon-legacy-192573
	2887dfb1a8caf       095f37015706d                                                                                                      About a minute ago   Running             kube-scheduler            0                   3f658161ef04f       kube-scheduler-ingress-addon-legacy-192573
	9a46c8d63f9e6       68a4fac29a865                                                                                                      About a minute ago   Running             kube-controller-manager   0                   53a8a33fb4060       kube-controller-manager-ingress-addon-legacy-192573
	405f1f226778c       2694cf044d665                                                                                                      About a minute ago   Running             kube-apiserver            0                   bd81614085bf0       kube-apiserver-ingress-addon-legacy-192573
	
	* 
	* ==> coredns [3b32360c9460] <==
	* [INFO] 172.17.0.1:49270 - 11723 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000101439s
	[INFO] 172.17.0.1:49270 - 60373 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000240754s
	[INFO] 172.17.0.1:49270 - 41600 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000044775s
	[INFO] 172.17.0.1:56209 - 41121 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.00113082s
	[INFO] 172.17.0.1:49270 - 51655 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001339164s
	[INFO] 172.17.0.1:56209 - 9046 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001329974s
	[INFO] 172.17.0.1:56209 - 28431 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000199811s
	[INFO] 172.17.0.1:49270 - 1326 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001051517s
	[INFO] 172.17.0.1:49270 - 56999 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000051504s
	[INFO] 172.17.0.1:47791 - 43759 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000085604s
	[INFO] 172.17.0.1:12735 - 59018 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000161657s
	[INFO] 172.17.0.1:12735 - 50522 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000063351s
	[INFO] 172.17.0.1:47791 - 49464 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000132496s
	[INFO] 172.17.0.1:12735 - 18380 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000056689s
	[INFO] 172.17.0.1:12735 - 26239 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000063967s
	[INFO] 172.17.0.1:47791 - 62692 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.00011707s
	[INFO] 172.17.0.1:12735 - 61072 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000052086s
	[INFO] 172.17.0.1:47791 - 46462 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000050018s
	[INFO] 172.17.0.1:47791 - 5856 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000091184s
	[INFO] 172.17.0.1:12735 - 38551 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001460246s
	[INFO] 172.17.0.1:47791 - 10735 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.000961974s
	[INFO] 172.17.0.1:12735 - 54998 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001179442s
	[INFO] 172.17.0.1:47791 - 35528 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001281761s
	[INFO] 172.17.0.1:47791 - 11465 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000046424s
	[INFO] 172.17.0.1:12735 - 59380 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000071761s
	
	* 
	* ==> describe nodes <==
	* Name:               ingress-addon-legacy-192573
	Roles:              master
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=ingress-addon-legacy-192573
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=a7848ba25aaaad8ebb50e721c0d343e471188fc7
	                    minikube.k8s.io/name=ingress-addon-legacy-192573
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_07_31T10_46_15_0700
	                    minikube.k8s.io/version=v1.31.1
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 31 Jul 2023 10:46:11 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ingress-addon-legacy-192573
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 31 Jul 2023 10:47:28 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 31 Jul 2023 10:47:19 +0000   Mon, 31 Jul 2023 10:46:04 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 31 Jul 2023 10:47:19 +0000   Mon, 31 Jul 2023 10:46:04 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 31 Jul 2023 10:47:19 +0000   Mon, 31 Jul 2023 10:46:04 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 31 Jul 2023 10:47:19 +0000   Mon, 31 Jul 2023 10:46:28 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ingress-addon-legacy-192573
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022628Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022628Ki
	  pods:               110
	System Info:
	  Machine ID:                 7080cc53427e45e0bd7621e9d30825f7
	  System UUID:                5748b54f-f78c-4060-b4e8-e191d41a1ad5
	  Boot ID:                    3709f028-2d57-4df1-ae3d-22c113dc2eeb
	  Kernel Version:             5.15.0-1040-aws
	  OS Image:                   Ubuntu 22.04.2 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  docker://24.0.4
	  Kubelet Version:            v1.18.20
	  Kube-Proxy Version:         v1.18.20
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (9 in total)
	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-5f5d8b66bb-nk2hb                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         28s
	  default                     nginx                                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         39s
	  kube-system                 coredns-66bff467f8-8rg49                               100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     67s
	  kube-system                 etcd-ingress-addon-legacy-192573                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         79s
	  kube-system                 kube-apiserver-ingress-addon-legacy-192573             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         79s
	  kube-system                 kube-controller-manager-ingress-addon-legacy-192573    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         79s
	  kube-system                 kube-proxy-ct6sv                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         67s
	  kube-system                 kube-scheduler-ingress-addon-legacy-192573             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         79s
	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         66s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                650m (32%!)(MISSING)  0 (0%!)(MISSING)
	  memory             70Mi (0%!)(MISSING)   170Mi (2%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                From        Message
	  ----    ------                   ----               ----        -------
	  Normal  Starting                 94s                kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  94s (x5 over 94s)  kubelet     Node ingress-addon-legacy-192573 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    94s (x4 over 94s)  kubelet     Node ingress-addon-legacy-192573 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     94s (x4 over 94s)  kubelet     Node ingress-addon-legacy-192573 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  94s                kubelet     Updated Node Allocatable limit across pods
	  Normal  Starting                 79s                kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  79s                kubelet     Node ingress-addon-legacy-192573 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    79s                kubelet     Node ingress-addon-legacy-192573 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     79s                kubelet     Node ingress-addon-legacy-192573 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  79s                kubelet     Updated Node Allocatable limit across pods
	  Normal  NodeReady                69s                kubelet     Node ingress-addon-legacy-192573 status is now: NodeReady
	  Normal  Starting                 66s                kube-proxy  Starting kube-proxy.
	
	* 
	* ==> dmesg <==
	* [  +0.001147] FS-Cache: O-key=[8] 'f7dfc90000000000'
	[  +0.000716] FS-Cache: N-cookie c=0000009c [p=00000093 fl=2 nc=0 na=1]
	[  +0.000951] FS-Cache: N-cookie d=00000000d17d7ada{9p.inode} n=00000000ef767523
	[  +0.001121] FS-Cache: N-key=[8] 'f7dfc90000000000'
	[  +0.002869] FS-Cache: Duplicate cookie detected
	[  +0.000796] FS-Cache: O-cookie c=00000096 [p=00000093 fl=226 nc=0 na=1]
	[  +0.001064] FS-Cache: O-cookie d=00000000d17d7ada{9p.inode} n=00000000cda0340b
	[  +0.001055] FS-Cache: O-key=[8] 'f7dfc90000000000'
	[  +0.000740] FS-Cache: N-cookie c=0000009d [p=00000093 fl=2 nc=0 na=1]
	[  +0.000941] FS-Cache: N-cookie d=00000000d17d7ada{9p.inode} n=0000000040ec07b0
	[  +0.001126] FS-Cache: N-key=[8] 'f7dfc90000000000'
	[  +2.165288] FS-Cache: Duplicate cookie detected
	[  +0.000760] FS-Cache: O-cookie c=00000094 [p=00000093 fl=226 nc=0 na=1]
	[  +0.000972] FS-Cache: O-cookie d=00000000d17d7ada{9p.inode} n=00000000ca9d321b
	[  +0.001179] FS-Cache: O-key=[8] 'f6dfc90000000000'
	[  +0.000706] FS-Cache: N-cookie c=0000009f [p=00000093 fl=2 nc=0 na=1]
	[  +0.000981] FS-Cache: N-cookie d=00000000d17d7ada{9p.inode} n=000000006d9d7fe3
	[  +0.001048] FS-Cache: N-key=[8] 'f6dfc90000000000'
	[  +0.280010] FS-Cache: Duplicate cookie detected
	[  +0.000797] FS-Cache: O-cookie c=00000099 [p=00000093 fl=226 nc=0 na=1]
	[  +0.001084] FS-Cache: O-cookie d=00000000d17d7ada{9p.inode} n=00000000f332cf5e
	[  +0.001044] FS-Cache: O-key=[8] 'fcdfc90000000000'
	[  +0.000726] FS-Cache: N-cookie c=000000a0 [p=00000093 fl=2 nc=0 na=1]
	[  +0.001030] FS-Cache: N-cookie d=00000000d17d7ada{9p.inode} n=00000000ef767523
	[  +0.001146] FS-Cache: N-key=[8] 'fcdfc90000000000'
	
	* 
	* ==> etcd [0abd26d6f839] <==
	* raft2023/07/31 10:46:06 INFO: aec36adc501070cc became follower at term 0
	raft2023/07/31 10:46:06 INFO: newRaft aec36adc501070cc [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
	raft2023/07/31 10:46:06 INFO: aec36adc501070cc became follower at term 1
	raft2023/07/31 10:46:06 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2023-07-31 10:46:06.642228 W | auth: simple token is not cryptographically signed
	2023-07-31 10:46:06.647674 I | etcdserver: starting server... [version: 3.4.3, cluster version: to_be_decided]
	2023-07-31 10:46:06.648512 I | etcdserver: aec36adc501070cc as single-node; fast-forwarding 9 ticks (election ticks 10)
	2023-07-31 10:46:06.651136 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 
	raft2023/07/31 10:46:06 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2023-07-31 10:46:06.651595 I | etcdserver/membership: added member aec36adc501070cc [https://192.168.49.2:2380] to cluster fa54960ea34d58be
	2023-07-31 10:46:06.651874 I | embed: listening for metrics on http://127.0.0.1:2381
	2023-07-31 10:46:06.652016 I | embed: listening for peers on 192.168.49.2:2380
	raft2023/07/31 10:46:07 INFO: aec36adc501070cc is starting a new election at term 1
	raft2023/07/31 10:46:07 INFO: aec36adc501070cc became candidate at term 2
	raft2023/07/31 10:46:07 INFO: aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2
	raft2023/07/31 10:46:07 INFO: aec36adc501070cc became leader at term 2
	raft2023/07/31 10:46:07 INFO: raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2
	2023-07-31 10:46:07.538940 I | etcdserver: published {Name:ingress-addon-legacy-192573 ClientURLs:[https://192.168.49.2:2379]} to cluster fa54960ea34d58be
	2023-07-31 10:46:07.539058 I | embed: ready to serve client requests
	2023-07-31 10:46:07.540179 I | embed: ready to serve client requests
	2023-07-31 10:46:07.540424 I | embed: serving client requests on 127.0.0.1:2379
	2023-07-31 10:46:07.540561 I | etcdserver: setting up the initial cluster version to 3.4
	2023-07-31 10:46:07.541889 I | embed: serving client requests on 192.168.49.2:2379
	2023-07-31 10:46:07.545025 N | etcdserver/membership: set the initial cluster version to 3.4
	2023-07-31 10:46:07.545250 I | etcdserver/api: enabled capabilities for version 3.4
	
	* 
	* ==> kernel <==
	*  10:47:37 up 18:30,  0 users,  load average: 2.23, 2.44, 2.88
	Linux ingress-addon-legacy-192573 5.15.0-1040-aws #45~20.04.1-Ubuntu SMP Tue Jul 11 19:11:12 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.2 LTS"
	
	* 
	* ==> kube-apiserver [405f1f226778] <==
	* I0731 10:46:11.764930       1 shared_informer.go:223] Waiting for caches to sync for crd-autoregister
	E0731 10:46:11.831408       1 controller.go:152] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.49.2, ResourceVersion: 0, AdditionalErrorMsg: 
	I0731 10:46:11.923177       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0731 10:46:11.923421       1 shared_informer.go:230] Caches are synced for cluster_authentication_trust_controller 
	I0731 10:46:11.923582       1 cache.go:39] Caches are synced for autoregister controller
	I0731 10:46:11.928852       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I0731 10:46:11.965540       1 shared_informer.go:230] Caches are synced for crd-autoregister 
	I0731 10:46:12.717859       1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
	I0731 10:46:12.717892       1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0731 10:46:12.734040       1 storage_scheduling.go:134] created PriorityClass system-node-critical with value 2000001000
	I0731 10:46:12.741805       1 storage_scheduling.go:134] created PriorityClass system-cluster-critical with value 2000000000
	I0731 10:46:12.742004       1 storage_scheduling.go:143] all system priority classes are created successfully or already exist.
	I0731 10:46:13.245437       1 controller.go:609] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0731 10:46:13.302692       1 controller.go:609] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W0731 10:46:13.446581       1 lease.go:224] Resetting endpoints for master service "kubernetes" to [192.168.49.2]
	I0731 10:46:13.447803       1 controller.go:609] quota admission added evaluator for: endpoints
	I0731 10:46:13.452344       1 controller.go:609] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0731 10:46:14.165348       1 controller.go:609] quota admission added evaluator for: serviceaccounts
	I0731 10:46:14.927391       1 controller.go:609] quota admission added evaluator for: deployments.apps
	I0731 10:46:15.048963       1 controller.go:609] quota admission added evaluator for: daemonsets.apps
	I0731 10:46:18.631316       1 controller.go:609] quota admission added evaluator for: leases.coordination.k8s.io
	I0731 10:46:30.232662       1 controller.go:609] quota admission added evaluator for: controllerrevisions.apps
	I0731 10:46:30.513563       1 controller.go:609] quota admission added evaluator for: replicasets.apps
	I0731 10:46:34.182203       1 controller.go:609] quota admission added evaluator for: jobs.batch
	I0731 10:46:57.847340       1 controller.go:609] quota admission added evaluator for: ingresses.networking.k8s.io
	
	* 
	* ==> kube-controller-manager [9a46c8d63f9e] <==
	* I0731 10:46:30.396246       1 shared_informer.go:230] Caches are synced for expand 
	I0731 10:46:30.407486       1 shared_informer.go:230] Caches are synced for attach detach 
	I0731 10:46:30.431555       1 shared_informer.go:230] Caches are synced for ClusterRoleAggregator 
	I0731 10:46:30.440236       1 shared_informer.go:230] Caches are synced for PVC protection 
	I0731 10:46:30.466498       1 shared_informer.go:230] Caches are synced for garbage collector 
	I0731 10:46:30.480093       1 shared_informer.go:230] Caches are synced for disruption 
	I0731 10:46:30.480160       1 disruption.go:339] Sending events to api server.
	I0731 10:46:30.481033       1 shared_informer.go:230] Caches are synced for persistent volume 
	I0731 10:46:30.481317       1 shared_informer.go:230] Caches are synced for stateful set 
	I0731 10:46:30.485168       1 shared_informer.go:230] Caches are synced for garbage collector 
	I0731 10:46:30.485198       1 garbagecollector.go:142] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0731 10:46:30.488897       1 shared_informer.go:230] Caches are synced for ReplicaSet 
	I0731 10:46:30.510663       1 shared_informer.go:230] Caches are synced for deployment 
	I0731 10:46:30.516288       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"coredns", UID:"a1f2e610-e5ff-4ced-8b35-bcad3ebf42ad", APIVersion:"apps/v1", ResourceVersion:"333", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set coredns-66bff467f8 to 1
	I0731 10:46:30.532464       1 shared_informer.go:230] Caches are synced for resource quota 
	I0731 10:46:30.532844       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-66bff467f8", UID:"49b2a94c-6fc4-407d-af3d-8cf5b8b7778c", APIVersion:"apps/v1", ResourceVersion:"348", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: coredns-66bff467f8-8rg49
	I0731 10:46:30.533493       1 shared_informer.go:230] Caches are synced for resource quota 
	I0731 10:46:34.153615       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"c2c1906c-e687-46b9-9097-7086b699e6eb", APIVersion:"apps/v1", ResourceVersion:"425", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set ingress-nginx-controller-7fcf777cb7 to 1
	I0731 10:46:34.175611       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7", UID:"bca7942d-e7f9-455b-b09b-a7995c7a7519", APIVersion:"apps/v1", ResourceVersion:"426", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-controller-7fcf777cb7-z6rkm
	I0731 10:46:34.194234       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"acb754f0-eef3-4bda-91e6-4af3eec5949d", APIVersion:"batch/v1", ResourceVersion:"430", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-create-rhjm5
	I0731 10:46:34.312394       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"82b5ef48-8ad9-40af-9296-c8aeb0582b19", APIVersion:"batch/v1", ResourceVersion:"441", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-patch-wq5xs
	I0731 10:46:37.053298       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"acb754f0-eef3-4bda-91e6-4af3eec5949d", APIVersion:"batch/v1", ResourceVersion:"440", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I0731 10:46:37.073240       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"82b5ef48-8ad9-40af-9296-c8aeb0582b19", APIVersion:"batch/v1", ResourceVersion:"453", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I0731 10:47:09.600979       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"default", Name:"hello-world-app", UID:"2cb32da5-54c2-4f5d-966a-b25d1fa43856", APIVersion:"apps/v1", ResourceVersion:"566", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set hello-world-app-5f5d8b66bb to 1
	I0731 10:47:09.609656       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"default", Name:"hello-world-app-5f5d8b66bb", UID:"1be87815-1e79-4b57-8a90-c3a5a05a0380", APIVersion:"apps/v1", ResourceVersion:"567", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: hello-world-app-5f5d8b66bb-nk2hb
	
	* 
	* ==> kube-proxy [c548e564d1cc] <==
	* W0731 10:46:31.338098       1 server_others.go:559] Unknown proxy mode "", assuming iptables proxy
	I0731 10:46:31.361626       1 node.go:136] Successfully retrieved node IP: 192.168.49.2
	I0731 10:46:31.361661       1 server_others.go:186] Using iptables Proxier.
	I0731 10:46:31.362104       1 server.go:583] Version: v1.18.20
	I0731 10:46:31.363621       1 config.go:315] Starting service config controller
	I0731 10:46:31.363697       1 shared_informer.go:223] Waiting for caches to sync for service config
	I0731 10:46:31.363948       1 config.go:133] Starting endpoints config controller
	I0731 10:46:31.363974       1 shared_informer.go:223] Waiting for caches to sync for endpoints config
	I0731 10:46:31.463970       1 shared_informer.go:230] Caches are synced for service config 
	I0731 10:46:31.464100       1 shared_informer.go:230] Caches are synced for endpoints config 
	
	* 
	* ==> kube-scheduler [2887dfb1a8ca] <==
	* I0731 10:46:11.918542       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0731 10:46:11.918659       1 shared_informer.go:223] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0731 10:46:11.918763       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	E0731 10:46:11.930762       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0731 10:46:11.930923       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0731 10:46:11.931096       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0731 10:46:11.931368       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0731 10:46:11.931558       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0731 10:46:11.931805       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0731 10:46:11.932039       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0731 10:46:11.932251       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0731 10:46:11.932816       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0731 10:46:11.933064       1 reflector.go:178] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:233: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0731 10:46:11.933403       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0731 10:46:11.940521       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0731 10:46:12.757352       1 reflector.go:178] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:233: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0731 10:46:12.781709       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0731 10:46:12.791113       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0731 10:46:12.822385       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0731 10:46:12.829718       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0731 10:46:12.856762       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0731 10:46:12.878712       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0731 10:46:12.921129       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0731 10:46:12.934282       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	I0731 10:46:15.318908       1 shared_informer.go:230] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	
	* 
	* ==> kubelet <==
	* Jul 31 10:47:14 ingress-addon-legacy-192573 kubelet[2859]: I0731 10:47:14.466115    2859 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: bda4b13e273e2db78b47d63a09927a79dd36719922a5885feea30e2b11bdc811
	Jul 31 10:47:14 ingress-addon-legacy-192573 kubelet[2859]: E0731 10:47:14.467470    2859 pod_workers.go:191] Error syncing pod 0911971c-ae46-42ad-9637-70bdbbbbfdd2 ("hello-world-app-5f5d8b66bb-nk2hb_default(0911971c-ae46-42ad-9637-70bdbbbbfdd2)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 10s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-nk2hb_default(0911971c-ae46-42ad-9637-70bdbbbbfdd2)"
	Jul 31 10:47:20 ingress-addon-legacy-192573 kubelet[2859]: I0731 10:47:20.675571    2859 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 91a3d5b181df901d6b0749157c72c26bff5f7d5121d01148f7ce8ec3d3f4e099
	Jul 31 10:47:20 ingress-addon-legacy-192573 kubelet[2859]: E0731 10:47:20.676227    2859 pod_workers.go:191] Error syncing pod dc0fed97-7293-4a2b-998b-bf8152f73100 ("kube-ingress-dns-minikube_kube-system(dc0fed97-7293-4a2b-998b-bf8152f73100)"), skipping: failed to "StartContainer" for "minikube-ingress-dns" with CrashLoopBackOff: "back-off 20s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(dc0fed97-7293-4a2b-998b-bf8152f73100)"
	Jul 31 10:47:25 ingress-addon-legacy-192573 kubelet[2859]: I0731 10:47:25.571445    2859 reconciler.go:196] operationExecutor.UnmountVolume started for volume "minikube-ingress-dns-token-4bkx6" (UniqueName: "kubernetes.io/secret/dc0fed97-7293-4a2b-998b-bf8152f73100-minikube-ingress-dns-token-4bkx6") pod "dc0fed97-7293-4a2b-998b-bf8152f73100" (UID: "dc0fed97-7293-4a2b-998b-bf8152f73100")
	Jul 31 10:47:25 ingress-addon-legacy-192573 kubelet[2859]: I0731 10:47:25.575939    2859 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc0fed97-7293-4a2b-998b-bf8152f73100-minikube-ingress-dns-token-4bkx6" (OuterVolumeSpecName: "minikube-ingress-dns-token-4bkx6") pod "dc0fed97-7293-4a2b-998b-bf8152f73100" (UID: "dc0fed97-7293-4a2b-998b-bf8152f73100"). InnerVolumeSpecName "minikube-ingress-dns-token-4bkx6". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jul 31 10:47:25 ingress-addon-legacy-192573 kubelet[2859]: I0731 10:47:25.671799    2859 reconciler.go:319] Volume detached for volume "minikube-ingress-dns-token-4bkx6" (UniqueName: "kubernetes.io/secret/dc0fed97-7293-4a2b-998b-bf8152f73100-minikube-ingress-dns-token-4bkx6") on node "ingress-addon-legacy-192573" DevicePath ""
	Jul 31 10:47:26 ingress-addon-legacy-192573 kubelet[2859]: I0731 10:47:26.675613    2859 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: bda4b13e273e2db78b47d63a09927a79dd36719922a5885feea30e2b11bdc811
	Jul 31 10:47:26 ingress-addon-legacy-192573 kubelet[2859]: W0731 10:47:26.858261    2859 container.go:412] Failed to create summary reader for "/kubepods/besteffort/pod0911971c-ae46-42ad-9637-70bdbbbbfdd2/df6bc8d99e84c81cd445ae57ea53bccfc2f4067879a22b05b43cb66e01463f76": none of the resources are being tracked.
	Jul 31 10:47:27 ingress-addon-legacy-192573 kubelet[2859]: W0731 10:47:27.577603    2859 docker_sandbox.go:400] failed to read pod IP from plugin/docker: Couldn't find network status for default/hello-world-app-5f5d8b66bb-nk2hb through plugin: invalid network status for
	Jul 31 10:47:27 ingress-addon-legacy-192573 kubelet[2859]: I0731 10:47:27.583101    2859 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: bda4b13e273e2db78b47d63a09927a79dd36719922a5885feea30e2b11bdc811
	Jul 31 10:47:27 ingress-addon-legacy-192573 kubelet[2859]: I0731 10:47:27.583803    2859 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: df6bc8d99e84c81cd445ae57ea53bccfc2f4067879a22b05b43cb66e01463f76
	Jul 31 10:47:27 ingress-addon-legacy-192573 kubelet[2859]: E0731 10:47:27.586163    2859 pod_workers.go:191] Error syncing pod 0911971c-ae46-42ad-9637-70bdbbbbfdd2 ("hello-world-app-5f5d8b66bb-nk2hb_default(0911971c-ae46-42ad-9637-70bdbbbbfdd2)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-nk2hb_default(0911971c-ae46-42ad-9637-70bdbbbbfdd2)"
	Jul 31 10:47:27 ingress-addon-legacy-192573 kubelet[2859]: I0731 10:47:27.597032    2859 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 91a3d5b181df901d6b0749157c72c26bff5f7d5121d01148f7ce8ec3d3f4e099
	Jul 31 10:47:28 ingress-addon-legacy-192573 kubelet[2859]: W0731 10:47:28.605644    2859 docker_sandbox.go:400] failed to read pod IP from plugin/docker: Couldn't find network status for default/hello-world-app-5f5d8b66bb-nk2hb through plugin: invalid network status for
	Jul 31 10:47:29 ingress-addon-legacy-192573 kubelet[2859]: E0731 10:47:29.555072    2859 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-z6rkm.1776ee0cf594739c", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-z6rkm", UID:"8aaae6bd-895f-4d07-a053-250d21973c0c", APIVersion:"v1", ResourceVersion:"434", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-192573"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc12a023060dd299c, ext:74685119719, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc12a023060dd299c, ext:74685119719, loc:(*time.Location)(0x6a0ef20)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-z6rkm.1776ee0cf594739c" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Jul 31 10:47:29 ingress-addon-legacy-192573 kubelet[2859]: E0731 10:47:29.586461    2859 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-z6rkm.1776ee0cf594739c", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-z6rkm", UID:"8aaae6bd-895f-4d07-a053-250d21973c0c", APIVersion:"v1", ResourceVersion:"434", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-192573"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc12a023060dd299c, ext:74685119719, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc12a02306208efc5, ext:74704765704, loc:(*time.Location)(0x6a0ef20)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-z6rkm.1776ee0cf594739c" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Jul 31 10:47:32 ingress-addon-legacy-192573 kubelet[2859]: W0731 10:47:32.646385    2859 pod_container_deletor.go:77] Container "4a19280df90b75bf827f677491c12630046d99acbbfe8d9c38cabf6f19ea95d9" not found in pod's containers
	Jul 31 10:47:33 ingress-addon-legacy-192573 kubelet[2859]: I0731 10:47:33.693752    2859 reconciler.go:196] operationExecutor.UnmountVolume started for volume "ingress-nginx-token-grkss" (UniqueName: "kubernetes.io/secret/8aaae6bd-895f-4d07-a053-250d21973c0c-ingress-nginx-token-grkss") pod "8aaae6bd-895f-4d07-a053-250d21973c0c" (UID: "8aaae6bd-895f-4d07-a053-250d21973c0c")
	Jul 31 10:47:33 ingress-addon-legacy-192573 kubelet[2859]: I0731 10:47:33.693804    2859 reconciler.go:196] operationExecutor.UnmountVolume started for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/8aaae6bd-895f-4d07-a053-250d21973c0c-webhook-cert") pod "8aaae6bd-895f-4d07-a053-250d21973c0c" (UID: "8aaae6bd-895f-4d07-a053-250d21973c0c")
	Jul 31 10:47:33 ingress-addon-legacy-192573 kubelet[2859]: I0731 10:47:33.702421    2859 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aaae6bd-895f-4d07-a053-250d21973c0c-ingress-nginx-token-grkss" (OuterVolumeSpecName: "ingress-nginx-token-grkss") pod "8aaae6bd-895f-4d07-a053-250d21973c0c" (UID: "8aaae6bd-895f-4d07-a053-250d21973c0c"). InnerVolumeSpecName "ingress-nginx-token-grkss". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jul 31 10:47:33 ingress-addon-legacy-192573 kubelet[2859]: I0731 10:47:33.703095    2859 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aaae6bd-895f-4d07-a053-250d21973c0c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8aaae6bd-895f-4d07-a053-250d21973c0c" (UID: "8aaae6bd-895f-4d07-a053-250d21973c0c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jul 31 10:47:33 ingress-addon-legacy-192573 kubelet[2859]: I0731 10:47:33.794339    2859 reconciler.go:319] Volume detached for volume "ingress-nginx-token-grkss" (UniqueName: "kubernetes.io/secret/8aaae6bd-895f-4d07-a053-250d21973c0c-ingress-nginx-token-grkss") on node "ingress-addon-legacy-192573" DevicePath ""
	Jul 31 10:47:33 ingress-addon-legacy-192573 kubelet[2859]: I0731 10:47:33.794409    2859 reconciler.go:319] Volume detached for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/8aaae6bd-895f-4d07-a053-250d21973c0c-webhook-cert") on node "ingress-addon-legacy-192573" DevicePath ""
	Jul 31 10:47:34 ingress-addon-legacy-192573 kubelet[2859]: W0731 10:47:34.690434    2859 kubelet_getters.go:297] Path "/var/lib/kubelet/pods/8aaae6bd-895f-4d07-a053-250d21973c0c/volumes" does not exist
	
	* 
	* ==> storage-provisioner [6be00d1f2597] <==
	* I0731 10:46:33.715015       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0731 10:46:33.741129       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0731 10:46:33.741314       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0731 10:46:33.749296       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0731 10:46:33.752055       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-192573_6227033c-09ce-4a5a-a931-81f5df8032af!
	I0731 10:46:33.749514       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"a07aa1e7-87cf-411f-8154-8c5f6b7038aa", APIVersion:"v1", ResourceVersion:"390", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' ingress-addon-legacy-192573_6227033c-09ce-4a5a-a931-81f5df8032af became leader
	I0731 10:46:33.852729       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-192573_6227033c-09ce-4a5a-a931-81f5df8032af!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p ingress-addon-legacy-192573 -n ingress-addon-legacy-192573
helpers_test.go:261: (dbg) Run:  kubectl --context ingress-addon-legacy-192573 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddons (53.12s)

                                                
                                    

Test pass (292/319)

Order passed test Duration
3 TestDownloadOnly/v1.16.0/json-events 7.74
4 TestDownloadOnly/v1.16.0/preload-exists 0
8 TestDownloadOnly/v1.16.0/LogsDuration 0.08
10 TestDownloadOnly/v1.27.3/json-events 7.24
11 TestDownloadOnly/v1.27.3/preload-exists 0
15 TestDownloadOnly/v1.27.3/LogsDuration 0.08
16 TestDownloadOnly/DeleteAll 0.23
17 TestDownloadOnly/DeleteAlwaysSucceeds 0.14
19 TestBinaryMirror 0.76
20 TestOffline 104
22 TestAddons/Setup 144.36
24 TestAddons/parallel/Registry 16.17
26 TestAddons/parallel/InspektorGadget 10.88
27 TestAddons/parallel/MetricsServer 5.95
30 TestAddons/parallel/CSI 56.29
31 TestAddons/parallel/Headlamp 13.85
32 TestAddons/parallel/CloudSpanner 5.77
35 TestAddons/serial/GCPAuth/Namespaces 0.18
36 TestAddons/StoppedEnableDisable 11.38
37 TestCertOptions 37.3
38 TestCertExpiration 255.13
39 TestDockerFlags 40.33
40 TestForceSystemdFlag 54.12
41 TestForceSystemdEnv 44.69
47 TestErrorSpam/setup 36.02
48 TestErrorSpam/start 0.82
49 TestErrorSpam/status 1.08
50 TestErrorSpam/pause 1.42
51 TestErrorSpam/unpause 1.57
52 TestErrorSpam/stop 2.1
55 TestFunctional/serial/CopySyncFile 0
56 TestFunctional/serial/StartWithProxy 54.8
57 TestFunctional/serial/AuditLog 0
58 TestFunctional/serial/SoftStart 39.85
59 TestFunctional/serial/KubeContext 0.07
60 TestFunctional/serial/KubectlGetPods 0.09
63 TestFunctional/serial/CacheCmd/cache/add_remote 3.03
64 TestFunctional/serial/CacheCmd/cache/add_local 1.01
65 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.06
66 TestFunctional/serial/CacheCmd/cache/list 0.06
67 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.35
68 TestFunctional/serial/CacheCmd/cache/cache_reload 1.73
69 TestFunctional/serial/CacheCmd/cache/delete 0.12
70 TestFunctional/serial/MinikubeKubectlCmd 0.15
71 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.14
72 TestFunctional/serial/ExtraConfig 42.77
73 TestFunctional/serial/ComponentHealth 0.11
74 TestFunctional/serial/LogsCmd 1.34
75 TestFunctional/serial/LogsFileCmd 1.34
76 TestFunctional/serial/InvalidService 4.56
78 TestFunctional/parallel/ConfigCmd 0.5
79 TestFunctional/parallel/DashboardCmd 10.13
80 TestFunctional/parallel/DryRun 0.47
81 TestFunctional/parallel/InternationalLanguage 0.2
82 TestFunctional/parallel/StatusCmd 1.1
86 TestFunctional/parallel/ServiceCmdConnect 8.72
87 TestFunctional/parallel/AddonsCmd 0.17
88 TestFunctional/parallel/PersistentVolumeClaim 27.53
90 TestFunctional/parallel/SSHCmd 0.85
91 TestFunctional/parallel/CpCmd 1.56
93 TestFunctional/parallel/FileSync 0.4
94 TestFunctional/parallel/CertSync 2.34
98 TestFunctional/parallel/NodeLabels 0.09
100 TestFunctional/parallel/NonActiveRuntimeDisabled 0.42
102 TestFunctional/parallel/License 0.37
103 TestFunctional/parallel/Version/short 0.07
104 TestFunctional/parallel/Version/components 0.72
105 TestFunctional/parallel/ImageCommands/ImageListShort 0.28
106 TestFunctional/parallel/ImageCommands/ImageListTable 0.31
107 TestFunctional/parallel/ImageCommands/ImageListJson 0.24
108 TestFunctional/parallel/ImageCommands/ImageListYaml 0.46
109 TestFunctional/parallel/ImageCommands/ImageBuild 3.06
110 TestFunctional/parallel/ImageCommands/Setup 2.73
111 TestFunctional/parallel/DockerEnv/bash 1.68
112 TestFunctional/parallel/UpdateContextCmd/no_changes 0.26
113 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.25
114 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.2
115 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 4.38
116 TestFunctional/parallel/ServiceCmd/DeployApp 10.36
117 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 2.94
118 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 5.72
119 TestFunctional/parallel/ServiceCmd/List 0.48
120 TestFunctional/parallel/ServiceCmd/JSONOutput 0.47
121 TestFunctional/parallel/ImageCommands/ImageSaveToFile 1.14
122 TestFunctional/parallel/ServiceCmd/HTTPS 0.48
123 TestFunctional/parallel/ServiceCmd/Format 0.65
124 TestFunctional/parallel/ImageCommands/ImageRemove 0.64
125 TestFunctional/parallel/ServiceCmd/URL 0.53
126 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 1.69
128 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.8
129 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 3.19
130 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
132 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 8.68
133 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.13
134 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
138 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
139 TestFunctional/parallel/ProfileCmd/profile_not_create 0.44
140 TestFunctional/parallel/ProfileCmd/profile_list 0.43
141 TestFunctional/parallel/ProfileCmd/profile_json_output 0.43
142 TestFunctional/parallel/MountCmd/any-port 7.45
144 TestFunctional/parallel/MountCmd/VerifyCleanup 2.61
145 TestFunctional/delete_addon-resizer_images 0.09
146 TestFunctional/delete_my-image_image 0.02
147 TestFunctional/delete_minikube_cached_images 0.02
151 TestImageBuild/serial/Setup 34.53
152 TestImageBuild/serial/NormalBuild 1.93
153 TestImageBuild/serial/BuildWithBuildArg 0.89
154 TestImageBuild/serial/BuildWithDockerIgnore 0.75
155 TestImageBuild/serial/BuildWithSpecifiedDockerfile 0.73
158 TestIngressAddonLegacy/StartLegacyK8sCluster 72.87
160 TestIngressAddonLegacy/serial/ValidateIngressAddonActivation 11.2
161 TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation 0.61
165 TestJSONOutput/start/Command 58.25
166 TestJSONOutput/start/Audit 0
168 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
169 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
171 TestJSONOutput/pause/Command 0.62
172 TestJSONOutput/pause/Audit 0
174 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
175 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
177 TestJSONOutput/unpause/Command 0.58
178 TestJSONOutput/unpause/Audit 0
180 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
181 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
183 TestJSONOutput/stop/Command 5.85
184 TestJSONOutput/stop/Audit 0
186 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
187 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
188 TestErrorJSONOutput 0.24
190 TestKicCustomNetwork/create_custom_network 37.64
191 TestKicCustomNetwork/use_default_bridge_network 37.06
192 TestKicExistingNetwork 31.58
193 TestKicCustomSubnet 37.52
194 TestKicStaticIP 36.19
195 TestMainNoArgs 0.06
196 TestMinikubeProfile 76.43
199 TestMountStart/serial/StartWithMountFirst 8.03
200 TestMountStart/serial/VerifyMountFirst 0.29
201 TestMountStart/serial/StartWithMountSecond 8.55
202 TestMountStart/serial/VerifyMountSecond 0.29
203 TestMountStart/serial/DeleteFirst 1.53
204 TestMountStart/serial/VerifyMountPostDelete 0.29
205 TestMountStart/serial/Stop 1.22
206 TestMountStart/serial/RestartStopped 8.31
207 TestMountStart/serial/VerifyMountPostStop 0.28
210 TestMultiNode/serial/FreshStart2Nodes 82.93
211 TestMultiNode/serial/DeployApp2Nodes 43.31
212 TestMultiNode/serial/PingHostFrom2Pods 1.21
213 TestMultiNode/serial/AddNode 18.28
214 TestMultiNode/serial/ProfileList 0.35
215 TestMultiNode/serial/CopyFile 11.38
216 TestMultiNode/serial/StopNode 2.42
217 TestMultiNode/serial/StartAfterStop 14.53
218 TestMultiNode/serial/RestartKeepsNodes 128.52
219 TestMultiNode/serial/DeleteNode 5.32
220 TestMultiNode/serial/StopMultiNode 21.79
221 TestMultiNode/serial/RestartMultiNode 84.38
222 TestMultiNode/serial/ValidateNameConflict 38.45
227 TestPreload 164.86
229 TestScheduledStopUnix 107.25
230 TestSkaffold 114.35
232 TestInsufficientStorage 12.29
233 TestRunningBinaryUpgrade 121.35
235 TestKubernetesUpgrade 142.24
236 TestMissingContainerUpgrade 201.08
238 TestPause/serial/Start 68.4
239 TestPause/serial/SecondStartNoReconfiguration 33.97
240 TestPause/serial/Pause 0.92
241 TestPause/serial/VerifyStatus 0.47
242 TestPause/serial/Unpause 0.79
243 TestPause/serial/PauseAgain 1.22
244 TestPause/serial/DeletePaused 2.28
245 TestPause/serial/VerifyDeletedResources 0.14
246 TestStoppedBinaryUpgrade/Setup 0.94
247 TestStoppedBinaryUpgrade/Upgrade 116.53
248 TestStoppedBinaryUpgrade/MinikubeLogs 2.83
257 TestNoKubernetes/serial/StartNoK8sWithVersion 0.08
258 TestNoKubernetes/serial/StartWithK8s 45.63
270 TestNoKubernetes/serial/StartWithStopK8s 9.84
271 TestNoKubernetes/serial/Start 13.96
272 TestNoKubernetes/serial/VerifyK8sNotRunning 0.38
273 TestNoKubernetes/serial/ProfileList 1.24
274 TestNoKubernetes/serial/Stop 1.29
275 TestNoKubernetes/serial/StartNoArgs 8.63
276 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.42
278 TestStartStop/group/old-k8s-version/serial/FirstStart 125.27
279 TestStartStop/group/old-k8s-version/serial/DeployApp 10.67
280 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 2.39
281 TestStartStop/group/old-k8s-version/serial/Stop 11.5
283 TestStartStop/group/no-preload/serial/FirstStart 103.75
284 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.54
285 TestStartStop/group/old-k8s-version/serial/SecondStart 425.08
286 TestStartStop/group/no-preload/serial/DeployApp 9.54
287 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 1.29
288 TestStartStop/group/no-preload/serial/Stop 11.03
289 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.2
290 TestStartStop/group/no-preload/serial/SecondStart 323.48
291 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 5.03
292 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 5.14
293 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.47
294 TestStartStop/group/old-k8s-version/serial/Pause 4.63
296 TestStartStop/group/embed-certs/serial/FirstStart 98.03
297 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 17.05
298 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.13
299 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.46
300 TestStartStop/group/no-preload/serial/Pause 4.26
302 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 52.07
303 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 9.61
304 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 1.25
305 TestStartStop/group/default-k8s-diff-port/serial/Stop 11.06
306 TestStartStop/group/embed-certs/serial/DeployApp 9.61
307 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.22
308 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 355.03
309 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 1.72
310 TestStartStop/group/embed-certs/serial/Stop 10.91
311 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.19
312 TestStartStop/group/embed-certs/serial/SecondStart 352.84
313 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 21.04
314 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 17.05
315 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 5.12
316 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.42
317 TestStartStop/group/default-k8s-diff-port/serial/Pause 3.3
318 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.15
320 TestStartStop/group/newest-cni/serial/FirstStart 63.63
321 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.51
322 TestStartStop/group/embed-certs/serial/Pause 4.1
323 TestNetworkPlugins/group/auto/Start 94.46
324 TestStartStop/group/newest-cni/serial/DeployApp 0
325 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 1.74
326 TestStartStop/group/newest-cni/serial/Stop 7.11
327 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.21
328 TestStartStop/group/newest-cni/serial/SecondStart 35.3
329 TestNetworkPlugins/group/auto/KubeletFlags 0.46
330 TestNetworkPlugins/group/auto/NetCatPod 11.62
331 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
332 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
333 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.48
334 TestStartStop/group/newest-cni/serial/Pause 3.39
335 TestNetworkPlugins/group/kindnet/Start 74.52
336 TestNetworkPlugins/group/auto/DNS 0.35
337 TestNetworkPlugins/group/auto/Localhost 0.23
338 TestNetworkPlugins/group/auto/HairPin 0.31
339 TestNetworkPlugins/group/calico/Start 80.18
340 TestNetworkPlugins/group/kindnet/ControllerPod 5.04
341 TestNetworkPlugins/group/kindnet/KubeletFlags 0.46
342 TestNetworkPlugins/group/kindnet/NetCatPod 11.79
343 TestNetworkPlugins/group/kindnet/DNS 0.46
344 TestNetworkPlugins/group/kindnet/Localhost 0.32
345 TestNetworkPlugins/group/kindnet/HairPin 0.3
346 TestNetworkPlugins/group/calico/ControllerPod 5.07
347 TestNetworkPlugins/group/calico/KubeletFlags 0.45
348 TestNetworkPlugins/group/calico/NetCatPod 12.71
349 TestNetworkPlugins/group/custom-flannel/Start 72.9
350 TestNetworkPlugins/group/calico/DNS 0.57
351 TestNetworkPlugins/group/calico/Localhost 0.47
352 TestNetworkPlugins/group/calico/HairPin 0.3
353 TestNetworkPlugins/group/false/Start 65.71
354 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.4
355 TestNetworkPlugins/group/custom-flannel/NetCatPod 11.44
356 TestNetworkPlugins/group/custom-flannel/DNS 0.27
357 TestNetworkPlugins/group/custom-flannel/Localhost 0.23
358 TestNetworkPlugins/group/custom-flannel/HairPin 0.23
359 TestNetworkPlugins/group/false/KubeletFlags 0.43
360 TestNetworkPlugins/group/false/NetCatPod 12.59
361 TestNetworkPlugins/group/enable-default-cni/Start 95.32
362 TestNetworkPlugins/group/false/DNS 0.4
363 TestNetworkPlugins/group/false/Localhost 0.38
364 TestNetworkPlugins/group/false/HairPin 0.38
365 TestNetworkPlugins/group/flannel/Start 71.8
366 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.49
367 TestNetworkPlugins/group/enable-default-cni/NetCatPod 14.58
368 TestNetworkPlugins/group/flannel/ControllerPod 5.03
369 TestNetworkPlugins/group/flannel/KubeletFlags 0.34
370 TestNetworkPlugins/group/enable-default-cni/DNS 0.29
371 TestNetworkPlugins/group/flannel/NetCatPod 9.52
372 TestNetworkPlugins/group/enable-default-cni/Localhost 0.28
373 TestNetworkPlugins/group/enable-default-cni/HairPin 0.21
374 TestNetworkPlugins/group/flannel/DNS 0.4
375 TestNetworkPlugins/group/flannel/Localhost 0.24
376 TestNetworkPlugins/group/flannel/HairPin 0.32
377 TestNetworkPlugins/group/bridge/Start 94.32
378 TestNetworkPlugins/group/kubenet/Start 95.8
379 TestNetworkPlugins/group/bridge/KubeletFlags 0.38
380 TestNetworkPlugins/group/bridge/NetCatPod 9.38
381 TestNetworkPlugins/group/bridge/DNS 0.22
382 TestNetworkPlugins/group/bridge/Localhost 0.21
383 TestNetworkPlugins/group/bridge/HairPin 0.18
384 TestNetworkPlugins/group/kubenet/KubeletFlags 0.5
385 TestNetworkPlugins/group/kubenet/NetCatPod 12.59
386 TestNetworkPlugins/group/kubenet/DNS 0.3
387 TestNetworkPlugins/group/kubenet/Localhost 0.31
388 TestNetworkPlugins/group/kubenet/HairPin 0.22
x
+
TestDownloadOnly/v1.16.0/json-events (7.74s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-930262 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=docker  --container-runtime=docker
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-930262 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=docker --driver=docker  --container-runtime=docker: (7.741858861s)
--- PASS: TestDownloadOnly/v1.16.0/json-events (7.74s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/preload-exists
--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/LogsDuration
aaa_download_only_test.go:169: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-930262
aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-930262: exit status 85 (75.158176ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-930262 | jenkins | v1.31.1 | 31 Jul 23 10:35 UTC |          |
	|         | -p download-only-930262        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/31 10:35:43
	Running on machine: ip-172-31-29-130
	Binary: Built with gc go1.20.6 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0731 10:35:43.272928  453599 out.go:296] Setting OutFile to fd 1 ...
	I0731 10:35:43.273118  453599 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0731 10:35:43.273126  453599 out.go:309] Setting ErrFile to fd 2...
	I0731 10:35:43.273132  453599 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0731 10:35:43.273395  453599 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16969-448039/.minikube/bin
	W0731 10:35:43.273530  453599 root.go:314] Error reading config file at /home/jenkins/minikube-integration/16969-448039/.minikube/config/config.json: open /home/jenkins/minikube-integration/16969-448039/.minikube/config/config.json: no such file or directory
	I0731 10:35:43.273998  453599 out.go:303] Setting JSON to true
	I0731 10:35:43.274936  453599 start.go:128] hostinfo: {"hostname":"ip-172-31-29-130","uptime":65891,"bootTime":1690733853,"procs":198,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0731 10:35:43.275006  453599 start.go:138] virtualization:  
	I0731 10:35:43.278127  453599 out.go:97] [download-only-930262] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	I0731 10:35:43.280014  453599 out.go:169] MINIKUBE_LOCATION=16969
	W0731 10:35:43.278396  453599 preload.go:295] Failed to list preload files: open /home/jenkins/minikube-integration/16969-448039/.minikube/cache/preloaded-tarball: no such file or directory
	I0731 10:35:43.278447  453599 notify.go:220] Checking for updates...
	I0731 10:35:43.283483  453599 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0731 10:35:43.285287  453599 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/16969-448039/kubeconfig
	I0731 10:35:43.287035  453599 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/16969-448039/.minikube
	I0731 10:35:43.288732  453599 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0731 10:35:43.292069  453599 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0731 10:35:43.292487  453599 driver.go:373] Setting default libvirt URI to qemu:///system
	I0731 10:35:43.321127  453599 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0731 10:35:43.321222  453599 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0731 10:35:43.399295  453599 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2023-07-31 10:35:43.389094946 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0731 10:35:43.399397  453599 docker.go:294] overlay module found
	I0731 10:35:43.401204  453599 out.go:97] Using the docker driver based on user configuration
	I0731 10:35:43.401227  453599 start.go:298] selected driver: docker
	I0731 10:35:43.401233  453599 start.go:898] validating driver "docker" against <nil>
	I0731 10:35:43.401336  453599 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0731 10:35:43.469626  453599 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2023-07-31 10:35:43.459215921 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0731 10:35:43.469781  453599 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0731 10:35:43.470038  453599 start_flags.go:382] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0731 10:35:43.470192  453599 start_flags.go:901] Wait components to verify : map[apiserver:true system_pods:true]
	I0731 10:35:43.472156  453599 out.go:169] Using Docker driver with root privileges
	I0731 10:35:43.473900  453599 cni.go:84] Creating CNI manager for ""
	I0731 10:35:43.473924  453599 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0731 10:35:43.473940  453599 start_flags.go:319] config:
	{Name:download-only-930262 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-930262 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket:
NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0731 10:35:43.475818  453599 out.go:97] Starting control plane node download-only-930262 in cluster download-only-930262
	I0731 10:35:43.475837  453599 cache.go:122] Beginning downloading kic base image for docker with docker
	I0731 10:35:43.477494  453599 out.go:97] Pulling base image ...
	I0731 10:35:43.477534  453599 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I0731 10:35:43.477678  453599 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0731 10:35:43.494987  453599 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 to local cache
	I0731 10:35:43.495175  453599 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory
	I0731 10:35:43.495277  453599 image.go:118] Writing gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 to local cache
	I0731 10:35:43.543609  453599 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	I0731 10:35:43.543635  453599 cache.go:57] Caching tarball of preloaded images
	I0731 10:35:43.544896  453599 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker
	I0731 10:35:43.547076  453599 out.go:97] Downloading Kubernetes v1.16.0 preload ...
	I0731 10:35:43.547096  453599 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4 ...
	I0731 10:35:43.670522  453599 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4?checksum=md5:a000baffb0664b293d602f95ed25caa6 -> /home/jenkins/minikube-integration/16969-448039/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-docker-overlay2-arm64.tar.lz4
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-930262"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:170: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/json-events (7.24s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-930262 --force --alsologtostderr --kubernetes-version=v1.27.3 --container-runtime=docker --driver=docker  --container-runtime=docker
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-930262 --force --alsologtostderr --kubernetes-version=v1.27.3 --container-runtime=docker --driver=docker  --container-runtime=docker: (7.2369524s)
--- PASS: TestDownloadOnly/v1.27.3/json-events (7.24s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/preload-exists
--- PASS: TestDownloadOnly/v1.27.3/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/LogsDuration
aaa_download_only_test.go:169: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-930262
aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-930262: exit status 85 (74.623418ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-930262 | jenkins | v1.31.1 | 31 Jul 23 10:35 UTC |          |
	|         | -p download-only-930262        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	| start   | -o=json --download-only        | download-only-930262 | jenkins | v1.31.1 | 31 Jul 23 10:35 UTC |          |
	|         | -p download-only-930262        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.27.3   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/31 10:35:51
	Running on machine: ip-172-31-29-130
	Binary: Built with gc go1.20.6 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0731 10:35:51.093425  453676 out.go:296] Setting OutFile to fd 1 ...
	I0731 10:35:51.093629  453676 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0731 10:35:51.093643  453676 out.go:309] Setting ErrFile to fd 2...
	I0731 10:35:51.093650  453676 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0731 10:35:51.093955  453676 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16969-448039/.minikube/bin
	W0731 10:35:51.094085  453676 root.go:314] Error reading config file at /home/jenkins/minikube-integration/16969-448039/.minikube/config/config.json: open /home/jenkins/minikube-integration/16969-448039/.minikube/config/config.json: no such file or directory
	I0731 10:35:51.094313  453676 out.go:303] Setting JSON to true
	I0731 10:35:51.095220  453676 start.go:128] hostinfo: {"hostname":"ip-172-31-29-130","uptime":65898,"bootTime":1690733853,"procs":194,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0731 10:35:51.095294  453676 start.go:138] virtualization:  
	I0731 10:35:51.097700  453676 out.go:97] [download-only-930262] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	I0731 10:35:51.099624  453676 out.go:169] MINIKUBE_LOCATION=16969
	I0731 10:35:51.098035  453676 notify.go:220] Checking for updates...
	I0731 10:35:51.101402  453676 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0731 10:35:51.103065  453676 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/16969-448039/kubeconfig
	I0731 10:35:51.105183  453676 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/16969-448039/.minikube
	I0731 10:35:51.106903  453676 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0731 10:35:51.110712  453676 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0731 10:35:51.111290  453676 config.go:182] Loaded profile config "download-only-930262": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0
	W0731 10:35:51.111360  453676 start.go:806] api.Load failed for download-only-930262: filestore "download-only-930262": Docker machine "download-only-930262" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0731 10:35:51.111517  453676 driver.go:373] Setting default libvirt URI to qemu:///system
	W0731 10:35:51.111546  453676 start.go:806] api.Load failed for download-only-930262: filestore "download-only-930262": Docker machine "download-only-930262" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0731 10:35:51.137939  453676 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0731 10:35:51.138023  453676 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0731 10:35:51.234213  453676 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:41 SystemTime:2023-07-31 10:35:51.223589662 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0731 10:35:51.234344  453676 docker.go:294] overlay module found
	I0731 10:35:51.236497  453676 out.go:97] Using the docker driver based on existing profile
	I0731 10:35:51.236527  453676 start.go:298] selected driver: docker
	I0731 10:35:51.236535  453676 start.go:898] validating driver "docker" against &{Name:download-only-930262 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-930262 Namespace:default APIServerName:minikubeCA APIServerName
s:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Static
IP: SSHAuthSock: SSHAgentPID:0}
	I0731 10:35:51.236733  453676 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0731 10:35:51.307221  453676 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:41 SystemTime:2023-07-31 10:35:51.297141617 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0731 10:35:51.307755  453676 cni.go:84] Creating CNI manager for ""
	I0731 10:35:51.307776  453676 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0731 10:35:51.307789  453676 start_flags.go:319] config:
	{Name:download-only-930262 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:download-only-930262 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket:
NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0731 10:35:51.309859  453676 out.go:97] Starting control plane node download-only-930262 in cluster download-only-930262
	I0731 10:35:51.309891  453676 cache.go:122] Beginning downloading kic base image for docker with docker
	I0731 10:35:51.311642  453676 out.go:97] Pulling base image ...
	I0731 10:35:51.311672  453676 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0731 10:35:51.311721  453676 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0731 10:35:51.333940  453676 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 to local cache
	I0731 10:35:51.334055  453676 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory
	I0731 10:35:51.334075  453676 image.go:66] Found gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory, skipping pull
	I0731 10:35:51.334079  453676 image.go:105] gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 exists in cache, skipping pull
	I0731 10:35:51.334086  453676 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 as a tarball
	I0731 10:35:51.382168  453676 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.27.3/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4
	I0731 10:35:51.382200  453676 cache.go:57] Caching tarball of preloaded images
	I0731 10:35:51.382877  453676 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime docker
	I0731 10:35:51.384877  453676 out.go:97] Downloading Kubernetes v1.27.3 preload ...
	I0731 10:35:51.384903  453676 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4 ...
	I0731 10:35:51.509048  453676 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.27.3/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4?checksum=md5:e061b1178966dc348ac19219444153f4 -> /home/jenkins/minikube-integration/16969-448039/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-docker-overlay2-arm64.tar.lz4
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-930262"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:170: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.27.3/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAll (0.23s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAll
aaa_download_only_test.go:187: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/DeleteAll (0.23s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAlwaysSucceeds (0.14s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds
aaa_download_only_test.go:199: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-930262
--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.14s)

                                                
                                    
x
+
TestBinaryMirror (0.76s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:304: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p binary-mirror-243601 --alsologtostderr --binary-mirror http://127.0.0.1:42265 --driver=docker  --container-runtime=docker
helpers_test.go:175: Cleaning up "binary-mirror-243601" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p binary-mirror-243601
--- PASS: TestBinaryMirror (0.76s)

                                                
                                    
x
+
TestOffline (104s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-linux-arm64 start -p offline-docker-018645 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=docker
aab_offline_test.go:55: (dbg) Done: out/minikube-linux-arm64 start -p offline-docker-018645 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=docker: (1m41.440630878s)
helpers_test.go:175: Cleaning up "offline-docker-018645" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p offline-docker-018645
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p offline-docker-018645: (2.558953758s)
--- PASS: TestOffline (104.00s)

                                                
                                    
x
+
TestAddons/Setup (144.36s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:88: (dbg) Run:  out/minikube-linux-arm64 start -p addons-766873 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=docker  --container-runtime=docker --addons=ingress --addons=ingress-dns
addons_test.go:88: (dbg) Done: out/minikube-linux-arm64 start -p addons-766873 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=docker  --container-runtime=docker --addons=ingress --addons=ingress-dns: (2m24.362332503s)
--- PASS: TestAddons/Setup (144.36s)

                                                
                                    
x
+
TestAddons/parallel/Registry (16.17s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:306: registry stabilized in 32.356927ms
addons_test.go:308: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-5zr9x" [de5bd8ed-f81e-44f2-98b6-2c8acc08a2eb] Running
addons_test.go:308: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.01875292s
addons_test.go:311: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-8nwth" [9b58b346-25fc-45b9-87df-8faeed904794] Running
addons_test.go:311: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.016213465s
addons_test.go:316: (dbg) Run:  kubectl --context addons-766873 delete po -l run=registry-test --now
addons_test.go:321: (dbg) Run:  kubectl --context addons-766873 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:321: (dbg) Done: kubectl --context addons-766873 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (4.984280798s)
addons_test.go:335: (dbg) Run:  out/minikube-linux-arm64 -p addons-766873 ip
2023/07/31 10:38:39 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p addons-766873 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (16.17s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (10.88s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-6xvpb" [99caeee5-4160-4c39-9ca1-c488f5640242] Running
addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.013188012s
addons_test.go:817: (dbg) Run:  out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-766873
addons_test.go:817: (dbg) Done: out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-766873: (5.86412946s)
--- PASS: TestAddons/parallel/InspektorGadget (10.88s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.95s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:383: metrics-server stabilized in 4.585626ms
addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-7746886d4f-4t6xb" [97ba39a7-b1cb-468d-9fd3-799cc25fed1e] Running
addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.01338932s
addons_test.go:391: (dbg) Run:  kubectl --context addons-766873 top pods -n kube-system
addons_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p addons-766873 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.95s)

                                                
                                    
x
+
TestAddons/parallel/CSI (56.29s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:537: csi-hostpath-driver pods stabilized in 8.147059ms
addons_test.go:540: (dbg) Run:  kubectl --context addons-766873 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:545: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:550: (dbg) Run:  kubectl --context addons-766873 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:555: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [1219f66d-617e-4705-960f-7510f042d509] Pending
helpers_test.go:344: "task-pv-pod" [1219f66d-617e-4705-960f-7510f042d509] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [1219f66d-617e-4705-960f-7510f042d509] Running
addons_test.go:555: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 12.028627415s
addons_test.go:560: (dbg) Run:  kubectl --context addons-766873 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:565: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-766873 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-766873 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-766873 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:570: (dbg) Run:  kubectl --context addons-766873 delete pod task-pv-pod
addons_test.go:576: (dbg) Run:  kubectl --context addons-766873 delete pvc hpvc
addons_test.go:582: (dbg) Run:  kubectl --context addons-766873 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:587: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-766873 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:592: (dbg) Run:  kubectl --context addons-766873 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:597: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [0b5ea066-db42-4d25-9318-5ec366a25da9] Pending
helpers_test.go:344: "task-pv-pod-restore" [0b5ea066-db42-4d25-9318-5ec366a25da9] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [0b5ea066-db42-4d25-9318-5ec366a25da9] Running
addons_test.go:597: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 7.021535748s
addons_test.go:602: (dbg) Run:  kubectl --context addons-766873 delete pod task-pv-pod-restore
addons_test.go:602: (dbg) Done: kubectl --context addons-766873 delete pod task-pv-pod-restore: (1.271674493s)
addons_test.go:606: (dbg) Run:  kubectl --context addons-766873 delete pvc hpvc-restore
addons_test.go:610: (dbg) Run:  kubectl --context addons-766873 delete volumesnapshot new-snapshot-demo
addons_test.go:614: (dbg) Run:  out/minikube-linux-arm64 -p addons-766873 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:614: (dbg) Done: out/minikube-linux-arm64 -p addons-766873 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.860760283s)
addons_test.go:618: (dbg) Run:  out/minikube-linux-arm64 -p addons-766873 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (56.29s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (13.85s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:800: (dbg) Run:  out/minikube-linux-arm64 addons enable headlamp -p addons-766873 --alsologtostderr -v=1
addons_test.go:800: (dbg) Done: out/minikube-linux-arm64 addons enable headlamp -p addons-766873 --alsologtostderr -v=1: (1.819251648s)
addons_test.go:805: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-66f6498c69-892vh" [43416abe-996e-4baa-b31c-e4f2e3a01575] Pending
helpers_test.go:344: "headlamp-66f6498c69-892vh" [43416abe-996e-4baa-b31c-e4f2e3a01575] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-66f6498c69-892vh" [43416abe-996e-4baa-b31c-e4f2e3a01575] Running
addons_test.go:805: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 12.032625768s
--- PASS: TestAddons/parallel/Headlamp (13.85s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.77s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:833: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-88647b4cb-kx5jf" [7f8a0b4d-b63b-4db5-bfe7-e48bff7c5624] Running
addons_test.go:833: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.016523585s
addons_test.go:836: (dbg) Run:  out/minikube-linux-arm64 addons disable cloud-spanner -p addons-766873
--- PASS: TestAddons/parallel/CloudSpanner (5.77s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.18s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:626: (dbg) Run:  kubectl --context addons-766873 create ns new-namespace
addons_test.go:640: (dbg) Run:  kubectl --context addons-766873 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.18s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (11.38s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:148: (dbg) Run:  out/minikube-linux-arm64 stop -p addons-766873
addons_test.go:148: (dbg) Done: out/minikube-linux-arm64 stop -p addons-766873: (11.08693118s)
addons_test.go:152: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-766873
addons_test.go:156: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-766873
addons_test.go:161: (dbg) Run:  out/minikube-linux-arm64 addons disable gvisor -p addons-766873
--- PASS: TestAddons/StoppedEnableDisable (11.38s)

                                                
                                    
x
+
TestCertOptions (37.3s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-arm64 start -p cert-options-721199 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=docker
E0731 11:17:25.493881  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
cert_options_test.go:49: (dbg) Done: out/minikube-linux-arm64 start -p cert-options-721199 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=docker: (34.407834494s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-arm64 -p cert-options-721199 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-721199 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-arm64 ssh -p cert-options-721199 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-721199" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-options-721199
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-options-721199: (2.206039982s)
--- PASS: TestCertOptions (37.30s)

                                                
                                    
x
+
TestCertExpiration (255.13s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-134589 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=docker
cert_options_test.go:123: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-134589 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=docker: (41.903037027s)
E0731 11:16:45.049955  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-134589 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=docker
cert_options_test.go:131: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-134589 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=docker: (30.986840212s)
helpers_test.go:175: Cleaning up "cert-expiration-134589" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-expiration-134589
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-expiration-134589: (2.244158965s)
--- PASS: TestCertExpiration (255.13s)

                                                
                                    
x
+
TestDockerFlags (40.33s)

                                                
                                                
=== RUN   TestDockerFlags
=== PAUSE TestDockerFlags

                                                
                                                

                                                
                                                
=== CONT  TestDockerFlags
docker_test.go:51: (dbg) Run:  out/minikube-linux-arm64 start -p docker-flags-294133 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
E0731 11:16:27.627496  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
docker_test.go:51: (dbg) Done: out/minikube-linux-arm64 start -p docker-flags-294133 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (37.330209147s)
docker_test.go:56: (dbg) Run:  out/minikube-linux-arm64 -p docker-flags-294133 ssh "sudo systemctl show docker --property=Environment --no-pager"
docker_test.go:67: (dbg) Run:  out/minikube-linux-arm64 -p docker-flags-294133 ssh "sudo systemctl show docker --property=ExecStart --no-pager"
helpers_test.go:175: Cleaning up "docker-flags-294133" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-flags-294133
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-flags-294133: (2.356745389s)
--- PASS: TestDockerFlags (40.33s)

                                                
                                    
x
+
TestForceSystemdFlag (54.12s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-flag-191219 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
docker_test.go:91: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-flag-191219 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (51.205428351s)
docker_test.go:110: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-flag-191219 ssh "docker info --format {{.CgroupDriver}}"
helpers_test.go:175: Cleaning up "force-systemd-flag-191219" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-flag-191219
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-flag-191219: (2.484635958s)
--- PASS: TestForceSystemdFlag (54.12s)

                                                
                                    
x
+
TestForceSystemdEnv (44.69s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-env-594014 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
E0731 11:15:09.337059  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
docker_test.go:155: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-env-594014 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (41.900902196s)
docker_test.go:110: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-env-594014 ssh "docker info --format {{.CgroupDriver}}"
helpers_test.go:175: Cleaning up "force-systemd-env-594014" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-env-594014
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-env-594014: (2.319588364s)
--- PASS: TestForceSystemdEnv (44.69s)

                                                
                                    
x
+
TestErrorSpam/setup (36.02s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -p nospam-217896 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-217896 --driver=docker  --container-runtime=docker
error_spam_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -p nospam-217896 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-217896 --driver=docker  --container-runtime=docker: (36.016661144s)
--- PASS: TestErrorSpam/setup (36.02s)

                                                
                                    
x
+
TestErrorSpam/start (0.82s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-217896 --log_dir /tmp/nospam-217896 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-217896 --log_dir /tmp/nospam-217896 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-217896 --log_dir /tmp/nospam-217896 start --dry-run
--- PASS: TestErrorSpam/start (0.82s)

                                                
                                    
x
+
TestErrorSpam/status (1.08s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-217896 --log_dir /tmp/nospam-217896 status
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-217896 --log_dir /tmp/nospam-217896 status
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-217896 --log_dir /tmp/nospam-217896 status
--- PASS: TestErrorSpam/status (1.08s)

                                                
                                    
x
+
TestErrorSpam/pause (1.42s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-217896 --log_dir /tmp/nospam-217896 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-217896 --log_dir /tmp/nospam-217896 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-217896 --log_dir /tmp/nospam-217896 pause
--- PASS: TestErrorSpam/pause (1.42s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.57s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-217896 --log_dir /tmp/nospam-217896 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-217896 --log_dir /tmp/nospam-217896 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-217896 --log_dir /tmp/nospam-217896 unpause
--- PASS: TestErrorSpam/unpause (1.57s)

                                                
                                    
x
+
TestErrorSpam/stop (2.1s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-217896 --log_dir /tmp/nospam-217896 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-arm64 -p nospam-217896 --log_dir /tmp/nospam-217896 stop: (1.896581997s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-217896 --log_dir /tmp/nospam-217896 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-217896 --log_dir /tmp/nospam-217896 stop
--- PASS: TestErrorSpam/stop (2.10s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /home/jenkins/minikube-integration/16969-448039/.minikube/files/etc/test/nested/copy/453594/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (54.8s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-linux-arm64 start -p functional-034793 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=docker
functional_test.go:2230: (dbg) Done: out/minikube-linux-arm64 start -p functional-034793 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=docker: (54.80335157s)
--- PASS: TestFunctional/serial/StartWithProxy (54.80s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (39.85s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-linux-arm64 start -p functional-034793 --alsologtostderr -v=8
functional_test.go:655: (dbg) Done: out/minikube-linux-arm64 start -p functional-034793 --alsologtostderr -v=8: (39.843595763s)
functional_test.go:659: soft start took 39.845611109s for "functional-034793" cluster.
--- PASS: TestFunctional/serial/SoftStart (39.85s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.07s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-034793 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (3.03s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-034793 cache add registry.k8s.io/pause:3.1: (1.078987052s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-034793 cache add registry.k8s.io/pause:3.3: (1.080783092s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 cache add registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (3.03s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.01s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-034793 /tmp/TestFunctionalserialCacheCmdcacheadd_local1725282020/001
functional_test.go:1085: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 cache add minikube-local-cache-test:functional-034793
functional_test.go:1090: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 cache delete minikube-local-cache-test:functional-034793
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-034793
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.01s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-linux-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.35s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.35s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (1.73s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh sudo docker rmi registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (343.394001ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1154: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 cache reload
functional_test.go:1159: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (1.73s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.12s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.12s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.15s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 kubectl -- --context functional-034793 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.15s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-034793 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.14s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (42.77s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-linux-arm64 start -p functional-034793 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
functional_test.go:753: (dbg) Done: out/minikube-linux-arm64 start -p functional-034793 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (42.767309237s)
functional_test.go:757: restart took 42.767400724s for "functional-034793" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (42.77s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-034793 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:821: etcd phase: Running
functional_test.go:831: etcd status: Ready
functional_test.go:821: kube-apiserver phase: Running
functional_test.go:831: kube-apiserver status: Ready
functional_test.go:821: kube-controller-manager phase: Running
functional_test.go:831: kube-controller-manager status: Ready
functional_test.go:821: kube-scheduler phase: Running
functional_test.go:831: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.34s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 logs
functional_test.go:1232: (dbg) Done: out/minikube-linux-arm64 -p functional-034793 logs: (1.341638389s)
--- PASS: TestFunctional/serial/LogsCmd (1.34s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.34s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 logs --file /tmp/TestFunctionalserialLogsFileCmd3068616552/001/logs.txt
E0731 10:43:24.580264  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 10:43:24.586007  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 10:43:24.596242  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 10:43:24.616492  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 10:43:24.656738  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 10:43:24.736984  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
functional_test.go:1246: (dbg) Done: out/minikube-linux-arm64 -p functional-034793 logs --file /tmp/TestFunctionalserialLogsFileCmd3068616552/001/logs.txt: (1.343574573s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.34s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (4.56s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-034793 apply -f testdata/invalidsvc.yaml
E0731 10:43:24.897921  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 10:43:25.218908  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 10:43:25.859796  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 10:43:27.140065  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
functional_test.go:2331: (dbg) Run:  out/minikube-linux-arm64 service invalid-svc -p functional-034793
functional_test.go:2331: (dbg) Non-zero exit: out/minikube-linux-arm64 service invalid-svc -p functional-034793: exit status 115 (578.043448ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:30380 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2323: (dbg) Run:  kubectl --context functional-034793 delete -f testdata/invalidsvc.yaml
--- PASS: TestFunctional/serial/InvalidService (4.56s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 config get cpus: exit status 14 (93.913732ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 config unset cpus
E0731 10:43:29.701106  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 config get cpus: exit status 14 (68.734695ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (10.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-034793 --alsologtostderr -v=1]
functional_test.go:906: (dbg) stopping [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-034793 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 492618: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (10.13s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-linux-arm64 start -p functional-034793 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker
functional_test.go:970: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-034793 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker: exit status 23 (205.225328ms)

                                                
                                                
-- stdout --
	* [functional-034793] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16969
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16969-448039/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16969-448039/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0731 10:44:20.609334  492298 out.go:296] Setting OutFile to fd 1 ...
	I0731 10:44:20.609545  492298 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0731 10:44:20.609570  492298 out.go:309] Setting ErrFile to fd 2...
	I0731 10:44:20.609588  492298 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0731 10:44:20.609884  492298 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16969-448039/.minikube/bin
	I0731 10:44:20.610280  492298 out.go:303] Setting JSON to false
	I0731 10:44:20.611496  492298 start.go:128] hostinfo: {"hostname":"ip-172-31-29-130","uptime":66408,"bootTime":1690733853,"procs":250,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0731 10:44:20.611631  492298 start.go:138] virtualization:  
	I0731 10:44:20.613991  492298 out.go:177] * [functional-034793] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	I0731 10:44:20.616392  492298 out.go:177]   - MINIKUBE_LOCATION=16969
	I0731 10:44:20.618158  492298 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0731 10:44:20.616533  492298 notify.go:220] Checking for updates...
	I0731 10:44:20.620148  492298 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16969-448039/kubeconfig
	I0731 10:44:20.621970  492298 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16969-448039/.minikube
	I0731 10:44:20.623592  492298 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0731 10:44:20.625390  492298 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0731 10:44:20.627685  492298 config.go:182] Loaded profile config "functional-034793": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0731 10:44:20.628289  492298 driver.go:373] Setting default libvirt URI to qemu:///system
	I0731 10:44:20.653264  492298 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0731 10:44:20.653379  492298 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0731 10:44:20.742502  492298 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:46 SystemTime:2023-07-31 10:44:20.732137657 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0731 10:44:20.742626  492298 docker.go:294] overlay module found
	I0731 10:44:20.744921  492298 out.go:177] * Using the docker driver based on existing profile
	I0731 10:44:20.746589  492298 start.go:298] selected driver: docker
	I0731 10:44:20.746613  492298 start.go:898] validating driver "docker" against &{Name:functional-034793 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:functional-034793 Namespace:default APIServerName:minikubeCA APIServerNames:[] A
PIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0731 10:44:20.746716  492298 start.go:909] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0731 10:44:20.748984  492298 out.go:177] 
	W0731 10:44:20.750943  492298 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0731 10:44:20.752953  492298 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-linux-arm64 start -p functional-034793 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
--- PASS: TestFunctional/parallel/DryRun (0.47s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-linux-arm64 start -p functional-034793 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-034793 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=docker: exit status 23 (198.746931ms)

                                                
                                                
-- stdout --
	* [functional-034793] minikube v1.31.1 sur Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16969
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16969-448039/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16969-448039/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0731 10:44:21.082560  492405 out.go:296] Setting OutFile to fd 1 ...
	I0731 10:44:21.082712  492405 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0731 10:44:21.082721  492405 out.go:309] Setting ErrFile to fd 2...
	I0731 10:44:21.082727  492405 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0731 10:44:21.083519  492405 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16969-448039/.minikube/bin
	I0731 10:44:21.083941  492405 out.go:303] Setting JSON to false
	I0731 10:44:21.085136  492405 start.go:128] hostinfo: {"hostname":"ip-172-31-29-130","uptime":66408,"bootTime":1690733853,"procs":249,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1040-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0731 10:44:21.085214  492405 start.go:138] virtualization:  
	I0731 10:44:21.087591  492405 out.go:177] * [functional-034793] minikube v1.31.1 sur Ubuntu 20.04 (arm64)
	I0731 10:44:21.089895  492405 out.go:177]   - MINIKUBE_LOCATION=16969
	I0731 10:44:21.090052  492405 notify.go:220] Checking for updates...
	I0731 10:44:21.093117  492405 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0731 10:44:21.094699  492405 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16969-448039/kubeconfig
	I0731 10:44:21.096671  492405 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16969-448039/.minikube
	I0731 10:44:21.098351  492405 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0731 10:44:21.099940  492405 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0731 10:44:21.102084  492405 config.go:182] Loaded profile config "functional-034793": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0731 10:44:21.102620  492405 driver.go:373] Setting default libvirt URI to qemu:///system
	I0731 10:44:21.129817  492405 docker.go:121] docker version: linux-24.0.5:Docker Engine - Community
	I0731 10:44:21.129915  492405 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0731 10:44:21.203513  492405 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:46 SystemTime:2023-07-31 10:44:21.193772587 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0731 10:44:21.203624  492405 docker.go:294] overlay module found
	I0731 10:44:21.205630  492405 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I0731 10:44:21.207778  492405 start.go:298] selected driver: docker
	I0731 10:44:21.207801  492405 start.go:898] validating driver "docker" against &{Name:functional-034793 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:functional-034793 Namespace:default APIServerName:minikubeCA APIServerNames:[] A
PIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.27.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun
tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0731 10:44:21.208018  492405 start.go:909] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0731 10:44:21.210445  492405 out.go:177] 
	W0731 10:44:21.212330  492405 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0731 10:44:21.214126  492405 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (1.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 status
functional_test.go:856: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:868: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.10s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (8.72s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1626: (dbg) Run:  kubectl --context functional-034793 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1634: (dbg) Run:  kubectl --context functional-034793 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-58d66798bb-xvz7p" [143b67a7-f41d-48b6-bda6-1894ca32d4ce] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-connect-58d66798bb-xvz7p" [143b67a7-f41d-48b6-bda6-1894ca32d4ce] Running
E0731 10:44:05.543810  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 8.022119748s
functional_test.go:1648: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 service hello-node-connect --url
functional_test.go:1654: found endpoint for hello-node-connect: http://192.168.49.2:32228
functional_test.go:1674: http://192.168.49.2:32228: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-58d66798bb-xvz7p

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:32228
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (8.72s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.17s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1689: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 addons list
functional_test.go:1701: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.17s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (27.53s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [635bb291-ea25-45f7-972a-6d0677faf246] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.01659107s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-034793 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-034793 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-034793 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-034793 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [35ed343f-bf3f-4cad-b7ac-7b285f7d14b2] Pending
helpers_test.go:344: "sp-pod" [35ed343f-bf3f-4cad-b7ac-7b285f7d14b2] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [35ed343f-bf3f-4cad-b7ac-7b285f7d14b2] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 12.018602538s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-034793 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-034793 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:106: (dbg) Done: kubectl --context functional-034793 delete -f testdata/storage-provisioner/pod.yaml: (1.031982627s)
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-034793 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [0fb9398c-df31-4ff2-9760-b4819115733b] Pending
helpers_test.go:344: "sp-pod" [0fb9398c-df31-4ff2-9760-b4819115733b] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [0fb9398c-df31-4ff2-9760-b4819115733b] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 8.021931913s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-034793 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (27.53s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.85s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1724: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "echo hello"
functional_test.go:1741: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.85s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (1.56s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh -n functional-034793 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 cp functional-034793:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd363957813/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh -n functional-034793 "sudo cat /home/docker/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.56s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/453594/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "sudo cat /etc/test/nested/copy/453594/hosts"
functional_test.go:1932: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.40s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (2.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/453594.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "sudo cat /etc/ssl/certs/453594.pem"
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/453594.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "sudo cat /usr/share/ca-certificates/453594.pem"
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/4535942.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "sudo cat /etc/ssl/certs/4535942.pem"
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/4535942.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "sudo cat /usr/share/ca-certificates/4535942.pem"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
E0731 10:43:34.821949  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
--- PASS: TestFunctional/parallel/CertSync (2.34s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-034793 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.42s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 ssh "sudo systemctl is-active crio": exit status 1 (415.230929ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.42s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-linux-arm64 license
--- PASS: TestFunctional/parallel/License (0.37s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 version --short
--- PASS: TestFunctional/parallel/Version/short (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.72s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 version -o=json --components
--- PASS: TestFunctional/parallel/Version/components (0.72s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-034793 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.9
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.27.3
registry.k8s.io/kube-proxy:v1.27.3
registry.k8s.io/kube-controller-manager:v1.27.3
registry.k8s.io/kube-apiserver:v1.27.3
registry.k8s.io/etcd:3.5.7-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.10.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
gcr.io/google-containers/addon-resizer:functional-034793
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/minikube-local-cache-test:functional-034793
docker.io/kubernetesui/metrics-scraper:<none>
docker.io/kubernetesui/dashboard:<none>
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-034793 image ls --format short --alsologtostderr:
I0731 10:44:32.926340  493592 out.go:296] Setting OutFile to fd 1 ...
I0731 10:44:32.926505  493592 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0731 10:44:32.926514  493592 out.go:309] Setting ErrFile to fd 2...
I0731 10:44:32.926520  493592 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0731 10:44:32.926782  493592 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16969-448039/.minikube/bin
I0731 10:44:32.927388  493592 config.go:182] Loaded profile config "functional-034793": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0731 10:44:32.927509  493592 config.go:182] Loaded profile config "functional-034793": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0731 10:44:32.928017  493592 cli_runner.go:164] Run: docker container inspect functional-034793 --format={{.State.Status}}
I0731 10:44:32.946924  493592 ssh_runner.go:195] Run: systemctl --version
I0731 10:44:32.946980  493592 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-034793
I0731 10:44:32.971640  493592 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35520 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/functional-034793/id_rsa Username:docker}
I0731 10:44:33.074784  493592 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.31s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-034793 image ls --format table --alsologtostderr:
|---------------------------------------------|-------------------|---------------|--------|
|                    Image                    |        Tag        |   Image ID    |  Size  |
|---------------------------------------------|-------------------|---------------|--------|
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc      | 1611cd07b61d5 | 3.55MB |
| docker.io/library/nginx                     | latest            | ff78c7a65ec2b | 192MB  |
| registry.k8s.io/kube-proxy                  | v1.27.3           | fb73e92641fd5 | 66.5MB |
| registry.k8s.io/kube-scheduler              | v1.27.3           | bcb9e554eaab6 | 56.2MB |
| registry.k8s.io/coredns/coredns             | v1.10.1           | 97e04611ad434 | 51.4MB |
| docker.io/kubernetesui/dashboard            | <none>            | 20b332c9a70d8 | 244MB  |
| gcr.io/k8s-minikube/storage-provisioner     | v5                | ba04bb24b9575 | 29MB   |
| registry.k8s.io/pause                       | 3.3               | 3d18732f8686c | 484kB  |
| registry.k8s.io/pause                       | 3.1               | 8057e0500773a | 525kB  |
| docker.io/library/minikube-local-cache-test | functional-034793 | 68c58c69f5bed | 30B    |
| gcr.io/google-containers/addon-resizer      | functional-034793 | ffd4cfbbe753e | 32.9MB |
| registry.k8s.io/pause                       | latest            | 8cb2091f603e7 | 240kB  |
| docker.io/library/nginx                     | alpine            | 66bf2c914bf4d | 41MB   |
| registry.k8s.io/kube-apiserver              | v1.27.3           | 39dfb036b0986 | 115MB  |
| registry.k8s.io/etcd                        | 3.5.7-0           | 24bc64e911039 | 181MB  |
| registry.k8s.io/pause                       | 3.9               | 829e9de338bd5 | 514kB  |
| docker.io/kubernetesui/metrics-scraper      | <none>            | a422e0e982356 | 42.3MB |
| registry.k8s.io/kube-controller-manager     | v1.27.3           | ab3683b584ae5 | 107MB  |
| registry.k8s.io/echoserver-arm              | 1.8               | 72565bf5bbedf | 85MB   |
|---------------------------------------------|-------------------|---------------|--------|
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-034793 image ls --format table --alsologtostderr:
I0731 10:44:36.006805  494239 out.go:296] Setting OutFile to fd 1 ...
I0731 10:44:36.007249  494239 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0731 10:44:36.007284  494239 out.go:309] Setting ErrFile to fd 2...
I0731 10:44:36.007304  494239 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0731 10:44:36.007638  494239 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16969-448039/.minikube/bin
I0731 10:44:36.008537  494239 config.go:182] Loaded profile config "functional-034793": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0731 10:44:36.008750  494239 config.go:182] Loaded profile config "functional-034793": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0731 10:44:36.009270  494239 cli_runner.go:164] Run: docker container inspect functional-034793 --format={{.State.Status}}
I0731 10:44:36.034356  494239 ssh_runner.go:195] Run: systemctl --version
I0731 10:44:36.034463  494239 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-034793
I0731 10:44:36.060605  494239 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35520 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/functional-034793/id_rsa Username:docker}
I0731 10:44:36.174131  494239 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.31s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-034793 image ls --format json --alsologtostderr:
[{"id":"bcb9e554eaab606a5237b493a9a52ec01b8c29a4e49306184916b1bffca38540","repoDigests":[],"repoTags":["registry.k8s.io/kube-scheduler:v1.27.3"],"size":"56200000"},{"id":"ab3683b584ae5afe0953106b2d8e470280eda3375ccd715feb601acc2d0611b8","repoDigests":[],"repoTags":["registry.k8s.io/kube-controller-manager:v1.27.3"],"size":"107000000"},{"id":"3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"484000"},{"id":"68c58c69f5bed18d23ac620e0a3921b4269c27fc5cb30c23f25a5018d0554df4","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-034793"],"size":"30"},{"id":"fb73e92641fd5ab6e5494f0c583616af0bdcc20bc15e4ec7a2e456190f11909a","repoDigests":[],"repoTags":["registry.k8s.io/kube-proxy:v1.27.3"],"size":"66500000"},{"id":"72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":[],"repoTags":["registry.k8s.io/echoserver-arm:1.8"],"size":"85000000"},{"id":"8cb2091f603e75187e2f6226c5
901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":[],"repoTags":["registry.k8s.io/pause:latest"],"size":"240000"},{"id":"24bc64e911039ecf00e263be2161797c758b7d82403ca5516ab64047a477f737","repoDigests":[],"repoTags":["registry.k8s.io/etcd:3.5.7-0"],"size":"181000000"},{"id":"8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.1"],"size":"525000"},{"id":"a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a","repoDigests":[],"repoTags":["docker.io/kubernetesui/metrics-scraper:\u003cnone\u003e"],"size":"42300000"},{"id":"ff78c7a65ec2b1fb09f58b27b0dd022ac1f4e16b9bcfe1cbdc18c36f2e0e1842","repoDigests":[],"repoTags":["docker.io/library/nginx:latest"],"size":"192000000"},{"id":"829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.9"],"size":"514000"},{"id":"97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108","repoDigests":[],"repoTags":["registry.k8s.io/c
oredns/coredns:v1.10.1"],"size":"51400000"},{"id":"20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8","repoDigests":[],"repoTags":["docker.io/kubernetesui/dashboard:\u003cnone\u003e"],"size":"244000000"},{"id":"ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","repoDigests":[],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"29000000"},{"id":"ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91","repoDigests":[],"repoTags":["gcr.io/google-containers/addon-resizer:functional-034793"],"size":"32900000"},{"id":"1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDigests":[],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"3550000"},{"id":"66bf2c914bf4d0aac4b62f09f9f74ad35898d613024a0f2ec94dca9e79fac6ea","repoDigests":[],"repoTags":["docker.io/library/nginx:alpine"],"size":"41000000"},{"id":"39dfb036b0986d18c80ba0cc45d2fd7256751d89ce9a477aac067fad9e14c473","repoDigests":[],"repoTags":["registry.k8s.io/kube-apiserver:v1.2
7.3"],"size":"115000000"}]
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-034793 image ls --format json --alsologtostderr:
I0731 10:44:35.749198  494208 out.go:296] Setting OutFile to fd 1 ...
I0731 10:44:35.749382  494208 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0731 10:44:35.749413  494208 out.go:309] Setting ErrFile to fd 2...
I0731 10:44:35.749434  494208 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0731 10:44:35.749717  494208 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16969-448039/.minikube/bin
I0731 10:44:35.750334  494208 config.go:182] Loaded profile config "functional-034793": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0731 10:44:35.750499  494208 config.go:182] Loaded profile config "functional-034793": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0731 10:44:35.751103  494208 cli_runner.go:164] Run: docker container inspect functional-034793 --format={{.State.Status}}
I0731 10:44:35.773399  494208 ssh_runner.go:195] Run: systemctl --version
I0731 10:44:35.773453  494208 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-034793
I0731 10:44:35.796979  494208 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35520 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/functional-034793/id_rsa Username:docker}
I0731 10:44:35.892021  494208 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.46s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-034793 image ls --format yaml --alsologtostderr:
- id: bcb9e554eaab606a5237b493a9a52ec01b8c29a4e49306184916b1bffca38540
repoDigests: []
repoTags:
- registry.k8s.io/kube-scheduler:v1.27.3
size: "56200000"
- id: 829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.9
size: "514000"
- id: ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91
repoDigests: []
repoTags:
- gcr.io/google-containers/addon-resizer:functional-034793
size: "32900000"
- id: 20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8
repoDigests: []
repoTags:
- docker.io/kubernetesui/dashboard:<none>
size: "244000000"
- id: a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a
repoDigests: []
repoTags:
- docker.io/kubernetesui/metrics-scraper:<none>
size: "42300000"
- id: 3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "484000"
- id: 8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "525000"
- id: 8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "240000"
- id: ff78c7a65ec2b1fb09f58b27b0dd022ac1f4e16b9bcfe1cbdc18c36f2e0e1842
repoDigests: []
repoTags:
- docker.io/library/nginx:latest
size: "192000000"
- id: 39dfb036b0986d18c80ba0cc45d2fd7256751d89ce9a477aac067fad9e14c473
repoDigests: []
repoTags:
- registry.k8s.io/kube-apiserver:v1.27.3
size: "115000000"
- id: ab3683b584ae5afe0953106b2d8e470280eda3375ccd715feb601acc2d0611b8
repoDigests: []
repoTags:
- registry.k8s.io/kube-controller-manager:v1.27.3
size: "107000000"
- id: 1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "3550000"
- id: 72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests: []
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "85000000"
- id: 66bf2c914bf4d0aac4b62f09f9f74ad35898d613024a0f2ec94dca9e79fac6ea
repoDigests: []
repoTags:
- docker.io/library/nginx:alpine
size: "41000000"
- id: fb73e92641fd5ab6e5494f0c583616af0bdcc20bc15e4ec7a2e456190f11909a
repoDigests: []
repoTags:
- registry.k8s.io/kube-proxy:v1.27.3
size: "66500000"
- id: 24bc64e911039ecf00e263be2161797c758b7d82403ca5516ab64047a477f737
repoDigests: []
repoTags:
- registry.k8s.io/etcd:3.5.7-0
size: "181000000"
- id: 68c58c69f5bed18d23ac620e0a3921b4269c27fc5cb30c23f25a5018d0554df4
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-034793
size: "30"
- id: 97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108
repoDigests: []
repoTags:
- registry.k8s.io/coredns/coredns:v1.10.1
size: "51400000"
- id: ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests: []
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "29000000"

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-034793 image ls --format yaml --alsologtostderr:
I0731 10:44:33.275644  493641 out.go:296] Setting OutFile to fd 1 ...
I0731 10:44:33.275873  493641 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0731 10:44:33.275888  493641 out.go:309] Setting ErrFile to fd 2...
I0731 10:44:33.275896  493641 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0731 10:44:33.276196  493641 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16969-448039/.minikube/bin
I0731 10:44:33.276868  493641 config.go:182] Loaded profile config "functional-034793": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0731 10:44:33.276986  493641 config.go:182] Loaded profile config "functional-034793": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0731 10:44:33.277456  493641 cli_runner.go:164] Run: docker container inspect functional-034793 --format={{.State.Status}}
I0731 10:44:33.336224  493641 ssh_runner.go:195] Run: systemctl --version
I0731 10:44:33.336277  493641 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-034793
I0731 10:44:33.418820  493641 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35520 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/functional-034793/id_rsa Username:docker}
I0731 10:44:33.519526  493641 ssh_runner.go:195] Run: docker images --no-trunc --format "{{json .}}"
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.46s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (3.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 ssh pgrep buildkitd: exit status 1 (637.793564ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image build -t localhost/my-image:functional-034793 testdata/build --alsologtostderr
functional_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p functional-034793 image build -t localhost/my-image:functional-034793 testdata/build --alsologtostderr: (2.197836127s)
functional_test.go:322: (dbg) Stderr: out/minikube-linux-arm64 -p functional-034793 image build -t localhost/my-image:functional-034793 testdata/build --alsologtostderr:
I0731 10:44:34.285361  493938 out.go:296] Setting OutFile to fd 1 ...
I0731 10:44:34.286238  493938 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0731 10:44:34.286254  493938 out.go:309] Setting ErrFile to fd 2...
I0731 10:44:34.286261  493938 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0731 10:44:34.286545  493938 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16969-448039/.minikube/bin
I0731 10:44:34.287221  493938 config.go:182] Loaded profile config "functional-034793": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0731 10:44:34.287835  493938 config.go:182] Loaded profile config "functional-034793": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
I0731 10:44:34.288373  493938 cli_runner.go:164] Run: docker container inspect functional-034793 --format={{.State.Status}}
I0731 10:44:34.307721  493938 ssh_runner.go:195] Run: systemctl --version
I0731 10:44:34.307775  493938 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-034793
I0731 10:44:34.326828  493938 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35520 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/functional-034793/id_rsa Username:docker}
I0731 10:44:34.422204  493938 build_images.go:151] Building image from path: /tmp/build.1290520931.tar
I0731 10:44:34.422279  493938 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0731 10:44:34.433053  493938 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.1290520931.tar
I0731 10:44:34.437817  493938 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.1290520931.tar: stat -c "%s %y" /var/lib/minikube/build/build.1290520931.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.1290520931.tar': No such file or directory
I0731 10:44:34.437850  493938 ssh_runner.go:362] scp /tmp/build.1290520931.tar --> /var/lib/minikube/build/build.1290520931.tar (3072 bytes)
I0731 10:44:34.476503  493938 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.1290520931
I0731 10:44:34.487934  493938 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.1290520931 -xf /var/lib/minikube/build/build.1290520931.tar
I0731 10:44:34.499193  493938 docker.go:339] Building image: /var/lib/minikube/build/build.1290520931
I0731 10:44:34.499261  493938 ssh_runner.go:195] Run: docker build -t localhost/my-image:functional-034793 /var/lib/minikube/build/build.1290520931
#0 building with "default" instance using docker driver

                                                
                                                
#1 [internal] load .dockerignore
#1 transferring context: 2B done
#1 DONE 0.1s

                                                
                                                
#2 [internal] load build definition from Dockerfile
#2 transferring dockerfile: 97B done
#2 DONE 0.1s

                                                
                                                
#3 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#3 DONE 0.8s

                                                
                                                
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.0s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 sha256:a77fe109c026308f149d36484d795b42efe0fd29b332be9071f63e1634c36ac9 527B / 527B done
#5 sha256:71a676dd070f4b701c3272e566d84951362f1326ea07d5bbad119d1c4f6b3d02 1.47kB / 1.47kB done
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0B / 828.50kB 0.1s
#5 sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 770B / 770B done
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 828.50kB / 828.50kB 0.2s done
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0.0s done
#5 DONE 0.4s

                                                
                                                
#6 [2/3] RUN true
#6 DONE 0.3s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.0s

                                                
                                                
#8 exporting to image
#8 exporting layers 0.0s done
#8 writing image sha256:09d393316fba87ed191b3defc6a739fe3cb3cb1d2ffa530ba9cd949a878edde2 done
#8 naming to localhost/my-image:functional-034793 done
#8 DONE 0.0s
I0731 10:44:36.396184  493938 ssh_runner.go:235] Completed: docker build -t localhost/my-image:functional-034793 /var/lib/minikube/build/build.1290520931: (1.896895475s)
I0731 10:44:36.396269  493938 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.1290520931
I0731 10:44:36.407419  493938 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.1290520931.tar
I0731 10:44:36.418191  493938 build_images.go:207] Built localhost/my-image:functional-034793 from /tmp/build.1290520931.tar
I0731 10:44:36.418221  493938 build_images.go:123] succeeded building to: functional-034793
I0731 10:44:36.418226  493938 build_images.go:124] failed building to: 
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (3.06s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (2.73s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:341: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (2.687713583s)
functional_test.go:346: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-034793
--- PASS: TestFunctional/parallel/ImageCommands/Setup (2.73s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv/bash (1.68s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv/bash
functional_test.go:495: (dbg) Run:  /bin/bash -c "eval $(out/minikube-linux-arm64 -p functional-034793 docker-env) && out/minikube-linux-arm64 status -p functional-034793"
functional_test.go:495: (dbg) Done: /bin/bash -c "eval $(out/minikube-linux-arm64 -p functional-034793 docker-env) && out/minikube-linux-arm64 status -p functional-034793": (1.114029345s)
functional_test.go:518: (dbg) Run:  /bin/bash -c "eval $(out/minikube-linux-arm64 -p functional-034793 docker-env) && docker images"
--- PASS: TestFunctional/parallel/DockerEnv/bash (1.68s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (4.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image load --daemon gcr.io/google-containers/addon-resizer:functional-034793 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-linux-arm64 -p functional-034793 image load --daemon gcr.io/google-containers/addon-resizer:functional-034793 --alsologtostderr: (4.121727414s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (4.38s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (10.36s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1436: (dbg) Run:  kubectl --context functional-034793 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1444: (dbg) Run:  kubectl --context functional-034793 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-7b684b55f9-mgrhc" [bf34e2a5-690a-48e7-94a7-a7f246181d9f] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-7b684b55f9-mgrhc" [bf34e2a5-690a-48e7-94a7-a7f246181d9f] Running
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 10.036656702s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (10.36s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (2.94s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image load --daemon gcr.io/google-containers/addon-resizer:functional-034793 --alsologtostderr
functional_test.go:364: (dbg) Done: out/minikube-linux-arm64 -p functional-034793 image load --daemon gcr.io/google-containers/addon-resizer:functional-034793 --alsologtostderr: (2.706091578s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (2.94s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (5.72s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:234: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (1.742238554s)
functional_test.go:239: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-034793
functional_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image load --daemon gcr.io/google-containers/addon-resizer:functional-034793 --alsologtostderr
E0731 10:43:45.063238  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
functional_test.go:244: (dbg) Done: out/minikube-linux-arm64 -p functional-034793 image load --daemon gcr.io/google-containers/addon-resizer:functional-034793 --alsologtostderr: (3.657228651s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (5.72s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.48s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1458: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.48s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1488: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 service list -o json
functional_test.go:1493: Took "468.394941ms" to run "out/minikube-linux-arm64 -p functional-034793 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.47s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (1.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image save gcr.io/google-containers/addon-resizer:functional-034793 /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr
functional_test.go:379: (dbg) Done: out/minikube-linux-arm64 -p functional-034793 image save gcr.io/google-containers/addon-resizer:functional-034793 /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr: (1.144024529s)
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (1.14s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.48s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1508: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 service --namespace=default --https --url hello-node
functional_test.go:1521: found endpoint: https://192.168.49.2:32720
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.48s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.65s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1539: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.65s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.64s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image rm gcr.io/google-containers/addon-resizer:functional-034793 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.64s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.53s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1558: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 service hello-node --url
functional_test.go:1564: found endpoint for hello-node: http://192.168.49.2:32720
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.53s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.69s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image load /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr
functional_test.go:408: (dbg) Done: out/minikube-linux-arm64 -p functional-034793 image load /home/jenkins/workspace/Docker_Linux_docker_arm64/addon-resizer-save.tar --alsologtostderr: (1.233480725s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.69s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.8s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-034793 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-034793 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-034793 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 489422: os: process already finished
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-034793 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.80s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (3.19s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-034793
functional_test.go:423: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 image save --daemon gcr.io/google-containers/addon-resizer:functional-034793 --alsologtostderr
functional_test.go:423: (dbg) Done: out/minikube-linux-arm64 -p functional-034793 image save --daemon gcr.io/google-containers/addon-resizer:functional-034793 --alsologtostderr: (3.112880796s)
functional_test.go:428: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-034793
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (3.19s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-arm64 -p functional-034793 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.68s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-034793 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [2b9cc0c8-43eb-4dc0-b693-40aa072ea349] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [2b9cc0c8-43eb-4dc0-b693-40aa072ea349] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 8.021126006s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.68s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-034793 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.109.56.248 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-arm64 -p functional-034793 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.44s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1269: (dbg) Run:  out/minikube-linux-arm64 profile lis
functional_test.go:1274: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.44s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.43s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1309: (dbg) Run:  out/minikube-linux-arm64 profile list
functional_test.go:1314: Took "371.101359ms" to run "out/minikube-linux-arm64 profile list"
functional_test.go:1323: (dbg) Run:  out/minikube-linux-arm64 profile list -l
functional_test.go:1328: Took "56.425849ms" to run "out/minikube-linux-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.43s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.43s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1360: (dbg) Run:  out/minikube-linux-arm64 profile list -o json
functional_test.go:1365: Took "363.275461ms" to run "out/minikube-linux-arm64 profile list -o json"
functional_test.go:1373: (dbg) Run:  out/minikube-linux-arm64 profile list -o json --light
functional_test.go:1378: Took "62.299244ms" to run "out/minikube-linux-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.43s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (7.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-034793 /tmp/TestFunctionalparallelMountCmdany-port1997260217/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1690800250186241151" to /tmp/TestFunctionalparallelMountCmdany-port1997260217/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1690800250186241151" to /tmp/TestFunctionalparallelMountCmdany-port1997260217/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1690800250186241151" to /tmp/TestFunctionalparallelMountCmdany-port1997260217/001/test-1690800250186241151
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (381.573633ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Jul 31 10:44 created-by-test
-rw-r--r-- 1 docker docker 24 Jul 31 10:44 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Jul 31 10:44 test-1690800250186241151
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh cat /mount-9p/test-1690800250186241151
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-034793 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [1c72dbd7-1d9a-4797-886d-a4dc33e511c3] Pending
helpers_test.go:344: "busybox-mount" [1c72dbd7-1d9a-4797-886d-a4dc33e511c3] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [1c72dbd7-1d9a-4797-886d-a4dc33e511c3] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [1c72dbd7-1d9a-4797-886d-a4dc33e511c3] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 4.018476134s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-034793 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-034793 /tmp/TestFunctionalparallelMountCmdany-port1997260217/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (7.45s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (2.61s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-034793 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2687081926/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-034793 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2687081926/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-034793 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2687081926/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T" /mount1: exit status 1 (889.036774ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-034793 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-arm64 mount -p functional-034793 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-034793 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2687081926/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-034793 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2687081926/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-034793 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2687081926/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (2.61s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.09s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-034793
--- PASS: TestFunctional/delete_addon-resizer_images (0.09s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-034793
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-034793
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestImageBuild/serial/Setup (34.53s)

                                                
                                                
=== RUN   TestImageBuild/serial/Setup
image_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -p image-550283 --driver=docker  --container-runtime=docker
E0731 10:44:46.504272  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
image_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -p image-550283 --driver=docker  --container-runtime=docker: (34.532271038s)
--- PASS: TestImageBuild/serial/Setup (34.53s)

                                                
                                    
x
+
TestImageBuild/serial/NormalBuild (1.93s)

                                                
                                                
=== RUN   TestImageBuild/serial/NormalBuild
image_test.go:78: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal -p image-550283
image_test.go:78: (dbg) Done: out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal -p image-550283: (1.925270882s)
--- PASS: TestImageBuild/serial/NormalBuild (1.93s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithBuildArg (0.89s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithBuildArg
image_test.go:99: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest --build-opt=build-arg=ENV_A=test_env_str --build-opt=no-cache ./testdata/image-build/test-arg -p image-550283
--- PASS: TestImageBuild/serial/BuildWithBuildArg (0.89s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithDockerIgnore (0.75s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithDockerIgnore
image_test.go:133: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest ./testdata/image-build/test-normal --build-opt=no-cache -p image-550283
--- PASS: TestImageBuild/serial/BuildWithDockerIgnore (0.75s)

                                                
                                    
x
+
TestImageBuild/serial/BuildWithSpecifiedDockerfile (0.73s)

                                                
                                                
=== RUN   TestImageBuild/serial/BuildWithSpecifiedDockerfile
image_test.go:88: (dbg) Run:  out/minikube-linux-arm64 image build -t aaa:latest -f inner/Dockerfile ./testdata/image-build/test-f -p image-550283
--- PASS: TestImageBuild/serial/BuildWithSpecifiedDockerfile (0.73s)

                                                
                                    
x
+
TestIngressAddonLegacy/StartLegacyK8sCluster (72.87s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/StartLegacyK8sCluster
ingress_addon_legacy_test.go:39: (dbg) Run:  out/minikube-linux-arm64 start -p ingress-addon-legacy-192573 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker
E0731 10:46:08.425318  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
ingress_addon_legacy_test.go:39: (dbg) Done: out/minikube-linux-arm64 start -p ingress-addon-legacy-192573 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: (1m12.866490136s)
--- PASS: TestIngressAddonLegacy/StartLegacyK8sCluster (72.87s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (11.2s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddonActivation
ingress_addon_legacy_test.go:70: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-192573 addons enable ingress --alsologtostderr -v=5
ingress_addon_legacy_test.go:70: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-192573 addons enable ingress --alsologtostderr -v=5: (11.196806274s)
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (11.20s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.61s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation
ingress_addon_legacy_test.go:79: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-192573 addons enable ingress-dns --alsologtostderr -v=5
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.61s)

                                                
                                    
x
+
TestJSONOutput/start/Command (58.25s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-397201 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=docker
E0731 10:48:24.580255  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 10:48:35.699364  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 10:48:35.704727  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 10:48:35.715051  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 10:48:35.735327  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 10:48:35.775567  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 10:48:35.855888  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 10:48:36.016388  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 10:48:36.337011  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 10:48:36.977906  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 10:48:38.258824  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 start -p json-output-397201 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=docker: (58.247756789s)
--- PASS: TestJSONOutput/start/Command (58.25s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.62s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 pause -p json-output-397201 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.62s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.58s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 unpause -p json-output-397201 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.58s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (5.85s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 stop -p json-output-397201 --output=json --user=testUser
E0731 10:48:40.819525  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 10:48:45.940150  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 stop -p json-output-397201 --output=json --user=testUser: (5.846613088s)
--- PASS: TestJSONOutput/stop/Command (5.85s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.24s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-error-209664 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p json-output-error-209664 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (82.189578ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"c120c509-0676-4f76-a8c2-277f0dae883b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-209664] minikube v1.31.1 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"3e78b656-349a-491f-96d5-b89fb779e08f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=16969"}}
	{"specversion":"1.0","id":"d38c3d79-35a2-4d11-8f05-36e230e10cdd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"d48985e1-5a26-40d5-ac2d-e62949472b1e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/16969-448039/kubeconfig"}}
	{"specversion":"1.0","id":"068c0386-6192-4ae3-84ff-8c3542deb20c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/16969-448039/.minikube"}}
	{"specversion":"1.0","id":"a54d096d-d58f-427d-b20a-e83e2a410d1b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"c5d94532-62ad-43b8-a704-80b5d2cd84b7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"971bebdd-fac7-4b0e-a510-9928ee3893d3","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-209664" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p json-output-error-209664
--- PASS: TestErrorJSONOutput (0.24s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (37.64s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-939745 --network=
E0731 10:48:52.266325  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 10:48:56.180805  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 10:49:16.661513  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-939745 --network=: (35.459861455s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-939745" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-939745
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-939745: (2.158849634s)
--- PASS: TestKicCustomNetwork/create_custom_network (37.64s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (37.06s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-880717 --network=bridge
E0731 10:49:57.622631  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-880717 --network=bridge: (35.061486878s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-880717" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-880717
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-880717: (1.974264975s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (37.06s)

                                                
                                    
x
+
TestKicExistingNetwork (31.58s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-arm64 start -p existing-network-828858 --network=existing-network
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-arm64 start -p existing-network-828858 --network=existing-network: (29.436458898s)
helpers_test.go:175: Cleaning up "existing-network-828858" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p existing-network-828858
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p existing-network-828858: (1.967507917s)
--- PASS: TestKicExistingNetwork (31.58s)

                                                
                                    
x
+
TestKicCustomSubnet (37.52s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-subnet-798292 --subnet=192.168.60.0/24
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-subnet-798292 --subnet=192.168.60.0/24: (35.328089637s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-798292 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-798292" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p custom-subnet-798292
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p custom-subnet-798292: (2.169715377s)
--- PASS: TestKicCustomSubnet (37.52s)

                                                
                                    
x
+
TestKicStaticIP (36.19s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-arm64 start -p static-ip-682069 --static-ip=192.168.200.200
E0731 10:51:19.544501  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 10:51:45.049424  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
E0731 10:51:45.055120  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
E0731 10:51:45.065393  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
E0731 10:51:45.085655  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
E0731 10:51:45.125992  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
E0731 10:51:45.206261  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
E0731 10:51:45.366604  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
E0731 10:51:45.687079  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-arm64 start -p static-ip-682069 --static-ip=192.168.200.200: (33.95395073s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-arm64 -p static-ip-682069 ip
helpers_test.go:175: Cleaning up "static-ip-682069" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p static-ip-682069
E0731 10:51:46.328073  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
E0731 10:51:47.608317  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p static-ip-682069: (2.076593882s)
--- PASS: TestKicStaticIP (36.19s)

                                                
                                    
x
+
TestMainNoArgs (0.06s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-arm64
--- PASS: TestMainNoArgs (0.06s)

                                                
                                    
x
+
TestMinikubeProfile (76.43s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p first-055125 --driver=docker  --container-runtime=docker
E0731 10:51:50.168541  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
E0731 10:51:55.289151  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
E0731 10:52:05.530173  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p first-055125 --driver=docker  --container-runtime=docker: (32.299280144s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p second-058202 --driver=docker  --container-runtime=docker
E0731 10:52:26.011079  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p second-058202 --driver=docker  --container-runtime=docker: (38.351799785s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile first-055125
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile second-058202
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
helpers_test.go:175: Cleaning up "second-058202" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p second-058202
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p second-058202: (2.229899339s)
helpers_test.go:175: Cleaning up "first-055125" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p first-055125
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p first-055125: (2.153043328s)
--- PASS: TestMinikubeProfile (76.43s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (8.03s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-1-671983 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker
E0731 10:53:06.971395  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-1-671983 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker: (7.027866106s)
--- PASS: TestMountStart/serial/StartWithMountFirst (8.03s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.29s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-1-671983 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.29s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (8.55s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-673944 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-673944 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=docker: (7.553519615s)
--- PASS: TestMountStart/serial/StartWithMountSecond (8.55s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.29s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-673944 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.29s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.53s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p mount-start-1-671983 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p mount-start-1-671983 --alsologtostderr -v=5: (1.53395186s)
--- PASS: TestMountStart/serial/DeleteFirst (1.53s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.29s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-673944 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.29s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.22s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-arm64 stop -p mount-start-2-673944
E0731 10:53:24.580166  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
mount_start_test.go:155: (dbg) Done: out/minikube-linux-arm64 stop -p mount-start-2-673944: (1.220620557s)
--- PASS: TestMountStart/serial/Stop (1.22s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (8.31s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-673944
mount_start_test.go:166: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-673944: (7.306842497s)
--- PASS: TestMountStart/serial/RestartStopped (8.31s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.28s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-673944 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.28s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (82.93s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:85: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-791561 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=docker
E0731 10:53:35.699606  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 10:54:03.385094  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 10:54:28.891829  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
multinode_test.go:85: (dbg) Done: out/minikube-linux-arm64 start -p multinode-791561 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=docker: (1m22.364574004s)
multinode_test.go:91: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (82.93s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (43.31s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:481: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:486: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- rollout status deployment/busybox
multinode_test.go:486: (dbg) Done: out/minikube-linux-arm64 kubectl -p multinode-791561 -- rollout status deployment/busybox: (2.739572724s)
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:502: expected 2 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.3'\n\n-- /stdout --"
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:516: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:524: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- exec busybox-67b7f59bb-jxzqp -- nslookup kubernetes.io
multinode_test.go:524: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- exec busybox-67b7f59bb-x66hg -- nslookup kubernetes.io
multinode_test.go:534: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- exec busybox-67b7f59bb-jxzqp -- nslookup kubernetes.default
multinode_test.go:534: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- exec busybox-67b7f59bb-x66hg -- nslookup kubernetes.default
multinode_test.go:542: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- exec busybox-67b7f59bb-jxzqp -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:542: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- exec busybox-67b7f59bb-x66hg -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (43.31s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (1.21s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:552: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:560: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- exec busybox-67b7f59bb-jxzqp -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- exec busybox-67b7f59bb-jxzqp -- sh -c "ping -c 1 192.168.58.1"
multinode_test.go:560: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- exec busybox-67b7f59bb-x66hg -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-791561 -- exec busybox-67b7f59bb-x66hg -- sh -c "ping -c 1 192.168.58.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (1.21s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (18.28s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:110: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-791561 -v 3 --alsologtostderr
multinode_test.go:110: (dbg) Done: out/minikube-linux-arm64 node add -p multinode-791561 -v 3 --alsologtostderr: (17.283081353s)
multinode_test.go:116: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (18.28s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.35s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:132: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.35s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (11.38s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:173: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 cp testdata/cp-test.txt multinode-791561:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 cp multinode-791561:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1249244321/001/cp-test_multinode-791561.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 cp multinode-791561:/home/docker/cp-test.txt multinode-791561-m02:/home/docker/cp-test_multinode-791561_multinode-791561-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561-m02 "sudo cat /home/docker/cp-test_multinode-791561_multinode-791561-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 cp multinode-791561:/home/docker/cp-test.txt multinode-791561-m03:/home/docker/cp-test_multinode-791561_multinode-791561-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561-m03 "sudo cat /home/docker/cp-test_multinode-791561_multinode-791561-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 cp testdata/cp-test.txt multinode-791561-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 cp multinode-791561-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1249244321/001/cp-test_multinode-791561-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 cp multinode-791561-m02:/home/docker/cp-test.txt multinode-791561:/home/docker/cp-test_multinode-791561-m02_multinode-791561.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561 "sudo cat /home/docker/cp-test_multinode-791561-m02_multinode-791561.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 cp multinode-791561-m02:/home/docker/cp-test.txt multinode-791561-m03:/home/docker/cp-test_multinode-791561-m02_multinode-791561-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561-m03 "sudo cat /home/docker/cp-test_multinode-791561-m02_multinode-791561-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 cp testdata/cp-test.txt multinode-791561-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 cp multinode-791561-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile1249244321/001/cp-test_multinode-791561-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 cp multinode-791561-m03:/home/docker/cp-test.txt multinode-791561:/home/docker/cp-test_multinode-791561-m03_multinode-791561.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561 "sudo cat /home/docker/cp-test_multinode-791561-m03_multinode-791561.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 cp multinode-791561-m03:/home/docker/cp-test.txt multinode-791561-m02:/home/docker/cp-test_multinode-791561-m03_multinode-791561-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 ssh -n multinode-791561-m02 "sudo cat /home/docker/cp-test_multinode-791561-m03_multinode-791561-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (11.38s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.42s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:210: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 node stop m03
multinode_test.go:210: (dbg) Done: out/minikube-linux-arm64 -p multinode-791561 node stop m03: (1.247869666s)
multinode_test.go:216: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 status
multinode_test.go:216: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-791561 status: exit status 7 (584.855229ms)

                                                
                                                
-- stdout --
	multinode-791561
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-791561-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-791561-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:223: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 status --alsologtostderr
multinode_test.go:223: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-791561 status --alsologtostderr: exit status 7 (584.646992ms)

                                                
                                                
-- stdout --
	multinode-791561
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-791561-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-791561-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0731 10:56:14.475571  558752 out.go:296] Setting OutFile to fd 1 ...
	I0731 10:56:14.475745  558752 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0731 10:56:14.475759  558752 out.go:309] Setting ErrFile to fd 2...
	I0731 10:56:14.475765  558752 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0731 10:56:14.476036  558752 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16969-448039/.minikube/bin
	I0731 10:56:14.476246  558752 out.go:303] Setting JSON to false
	I0731 10:56:14.476336  558752 mustload.go:65] Loading cluster: multinode-791561
	I0731 10:56:14.476429  558752 notify.go:220] Checking for updates...
	I0731 10:56:14.476715  558752 config.go:182] Loaded profile config "multinode-791561": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0731 10:56:14.476724  558752 status.go:255] checking status of multinode-791561 ...
	I0731 10:56:14.477212  558752 cli_runner.go:164] Run: docker container inspect multinode-791561 --format={{.State.Status}}
	I0731 10:56:14.496352  558752 status.go:330] multinode-791561 host status = "Running" (err=<nil>)
	I0731 10:56:14.496377  558752 host.go:66] Checking if "multinode-791561" exists ...
	I0731 10:56:14.496663  558752 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-791561
	I0731 10:56:14.518959  558752 host.go:66] Checking if "multinode-791561" exists ...
	I0731 10:56:14.519386  558752 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0731 10:56:14.519453  558752 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-791561
	I0731 10:56:14.549724  558752 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35590 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/multinode-791561/id_rsa Username:docker}
	I0731 10:56:14.646579  558752 ssh_runner.go:195] Run: systemctl --version
	I0731 10:56:14.652632  558752 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0731 10:56:14.667101  558752 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0731 10:56:14.750494  558752 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:40 OomKillDisable:true NGoroutines:55 SystemTime:2023-07-31 10:56:14.739902699 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1040-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215171072 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.5 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.20.2]] Warnings:<nil>}}
	I0731 10:56:14.751158  558752 kubeconfig.go:92] found "multinode-791561" server: "https://192.168.58.2:8443"
	I0731 10:56:14.751197  558752 api_server.go:166] Checking apiserver status ...
	I0731 10:56:14.751240  558752 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0731 10:56:14.765345  558752 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/2166/cgroup
	I0731 10:56:14.777606  558752 api_server.go:182] apiserver freezer: "11:freezer:/docker/a44baaabc3062646e35629a014e4c21e9c9bd0cd01d8e3439c0483a6859f7fd3/kubepods/burstable/pod7134e6b54070f264fe32b2fb494be3c4/78ba2d73aad09947217914bc5856a62647539810cc831ed57a599f02aee8dbbc"
	I0731 10:56:14.777711  558752 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/a44baaabc3062646e35629a014e4c21e9c9bd0cd01d8e3439c0483a6859f7fd3/kubepods/burstable/pod7134e6b54070f264fe32b2fb494be3c4/78ba2d73aad09947217914bc5856a62647539810cc831ed57a599f02aee8dbbc/freezer.state
	I0731 10:56:14.788863  558752 api_server.go:204] freezer state: "THAWED"
	I0731 10:56:14.788891  558752 api_server.go:253] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...
	I0731 10:56:14.798067  558752 api_server.go:279] https://192.168.58.2:8443/healthz returned 200:
	ok
	I0731 10:56:14.798142  558752 status.go:421] multinode-791561 apiserver status = Running (err=<nil>)
	I0731 10:56:14.798159  558752 status.go:257] multinode-791561 status: &{Name:multinode-791561 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0731 10:56:14.798180  558752 status.go:255] checking status of multinode-791561-m02 ...
	I0731 10:56:14.798495  558752 cli_runner.go:164] Run: docker container inspect multinode-791561-m02 --format={{.State.Status}}
	I0731 10:56:14.820632  558752 status.go:330] multinode-791561-m02 host status = "Running" (err=<nil>)
	I0731 10:56:14.820658  558752 host.go:66] Checking if "multinode-791561-m02" exists ...
	I0731 10:56:14.820975  558752 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-791561-m02
	I0731 10:56:14.841579  558752 host.go:66] Checking if "multinode-791561-m02" exists ...
	I0731 10:56:14.841918  558752 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0731 10:56:14.841968  558752 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-791561-m02
	I0731 10:56:14.865513  558752 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35595 SSHKeyPath:/home/jenkins/minikube-integration/16969-448039/.minikube/machines/multinode-791561-m02/id_rsa Username:docker}
	I0731 10:56:14.958732  558752 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0731 10:56:14.973531  558752 status.go:257] multinode-791561-m02 status: &{Name:multinode-791561-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0731 10:56:14.973567  558752 status.go:255] checking status of multinode-791561-m03 ...
	I0731 10:56:14.973872  558752 cli_runner.go:164] Run: docker container inspect multinode-791561-m03 --format={{.State.Status}}
	I0731 10:56:14.996173  558752 status.go:330] multinode-791561-m03 host status = "Stopped" (err=<nil>)
	I0731 10:56:14.996199  558752 status.go:343] host is not running, skipping remaining checks
	I0731 10:56:14.996206  558752 status.go:257] multinode-791561-m03 status: &{Name:multinode-791561-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.42s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (14.53s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:244: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:254: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 node start m03 --alsologtostderr
multinode_test.go:254: (dbg) Done: out/minikube-linux-arm64 -p multinode-791561 node start m03 --alsologtostderr: (13.634535714s)
multinode_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 status
multinode_test.go:275: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (14.53s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (128.52s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:283: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-791561
multinode_test.go:290: (dbg) Run:  out/minikube-linux-arm64 stop -p multinode-791561
E0731 10:56:45.049197  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
multinode_test.go:290: (dbg) Done: out/minikube-linux-arm64 stop -p multinode-791561: (22.723932214s)
multinode_test.go:295: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-791561 --wait=true -v=8 --alsologtostderr
E0731 10:57:12.732904  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
E0731 10:58:24.580882  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 10:58:35.699000  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
multinode_test.go:295: (dbg) Done: out/minikube-linux-arm64 start -p multinode-791561 --wait=true -v=8 --alsologtostderr: (1m45.653057468s)
multinode_test.go:300: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-791561
--- PASS: TestMultiNode/serial/RestartKeepsNodes (128.52s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.32s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:394: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 node delete m03
multinode_test.go:394: (dbg) Done: out/minikube-linux-arm64 -p multinode-791561 node delete m03: (4.467008608s)
multinode_test.go:400: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 status --alsologtostderr
multinode_test.go:414: (dbg) Run:  docker volume ls
multinode_test.go:424: (dbg) Run:  kubectl get nodes
multinode_test.go:432: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.32s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (21.79s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 stop
multinode_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p multinode-791561 stop: (21.591878367s)
multinode_test.go:320: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 status
multinode_test.go:320: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-791561 status: exit status 7 (95.708611ms)

                                                
                                                
-- stdout --
	multinode-791561
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-791561-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:327: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 status --alsologtostderr
multinode_test.go:327: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-791561 status --alsologtostderr: exit status 7 (100.642293ms)

                                                
                                                
-- stdout --
	multinode-791561
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-791561-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0731 10:59:05.112229  574666 out.go:296] Setting OutFile to fd 1 ...
	I0731 10:59:05.112436  574666 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0731 10:59:05.112461  574666 out.go:309] Setting ErrFile to fd 2...
	I0731 10:59:05.112480  574666 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0731 10:59:05.112787  574666 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16969-448039/.minikube/bin
	I0731 10:59:05.113009  574666 out.go:303] Setting JSON to false
	I0731 10:59:05.113190  574666 mustload.go:65] Loading cluster: multinode-791561
	I0731 10:59:05.113297  574666 notify.go:220] Checking for updates...
	I0731 10:59:05.113727  574666 config.go:182] Loaded profile config "multinode-791561": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.27.3
	I0731 10:59:05.113769  574666 status.go:255] checking status of multinode-791561 ...
	I0731 10:59:05.115645  574666 cli_runner.go:164] Run: docker container inspect multinode-791561 --format={{.State.Status}}
	I0731 10:59:05.134541  574666 status.go:330] multinode-791561 host status = "Stopped" (err=<nil>)
	I0731 10:59:05.134561  574666 status.go:343] host is not running, skipping remaining checks
	I0731 10:59:05.134568  574666 status.go:257] multinode-791561 status: &{Name:multinode-791561 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0731 10:59:05.134593  574666 status.go:255] checking status of multinode-791561-m02 ...
	I0731 10:59:05.134920  574666 cli_runner.go:164] Run: docker container inspect multinode-791561-m02 --format={{.State.Status}}
	I0731 10:59:05.155328  574666 status.go:330] multinode-791561-m02 host status = "Stopped" (err=<nil>)
	I0731 10:59:05.155349  574666 status.go:343] host is not running, skipping remaining checks
	I0731 10:59:05.155357  574666 status.go:257] multinode-791561-m02 status: &{Name:multinode-791561-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (21.79s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (84.38s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:344: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:354: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-791561 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=docker
E0731 10:59:47.626764  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
multinode_test.go:354: (dbg) Done: out/minikube-linux-arm64 start -p multinode-791561 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=docker: (1m23.565166614s)
multinode_test.go:360: (dbg) Run:  out/minikube-linux-arm64 -p multinode-791561 status --alsologtostderr
multinode_test.go:374: (dbg) Run:  kubectl get nodes
multinode_test.go:382: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (84.38s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (38.45s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:443: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-791561
multinode_test.go:452: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-791561-m02 --driver=docker  --container-runtime=docker
multinode_test.go:452: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p multinode-791561-m02 --driver=docker  --container-runtime=docker: exit status 14 (88.315606ms)

                                                
                                                
-- stdout --
	* [multinode-791561-m02] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16969
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16969-448039/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16969-448039/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-791561-m02' is duplicated with machine name 'multinode-791561-m02' in profile 'multinode-791561'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:460: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-791561-m03 --driver=docker  --container-runtime=docker
multinode_test.go:460: (dbg) Done: out/minikube-linux-arm64 start -p multinode-791561-m03 --driver=docker  --container-runtime=docker: (35.739726751s)
multinode_test.go:467: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-791561
multinode_test.go:467: (dbg) Non-zero exit: out/minikube-linux-arm64 node add -p multinode-791561: exit status 80 (365.231271ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-791561
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-791561-m03 already exists in multinode-791561-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-arm64 delete -p multinode-791561-m03
multinode_test.go:472: (dbg) Done: out/minikube-linux-arm64 delete -p multinode-791561-m03: (2.208834219s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (38.45s)

                                                
                                    
x
+
TestPreload (164.86s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-882164 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.24.4
E0731 11:01:45.049817  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
preload_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-882164 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.24.4: (1m38.843072564s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-882164 image pull gcr.io/k8s-minikube/busybox
preload_test.go:52: (dbg) Done: out/minikube-linux-arm64 -p test-preload-882164 image pull gcr.io/k8s-minikube/busybox: (1.556186416s)
preload_test.go:58: (dbg) Run:  out/minikube-linux-arm64 stop -p test-preload-882164
preload_test.go:58: (dbg) Done: out/minikube-linux-arm64 stop -p test-preload-882164: (10.959400539s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-882164 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=docker
E0731 11:03:24.580803  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 11:03:35.698994  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
preload_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-882164 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=docker: (51.032035989s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-882164 image list
helpers_test.go:175: Cleaning up "test-preload-882164" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p test-preload-882164
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p test-preload-882164: (2.237890535s)
--- PASS: TestPreload (164.86s)

                                                
                                    
x
+
TestScheduledStopUnix (107.25s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-arm64 start -p scheduled-stop-383841 --memory=2048 --driver=docker  --container-runtime=docker
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-arm64 start -p scheduled-stop-383841 --memory=2048 --driver=docker  --container-runtime=docker: (33.835253326s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-383841 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-arm64 status --format={{.TimeToStop}} -p scheduled-stop-383841 -n scheduled-stop-383841
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-383841 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-383841 --cancel-scheduled
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-383841 -n scheduled-stop-383841
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-383841
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-383841 --schedule 15s
E0731 11:04:58.745329  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-383841
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p scheduled-stop-383841: exit status 7 (82.826997ms)

                                                
                                                
-- stdout --
	scheduled-stop-383841
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-383841 -n scheduled-stop-383841
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-383841 -n scheduled-stop-383841: exit status 7 (74.320604ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-383841" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p scheduled-stop-383841
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p scheduled-stop-383841: (1.720559744s)
--- PASS: TestScheduledStopUnix (107.25s)

                                                
                                    
x
+
TestSkaffold (114.35s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:59: (dbg) Run:  /tmp/skaffold.exe4116323353 version
skaffold_test.go:63: skaffold version: v2.6.0
skaffold_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p skaffold-512220 --memory=2600 --driver=docker  --container-runtime=docker
skaffold_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p skaffold-512220 --memory=2600 --driver=docker  --container-runtime=docker: (37.137014253s)
skaffold_test.go:86: copying out/minikube-linux-arm64 to /home/jenkins/workspace/Docker_Linux_docker_arm64/out/minikube
skaffold_test.go:105: (dbg) Run:  /tmp/skaffold.exe4116323353 run --minikube-profile skaffold-512220 --kube-context skaffold-512220 --status-check=true --port-forward=false --interactive=false
E0731 11:06:45.051145  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
skaffold_test.go:105: (dbg) Done: /tmp/skaffold.exe4116323353 run --minikube-profile skaffold-512220 --kube-context skaffold-512220 --status-check=true --port-forward=false --interactive=false: (1m2.319632262s)
skaffold_test.go:111: (dbg) TestSkaffold: waiting 1m0s for pods matching "app=leeroy-app" in namespace "default" ...
helpers_test.go:344: "leeroy-app-6d47c576b5-8tr7z" [fa8fab91-3174-47b4-a411-1e4ea3f7ed25] Running
skaffold_test.go:111: (dbg) TestSkaffold: app=leeroy-app healthy within 5.035184481s
skaffold_test.go:114: (dbg) TestSkaffold: waiting 1m0s for pods matching "app=leeroy-web" in namespace "default" ...
helpers_test.go:344: "leeroy-web-d58855485-plb74" [ed99c6df-bdc1-4025-9114-f5a4470e3fb0] Running
skaffold_test.go:114: (dbg) TestSkaffold: app=leeroy-web healthy within 5.010479742s
helpers_test.go:175: Cleaning up "skaffold-512220" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p skaffold-512220
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p skaffold-512220: (2.989671721s)
--- PASS: TestSkaffold (114.35s)

                                                
                                    
x
+
TestInsufficientStorage (12.29s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-arm64 start -p insufficient-storage-393867 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=docker
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p insufficient-storage-393867 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=docker: exit status 26 (9.863845106s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"9f9dc2ee-a990-4d73-8569-1e8342c52e75","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-393867] minikube v1.31.1 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"1bec43bd-4f87-4603-b832-ecadaec88452","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=16969"}}
	{"specversion":"1.0","id":"0987db97-588b-48d6-a589-92a4cce4ec17","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"9b7fcc0a-5065-45d9-b231-d8b67b352783","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/16969-448039/kubeconfig"}}
	{"specversion":"1.0","id":"843ea016-277a-4057-b451-6efe971fa4cc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/16969-448039/.minikube"}}
	{"specversion":"1.0","id":"fa1c46ef-9ae9-4f2e-80ba-26aa9ef59b9b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"a29712a8-dbff-44a3-b620-1cc1d5b3d3d4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"c3567af4-96b0-4b60-940b-a3226c08914b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"7b70ffb6-c762-499d-93e7-17e8fe157ab6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"8d189497-ab99-4285-a60c-9389e51ce898","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"fecba211-7523-4506-962c-c8ad1d274cc9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"4627b3ad-c767-4bd5-9856-b37133f496d5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node insufficient-storage-393867 in cluster insufficient-storage-393867","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"ca593580-49b1-4dc9-8f21-157c62e0c9fd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"f054a702-d9de-4fa9-85f3-b392fc7a040b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"4b9161dd-e49c-446f-8159-8a03e94c22a1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-393867 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-393867 --output=json --layout=cluster: exit status 7 (312.620757ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-393867","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.31.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-393867","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0731 11:07:48.705226  610933 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-393867" does not appear in /home/jenkins/minikube-integration/16969-448039/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-393867 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-393867 --output=json --layout=cluster: exit status 7 (348.680999ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-393867","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.31.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-393867","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0731 11:07:49.053430  610987 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-393867" does not appear in /home/jenkins/minikube-integration/16969-448039/kubeconfig
	E0731 11:07:49.067222  610987 status.go:559] unable to read event log: stat: stat /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/insufficient-storage-393867/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-393867" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p insufficient-storage-393867
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p insufficient-storage-393867: (1.759527756s)
--- PASS: TestInsufficientStorage (12.29s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (121.35s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:132: (dbg) Run:  /tmp/minikube-v1.17.0.17636546.exe start -p running-upgrade-382908 --memory=2200 --vm-driver=docker  --container-runtime=docker
E0731 11:13:06.455371  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
version_upgrade_test.go:132: (dbg) Done: /tmp/minikube-v1.17.0.17636546.exe start -p running-upgrade-382908 --memory=2200 --vm-driver=docker  --container-runtime=docker: (1m0.482113273s)
version_upgrade_test.go:142: (dbg) Run:  out/minikube-linux-arm64 start -p running-upgrade-382908 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
version_upgrade_test.go:142: (dbg) Done: out/minikube-linux-arm64 start -p running-upgrade-382908 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (57.265752813s)
helpers_test.go:175: Cleaning up "running-upgrade-382908" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p running-upgrade-382908
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p running-upgrade-382908: (2.629619568s)
--- PASS: TestRunningBinaryUpgrade (121.35s)

                                                
                                    
x
+
TestKubernetesUpgrade (142.24s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:234: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-128719 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
version_upgrade_test.go:234: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-128719 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (1m12.539635739s)
version_upgrade_test.go:239: (dbg) Run:  out/minikube-linux-arm64 stop -p kubernetes-upgrade-128719
version_upgrade_test.go:239: (dbg) Done: out/minikube-linux-arm64 stop -p kubernetes-upgrade-128719: (2.3326111s)
version_upgrade_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p kubernetes-upgrade-128719 status --format={{.Host}}
version_upgrade_test.go:244: (dbg) Non-zero exit: out/minikube-linux-arm64 -p kubernetes-upgrade-128719 status --format={{.Host}}: exit status 7 (106.229501ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:246: status error: exit status 7 (may be ok)
version_upgrade_test.go:255: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-128719 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
version_upgrade_test.go:255: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-128719 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (35.412921604s)
version_upgrade_test.go:260: (dbg) Run:  kubectl --context kubernetes-upgrade-128719 version --output=json
version_upgrade_test.go:279: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:281: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-128719 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=docker
version_upgrade_test.go:281: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p kubernetes-upgrade-128719 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=docker: exit status 106 (109.776551ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-128719] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16969
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16969-448039/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16969-448039/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.27.3 cluster to v1.16.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.16.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-128719
	    minikube start -p kubernetes-upgrade-128719 --kubernetes-version=v1.16.0
	    
	    2) Create a second cluster with Kubernetes 1.16.0, by running:
	    
	    minikube start -p kubernetes-upgrade-1287192 --kubernetes-version=v1.16.0
	    
	    3) Use the existing cluster at version Kubernetes 1.27.3, by running:
	    
	    minikube start -p kubernetes-upgrade-128719 --kubernetes-version=v1.27.3
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:285: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:287: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-128719 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
version_upgrade_test.go:287: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-128719 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (29.521209942s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-128719" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubernetes-upgrade-128719
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p kubernetes-upgrade-128719: (2.091450429s)
--- PASS: TestKubernetesUpgrade (142.24s)

                                                
                                    
x
+
TestMissingContainerUpgrade (201.08s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:321: (dbg) Run:  /tmp/minikube-v1.17.0.1493800541.exe start -p missing-upgrade-841410 --memory=2200 --driver=docker  --container-runtime=docker
version_upgrade_test.go:321: (dbg) Done: /tmp/minikube-v1.17.0.1493800541.exe start -p missing-upgrade-841410 --memory=2200 --driver=docker  --container-runtime=docker: (2m1.538053129s)
version_upgrade_test.go:330: (dbg) Run:  docker stop missing-upgrade-841410
version_upgrade_test.go:330: (dbg) Done: docker stop missing-upgrade-841410: (1.081015674s)
version_upgrade_test.go:335: (dbg) Run:  docker rm missing-upgrade-841410
version_upgrade_test.go:341: (dbg) Run:  out/minikube-linux-arm64 start -p missing-upgrade-841410 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E0731 11:11:45.050073  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
version_upgrade_test.go:341: (dbg) Done: out/minikube-linux-arm64 start -p missing-upgrade-841410 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (1m14.826854271s)
helpers_test.go:175: Cleaning up "missing-upgrade-841410" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p missing-upgrade-841410
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p missing-upgrade-841410: (2.53520778s)
--- PASS: TestMissingContainerUpgrade (201.08s)

                                                
                                    
x
+
TestPause/serial/Start (68.4s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-arm64 start -p pause-060861 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=docker
E0731 11:08:08.093856  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
E0731 11:08:24.580130  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 11:08:35.698756  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
pause_test.go:80: (dbg) Done: out/minikube-linux-arm64 start -p pause-060861 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=docker: (1m8.403117512s)
--- PASS: TestPause/serial/Start (68.40s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (33.97s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-arm64 start -p pause-060861 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
pause_test.go:92: (dbg) Done: out/minikube-linux-arm64 start -p pause-060861 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (33.935224301s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (33.97s)

                                                
                                    
x
+
TestPause/serial/Pause (0.92s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-060861 --alsologtostderr -v=5
--- PASS: TestPause/serial/Pause (0.92s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.47s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p pause-060861 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p pause-060861 --output=json --layout=cluster: exit status 2 (467.003878ms)

                                                
                                                
-- stdout --
	{"Name":"pause-060861","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 12 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.31.1","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-060861","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.47s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.79s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-arm64 unpause -p pause-060861 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.79s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (1.22s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-060861 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-060861 --alsologtostderr -v=5: (1.220203961s)
--- PASS: TestPause/serial/PauseAgain (1.22s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (2.28s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p pause-060861 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p pause-060861 --alsologtostderr -v=5: (2.283264237s)
--- PASS: TestPause/serial/DeletePaused (2.28s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (0.14s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-060861
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-060861: exit status 1 (18.880887ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-060861: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (0.14s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (0.94s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (0.94s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (116.53s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:195: (dbg) Run:  /tmp/minikube-v1.17.0.3456491644.exe start -p stopped-upgrade-929927 --memory=2200 --vm-driver=docker  --container-runtime=docker
E0731 11:12:25.493441  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
E0731 11:12:25.499443  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
E0731 11:12:25.509669  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
E0731 11:12:25.529926  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
E0731 11:12:25.570181  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
E0731 11:12:25.650971  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
E0731 11:12:25.811650  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
E0731 11:12:26.132910  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
E0731 11:12:26.773412  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
E0731 11:12:28.053677  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
E0731 11:12:30.614239  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
E0731 11:12:35.734805  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
E0731 11:12:45.975002  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
version_upgrade_test.go:195: (dbg) Done: /tmp/minikube-v1.17.0.3456491644.exe start -p stopped-upgrade-929927 --memory=2200 --vm-driver=docker  --container-runtime=docker: (1m4.416792675s)
version_upgrade_test.go:204: (dbg) Run:  /tmp/minikube-v1.17.0.3456491644.exe -p stopped-upgrade-929927 stop
version_upgrade_test.go:204: (dbg) Done: /tmp/minikube-v1.17.0.3456491644.exe -p stopped-upgrade-929927 stop: (11.045155303s)
version_upgrade_test.go:210: (dbg) Run:  out/minikube-linux-arm64 start -p stopped-upgrade-929927 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker
E0731 11:13:24.580266  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 11:13:35.698842  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 11:13:47.415806  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
version_upgrade_test.go:210: (dbg) Done: out/minikube-linux-arm64 start -p stopped-upgrade-929927 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (41.066724557s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (116.53s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (2.83s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:218: (dbg) Run:  out/minikube-linux-arm64 logs -p stopped-upgrade-929927
version_upgrade_test.go:218: (dbg) Done: out/minikube-linux-arm64 logs -p stopped-upgrade-929927: (2.825897368s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (2.83s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.08s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-089341 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=docker
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p NoKubernetes-089341 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=docker: exit status 14 (78.27221ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-089341] minikube v1.31.1 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16969
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16969-448039/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16969-448039/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.08s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (45.63s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-089341 --driver=docker  --container-runtime=docker
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-089341 --driver=docker  --container-runtime=docker: (45.208069108s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-089341 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (45.63s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (9.84s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-089341 --no-kubernetes --driver=docker  --container-runtime=docker
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-089341 --no-kubernetes --driver=docker  --container-runtime=docker: (7.399735288s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-089341 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-arm64 -p NoKubernetes-089341 status -o json: exit status 2 (438.717906ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-089341","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-arm64 delete -p NoKubernetes-089341
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-arm64 delete -p NoKubernetes-089341: (2.003073246s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (9.84s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (13.96s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-089341 --no-kubernetes --driver=docker  --container-runtime=docker
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-089341 --no-kubernetes --driver=docker  --container-runtime=docker: (13.955164742s)
--- PASS: TestNoKubernetes/serial/Start (13.96s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.38s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-089341 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-089341 "sudo systemctl is-active --quiet service kubelet": exit status 1 (379.63686ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.38s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (1.24s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-arm64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (1.24s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.29s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-arm64 stop -p NoKubernetes-089341
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-arm64 stop -p NoKubernetes-089341: (1.287348251s)
--- PASS: TestNoKubernetes/serial/Stop (1.29s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (8.63s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-089341 --driver=docker  --container-runtime=docker
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-089341 --driver=docker  --container-runtime=docker: (8.627907441s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (8.63s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.42s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-089341 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-089341 "sudo systemctl is-active --quiet service kubelet": exit status 1 (421.471059ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.42s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (125.27s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-865762 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0
E0731 11:17:53.177896  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
E0731 11:18:24.580442  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 11:18:35.698637  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-865762 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0: (2m5.272201767s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (125.27s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (10.67s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-865762 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [2df83869-7ee3-40d0-aea3-65f630507f57] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [2df83869-7ee3-40d0-aea3-65f630507f57] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 10.033351901s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-865762 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (10.67s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (2.39s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-865762 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-865762 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (2.145583524s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-865762 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (2.39s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (11.5s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p old-k8s-version-865762 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p old-k8s-version-865762 --alsologtostderr -v=3: (11.495676993s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (11.50s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (103.75s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-683697 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-683697 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (1m43.754593026s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (103.75s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.54s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-865762 -n old-k8s-version-865762
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-865762 -n old-k8s-version-865762: exit status 7 (224.25465ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p old-k8s-version-865762 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.54s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (425.08s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-865762 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0
E0731 11:21:38.746410  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 11:21:45.049611  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-865762 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.16.0: (7m4.598590736s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-865762 -n old-k8s-version-865762
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (425.08s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (9.54s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-683697 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [f181ad95-7d8e-45c7-ba55-07abaf6fb58b] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [f181ad95-7d8e-45c7-ba55-07abaf6fb58b] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 9.044784747s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-683697 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (9.54s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.29s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p no-preload-683697 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p no-preload-683697 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.167001376s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-683697 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.29s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (11.03s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p no-preload-683697 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p no-preload-683697 --alsologtostderr -v=3: (11.030574568s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (11.03s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-683697 -n no-preload-683697
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-683697 -n no-preload-683697: exit status 7 (78.252954ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p no-preload-683697 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (323.48s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-683697 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0731 11:22:25.493517  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
E0731 11:23:24.580434  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 11:23:35.698557  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 11:24:48.094493  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
E0731 11:26:45.049874  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-683697 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (5m22.68618029s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-683697 -n no-preload-683697
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (323.48s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.03s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-cx8gt" [2a92c919-c357-4693-97cf-ed90bc80d7db] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.028402777s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.03s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.14s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-cx8gt" [2a92c919-c357-4693-97cf-ed90bc80d7db] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.009650987s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-865762 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.14s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.47s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p old-k8s-version-865762 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.47s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (4.63s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p old-k8s-version-865762 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 pause -p old-k8s-version-865762 --alsologtostderr -v=1: (1.020385991s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-865762 -n old-k8s-version-865762
E0731 11:27:25.493809  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-865762 -n old-k8s-version-865762: exit status 2 (695.941087ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-865762 -n old-k8s-version-865762
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-865762 -n old-k8s-version-865762: exit status 2 (540.060205ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p old-k8s-version-865762 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 unpause -p old-k8s-version-865762 --alsologtostderr -v=1: (1.002460575s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-865762 -n old-k8s-version-865762
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-865762 -n old-k8s-version-865762
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (4.63s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (98.03s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-266705 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-266705 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (1m38.031371757s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (98.03s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (17.05s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-cccm2" [b4bbd5a1-ea09-4476-8320-5e4d1599ba2f] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-cccm2" [b4bbd5a1-ea09-4476-8320-5e4d1599ba2f] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 17.043715054s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (17.05s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.13s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-cccm2" [b4bbd5a1-ea09-4476-8320-5e4d1599ba2f] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.015505998s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-683697 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.13s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.46s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p no-preload-683697 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.46s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (4.26s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p no-preload-683697 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-683697 -n no-preload-683697
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-683697 -n no-preload-683697: exit status 2 (499.712291ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-683697 -n no-preload-683697
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-683697 -n no-preload-683697: exit status 2 (495.660673ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p no-preload-683697 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-683697 -n no-preload-683697
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-683697 -n no-preload-683697
--- PASS: TestStartStop/group/no-preload/serial/Pause (4.26s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (52.07s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-108135 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0731 11:28:24.580874  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 11:28:35.699350  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 11:28:48.538750  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-108135 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (52.071036425s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (52.07s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (9.61s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-108135 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [c5fe532c-786a-4735-835f-4283b3de2750] Pending
helpers_test.go:344: "busybox" [c5fe532c-786a-4735-835f-4283b3de2750] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [c5fe532c-786a-4735-835f-4283b3de2750] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 9.034755085s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-108135 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (9.61s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.25s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-108135 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-108135 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.127975858s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-108135 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.25s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (11.06s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p default-k8s-diff-port-108135 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p default-k8s-diff-port-108135 --alsologtostderr -v=3: (11.060464805s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (11.06s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (9.61s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-266705 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [580e9307-3947-43d4-a18c-2d0636ad86d9] Pending
helpers_test.go:344: "busybox" [580e9307-3947-43d4-a18c-2d0636ad86d9] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [580e9307-3947-43d4-a18c-2d0636ad86d9] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 9.032461717s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-266705 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (9.61s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.22s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-108135 -n default-k8s-diff-port-108135
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-108135 -n default-k8s-diff-port-108135: exit status 7 (91.230444ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p default-k8s-diff-port-108135 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.22s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (355.03s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-108135 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-108135 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (5m54.411707167s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-108135 -n default-k8s-diff-port-108135
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (355.03s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.72s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-266705 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-266705 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.548230929s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-266705 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.72s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (10.91s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p embed-certs-266705 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p embed-certs-266705 --alsologtostderr -v=3: (10.907956593s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (10.91s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-266705 -n embed-certs-266705
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-266705 -n embed-certs-266705: exit status 7 (78.745074ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p embed-certs-266705 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.19s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (352.84s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-266705 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0731 11:29:43.723642  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:29:43.729253  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:29:43.739473  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:29:43.760430  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:29:43.800897  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:29:43.881128  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:29:44.041344  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:29:44.361731  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:29:45.002627  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:29:46.283747  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:29:48.844931  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:29:53.965995  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:30:04.206761  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:30:24.687867  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:31:05.648482  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:31:45.049424  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
E0731 11:31:49.124963  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:31:49.130304  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:31:49.140674  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:31:49.160988  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:31:49.201260  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:31:49.281615  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:31:49.442516  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:31:49.762943  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:31:50.403861  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:31:51.684091  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:31:54.244635  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:31:59.365413  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:32:09.606583  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:32:25.494032  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
E0731 11:32:27.568927  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:32:30.087417  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:33:07.628331  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 11:33:11.047588  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:33:24.580717  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 11:33:35.699466  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 11:34:32.967810  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:34:43.723834  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:35:11.409470  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-266705 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (5m52.176647982s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-266705 -n embed-certs-266705
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (352.84s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (21.04s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-g4plh" [4ef10b0a-0068-4ebb-a70e-cc3293d6e6fb] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-g4plh" [4ef10b0a-0068-4ebb-a70e-cc3293d6e6fb] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 21.041738355s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (21.04s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (17.05s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-rqdfw" [37f4ee60-5f9c-4f8c-a083-e00f48f7ca5c] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-rqdfw" [37f4ee60-5f9c-4f8c-a083-e00f48f7ca5c] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 17.050159989s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (17.05s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.12s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-g4plh" [4ef10b0a-0068-4ebb-a70e-cc3293d6e6fb] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.016046624s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-108135 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.12s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.42s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p default-k8s-diff-port-108135 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.42s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (3.3s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p default-k8s-diff-port-108135 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-108135 -n default-k8s-diff-port-108135
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-108135 -n default-k8s-diff-port-108135: exit status 2 (397.924314ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-108135 -n default-k8s-diff-port-108135
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-108135 -n default-k8s-diff-port-108135: exit status 2 (363.16547ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p default-k8s-diff-port-108135 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-108135 -n default-k8s-diff-port-108135
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-108135 -n default-k8s-diff-port-108135
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (3.30s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.15s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-rqdfw" [37f4ee60-5f9c-4f8c-a083-e00f48f7ca5c] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.011700409s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-266705 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.15s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (63.63s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-577115 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-577115 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (1m3.634768421s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (63.63s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.51s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p embed-certs-266705 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.51s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (4.1s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p embed-certs-266705 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-266705 -n embed-certs-266705
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-266705 -n embed-certs-266705: exit status 2 (443.013021ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-266705 -n embed-certs-266705
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-266705 -n embed-certs-266705: exit status 2 (462.020197ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p embed-certs-266705 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-266705 -n embed-certs-266705
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-266705 -n embed-certs-266705
--- PASS: TestStartStop/group/embed-certs/serial/Pause (4.10s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (94.46s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p auto-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=docker
E0731 11:36:45.049251  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
E0731 11:36:49.124640  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p auto-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=docker: (1m34.455370331s)
--- PASS: TestNetworkPlugins/group/auto/Start (94.46s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.74s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-577115 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-577115 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.741471487s)
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.74s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (7.11s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p newest-cni-577115 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p newest-cni-577115 --alsologtostderr -v=3: (7.11147274s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (7.11s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.21s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-577115 -n newest-cni-577115
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-577115 -n newest-cni-577115: exit status 7 (81.14783ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p newest-cni-577115 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.21s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (35.3s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-577115 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3
E0731 11:37:16.808407  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/no-preload-683697/client.crt: no such file or directory
E0731 11:37:25.493152  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-577115 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=docker --kubernetes-version=v1.27.3: (34.791161446s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-577115 -n newest-cni-577115
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (35.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.46s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p auto-762370 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.46s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (11.62s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-762370 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-thfbm" [a3e32465-a8de-414b-a5dc-79f43603fabf] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-thfbm" [a3e32465-a8de-414b-a5dc-79f43603fabf] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 11.019752191s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (11.62s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.48s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p newest-cni-577115 "sudo crictl images -o json"
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.48s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (3.39s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p newest-cni-577115 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-577115 -n newest-cni-577115
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-577115 -n newest-cni-577115: exit status 2 (370.864855ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-577115 -n newest-cni-577115
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-577115 -n newest-cni-577115: exit status 2 (366.778046ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p newest-cni-577115 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-577115 -n newest-cni-577115
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-577115 -n newest-cni-577115
--- PASS: TestStartStop/group/newest-cni/serial/Pause (3.39s)
E0731 11:45:55.126409  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/custom-flannel-762370/client.crt: no such file or directory
E0731 11:45:55.447031  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/custom-flannel-762370/client.crt: no such file or directory
E0731 11:45:56.087298  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/custom-flannel-762370/client.crt: no such file or directory
E0731 11:45:57.367425  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/custom-flannel-762370/client.crt: no such file or directory
E0731 11:45:59.928265  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/custom-flannel-762370/client.crt: no such file or directory
E0731 11:46:05.049304  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/custom-flannel-762370/client.crt: no such file or directory
E0731 11:46:06.770036  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (74.52s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kindnet-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kindnet-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=docker: (1m14.522132278s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (74.52s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.35s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-762370 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (80.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p calico-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=docker
E0731 11:38:18.747355  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
E0731 11:38:24.580657  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/addons-766873/client.crt: no such file or directory
E0731 11:38:35.698439  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/functional-034793/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p calico-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=docker: (1m20.184339032s)
--- PASS: TestNetworkPlugins/group/calico/Start (80.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (5.04s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-wn7fl" [1cec17d9-52f0-4c49-ad8e-43bc3cd58e6f] Running
E0731 11:38:57.593831  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/default-k8s-diff-port-108135/client.crt: no such file or directory
E0731 11:38:57.599142  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/default-k8s-diff-port-108135/client.crt: no such file or directory
E0731 11:38:57.609495  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/default-k8s-diff-port-108135/client.crt: no such file or directory
E0731 11:38:57.629835  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/default-k8s-diff-port-108135/client.crt: no such file or directory
E0731 11:38:57.670305  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/default-k8s-diff-port-108135/client.crt: no such file or directory
E0731 11:38:57.750709  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/default-k8s-diff-port-108135/client.crt: no such file or directory
E0731 11:38:57.911251  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/default-k8s-diff-port-108135/client.crt: no such file or directory
E0731 11:38:58.232385  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/default-k8s-diff-port-108135/client.crt: no such file or directory
E0731 11:38:58.873115  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/default-k8s-diff-port-108135/client.crt: no such file or directory
E0731 11:39:00.154244  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/default-k8s-diff-port-108135/client.crt: no such file or directory
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 5.03116177s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (5.04s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.46s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kindnet-762370 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.46s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (11.79s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-762370 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-tk858" [0e5702a9-095b-4b0e-96ce-0011a3736a5f] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0731 11:39:02.715195  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/default-k8s-diff-port-108135/client.crt: no such file or directory
E0731 11:39:07.835806  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/default-k8s-diff-port-108135/client.crt: no such file or directory
helpers_test.go:344: "netcat-7458db8b8-tk858" [0e5702a9-095b-4b0e-96ce-0011a3736a5f] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 11.022989801s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (11.79s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.46s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-762370 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.46s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (5.07s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-xzhdt" [861649ac-aa2c-47c2-83c7-0d91f3a8ca82] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 5.05106983s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (5.07s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.45s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p calico-762370 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.45s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (12.71s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-762370 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-sjpdl" [77fdbb3e-f25a-4685-9461-a20a50933eeb] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-sjpdl" [77fdbb3e-f25a-4685-9461-a20a50933eeb] Running
E0731 11:39:43.723492  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 12.011726603s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (12.71s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (72.9s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-flannel-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-flannel-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=docker: (1m12.898326999s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (72.90s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.57s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-762370 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.57s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.47s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.47s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Start (65.71s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p false-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=docker  --container-runtime=docker
E0731 11:40:19.517298  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/default-k8s-diff-port-108135/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p false-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=docker  --container-runtime=docker: (1m5.713264829s)
--- PASS: TestNetworkPlugins/group/false/Start (65.71s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p custom-flannel-762370 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (11.44s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-762370 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-5pd5z" [164c7a44-2eb9-419a-91c1-2e95d200244c] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-5pd5z" [164c7a44-2eb9-419a-91c1-2e95d200244c] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 11.014425678s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (11.44s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-762370 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/KubeletFlags (0.43s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p false-762370 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/false/KubeletFlags (0.43s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/NetCatPod (12.59s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context false-762370 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/false/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-pmnrg" [84d3c9c1-4761-475f-91e0-855031d89827] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0731 11:41:28.094929  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/ingress-addon-legacy-192573/client.crt: no such file or directory
helpers_test.go:344: "netcat-7458db8b8-pmnrg" [84d3c9c1-4761-475f-91e0-855031d89827] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/false/NetCatPod: app=netcat healthy within 12.011591801s
--- PASS: TestNetworkPlugins/group/false/NetCatPod (12.59s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (95.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p enable-default-cni-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=docker
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p enable-default-cni-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=docker: (1m35.317731572s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (95.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/DNS (0.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/DNS
net_test.go:175: (dbg) Run:  kubectl --context false-762370 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/false/DNS (0.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Localhost (0.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Localhost
net_test.go:194: (dbg) Run:  kubectl --context false-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/false/Localhost (0.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/HairPin (0.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/HairPin
net_test.go:264: (dbg) Run:  kubectl --context false-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/false/HairPin (0.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (71.8s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p flannel-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=docker
E0731 11:42:25.493727  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
E0731 11:42:31.272046  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/auto-762370/client.crt: no such file or directory
E0731 11:42:31.277415  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/auto-762370/client.crt: no such file or directory
E0731 11:42:31.287646  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/auto-762370/client.crt: no such file or directory
E0731 11:42:31.307888  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/auto-762370/client.crt: no such file or directory
E0731 11:42:31.348189  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/auto-762370/client.crt: no such file or directory
E0731 11:42:31.428399  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/auto-762370/client.crt: no such file or directory
E0731 11:42:31.588814  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/auto-762370/client.crt: no such file or directory
E0731 11:42:31.909341  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/auto-762370/client.crt: no such file or directory
E0731 11:42:32.549781  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/auto-762370/client.crt: no such file or directory
E0731 11:42:33.830147  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/auto-762370/client.crt: no such file or directory
E0731 11:42:36.390728  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/auto-762370/client.crt: no such file or directory
E0731 11:42:41.511557  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/auto-762370/client.crt: no such file or directory
E0731 11:42:51.751751  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/auto-762370/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p flannel-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=docker: (1m11.79826435s)
--- PASS: TestNetworkPlugins/group/flannel/Start (71.80s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.49s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p enable-default-cni-762370 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.49s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (14.58s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-762370 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-ttrs4" [bf02ce20-99c4-4cae-853b-6507b59a65c5] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0731 11:43:12.231976  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/auto-762370/client.crt: no such file or directory
helpers_test.go:344: "netcat-7458db8b8-ttrs4" [bf02ce20-99c4-4cae-853b-6507b59a65c5] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 14.026625704s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (14.58s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (5.03s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-m59jq" [6c3d4bfc-6d40-4e8b-a9a6-a524b56e85ea] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 5.029608263s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (5.03s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p flannel-762370 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-762370 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (9.52s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-762370 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-pqlrb" [4c0fa02e-00b4-423b-85b3-b4e8eb850245] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-pqlrb" [4c0fa02e-00b4-423b-85b3-b4e8eb850245] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 9.016978749s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (9.52s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-762370 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (94.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p bridge-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=docker
E0731 11:43:53.193546  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/auto-762370/client.crt: no such file or directory
E0731 11:43:56.174494  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/kindnet-762370/client.crt: no such file or directory
E0731 11:43:56.179786  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/kindnet-762370/client.crt: no such file or directory
E0731 11:43:56.190102  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/kindnet-762370/client.crt: no such file or directory
E0731 11:43:56.210335  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/kindnet-762370/client.crt: no such file or directory
E0731 11:43:56.252401  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/kindnet-762370/client.crt: no such file or directory
E0731 11:43:56.333502  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/kindnet-762370/client.crt: no such file or directory
E0731 11:43:56.494456  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/kindnet-762370/client.crt: no such file or directory
E0731 11:43:56.814763  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/kindnet-762370/client.crt: no such file or directory
E0731 11:43:57.455471  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/kindnet-762370/client.crt: no such file or directory
E0731 11:43:57.593880  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/default-k8s-diff-port-108135/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p bridge-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=docker: (1m34.317750951s)
--- PASS: TestNetworkPlugins/group/bridge/Start (94.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Start (95.8s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kubenet-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=docker  --container-runtime=docker
E0731 11:44:06.416660  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/kindnet-762370/client.crt: no such file or directory
E0731 11:44:16.657729  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/kindnet-762370/client.crt: no such file or directory
E0731 11:44:25.279440  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/default-k8s-diff-port-108135/client.crt: no such file or directory
E0731 11:44:29.157989  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/calico-762370/client.crt: no such file or directory
E0731 11:44:29.163238  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/calico-762370/client.crt: no such file or directory
E0731 11:44:29.174060  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/calico-762370/client.crt: no such file or directory
E0731 11:44:29.194338  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/calico-762370/client.crt: no such file or directory
E0731 11:44:29.234600  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/calico-762370/client.crt: no such file or directory
E0731 11:44:29.314908  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/calico-762370/client.crt: no such file or directory
E0731 11:44:29.475254  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/calico-762370/client.crt: no such file or directory
E0731 11:44:29.795428  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/calico-762370/client.crt: no such file or directory
E0731 11:44:30.436254  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/calico-762370/client.crt: no such file or directory
E0731 11:44:31.717075  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/calico-762370/client.crt: no such file or directory
E0731 11:44:34.277621  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/calico-762370/client.crt: no such file or directory
E0731 11:44:37.138259  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/kindnet-762370/client.crt: no such file or directory
E0731 11:44:39.398307  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/calico-762370/client.crt: no such file or directory
E0731 11:44:43.723812  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/old-k8s-version-865762/client.crt: no such file or directory
E0731 11:44:49.638541  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/calico-762370/client.crt: no such file or directory
E0731 11:45:10.118791  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/calico-762370/client.crt: no such file or directory
E0731 11:45:15.114225  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/auto-762370/client.crt: no such file or directory
E0731 11:45:18.099301  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/kindnet-762370/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kubenet-762370 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=docker  --container-runtime=docker: (1m35.801054741s)
--- PASS: TestNetworkPlugins/group/kubenet/Start (95.80s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p bridge-762370 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (9.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-762370 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-6vjbj" [4a5066bd-fe57-4c65-a7d1-2f05fa54a920] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-6vjbj" [4a5066bd-fe57-4c65-a7d1-2f05fa54a920] Running
E0731 11:45:28.539823  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/skaffold-512220/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 9.012571558s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (9.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-762370 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/KubeletFlags (0.5s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kubenet-762370 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kubenet/KubeletFlags (0.50s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/NetCatPod (12.59s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kubenet-762370 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kubenet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-4gjrm" [4cfa5c08-ba51-456a-ada3-9d67a40a9f7e] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-4gjrm" [4cfa5c08-ba51-456a-ada3-9d67a40a9f7e] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kubenet/NetCatPod: app=netcat healthy within 12.014113853s
--- PASS: TestNetworkPlugins/group/kubenet/NetCatPod (12.59s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/DNS (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kubenet-762370 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kubenet/DNS (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Localhost (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kubenet-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
E0731 11:45:51.079215  453594 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16969-448039/.minikube/profiles/calico-762370/client.crt: no such file or directory
--- PASS: TestNetworkPlugins/group/kubenet/Localhost (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/HairPin (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kubenet-762370 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kubenet/HairPin (0.22s)

                                                
                                    

Test skip (24/319)

x
+
TestDownloadOnly/v1.16.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.16.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/binaries
aaa_download_only_test.go:136: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.16.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/kubectl
aaa_download_only_test.go:152: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.16.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.27.3/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/binaries
aaa_download_only_test.go:136: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.27.3/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/kubectl
aaa_download_only_test.go:152: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.27.3/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0.58s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:222: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p download-docker-761807 --alsologtostderr --driver=docker  --container-runtime=docker
aaa_download_only_test.go:234: Skip for arm64 platform. See https://github.com/kubernetes/minikube/issues/10144
helpers_test.go:175: Cleaning up "download-docker-761807" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p download-docker-761807
--- SKIP: TestDownloadOnlyKic (0.58s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (0s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:420: skip Helm test on arm64
--- SKIP: TestAddons/parallel/HelmTiller (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:474: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with docker true linux arm64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:45: Skip if arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1783: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing docker
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild/serial/validateImageBuildWithBuildEnv (0s)

                                                
                                                
=== RUN   TestImageBuild/serial/validateImageBuildWithBuildEnv
image_test.go:114: skipping due to https://github.com/kubernetes/minikube/issues/12431
--- SKIP: TestImageBuild/serial/validateImageBuildWithBuildEnv (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.24s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-069212" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p disable-driver-mounts-069212
--- SKIP: TestStartStop/group/disable-driver-mounts (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (6.51s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:522: 
----------------------- debugLogs start: cilium-762370 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-762370

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-762370

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-762370

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-762370

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-762370

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-762370

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-762370

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-762370

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-762370

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-762370

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-762370

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-762370" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-762370" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-762370" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-762370" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-762370" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-762370" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-762370" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-762370" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-762370

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-762370

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-762370" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-762370" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-762370

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-762370

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-762370" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-762370" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-762370" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-762370" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-762370" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-762370

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-762370" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-762370"

                                                
                                                
----------------------- debugLogs end: cilium-762370 [took: 6.167677927s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-762370" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cilium-762370
--- SKIP: TestNetworkPlugins/group/cilium (6.51s)

                                                
                                    
Copied to clipboard