Test Report: Docker_Linux_containerd_arm64 16899

                    
                      f8194aff3a7b98ea29a2e4b2da65132feb1e4119:2023-07-18:30190
                    
                

Test fail (9/304)

x
+
TestAddons/parallel/Ingress (29.65s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:183: (dbg) Run:  kubectl --context addons-225437 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:208: (dbg) Run:  kubectl --context addons-225437 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:221: (dbg) Run:  kubectl --context addons-225437 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:226: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [53eb1a14-3c98-441c-bea8-c2ff05f3f560] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [53eb1a14-3c98-441c-bea8-c2ff05f3f560] Running
addons_test.go:226: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 7.014989906s
addons_test.go:238: (dbg) Run:  out/minikube-linux-arm64 -p addons-225437 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Run:  kubectl --context addons-225437 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:267: (dbg) Run:  out/minikube-linux-arm64 -p addons-225437 ip
addons_test.go:273: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:273: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.054351426s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:275: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:279: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p addons-225437 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p addons-225437 addons disable ingress-dns --alsologtostderr -v=1: (1.948503391s)
addons_test.go:287: (dbg) Run:  out/minikube-linux-arm64 -p addons-225437 addons disable ingress --alsologtostderr -v=1
addons_test.go:287: (dbg) Non-zero exit: out/minikube-linux-arm64 -p addons-225437 addons disable ingress --alsologtostderr -v=1: exit status 11 (640.490038ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 23:36:10.729838 1788336 out.go:296] Setting OutFile to fd 1 ...
	I0717 23:36:10.730997 1788336 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:36:10.731028 1788336 out.go:309] Setting ErrFile to fd 2...
	I0717 23:36:10.731049 1788336 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:36:10.731359 1788336 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
	I0717 23:36:10.731750 1788336 addons.go:594] checking whether the cluster is paused
	I0717 23:36:10.732313 1788336 config.go:182] Loaded profile config "addons-225437": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
	I0717 23:36:10.732381 1788336 host.go:66] Checking if "addons-225437" exists ...
	I0717 23:36:10.732887 1788336 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:36:10.752710 1788336 ssh_runner.go:195] Run: systemctl --version
	I0717 23:36:10.752767 1788336 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:36:10.776388 1788336 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:36:10.876704 1788336 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0717 23:36:10.876790 1788336 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0717 23:36:11.006296 1788336 cri.go:89] found id: "8194fbbdab46d8a49fdeec27af231e8402c9bd1a7bc979ffa57ab6c6799c1667"
	I0717 23:36:11.006317 1788336 cri.go:89] found id: "fb4a3a9ee0f72b1342227392dcea136882211536e9de4cf650cdcbee660d5c5e"
	I0717 23:36:11.006322 1788336 cri.go:89] found id: "4424ab31a3451ba187073bc503ea876d270702ae94548281b86106203833cf6c"
	I0717 23:36:11.006327 1788336 cri.go:89] found id: "f62cbb540a31031fe1d2353f8426f6a780935bbaaa7f8ff3254c93d45de0ad37"
	I0717 23:36:11.006332 1788336 cri.go:89] found id: "8b75e1e1a07229896758d8cb070ba0c8bdeecb0dc9eac5951b2eefc1824d13d4"
	I0717 23:36:11.006337 1788336 cri.go:89] found id: "9a4ce7b5f22ff08402cc8b8a797f4975ad902837e61c09d128c9654cff8dff64"
	I0717 23:36:11.006341 1788336 cri.go:89] found id: "308ec8fc3aa3fd396f6405b682ba76c4d4f66d3c3d5e5353d6fd91ac71ba3c4b"
	I0717 23:36:11.006345 1788336 cri.go:89] found id: "9bd1951ed0078de4d2578ca495ad861ca559294ba4a5c6fdc78b03c9a9a078b2"
	I0717 23:36:11.006349 1788336 cri.go:89] found id: "515e5a3a39f01da8c3e72a7b74dd5c2a4d40ece0a5980eae174a3923084ad709"
	I0717 23:36:11.006358 1788336 cri.go:89] found id: "2666fbb2a553480cf694552a71bd9a4726b28008403cde6cc628240e410dee12"
	I0717 23:36:11.006362 1788336 cri.go:89] found id: "4f2de59b0c090fc61b5ca0b48d241e0ed4d7bdfb8e2bbb9a127ee50c26d4c13a"
	I0717 23:36:11.006366 1788336 cri.go:89] found id: "656325e68f00f807644ce9a6a8e1be60ede04c1e480d8b13d6e2e753c157b4b9"
	I0717 23:36:11.006371 1788336 cri.go:89] found id: "8a798ba588719fdd2d7d1c10f91de7b52190159b5b60acb86168ae6919820310"
	I0717 23:36:11.006375 1788336 cri.go:89] found id: "00785b60065b85dfe5cee9027495a352b65548cf006006edc289d7f8bb955f14"
	I0717 23:36:11.006381 1788336 cri.go:89] found id: "4136f14d84958d5592a3b23632a3620015c54ae510c73ebcc2aba5dea573dfd9"
	I0717 23:36:11.006385 1788336 cri.go:89] found id: "8b635446134bc52967f7cb3bc6b522eef40a1a9b1ecaa36f6cd479b0191c764e"
	I0717 23:36:11.006389 1788336 cri.go:89] found id: "ed601b05253d4c1ed2c740f7b66a1b334c35fe0bd1c76e396aaed58cd98da640"
	I0717 23:36:11.006394 1788336 cri.go:89] found id: "8063430f3d8bb17fefeac2495eb5c8d20fd8344967fe802a867e1bb9b29fa2ff"
	I0717 23:36:11.006397 1788336 cri.go:89] found id: "f7ad0e9dc046b642c6cfa72d58aed55c2d89530a4a6e8dddb7ae1be7d46b3407"
	I0717 23:36:11.006401 1788336 cri.go:89] found id: ""
	I0717 23:36:11.006464 1788336 ssh_runner.go:195] Run: sudo runc --root /run/containerd/runc/k8s.io list -f json
	I0717 23:36:11.052860 1788336 out.go:177] 
	W0717 23:36:11.055051 1788336 out.go:239] X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc --root /run/containerd/runc/k8s.io list -f json: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-17T23:36:11Z" level=error msg="stat /run/containerd/runc/k8s.io/81c6385d5251f785355caf233a83e2a224b007d53cd39ea6f07e8e5253c84250: no such file or directory"
	
	X Exiting due to MK_ADDON_DISABLE_PAUSED: disable failed: check paused: list paused: runc: sudo runc --root /run/containerd/runc/k8s.io list -f json: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-17T23:36:11Z" level=error msg="stat /run/containerd/runc/k8s.io/81c6385d5251f785355caf233a83e2a224b007d53cd39ea6f07e8e5253c84250: no such file or directory"
	
	W0717 23:36:11.055136 1788336 out.go:239] * 
	* 
	W0717 23:36:11.285811 1788336 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_addons_62553deefc570c97f2052ef703df7b8905a654d6_0.log                  │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_addons_62553deefc570c97f2052ef703df7b8905a654d6_0.log                  │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0717 23:36:11.288353 1788336 out.go:177] 

                                                
                                                
** /stderr **
addons_test.go:289: failed to disable ingress addon. args "out/minikube-linux-arm64 -p addons-225437 addons disable ingress --alsologtostderr -v=1" : exit status 11
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/Ingress]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-225437
helpers_test.go:235: (dbg) docker inspect addons-225437:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "edf3d3d51482068713dd53d3bc1a1dc5913d5a6dc5bcb9113e7058cc58289870",
	        "Created": "2023-07-17T23:33:54.94959162Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 1780314,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-07-17T23:33:55.322412033Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:f52519afe5f6d6f3ce84cbd7f651b1292638d32ca98ee43d88f2d69e113e44de",
	        "ResolvConfPath": "/var/lib/docker/containers/edf3d3d51482068713dd53d3bc1a1dc5913d5a6dc5bcb9113e7058cc58289870/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/edf3d3d51482068713dd53d3bc1a1dc5913d5a6dc5bcb9113e7058cc58289870/hostname",
	        "HostsPath": "/var/lib/docker/containers/edf3d3d51482068713dd53d3bc1a1dc5913d5a6dc5bcb9113e7058cc58289870/hosts",
	        "LogPath": "/var/lib/docker/containers/edf3d3d51482068713dd53d3bc1a1dc5913d5a6dc5bcb9113e7058cc58289870/edf3d3d51482068713dd53d3bc1a1dc5913d5a6dc5bcb9113e7058cc58289870-json.log",
	        "Name": "/addons-225437",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "addons-225437:/var",
	                "/lib/modules:/lib/modules:ro"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "addons-225437",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/3211ff1b18e203b9dade1f76fe5786f4e8bcd487dacc5448cd1d1f7187face1f-init/diff:/var/lib/docker/overlay2/35c7dfa0dd79ade1d127735ea1c2fdf1590faeb4a5550d4cf4092ab5865caa24/diff",
	                "MergedDir": "/var/lib/docker/overlay2/3211ff1b18e203b9dade1f76fe5786f4e8bcd487dacc5448cd1d1f7187face1f/merged",
	                "UpperDir": "/var/lib/docker/overlay2/3211ff1b18e203b9dade1f76fe5786f4e8bcd487dacc5448cd1d1f7187face1f/diff",
	                "WorkDir": "/var/lib/docker/overlay2/3211ff1b18e203b9dade1f76fe5786f4e8bcd487dacc5448cd1d1f7187face1f/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "addons-225437",
	                "Source": "/var/lib/docker/volumes/addons-225437/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-225437",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-225437",
	                "name.minikube.sigs.k8s.io": "addons-225437",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "66fbc11d2bc17959fefd640f44272b4a5e6d39680d1f7f01235ac3cc5d304813",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34658"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34657"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34654"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34656"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34655"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/66fbc11d2bc1",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-225437": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "edf3d3d51482",
	                        "addons-225437"
	                    ],
	                    "NetworkID": "d429826a5967448d8d200a9664477875bfd2c3ba5c304e87683883a39287472e",
	                    "EndpointID": "5e47314eb0b7b083dea7e6fdb8721d6ace07a23864e978c36a96c0dc6dae00cd",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-225437 -n addons-225437
helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-225437 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-225437 logs -n 25: (1.652923444s)
helpers_test.go:252: TestAddons/parallel/Ingress logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-330878   | jenkins | v1.31.0 | 17 Jul 23 23:33 UTC |                     |
	|         | -p download-only-330878        |                        |         |         |                     |                     |
	|         | --force --alsologtostderr      |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0   |                        |         |         |                     |                     |
	|         | --container-runtime=containerd |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=containerd |                        |         |         |                     |                     |
	| start   | -o=json --download-only        | download-only-330878   | jenkins | v1.31.0 | 17 Jul 23 23:33 UTC |                     |
	|         | -p download-only-330878        |                        |         |         |                     |                     |
	|         | --force --alsologtostderr      |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.27.3   |                        |         |         |                     |                     |
	|         | --container-runtime=containerd |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=containerd |                        |         |         |                     |                     |
	| delete  | --all                          | minikube               | jenkins | v1.31.0 | 17 Jul 23 23:33 UTC | 17 Jul 23 23:33 UTC |
	| delete  | -p download-only-330878        | download-only-330878   | jenkins | v1.31.0 | 17 Jul 23 23:33 UTC | 17 Jul 23 23:33 UTC |
	| delete  | -p download-only-330878        | download-only-330878   | jenkins | v1.31.0 | 17 Jul 23 23:33 UTC | 17 Jul 23 23:33 UTC |
	| start   | --download-only -p             | download-docker-159418 | jenkins | v1.31.0 | 17 Jul 23 23:33 UTC |                     |
	|         | download-docker-159418         |                        |         |         |                     |                     |
	|         | --alsologtostderr              |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=containerd |                        |         |         |                     |                     |
	| delete  | -p download-docker-159418      | download-docker-159418 | jenkins | v1.31.0 | 17 Jul 23 23:33 UTC | 17 Jul 23 23:33 UTC |
	| start   | --download-only -p             | binary-mirror-124207   | jenkins | v1.31.0 | 17 Jul 23 23:33 UTC |                     |
	|         | binary-mirror-124207           |                        |         |         |                     |                     |
	|         | --alsologtostderr              |                        |         |         |                     |                     |
	|         | --binary-mirror                |                        |         |         |                     |                     |
	|         | http://127.0.0.1:37497         |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=containerd |                        |         |         |                     |                     |
	| delete  | -p binary-mirror-124207        | binary-mirror-124207   | jenkins | v1.31.0 | 17 Jul 23 23:33 UTC | 17 Jul 23 23:33 UTC |
	| start   | -p addons-225437               | addons-225437          | jenkins | v1.31.0 | 17 Jul 23 23:33 UTC | 17 Jul 23 23:35 UTC |
	|         | --wait=true --memory=4000      |                        |         |         |                     |                     |
	|         | --alsologtostderr              |                        |         |         |                     |                     |
	|         | --addons=registry              |                        |         |         |                     |                     |
	|         | --addons=metrics-server        |                        |         |         |                     |                     |
	|         | --addons=volumesnapshots       |                        |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver   |                        |         |         |                     |                     |
	|         | --addons=gcp-auth              |                        |         |         |                     |                     |
	|         | --addons=cloud-spanner         |                        |         |         |                     |                     |
	|         | --addons=inspektor-gadget      |                        |         |         |                     |                     |
	|         | --driver=docker                |                        |         |         |                     |                     |
	|         | --container-runtime=containerd |                        |         |         |                     |                     |
	|         | --addons=ingress               |                        |         |         |                     |                     |
	|         | --addons=ingress-dns           |                        |         |         |                     |                     |
	| addons  | disable cloud-spanner -p       | addons-225437          | jenkins | v1.31.0 | 17 Jul 23 23:35 UTC | 17 Jul 23 23:35 UTC |
	|         | addons-225437                  |                        |         |         |                     |                     |
	| addons  | enable headlamp                | addons-225437          | jenkins | v1.31.0 | 17 Jul 23 23:35 UTC | 17 Jul 23 23:35 UTC |
	|         | -p addons-225437               |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1         |                        |         |         |                     |                     |
	| ip      | addons-225437 ip               | addons-225437          | jenkins | v1.31.0 | 17 Jul 23 23:35 UTC | 17 Jul 23 23:35 UTC |
	| addons  | addons-225437 addons disable   | addons-225437          | jenkins | v1.31.0 | 17 Jul 23 23:35 UTC | 17 Jul 23 23:35 UTC |
	|         | registry --alsologtostderr     |                        |         |         |                     |                     |
	|         | -v=1                           |                        |         |         |                     |                     |
	| ssh     | addons-225437 ssh curl -s      | addons-225437          | jenkins | v1.31.0 | 17 Jul 23 23:35 UTC | 17 Jul 23 23:35 UTC |
	|         | http://127.0.0.1/ -H 'Host:    |                        |         |         |                     |                     |
	|         | nginx.example.com'             |                        |         |         |                     |                     |
	| ip      | addons-225437 ip               | addons-225437          | jenkins | v1.31.0 | 17 Jul 23 23:35 UTC | 17 Jul 23 23:35 UTC |
	| addons  | addons-225437 addons disable   | addons-225437          | jenkins | v1.31.0 | 17 Jul 23 23:36 UTC | 17 Jul 23 23:36 UTC |
	|         | ingress-dns --alsologtostderr  |                        |         |         |                     |                     |
	|         | -v=1                           |                        |         |         |                     |                     |
	| addons  | addons-225437 addons disable   | addons-225437          | jenkins | v1.31.0 | 17 Jul 23 23:36 UTC |                     |
	|         | ingress --alsologtostderr -v=1 |                        |         |         |                     |                     |
	|---------|--------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/17 23:33:31
	Running on machine: ip-172-31-29-130
	Binary: Built with gc go1.20.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0717 23:33:31.976742 1779851 out.go:296] Setting OutFile to fd 1 ...
	I0717 23:33:31.977741 1779851 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:33:31.977789 1779851 out.go:309] Setting ErrFile to fd 2...
	I0717 23:33:31.977812 1779851 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:33:31.978108 1779851 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
	I0717 23:33:31.978651 1779851 out.go:303] Setting JSON to false
	I0717 23:33:31.979705 1779851 start.go:128] hostinfo: {"hostname":"ip-172-31-29-130","uptime":29755,"bootTime":1689607057,"procs":296,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0717 23:33:31.979814 1779851 start.go:138] virtualization:  
	I0717 23:33:31.983755 1779851 out.go:177] * [addons-225437] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	I0717 23:33:31.986126 1779851 out.go:177]   - MINIKUBE_LOCATION=16899
	I0717 23:33:31.988070 1779851 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 23:33:31.986216 1779851 notify.go:220] Checking for updates...
	I0717 23:33:31.990305 1779851 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig
	I0717 23:33:31.992174 1779851 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube
	I0717 23:33:31.994214 1779851 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0717 23:33:31.996237 1779851 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0717 23:33:31.998667 1779851 driver.go:373] Setting default libvirt URI to qemu:///system
	I0717 23:33:32.031326 1779851 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0717 23:33:32.031450 1779851 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 23:33:32.105254 1779851 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-07-17 23:33:32.095240142 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215175168 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 23:33:32.105362 1779851 docker.go:294] overlay module found
	I0717 23:33:32.110973 1779851 out.go:177] * Using the docker driver based on user configuration
	I0717 23:33:32.112581 1779851 start.go:298] selected driver: docker
	I0717 23:33:32.112598 1779851 start.go:880] validating driver "docker" against <nil>
	I0717 23:33:32.112612 1779851 start.go:891] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0717 23:33:32.113281 1779851 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 23:33:32.191347 1779851 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-07-17 23:33:32.181729744 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215175168 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 23:33:32.191506 1779851 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0717 23:33:32.191757 1779851 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0717 23:33:32.194286 1779851 out.go:177] * Using Docker driver with root privileges
	I0717 23:33:32.196655 1779851 cni.go:84] Creating CNI manager for ""
	I0717 23:33:32.196679 1779851 cni.go:149] "docker" driver + "containerd" runtime found, recommending kindnet
	I0717 23:33:32.196691 1779851 start_flags.go:314] Found "CNI" CNI - setting NetworkPlugin=cni
	I0717 23:33:32.196703 1779851 start_flags.go:319] config:
	{Name:addons-225437 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:addons-225437 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlu
gin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 23:33:32.199853 1779851 out.go:177] * Starting control plane node addons-225437 in cluster addons-225437
	I0717 23:33:32.201871 1779851 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0717 23:33:32.203959 1779851 out.go:177] * Pulling base image ...
	I0717 23:33:32.205505 1779851 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime containerd
	I0717 23:33:32.205535 1779851 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0717 23:33:32.205550 1779851 preload.go:148] Found local preload: /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-containerd-overlay2-arm64.tar.lz4
	I0717 23:33:32.205566 1779851 cache.go:57] Caching tarball of preloaded images
	I0717 23:33:32.205639 1779851 preload.go:174] Found /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
	I0717 23:33:32.205648 1779851 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.3 on containerd
	I0717 23:33:32.206006 1779851 profile.go:148] Saving config to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/config.json ...
	I0717 23:33:32.206028 1779851 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/config.json: {Name:mkd96fcaed8e33055ca8c6d627d0f8efd815afee Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:33:32.222688 1779851 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 to local cache
	I0717 23:33:32.222806 1779851 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory
	I0717 23:33:32.222835 1779851 image.go:66] Found gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory, skipping pull
	I0717 23:33:32.222840 1779851 image.go:105] gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 exists in cache, skipping pull
	I0717 23:33:32.222848 1779851 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 as a tarball
	I0717 23:33:32.222857 1779851 cache.go:163] Loading gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 from local cache
	I0717 23:33:48.199847 1779851 cache.go:165] successfully loaded and using gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 from cached tarball
	I0717 23:33:48.199886 1779851 cache.go:195] Successfully downloaded all kic artifacts
	I0717 23:33:48.199936 1779851 start.go:365] acquiring machines lock for addons-225437: {Name:mkdf9ba633e22b383bb5d649ea177e6749c68b33 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0717 23:33:48.200387 1779851 start.go:369] acquired machines lock for "addons-225437" in 426.56µs
	I0717 23:33:48.200424 1779851 start.go:93] Provisioning new machine with config: &{Name:addons-225437 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:addons-225437 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServ
erIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fal
se CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0} &{Name: IP: Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0717 23:33:48.200515 1779851 start.go:125] createHost starting for "" (driver="docker")
	I0717 23:33:48.202961 1779851 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I0717 23:33:48.203205 1779851 start.go:159] libmachine.API.Create for "addons-225437" (driver="docker")
	I0717 23:33:48.203237 1779851 client.go:168] LocalClient.Create starting
	I0717 23:33:48.203347 1779851 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem
	I0717 23:33:48.440204 1779851 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem
	I0717 23:33:48.856247 1779851 cli_runner.go:164] Run: docker network inspect addons-225437 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0717 23:33:48.872636 1779851 cli_runner.go:211] docker network inspect addons-225437 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0717 23:33:48.872724 1779851 network_create.go:281] running [docker network inspect addons-225437] to gather additional debugging logs...
	I0717 23:33:48.872745 1779851 cli_runner.go:164] Run: docker network inspect addons-225437
	W0717 23:33:48.890478 1779851 cli_runner.go:211] docker network inspect addons-225437 returned with exit code 1
	I0717 23:33:48.890512 1779851 network_create.go:284] error running [docker network inspect addons-225437]: docker network inspect addons-225437: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-225437 not found
	I0717 23:33:48.890543 1779851 network_create.go:286] output of [docker network inspect addons-225437]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-225437 not found
	
	** /stderr **
	I0717 23:33:48.890624 1779851 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0717 23:33:48.910638 1779851 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40011bb9c0}
	I0717 23:33:48.910686 1779851 network_create.go:123] attempt to create docker network addons-225437 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0717 23:33:48.910744 1779851 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-225437 addons-225437
	I0717 23:33:48.983212 1779851 network_create.go:107] docker network addons-225437 192.168.49.0/24 created
	I0717 23:33:48.983238 1779851 kic.go:117] calculated static IP "192.168.49.2" for the "addons-225437" container
	I0717 23:33:48.983326 1779851 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0717 23:33:49.003865 1779851 cli_runner.go:164] Run: docker volume create addons-225437 --label name.minikube.sigs.k8s.io=addons-225437 --label created_by.minikube.sigs.k8s.io=true
	I0717 23:33:49.023090 1779851 oci.go:103] Successfully created a docker volume addons-225437
	I0717 23:33:49.023176 1779851 cli_runner.go:164] Run: docker run --rm --name addons-225437-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-225437 --entrypoint /usr/bin/test -v addons-225437:/var gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -d /var/lib
	I0717 23:33:50.848410 1779851 cli_runner.go:217] Completed: docker run --rm --name addons-225437-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-225437 --entrypoint /usr/bin/test -v addons-225437:/var gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -d /var/lib: (1.825194653s)
	I0717 23:33:50.848441 1779851 oci.go:107] Successfully prepared a docker volume addons-225437
	I0717 23:33:50.848461 1779851 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime containerd
	I0717 23:33:50.848479 1779851 kic.go:190] Starting extracting preloaded images to volume ...
	I0717 23:33:50.848572 1779851 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-225437:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -I lz4 -xf /preloaded.tar -C /extractDir
	I0717 23:33:54.867211 1779851 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-225437:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -I lz4 -xf /preloaded.tar -C /extractDir: (4.018576444s)
	I0717 23:33:54.867242 1779851 kic.go:199] duration metric: took 4.018759 seconds to extract preloaded images to volume
	W0717 23:33:54.867375 1779851 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0717 23:33:54.867482 1779851 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0717 23:33:54.934118 1779851 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-225437 --name addons-225437 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-225437 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-225437 --network addons-225437 --ip 192.168.49.2 --volume addons-225437:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631
	I0717 23:33:55.331143 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Running}}
	I0717 23:33:55.355803 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:33:55.380044 1779851 cli_runner.go:164] Run: docker exec addons-225437 stat /var/lib/dpkg/alternatives/iptables
	I0717 23:33:55.440894 1779851 oci.go:144] the created container "addons-225437" has a running status.
	I0717 23:33:55.440921 1779851 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa...
	I0717 23:33:56.574291 1779851 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0717 23:33:56.605484 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:33:56.624794 1779851 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0717 23:33:56.624819 1779851 kic_runner.go:114] Args: [docker exec --privileged addons-225437 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0717 23:33:56.700315 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:33:56.718569 1779851 machine.go:88] provisioning docker machine ...
	I0717 23:33:56.718607 1779851 ubuntu.go:169] provisioning hostname "addons-225437"
	I0717 23:33:56.718673 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:33:56.744573 1779851 main.go:141] libmachine: Using SSH client type: native
	I0717 23:33:56.745036 1779851 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34658 <nil> <nil>}
	I0717 23:33:56.745049 1779851 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-225437 && echo "addons-225437" | sudo tee /etc/hostname
	I0717 23:33:56.889622 1779851 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-225437
	
	I0717 23:33:56.889726 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:33:56.908375 1779851 main.go:141] libmachine: Using SSH client type: native
	I0717 23:33:56.908821 1779851 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34658 <nil> <nil>}
	I0717 23:33:56.908845 1779851 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-225437' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-225437/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-225437' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0717 23:33:57.039000 1779851 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0717 23:33:57.039028 1779851 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/16899-1773963/.minikube CaCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/16899-1773963/.minikube}
	I0717 23:33:57.039132 1779851 ubuntu.go:177] setting up certificates
	I0717 23:33:57.039143 1779851 provision.go:83] configureAuth start
	I0717 23:33:57.039231 1779851 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-225437
	I0717 23:33:57.057051 1779851 provision.go:138] copyHostCerts
	I0717 23:33:57.057134 1779851 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem (1123 bytes)
	I0717 23:33:57.057420 1779851 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem (1679 bytes)
	I0717 23:33:57.057502 1779851 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem (1078 bytes)
	I0717 23:33:57.057626 1779851 provision.go:112] generating server cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem org=jenkins.addons-225437 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube addons-225437]
	I0717 23:33:57.524980 1779851 provision.go:172] copyRemoteCerts
	I0717 23:33:57.525070 1779851 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0717 23:33:57.525115 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:33:57.542616 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:33:57.635663 1779851 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0717 23:33:57.663321 1779851 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
	I0717 23:33:57.690634 1779851 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0717 23:33:57.719033 1779851 provision.go:86] duration metric: configureAuth took 679.877326ms
	I0717 23:33:57.719057 1779851 ubuntu.go:193] setting minikube options for container-runtime
	I0717 23:33:57.719249 1779851 config.go:182] Loaded profile config "addons-225437": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
	I0717 23:33:57.719262 1779851 machine.go:91] provisioned docker machine in 1.00067818s
	I0717 23:33:57.719268 1779851 client.go:171] LocalClient.Create took 9.51602531s
	I0717 23:33:57.719285 1779851 start.go:167] duration metric: libmachine.API.Create for "addons-225437" took 9.516081769s
	I0717 23:33:57.719296 1779851 start.go:300] post-start starting for "addons-225437" (driver="docker")
	I0717 23:33:57.719304 1779851 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0717 23:33:57.719366 1779851 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0717 23:33:57.719416 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:33:57.737142 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:33:57.832077 1779851 ssh_runner.go:195] Run: cat /etc/os-release
	I0717 23:33:57.836338 1779851 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0717 23:33:57.836376 1779851 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0717 23:33:57.836388 1779851 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0717 23:33:57.836395 1779851 info.go:137] Remote host: Ubuntu 22.04.2 LTS
	I0717 23:33:57.836405 1779851 filesync.go:126] Scanning /home/jenkins/minikube-integration/16899-1773963/.minikube/addons for local assets ...
	I0717 23:33:57.836478 1779851 filesync.go:126] Scanning /home/jenkins/minikube-integration/16899-1773963/.minikube/files for local assets ...
	I0717 23:33:57.836503 1779851 start.go:303] post-start completed in 117.201661ms
	I0717 23:33:57.836822 1779851 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-225437
	I0717 23:33:57.853973 1779851 profile.go:148] Saving config to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/config.json ...
	I0717 23:33:57.854240 1779851 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0717 23:33:57.854290 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:33:57.871323 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:33:57.963207 1779851 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0717 23:33:57.969073 1779851 start.go:128] duration metric: createHost completed in 9.768543659s
	I0717 23:33:57.969102 1779851 start.go:83] releasing machines lock for "addons-225437", held for 9.768695586s
	I0717 23:33:57.969198 1779851 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-225437
	I0717 23:33:57.986239 1779851 ssh_runner.go:195] Run: cat /version.json
	I0717 23:33:57.986267 1779851 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0717 23:33:57.986292 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:33:57.986322 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:33:58.015463 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:33:58.017480 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:33:58.110396 1779851 ssh_runner.go:195] Run: systemctl --version
	I0717 23:33:58.241297 1779851 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0717 23:33:58.246635 1779851 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0717 23:33:58.275637 1779851 cni.go:236] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0717 23:33:58.275742 1779851 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0717 23:33:58.312432 1779851 cni.go:268] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0717 23:33:58.312500 1779851 start.go:466] detecting cgroup driver to use...
	I0717 23:33:58.312547 1779851 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0717 23:33:58.312625 1779851 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0717 23:33:58.326945 1779851 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0717 23:33:58.340786 1779851 docker.go:196] disabling cri-docker service (if available) ...
	I0717 23:33:58.340908 1779851 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0717 23:33:58.357324 1779851 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0717 23:33:58.373832 1779851 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0717 23:33:58.468261 1779851 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0717 23:33:58.571239 1779851 docker.go:212] disabling docker service ...
	I0717 23:33:58.571334 1779851 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0717 23:33:58.592501 1779851 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0717 23:33:58.607018 1779851 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0717 23:33:58.698002 1779851 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0717 23:33:58.797936 1779851 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0717 23:33:58.811419 1779851 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0717 23:33:58.830926 1779851 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I0717 23:33:58.843257 1779851 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0717 23:33:58.855660 1779851 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0717 23:33:58.855762 1779851 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0717 23:33:58.868190 1779851 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0717 23:33:58.880789 1779851 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0717 23:33:58.893253 1779851 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0717 23:33:58.904947 1779851 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0717 23:33:58.916420 1779851 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0717 23:33:58.928448 1779851 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0717 23:33:58.939018 1779851 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0717 23:33:58.949318 1779851 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0717 23:33:59.042028 1779851 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0717 23:33:59.131169 1779851 start.go:513] Will wait 60s for socket path /run/containerd/containerd.sock
	I0717 23:33:59.131265 1779851 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0717 23:33:59.135826 1779851 start.go:534] Will wait 60s for crictl version
	I0717 23:33:59.135883 1779851 ssh_runner.go:195] Run: which crictl
	I0717 23:33:59.140265 1779851 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0717 23:33:59.197954 1779851 start.go:550] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.21
	RuntimeApiVersion:  v1
	I0717 23:33:59.198096 1779851 ssh_runner.go:195] Run: containerd --version
	I0717 23:33:59.230391 1779851 ssh_runner.go:195] Run: containerd --version
	I0717 23:33:59.260926 1779851 out.go:177] * Preparing Kubernetes v1.27.3 on containerd 1.6.21 ...
	I0717 23:33:59.262420 1779851 cli_runner.go:164] Run: docker network inspect addons-225437 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0717 23:33:59.279315 1779851 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0717 23:33:59.283940 1779851 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0717 23:33:59.297621 1779851 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime containerd
	I0717 23:33:59.297687 1779851 ssh_runner.go:195] Run: sudo crictl images --output json
	I0717 23:33:59.339297 1779851 containerd.go:604] all images are preloaded for containerd runtime.
	I0717 23:33:59.339317 1779851 containerd.go:518] Images already preloaded, skipping extraction
	I0717 23:33:59.339373 1779851 ssh_runner.go:195] Run: sudo crictl images --output json
	I0717 23:33:59.380420 1779851 containerd.go:604] all images are preloaded for containerd runtime.
	I0717 23:33:59.380443 1779851 cache_images.go:84] Images are preloaded, skipping loading
	I0717 23:33:59.380505 1779851 ssh_runner.go:195] Run: sudo crictl info
	I0717 23:33:59.430040 1779851 cni.go:84] Creating CNI manager for ""
	I0717 23:33:59.430063 1779851 cni.go:149] "docker" driver + "containerd" runtime found, recommending kindnet
	I0717 23:33:59.430074 1779851 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0717 23:33:59.430091 1779851 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.27.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-225437 NodeName:addons-225437 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0717 23:33:59.430218 1779851 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///run/containerd/containerd.sock
	  name: "addons-225437"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.27.3
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0717 23:33:59.430289 1779851 kubeadm.go:976] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.27.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=addons-225437 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.27.3 ClusterName:addons-225437 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0717 23:33:59.430354 1779851 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.27.3
	I0717 23:33:59.440876 1779851 binaries.go:44] Found k8s binaries, skipping transfer
	I0717 23:33:59.440946 1779851 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0717 23:33:59.451131 1779851 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (385 bytes)
	I0717 23:33:59.471923 1779851 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0717 23:33:59.492688 1779851 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2102 bytes)
	I0717 23:33:59.513656 1779851 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0717 23:33:59.518224 1779851 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0717 23:33:59.531611 1779851 certs.go:56] Setting up /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437 for IP: 192.168.49.2
	I0717 23:33:59.531693 1779851 certs.go:190] acquiring lock for shared ca certs: {Name:mk1a0756f7f2633b530348b8dc6aa0086e9260f7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:33:59.532217 1779851 certs.go:204] generating minikubeCA CA: /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.key
	I0717 23:33:59.714317 1779851 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.crt ...
	I0717 23:33:59.714348 1779851 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.crt: {Name:mk857895ca84dbc0170632b874e3e02f0ad2afe6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:33:59.714544 1779851 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.key ...
	I0717 23:33:59.714556 1779851 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.key: {Name:mka814e7f9be05e802c691a08b48064c74b197a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:33:59.714645 1779851 certs.go:204] generating proxyClientCA CA: /home/jenkins/minikube-integration/16899-1773963/.minikube/proxy-client-ca.key
	I0717 23:34:00.583680 1779851 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16899-1773963/.minikube/proxy-client-ca.crt ...
	I0717 23:34:00.583712 1779851 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/proxy-client-ca.crt: {Name:mkba8965f5ac7d44b2433ff5751eddc38f729f95 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:34:00.583907 1779851 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16899-1773963/.minikube/proxy-client-ca.key ...
	I0717 23:34:00.583915 1779851 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/proxy-client-ca.key: {Name:mk29e1ad86629548e31441b347c02706cb3a2e4e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:34:00.584024 1779851 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.key
	I0717 23:34:00.584042 1779851 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt with IP's: []
	I0717 23:34:00.850345 1779851 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt ...
	I0717 23:34:00.850376 1779851 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: {Name:mk38d3df562d34b8e377b92f0654b854cdfc593e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:34:00.850567 1779851 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.key ...
	I0717 23:34:00.850580 1779851 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.key: {Name:mk9a5cc1fd6132eb051ca5e9858f01bb0d5d3d37 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:34:00.851080 1779851 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/apiserver.key.dd3b5fb2
	I0717 23:34:00.851101 1779851 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0717 23:34:01.692136 1779851 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/apiserver.crt.dd3b5fb2 ...
	I0717 23:34:01.692169 1779851 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/apiserver.crt.dd3b5fb2: {Name:mk09e9a10b35a67b6ae85aa8187ada552b48c009 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:34:01.692362 1779851 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/apiserver.key.dd3b5fb2 ...
	I0717 23:34:01.692374 1779851 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/apiserver.key.dd3b5fb2: {Name:mk6cbc53e01b8756b57790346aa6724204d7088a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:34:01.692920 1779851 certs.go:337] copying /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/apiserver.crt
	I0717 23:34:01.693004 1779851 certs.go:341] copying /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/apiserver.key
	I0717 23:34:01.693058 1779851 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/proxy-client.key
	I0717 23:34:01.693082 1779851 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/proxy-client.crt with IP's: []
	I0717 23:34:01.932286 1779851 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/proxy-client.crt ...
	I0717 23:34:01.932318 1779851 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/proxy-client.crt: {Name:mke6f79c68faeb2e77622a437b6b4a23af104953 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:34:01.933024 1779851 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/proxy-client.key ...
	I0717 23:34:01.933041 1779851 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/proxy-client.key: {Name:mkd98962e776cc3b020715bd082f3f8ea90dfc65 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:34:01.933833 1779851 certs.go:437] found cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem (1679 bytes)
	I0717 23:34:01.933879 1779851 certs.go:437] found cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem (1078 bytes)
	I0717 23:34:01.933910 1779851 certs.go:437] found cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem (1123 bytes)
	I0717 23:34:01.933939 1779851 certs.go:437] found cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem (1679 bytes)
	I0717 23:34:01.934555 1779851 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0717 23:34:01.966256 1779851 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0717 23:34:01.998741 1779851 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0717 23:34:02.034005 1779851 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0717 23:34:02.064130 1779851 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0717 23:34:02.094333 1779851 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0717 23:34:02.125989 1779851 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0717 23:34:02.155951 1779851 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0717 23:34:02.185814 1779851 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0717 23:34:02.217770 1779851 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0717 23:34:02.240013 1779851 ssh_runner.go:195] Run: openssl version
	I0717 23:34:02.247430 1779851 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0717 23:34:02.259657 1779851 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0717 23:34:02.264512 1779851 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Jul 17 23:33 /usr/share/ca-certificates/minikubeCA.pem
	I0717 23:34:02.264597 1779851 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0717 23:34:02.273296 1779851 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0717 23:34:02.285572 1779851 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0717 23:34:02.290206 1779851 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0717 23:34:02.290253 1779851 kubeadm.go:404] StartCluster: {Name:addons-225437 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:addons-225437 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clu
ster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQ
emuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 23:34:02.290335 1779851 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0717 23:34:02.290402 1779851 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0717 23:34:02.335012 1779851 cri.go:89] found id: ""
	I0717 23:34:02.335150 1779851 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0717 23:34:02.346489 1779851 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0717 23:34:02.357301 1779851 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0717 23:34:02.357390 1779851 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0717 23:34:02.368727 1779851 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0717 23:34:02.368769 1779851 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0717 23:34:02.424198 1779851 kubeadm.go:322] [init] Using Kubernetes version: v1.27.3
	I0717 23:34:02.424261 1779851 kubeadm.go:322] [preflight] Running pre-flight checks
	I0717 23:34:02.469470 1779851 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0717 23:34:02.469542 1779851 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1039-aws
	I0717 23:34:02.469579 1779851 kubeadm.go:322] OS: Linux
	I0717 23:34:02.469629 1779851 kubeadm.go:322] CGROUPS_CPU: enabled
	I0717 23:34:02.469681 1779851 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0717 23:34:02.469749 1779851 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0717 23:34:02.469804 1779851 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0717 23:34:02.469863 1779851 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0717 23:34:02.469942 1779851 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0717 23:34:02.469989 1779851 kubeadm.go:322] CGROUPS_PIDS: enabled
	I0717 23:34:02.470047 1779851 kubeadm.go:322] CGROUPS_HUGETLB: enabled
	I0717 23:34:02.470095 1779851 kubeadm.go:322] CGROUPS_BLKIO: enabled
	I0717 23:34:02.555305 1779851 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0717 23:34:02.555418 1779851 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0717 23:34:02.555511 1779851 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0717 23:34:02.817524 1779851 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0717 23:34:02.820535 1779851 out.go:204]   - Generating certificates and keys ...
	I0717 23:34:02.820634 1779851 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0717 23:34:02.820702 1779851 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0717 23:34:03.122858 1779851 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0717 23:34:03.561678 1779851 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0717 23:34:04.152371 1779851 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0717 23:34:04.557277 1779851 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0717 23:34:05.240333 1779851 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0717 23:34:05.240730 1779851 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-225437 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0717 23:34:05.992180 1779851 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0717 23:34:05.992471 1779851 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-225437 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0717 23:34:06.521665 1779851 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0717 23:34:07.146073 1779851 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0717 23:34:07.377525 1779851 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0717 23:34:07.377829 1779851 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0717 23:34:07.609201 1779851 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0717 23:34:07.898450 1779851 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0717 23:34:08.082838 1779851 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0717 23:34:08.653724 1779851 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0717 23:34:08.667786 1779851 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0717 23:34:08.669320 1779851 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0717 23:34:08.669667 1779851 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0717 23:34:08.768442 1779851 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0717 23:34:08.770646 1779851 out.go:204]   - Booting up control plane ...
	I0717 23:34:08.770757 1779851 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0717 23:34:08.773935 1779851 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0717 23:34:08.784704 1779851 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0717 23:34:08.786215 1779851 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0717 23:34:08.789217 1779851 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0717 23:34:16.293299 1779851 kubeadm.go:322] [apiclient] All control plane components are healthy after 7.502738 seconds
	I0717 23:34:16.293419 1779851 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0717 23:34:16.308056 1779851 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0717 23:34:16.836318 1779851 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0717 23:34:16.836503 1779851 kubeadm.go:322] [mark-control-plane] Marking the node addons-225437 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0717 23:34:17.346726 1779851 kubeadm.go:322] [bootstrap-token] Using token: g6efqc.99iim7iw1qowquu7
	I0717 23:34:17.348638 1779851 out.go:204]   - Configuring RBAC rules ...
	I0717 23:34:17.348771 1779851 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0717 23:34:17.354615 1779851 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0717 23:34:17.362889 1779851 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0717 23:34:17.367023 1779851 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0717 23:34:17.370874 1779851 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0717 23:34:17.376453 1779851 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0717 23:34:17.394431 1779851 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0717 23:34:17.651092 1779851 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0717 23:34:17.761544 1779851 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0717 23:34:17.762325 1779851 kubeadm.go:322] 
	I0717 23:34:17.762392 1779851 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0717 23:34:17.762398 1779851 kubeadm.go:322] 
	I0717 23:34:17.762470 1779851 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0717 23:34:17.762475 1779851 kubeadm.go:322] 
	I0717 23:34:17.762499 1779851 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0717 23:34:17.762554 1779851 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0717 23:34:17.762602 1779851 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0717 23:34:17.762606 1779851 kubeadm.go:322] 
	I0717 23:34:17.762657 1779851 kubeadm.go:322] Alternatively, if you are the root user, you can run:
	I0717 23:34:17.762662 1779851 kubeadm.go:322] 
	I0717 23:34:17.762707 1779851 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0717 23:34:17.762711 1779851 kubeadm.go:322] 
	I0717 23:34:17.762760 1779851 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0717 23:34:17.762830 1779851 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0717 23:34:17.762894 1779851 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0717 23:34:17.762899 1779851 kubeadm.go:322] 
	I0717 23:34:17.762977 1779851 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0717 23:34:17.763049 1779851 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0717 23:34:17.763054 1779851 kubeadm.go:322] 
	I0717 23:34:17.763132 1779851 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token g6efqc.99iim7iw1qowquu7 \
	I0717 23:34:17.763241 1779851 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:24e6e85287b2ebc7031b3b104d990fde329a6ed6ae7e93d24f1e459f7a5f641f \
	I0717 23:34:17.763267 1779851 kubeadm.go:322] 	--control-plane 
	I0717 23:34:17.763272 1779851 kubeadm.go:322] 
	I0717 23:34:17.763351 1779851 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0717 23:34:17.763355 1779851 kubeadm.go:322] 
	I0717 23:34:17.763432 1779851 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token g6efqc.99iim7iw1qowquu7 \
	I0717 23:34:17.763527 1779851 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:24e6e85287b2ebc7031b3b104d990fde329a6ed6ae7e93d24f1e459f7a5f641f 
	I0717 23:34:17.767542 1779851 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1039-aws\n", err: exit status 1
	I0717 23:34:17.767659 1779851 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0717 23:34:17.767673 1779851 cni.go:84] Creating CNI manager for ""
	I0717 23:34:17.767683 1779851 cni.go:149] "docker" driver + "containerd" runtime found, recommending kindnet
	I0717 23:34:17.769896 1779851 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0717 23:34:17.771760 1779851 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0717 23:34:17.782730 1779851 cni.go:188] applying CNI manifest using /var/lib/minikube/binaries/v1.27.3/kubectl ...
	I0717 23:34:17.782750 1779851 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
	I0717 23:34:17.814559 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0717 23:34:18.762435 1779851 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0717 23:34:18.762572 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:18.762653 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl label nodes minikube.k8s.io/version=v1.31.0 minikube.k8s.io/commit=b76e7e219387ed29a8027b03764cb35e04d80ac8 minikube.k8s.io/name=addons-225437 minikube.k8s.io/updated_at=2023_07_17T23_34_18_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:18.946411 1779851 ops.go:34] apiserver oom_adj: -16
	I0717 23:34:18.946513 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:19.553410 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:20.053940 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:20.553445 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:21.054241 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:21.553833 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:22.053704 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:22.553872 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:23.053820 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:23.553330 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:24.053292 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:24.553978 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:25.054010 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:25.553317 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:26.053316 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:26.553300 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:27.053636 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:27.553565 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:28.054211 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:28.554091 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:29.053962 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:29.553696 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:30.053736 1779851 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.27.3/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:34:30.225087 1779851 kubeadm.go:1081] duration metric: took 11.462562928s to wait for elevateKubeSystemPrivileges.
	I0717 23:34:30.225124 1779851 kubeadm.go:406] StartCluster complete in 27.934874226s
	I0717 23:34:30.225142 1779851 settings.go:142] acquiring lock: {Name:mk76776fb395317efa56a4deef1ca709888670e3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:34:30.225710 1779851 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/16899-1773963/kubeconfig
	I0717 23:34:30.226113 1779851 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/kubeconfig: {Name:mk030404123fbc4983ca7ea10e5affac98840d29 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:34:30.226777 1779851 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0717 23:34:30.227155 1779851 config.go:182] Loaded profile config "addons-225437": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
	I0717 23:34:30.227331 1779851 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:true]
	I0717 23:34:30.227407 1779851 addons.go:69] Setting volumesnapshots=true in profile "addons-225437"
	I0717 23:34:30.227430 1779851 addons.go:231] Setting addon volumesnapshots=true in "addons-225437"
	I0717 23:34:30.227474 1779851 host.go:66] Checking if "addons-225437" exists ...
	I0717 23:34:30.227975 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:34:30.229530 1779851 addons.go:69] Setting cloud-spanner=true in profile "addons-225437"
	I0717 23:34:30.229565 1779851 addons.go:231] Setting addon cloud-spanner=true in "addons-225437"
	I0717 23:34:30.229610 1779851 host.go:66] Checking if "addons-225437" exists ...
	I0717 23:34:30.230268 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:34:30.244683 1779851 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-225437"
	I0717 23:34:30.244773 1779851 addons.go:231] Setting addon csi-hostpath-driver=true in "addons-225437"
	I0717 23:34:30.244839 1779851 host.go:66] Checking if "addons-225437" exists ...
	I0717 23:34:30.245484 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:34:30.253340 1779851 addons.go:69] Setting ingress-dns=true in profile "addons-225437"
	I0717 23:34:30.253374 1779851 addons.go:231] Setting addon ingress-dns=true in "addons-225437"
	I0717 23:34:30.253531 1779851 host.go:66] Checking if "addons-225437" exists ...
	I0717 23:34:30.260059 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:34:30.260560 1779851 addons.go:69] Setting default-storageclass=true in profile "addons-225437"
	I0717 23:34:30.260583 1779851 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-225437"
	I0717 23:34:30.261246 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:34:30.261528 1779851 addons.go:69] Setting gcp-auth=true in profile "addons-225437"
	I0717 23:34:30.261555 1779851 mustload.go:65] Loading cluster: addons-225437
	I0717 23:34:30.261784 1779851 config.go:182] Loaded profile config "addons-225437": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
	I0717 23:34:30.262217 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:34:30.262433 1779851 addons.go:69] Setting ingress=true in profile "addons-225437"
	I0717 23:34:30.262452 1779851 addons.go:231] Setting addon ingress=true in "addons-225437"
	I0717 23:34:30.262501 1779851 host.go:66] Checking if "addons-225437" exists ...
	I0717 23:34:30.263293 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:34:30.276594 1779851 addons.go:69] Setting inspektor-gadget=true in profile "addons-225437"
	I0717 23:34:30.276627 1779851 addons.go:231] Setting addon inspektor-gadget=true in "addons-225437"
	I0717 23:34:30.276684 1779851 host.go:66] Checking if "addons-225437" exists ...
	I0717 23:34:30.277139 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:34:30.277252 1779851 addons.go:69] Setting metrics-server=true in profile "addons-225437"
	I0717 23:34:30.277263 1779851 addons.go:231] Setting addon metrics-server=true in "addons-225437"
	I0717 23:34:30.277292 1779851 host.go:66] Checking if "addons-225437" exists ...
	I0717 23:34:30.277697 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:34:30.277777 1779851 addons.go:69] Setting registry=true in profile "addons-225437"
	I0717 23:34:30.277791 1779851 addons.go:231] Setting addon registry=true in "addons-225437"
	I0717 23:34:30.277816 1779851 host.go:66] Checking if "addons-225437" exists ...
	I0717 23:34:30.278177 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:34:30.278248 1779851 addons.go:69] Setting storage-provisioner=true in profile "addons-225437"
	I0717 23:34:30.278260 1779851 addons.go:231] Setting addon storage-provisioner=true in "addons-225437"
	I0717 23:34:30.278284 1779851 host.go:66] Checking if "addons-225437" exists ...
	I0717 23:34:30.326610 1779851 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I0717 23:34:30.323690 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:34:30.361681 1779851 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.7
	I0717 23:34:30.363846 1779851 addons.go:423] installing /etc/kubernetes/addons/deployment.yaml
	I0717 23:34:30.363905 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1003 bytes)
	I0717 23:34:30.363985 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:34:30.369089 1779851 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I0717 23:34:30.374938 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I0717 23:34:30.375301 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:34:30.379781 1779851 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2
	I0717 23:34:30.381714 1779851 addons.go:423] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0717 23:34:30.381783 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I0717 23:34:30.381890 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:34:30.450109 1779851 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I0717 23:34:30.461408 1779851 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I0717 23:34:30.476632 1779851 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I0717 23:34:30.461899 1779851 host.go:66] Checking if "addons-225437" exists ...
	I0717 23:34:30.487498 1779851 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I0717 23:34:30.491182 1779851 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I0717 23:34:30.502635 1779851 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I0717 23:34:30.505299 1779851 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I0717 23:34:30.509282 1779851 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I0717 23:34:30.514486 1779851 addons.go:423] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I0717 23:34:30.514550 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I0717 23:34:30.514641 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:34:30.515608 1779851 addons.go:231] Setting addon default-storageclass=true in "addons-225437"
	I0717 23:34:30.515650 1779851 host.go:66] Checking if "addons-225437" exists ...
	I0717 23:34:30.518638 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:34:30.580406 1779851 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0717 23:34:30.584269 1779851 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0717 23:34:30.584274 1779851 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.6.3
	I0717 23:34:30.589322 1779851 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.18.1
	I0717 23:34:30.597288 1779851 addons.go:423] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0717 23:34:30.597311 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0717 23:34:30.597380 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:34:30.597608 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:34:30.600971 1779851 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.5
	I0717 23:34:30.598850 1779851 addons.go:423] installing /etc/kubernetes/addons/ig-namespace.yaml
	I0717 23:34:30.607762 1779851 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.8.1
	I0717 23:34:30.603268 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I0717 23:34:30.609386 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:34:30.609781 1779851 addons.go:423] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I0717 23:34:30.609795 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16083 bytes)
	I0717 23:34:30.609834 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:34:30.609897 1779851 out.go:177]   - Using image docker.io/registry:2.8.1
	I0717 23:34:30.613334 1779851 addons.go:423] installing /etc/kubernetes/addons/registry-rc.yaml
	I0717 23:34:30.613352 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)
	I0717 23:34:30.613408 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:34:30.650984 1779851 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0717 23:34:30.652724 1779851 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0717 23:34:30.652749 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0717 23:34:30.652824 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:34:30.677690 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:34:30.718093 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:34:30.747118 1779851 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I0717 23:34:30.747139 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0717 23:34:30.747207 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:34:30.749330 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:34:30.779409 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:34:30.789969 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:34:30.834699 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:34:30.864220 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:34:30.881258 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:34:30.882629 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:34:30.898605 1779851 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0717 23:34:30.966302 1779851 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-225437" context rescaled to 1 replicas
	I0717 23:34:30.966398 1779851 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0717 23:34:30.969880 1779851 out.go:177] * Verifying Kubernetes components...
	I0717 23:34:30.971692 1779851 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 23:34:31.296668 1779851 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I0717 23:34:31.296698 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I0717 23:34:31.352355 1779851 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I0717 23:34:31.467141 1779851 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I0717 23:34:31.478444 1779851 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0717 23:34:31.520055 1779851 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0717 23:34:31.639143 1779851 addons.go:423] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0717 23:34:31.639177 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I0717 23:34:31.733829 1779851 addons.go:423] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I0717 23:34:31.733852 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I0717 23:34:31.756900 1779851 addons.go:423] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0717 23:34:31.756925 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0717 23:34:31.768169 1779851 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I0717 23:34:31.768193 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I0717 23:34:31.774258 1779851 addons.go:423] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I0717 23:34:31.774284 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I0717 23:34:31.799208 1779851 addons.go:423] installing /etc/kubernetes/addons/registry-svc.yaml
	I0717 23:34:31.799233 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I0717 23:34:31.802477 1779851 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0717 23:34:31.883476 1779851 addons.go:423] installing /etc/kubernetes/addons/ig-role.yaml
	I0717 23:34:31.883503 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I0717 23:34:31.919972 1779851 addons.go:423] installing /etc/kubernetes/addons/registry-proxy.yaml
	I0717 23:34:31.920044 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I0717 23:34:31.999190 1779851 addons.go:423] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I0717 23:34:31.999267 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I0717 23:34:32.008240 1779851 addons.go:423] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0717 23:34:32.008312 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0717 23:34:32.120202 1779851 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I0717 23:34:32.132882 1779851 addons.go:423] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I0717 23:34:32.132949 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I0717 23:34:32.218721 1779851 addons.go:423] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I0717 23:34:32.218788 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I0717 23:34:32.237719 1779851 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0717 23:34:32.247442 1779851 addons.go:423] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I0717 23:34:32.247518 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I0717 23:34:32.316546 1779851 addons.go:423] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I0717 23:34:32.316604 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I0717 23:34:32.319806 1779851 addons.go:423] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I0717 23:34:32.319826 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I0717 23:34:32.366144 1779851 addons.go:423] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I0717 23:34:32.366171 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I0717 23:34:32.380139 1779851 addons.go:423] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0717 23:34:32.380159 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I0717 23:34:32.446003 1779851 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I0717 23:34:32.446063 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I0717 23:34:32.465858 1779851 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I0717 23:34:32.465928 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I0717 23:34:32.582888 1779851 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0717 23:34:32.664998 1779851 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I0717 23:34:32.665020 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I0717 23:34:32.676725 1779851 addons.go:423] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I0717 23:34:32.676793 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I0717 23:34:32.849215 1779851 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I0717 23:34:32.849285 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I0717 23:34:32.979079 1779851 addons.go:423] installing /etc/kubernetes/addons/ig-crd.yaml
	I0717 23:34:32.979170 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I0717 23:34:33.083774 1779851 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I0717 23:34:33.083845 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I0717 23:34:33.236176 1779851 addons.go:423] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I0717 23:34:33.236242 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7741 bytes)
	I0717 23:34:33.318838 1779851 addons.go:423] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0717 23:34:33.318907 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I0717 23:34:33.365625 1779851 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (2.393895623s)
	I0717 23:34:33.365699 1779851 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.27.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.467069763s)
	I0717 23:34:33.365786 1779851 start.go:901] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0717 23:34:33.366702 1779851 node_ready.go:35] waiting up to 6m0s for node "addons-225437" to be "Ready" ...
	I0717 23:34:33.370379 1779851 node_ready.go:49] node "addons-225437" has status "Ready":"True"
	I0717 23:34:33.370438 1779851 node_ready.go:38] duration metric: took 3.689046ms waiting for node "addons-225437" to be "Ready" ...
	I0717 23:34:33.370463 1779851 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0717 23:34:33.379626 1779851 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5d78c9869d-wqt5f" in "kube-system" namespace to be "Ready" ...
	I0717 23:34:33.416334 1779851 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I0717 23:34:33.593930 1779851 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0717 23:34:34.135779 1779851 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (2.783388703s)
	I0717 23:34:35.442346 1779851 pod_ready.go:102] pod "coredns-5d78c9869d-wqt5f" in "kube-system" namespace has status "Ready":"False"
	I0717 23:34:37.308938 1779851 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I0717 23:34:37.309060 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:34:37.340309 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:34:37.443385 1779851 pod_ready.go:102] pod "coredns-5d78c9869d-wqt5f" in "kube-system" namespace has status "Ready":"False"
	I0717 23:34:37.536596 1779851 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (6.069411731s)
	I0717 23:34:37.536671 1779851 addons.go:467] Verifying addon ingress=true in "addons-225437"
	I0717 23:34:37.538674 1779851 out.go:177] * Verifying ingress addon...
	I0717 23:34:37.536876 1779851 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (6.058405649s)
	I0717 23:34:37.537005 1779851 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (6.016922085s)
	I0717 23:34:37.537055 1779851 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (5.73455428s)
	I0717 23:34:37.537086 1779851 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (5.416816175s)
	I0717 23:34:37.537145 1779851 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (5.299365727s)
	I0717 23:34:37.537257 1779851 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (4.95433969s)
	I0717 23:34:37.537340 1779851 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (4.120923799s)
	I0717 23:34:37.538947 1779851 addons.go:467] Verifying addon metrics-server=true in "addons-225437"
	I0717 23:34:37.538956 1779851 addons.go:467] Verifying addon registry=true in "addons-225437"
	W0717 23:34:37.538984 1779851 addons.go:449] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0717 23:34:37.542400 1779851 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I0717 23:34:37.544023 1779851 out.go:177] * Verifying registry addon...
	I0717 23:34:37.551475 1779851 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I0717 23:34:37.544135 1779851 retry.go:31] will retry after 224.927211ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0717 23:34:37.548912 1779851 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I0717 23:34:37.551674 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:37.557119 1779851 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I0717 23:34:37.557201 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:37.603661 1779851 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I0717 23:34:37.651830 1779851 addons.go:231] Setting addon gcp-auth=true in "addons-225437"
	I0717 23:34:37.651921 1779851 host.go:66] Checking if "addons-225437" exists ...
	I0717 23:34:37.652433 1779851 cli_runner.go:164] Run: docker container inspect addons-225437 --format={{.State.Status}}
	I0717 23:34:37.672916 1779851 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I0717 23:34:37.672974 1779851 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-225437
	I0717 23:34:37.704666 1779851 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34658 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/addons-225437/id_rsa Username:docker}
	I0717 23:34:37.777108 1779851 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0717 23:34:38.061991 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:38.078350 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:38.573297 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:38.574848 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:39.060029 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:39.066339 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:39.374177 1779851 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (5.780153302s)
	I0717 23:34:39.374270 1779851 addons.go:467] Verifying addon csi-hostpath-driver=true in "addons-225437"
	I0717 23:34:39.377812 1779851 out.go:177] * Verifying csi-hostpath-driver addon...
	I0717 23:34:39.380573 1779851 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I0717 23:34:39.386629 1779851 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0717 23:34:39.386658 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:39.557336 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:39.562301 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:39.790578 1779851 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.117635273s)
	I0717 23:34:39.794137 1779851 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230407
	I0717 23:34:39.790791 1779851 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.013397723s)
	I0717 23:34:39.799300 1779851 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0
	I0717 23:34:39.801371 1779851 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I0717 23:34:39.801401 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I0717 23:34:39.847683 1779851 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I0717 23:34:39.847763 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I0717 23:34:39.880555 1779851 addons.go:423] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0717 23:34:39.880636 1779851 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5412 bytes)
	I0717 23:34:39.896981 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:39.900862 1779851 pod_ready.go:102] pod "coredns-5d78c9869d-wqt5f" in "kube-system" namespace has status "Ready":"False"
	I0717 23:34:39.945316 1779851 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.27.3/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0717 23:34:40.058227 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:40.063687 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:40.395595 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:40.557355 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:40.562693 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:40.792538 1779851 addons.go:467] Verifying addon gcp-auth=true in "addons-225437"
	I0717 23:34:40.794684 1779851 out.go:177] * Verifying gcp-auth addon...
	I0717 23:34:40.797208 1779851 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I0717 23:34:40.809406 1779851 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0717 23:34:40.809473 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:40.896592 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:41.057282 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:41.062296 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:41.313393 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:41.395695 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:41.557441 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:41.562378 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:41.813774 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:41.894569 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:42.057793 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:42.062565 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:42.313831 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:42.394468 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:42.396277 1779851 pod_ready.go:102] pod "coredns-5d78c9869d-wqt5f" in "kube-system" namespace has status "Ready":"False"
	I0717 23:34:42.557285 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:42.561332 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:42.814061 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:42.897011 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:43.057224 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:43.061883 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:43.313901 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:43.397526 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:43.556757 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:43.562777 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:43.814496 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:43.895996 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:44.079032 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:44.079593 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:44.313630 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:44.394506 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:44.557043 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:44.563035 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:44.814391 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:44.894392 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:44.896943 1779851 pod_ready.go:102] pod "coredns-5d78c9869d-wqt5f" in "kube-system" namespace has status "Ready":"False"
	I0717 23:34:45.058010 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:45.073743 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:45.313984 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:45.397121 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:45.402839 1779851 pod_ready.go:92] pod "coredns-5d78c9869d-wqt5f" in "kube-system" namespace has status "Ready":"True"
	I0717 23:34:45.402944 1779851 pod_ready.go:81] duration metric: took 12.023249942s waiting for pod "coredns-5d78c9869d-wqt5f" in "kube-system" namespace to be "Ready" ...
	I0717 23:34:45.403087 1779851 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-225437" in "kube-system" namespace to be "Ready" ...
	I0717 23:34:45.413083 1779851 pod_ready.go:92] pod "etcd-addons-225437" in "kube-system" namespace has status "Ready":"True"
	I0717 23:34:45.413144 1779851 pod_ready.go:81] duration metric: took 10.005329ms waiting for pod "etcd-addons-225437" in "kube-system" namespace to be "Ready" ...
	I0717 23:34:45.413177 1779851 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-225437" in "kube-system" namespace to be "Ready" ...
	I0717 23:34:45.422063 1779851 pod_ready.go:92] pod "kube-apiserver-addons-225437" in "kube-system" namespace has status "Ready":"True"
	I0717 23:34:45.422090 1779851 pod_ready.go:81] duration metric: took 8.902635ms waiting for pod "kube-apiserver-addons-225437" in "kube-system" namespace to be "Ready" ...
	I0717 23:34:45.422103 1779851 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-225437" in "kube-system" namespace to be "Ready" ...
	I0717 23:34:45.432451 1779851 pod_ready.go:92] pod "kube-controller-manager-addons-225437" in "kube-system" namespace has status "Ready":"True"
	I0717 23:34:45.432477 1779851 pod_ready.go:81] duration metric: took 10.364237ms waiting for pod "kube-controller-manager-addons-225437" in "kube-system" namespace to be "Ready" ...
	I0717 23:34:45.432491 1779851 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-vjn2r" in "kube-system" namespace to be "Ready" ...
	I0717 23:34:45.441273 1779851 pod_ready.go:92] pod "kube-proxy-vjn2r" in "kube-system" namespace has status "Ready":"True"
	I0717 23:34:45.441297 1779851 pod_ready.go:81] duration metric: took 8.79847ms waiting for pod "kube-proxy-vjn2r" in "kube-system" namespace to be "Ready" ...
	I0717 23:34:45.441310 1779851 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-225437" in "kube-system" namespace to be "Ready" ...
	I0717 23:34:45.576429 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:45.577415 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:45.791180 1779851 pod_ready.go:92] pod "kube-scheduler-addons-225437" in "kube-system" namespace has status "Ready":"True"
	I0717 23:34:45.791204 1779851 pod_ready.go:81] duration metric: took 349.886453ms waiting for pod "kube-scheduler-addons-225437" in "kube-system" namespace to be "Ready" ...
	I0717 23:34:45.791213 1779851 pod_ready.go:38] duration metric: took 12.420727094s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0717 23:34:45.791248 1779851 api_server.go:52] waiting for apiserver process to appear ...
	I0717 23:34:45.791324 1779851 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0717 23:34:45.808714 1779851 api_server.go:72] duration metric: took 14.842246797s to wait for apiserver process to appear ...
	I0717 23:34:45.808740 1779851 api_server.go:88] waiting for apiserver healthz status ...
	I0717 23:34:45.808759 1779851 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0717 23:34:45.818577 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:45.818733 1779851 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0717 23:34:45.820098 1779851 api_server.go:141] control plane version: v1.27.3
	I0717 23:34:45.820121 1779851 api_server.go:131] duration metric: took 11.372638ms to wait for apiserver health ...
	I0717 23:34:45.820129 1779851 system_pods.go:43] waiting for kube-system pods to appear ...
	I0717 23:34:45.892748 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:45.998531 1779851 system_pods.go:59] 17 kube-system pods found
	I0717 23:34:45.998568 1779851 system_pods.go:61] "coredns-5d78c9869d-wqt5f" [089f565e-f54f-48bf-adfd-079a03b1455a] Running
	I0717 23:34:45.998578 1779851 system_pods.go:61] "csi-hostpath-attacher-0" [867c9899-f490-48d2-b91e-09a95bc90106] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0717 23:34:45.998588 1779851 system_pods.go:61] "csi-hostpath-resizer-0" [98372872-82e8-410a-9660-7d70263a3de2] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0717 23:34:45.998622 1779851 system_pods.go:61] "csi-hostpathplugin-pbglb" [982add11-5b87-4a42-bd0b-6681ba643a70] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0717 23:34:45.998639 1779851 system_pods.go:61] "etcd-addons-225437" [c42e4793-8647-489f-a8ed-3213b5b42acf] Running
	I0717 23:34:45.998646 1779851 system_pods.go:61] "kindnet-kxgbd" [c119867c-8138-4d40-a2b6-690796a1e142] Running
	I0717 23:34:45.998655 1779851 system_pods.go:61] "kube-apiserver-addons-225437" [f731180a-4ce6-43a4-b340-e936c5cc2f46] Running
	I0717 23:34:45.998661 1779851 system_pods.go:61] "kube-controller-manager-addons-225437" [323e8041-75c6-43f0-8497-4b484d86872e] Running
	I0717 23:34:45.998675 1779851 system_pods.go:61] "kube-ingress-dns-minikube" [e7dbf71c-9669-4ff8-a4d9-3551afafa6ec] Running / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0717 23:34:45.998681 1779851 system_pods.go:61] "kube-proxy-vjn2r" [210a708a-1793-4d4e-a23b-5d95d93cf449] Running
	I0717 23:34:45.998702 1779851 system_pods.go:61] "kube-scheduler-addons-225437" [b4b56813-5272-4646-b993-1a07c64cd739] Running
	I0717 23:34:45.998717 1779851 system_pods.go:61] "metrics-server-844d8db974-rgqwg" [bdf7b9b1-aa0a-4a0b-ab1e-40b88314e21e] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0717 23:34:45.998728 1779851 system_pods.go:61] "registry-mpd5g" [6d2458e5-2aa3-4a34-944f-b3156a771a51] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0717 23:34:45.998740 1779851 system_pods.go:61] "registry-proxy-mt8xb" [35338a9d-2f69-4958-9f69-ae884a7b90ec] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0717 23:34:45.998749 1779851 system_pods.go:61] "snapshot-controller-75bbb956b9-frrlr" [7392b88e-2943-499a-a7e7-8a6f396de403] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0717 23:34:45.998758 1779851 system_pods.go:61] "snapshot-controller-75bbb956b9-x6brx" [95324119-3ed8-44ed-b027-7bcc0f3bcadf] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0717 23:34:45.998774 1779851 system_pods.go:61] "storage-provisioner" [cba8595d-3ea8-4f40-8638-e7765e03dac4] Running
	I0717 23:34:45.998781 1779851 system_pods.go:74] duration metric: took 178.647045ms to wait for pod list to return data ...
	I0717 23:34:45.998789 1779851 default_sa.go:34] waiting for default service account to be created ...
	I0717 23:34:46.057450 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:46.062444 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:46.190468 1779851 default_sa.go:45] found service account: "default"
	I0717 23:34:46.190496 1779851 default_sa.go:55] duration metric: took 191.702003ms for default service account to be created ...
	I0717 23:34:46.190506 1779851 system_pods.go:116] waiting for k8s-apps to be running ...
	I0717 23:34:46.313064 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:46.393086 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:46.399807 1779851 system_pods.go:86] 17 kube-system pods found
	I0717 23:34:46.399842 1779851 system_pods.go:89] "coredns-5d78c9869d-wqt5f" [089f565e-f54f-48bf-adfd-079a03b1455a] Running
	I0717 23:34:46.399853 1779851 system_pods.go:89] "csi-hostpath-attacher-0" [867c9899-f490-48d2-b91e-09a95bc90106] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0717 23:34:46.399861 1779851 system_pods.go:89] "csi-hostpath-resizer-0" [98372872-82e8-410a-9660-7d70263a3de2] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0717 23:34:46.399871 1779851 system_pods.go:89] "csi-hostpathplugin-pbglb" [982add11-5b87-4a42-bd0b-6681ba643a70] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0717 23:34:46.399877 1779851 system_pods.go:89] "etcd-addons-225437" [c42e4793-8647-489f-a8ed-3213b5b42acf] Running
	I0717 23:34:46.399883 1779851 system_pods.go:89] "kindnet-kxgbd" [c119867c-8138-4d40-a2b6-690796a1e142] Running
	I0717 23:34:46.399893 1779851 system_pods.go:89] "kube-apiserver-addons-225437" [f731180a-4ce6-43a4-b340-e936c5cc2f46] Running
	I0717 23:34:46.399899 1779851 system_pods.go:89] "kube-controller-manager-addons-225437" [323e8041-75c6-43f0-8497-4b484d86872e] Running
	I0717 23:34:46.399909 1779851 system_pods.go:89] "kube-ingress-dns-minikube" [e7dbf71c-9669-4ff8-a4d9-3551afafa6ec] Running / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0717 23:34:46.399914 1779851 system_pods.go:89] "kube-proxy-vjn2r" [210a708a-1793-4d4e-a23b-5d95d93cf449] Running
	I0717 23:34:46.399926 1779851 system_pods.go:89] "kube-scheduler-addons-225437" [b4b56813-5272-4646-b993-1a07c64cd739] Running
	I0717 23:34:46.399933 1779851 system_pods.go:89] "metrics-server-844d8db974-rgqwg" [bdf7b9b1-aa0a-4a0b-ab1e-40b88314e21e] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0717 23:34:46.399944 1779851 system_pods.go:89] "registry-mpd5g" [6d2458e5-2aa3-4a34-944f-b3156a771a51] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0717 23:34:46.399956 1779851 system_pods.go:89] "registry-proxy-mt8xb" [35338a9d-2f69-4958-9f69-ae884a7b90ec] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0717 23:34:46.399969 1779851 system_pods.go:89] "snapshot-controller-75bbb956b9-frrlr" [7392b88e-2943-499a-a7e7-8a6f396de403] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0717 23:34:46.399977 1779851 system_pods.go:89] "snapshot-controller-75bbb956b9-x6brx" [95324119-3ed8-44ed-b027-7bcc0f3bcadf] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0717 23:34:46.399982 1779851 system_pods.go:89] "storage-provisioner" [cba8595d-3ea8-4f40-8638-e7765e03dac4] Running
	I0717 23:34:46.399992 1779851 system_pods.go:126] duration metric: took 209.48104ms to wait for k8s-apps to be running ...
	I0717 23:34:46.400003 1779851 system_svc.go:44] waiting for kubelet service to be running ....
	I0717 23:34:46.400062 1779851 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 23:34:46.413799 1779851 system_svc.go:56] duration metric: took 13.787674ms WaitForService to wait for kubelet.
	I0717 23:34:46.413826 1779851 kubeadm.go:581] duration metric: took 15.447363638s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0717 23:34:46.413865 1779851 node_conditions.go:102] verifying NodePressure condition ...
	I0717 23:34:46.556594 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:46.562333 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:46.591370 1779851 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0717 23:34:46.591401 1779851 node_conditions.go:123] node cpu capacity is 2
	I0717 23:34:46.591416 1779851 node_conditions.go:105] duration metric: took 177.541422ms to run NodePressure ...
	I0717 23:34:46.591428 1779851 start.go:228] waiting for startup goroutines ...
	I0717 23:34:46.813619 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:46.893262 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:47.056517 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:47.063367 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:47.313268 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:47.392956 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:47.556357 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:47.561973 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:47.814529 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:47.892579 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:48.057282 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:48.062200 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:48.313828 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:48.396242 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:48.560030 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:48.565268 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:48.813484 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:48.893698 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:49.056707 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:49.062589 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:49.315044 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:49.393319 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:49.559787 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:49.563471 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:49.813997 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:49.894067 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:50.057473 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:50.062113 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:50.313436 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:50.393672 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:50.557933 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:50.562725 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:50.814056 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:50.892994 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:51.057011 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:51.064399 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0717 23:34:51.313367 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:51.393926 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:51.556504 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:51.561926 1779851 kapi.go:107] duration metric: took 14.010451597s to wait for kubernetes.io/minikube-addons=registry ...
	I0717 23:34:51.813869 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:51.893207 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:52.056629 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:52.317516 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:52.394791 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:52.556071 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:52.814059 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:52.893418 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:53.056854 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:53.314911 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:53.394030 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:53.556306 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:53.813551 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:53.892347 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:54.056835 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:54.313695 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:54.392283 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:54.557358 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:54.814156 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:54.893494 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:55.056898 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:55.314325 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:55.393641 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:55.559504 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:55.816241 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:55.896380 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:56.076747 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:56.318718 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:56.409481 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:56.559186 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:56.817709 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:56.896089 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:57.057856 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:57.316879 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:57.393466 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:57.556928 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:57.815625 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:57.894259 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:58.057035 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:58.317927 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:58.394626 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:58.574950 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:58.813815 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:58.895884 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:59.056691 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:59.313596 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:59.393638 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:34:59.557025 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:34:59.813317 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:34:59.893625 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:00.057998 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:00.315660 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:00.394195 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:00.557898 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:00.814148 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:00.893655 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:01.057509 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:01.314324 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:01.393533 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:01.558025 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:01.813921 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:01.894176 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:02.057447 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:02.313831 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:02.393945 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:02.558205 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:02.814527 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:02.892971 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:03.057051 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:03.313739 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:03.393305 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:03.557602 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:03.814413 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:03.893307 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:04.057032 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:04.314408 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:04.392641 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:04.558112 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:04.814082 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:04.894202 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:05.056690 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:05.313473 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:05.392929 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:05.556781 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:05.814406 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:05.895122 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:06.056510 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:06.314385 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:06.394289 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:06.573859 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:06.814076 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:06.897553 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:07.057135 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:07.313976 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:07.394877 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:07.556850 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:07.814251 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:07.894106 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:08.056424 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:08.313698 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:08.393045 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:08.565775 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:08.814933 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:08.894135 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:09.056954 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:09.320274 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:09.393214 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:09.557876 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:09.814254 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:09.892739 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:10.056418 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:10.316994 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:10.398432 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:10.556940 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:10.814139 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:10.894117 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:11.057624 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:11.314482 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:11.393713 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:11.556423 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:11.813859 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:11.893117 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:12.056269 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:12.315351 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:12.392860 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:12.556218 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:12.812970 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:12.893431 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:13.057609 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:13.314059 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:13.393569 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:13.557543 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:13.813750 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:13.893446 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:14.058046 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:14.313652 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:14.392667 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:14.564308 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:14.814089 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:14.896571 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:15.060163 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:15.313999 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:15.392788 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:15.557849 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:15.814399 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:15.894656 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:16.057941 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:16.313317 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:16.393755 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:16.557533 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:16.813961 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:16.894005 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:17.057631 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:17.313106 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:17.393257 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:17.557490 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:17.818392 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:17.893818 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:18.056756 1779851 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0717 23:35:18.313749 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:18.400365 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:18.556976 1779851 kapi.go:107] duration metric: took 41.014585697s to wait for app.kubernetes.io/name=ingress-nginx ...
	I0717 23:35:18.813469 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:18.893540 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:19.313267 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:19.392807 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:19.814992 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:19.893398 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:20.315739 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:20.394008 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:20.813893 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:20.892831 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:21.313278 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0717 23:35:21.407233 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:21.818289 1779851 kapi.go:107] duration metric: took 41.02107807s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I0717 23:35:21.820349 1779851 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-225437 cluster.
	I0717 23:35:21.822110 1779851 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I0717 23:35:21.823856 1779851 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I0717 23:35:21.894184 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:22.393076 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:22.894989 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:23.398745 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:23.892760 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:24.392457 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:24.893200 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:25.391985 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:25.892926 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:26.392855 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:26.893959 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:27.393212 1779851 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0717 23:35:27.893015 1779851 kapi.go:107] duration metric: took 48.512441272s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I0717 23:35:27.895234 1779851 out.go:177] * Enabled addons: cloud-spanner, ingress-dns, default-storageclass, storage-provisioner, inspektor-gadget, metrics-server, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver
	I0717 23:35:27.897286 1779851 addons.go:502] enable addons completed in 57.669944112s: enabled=[cloud-spanner ingress-dns default-storageclass storage-provisioner inspektor-gadget metrics-server volumesnapshots registry ingress gcp-auth csi-hostpath-driver]
	I0717 23:35:27.897348 1779851 start.go:233] waiting for cluster config update ...
	I0717 23:35:27.897374 1779851 start.go:242] writing updated cluster config ...
	I0717 23:35:27.897702 1779851 ssh_runner.go:195] Run: rm -f paused
	I0717 23:35:27.998953 1779851 start.go:578] kubectl: 1.27.3, cluster: 1.27.3 (minor skew: 0)
	I0717 23:35:28.007925 1779851 out.go:177] * Done! kubectl is now configured to use "addons-225437" cluster and "default" namespace by default
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED              STATE               NAME                                     ATTEMPT             POD ID              POD
	3e96197283cba       2002d33a54f72       1 second ago         Running             task-pv-container                        0                   5d9492997d9f3       task-pv-pod
	81c6385d5251f       13753a81eccfd       1 second ago         Exited              hello-world-app                          2                   89d7eea1dbcae       hello-world-app-65bdb79f98-674bb
	df9879b79b290       66bf2c914bf4d       25 seconds ago       Running             nginx                                    0                   f728dcefdce0a       nginx
	042ed79e474f0       71a676dd070f4       32 seconds ago       Exited              registry-test                            0                   a154b953a7a75       registry-test
	0bd54f7a1cec1       e52b21e9e4589       33 seconds ago       Running             headlamp                                 0                   a7dd3eb92852d       headlamp-66f6498c69-bmv7z
	8194fbbdab46d       ee6d597e62dc8       45 seconds ago       Running             csi-snapshotter                          0                   fbc6200e73827       csi-hostpathplugin-pbglb
	fb4a3a9ee0f72       642ded511e141       47 seconds ago       Running             csi-provisioner                          0                   fbc6200e73827       csi-hostpathplugin-pbglb
	4424ab31a3451       922312104da8a       49 seconds ago       Running             liveness-probe                           0                   fbc6200e73827       csi-hostpathplugin-pbglb
	f62cbb540a310       08f6b2990811a       50 seconds ago       Running             hostpath                                 0                   fbc6200e73827       csi-hostpathplugin-pbglb
	51e690ec388b2       2a5f29343eb03       52 seconds ago       Running             gcp-auth                                 0                   f3cb3b77acdfc       gcp-auth-58478865f7-xjwdq
	8b75e1e1a0722       0107d56dbc0be       54 seconds ago       Running             node-driver-registrar                    0                   fbc6200e73827       csi-hostpathplugin-pbglb
	292e9c16d1b81       b26fbddce4d07       55 seconds ago       Running             controller                               0                   baf0fb30c341c       ingress-nginx-controller-7799c6795f-pkpcx
	35c99caa9ab5c       8f2588812ab29       About a minute ago   Exited              patch                                    0                   ead5949760624       gcp-auth-certs-patch-h8pkb
	4f7a229286f79       8f2588812ab29       About a minute ago   Exited              create                                   0                   0b2145ed4c7c9       gcp-auth-certs-create-t495r
	9a4ce7b5f22ff       1461903ec4fe9       About a minute ago   Running             csi-external-health-monitor-controller   0                   fbc6200e73827       csi-hostpathplugin-pbglb
	308ec8fc3aa3f       487fa743e1e22       About a minute ago   Running             csi-resizer                              0                   989558ff5dfb4       csi-hostpath-resizer-0
	9bd1951ed0078       9a80d518f102c       About a minute ago   Running             csi-attacher                             0                   724cc6f4c5775       csi-hostpath-attacher-0
	6ea3fdb4e57f5       8f2588812ab29       About a minute ago   Exited              patch                                    1                   bcb617dbb92da       ingress-nginx-admission-patch-tn2j7
	af60f3399044b       8f2588812ab29       About a minute ago   Exited              create                                   0                   55c58b79677a1       ingress-nginx-admission-create-jj6fw
	65b5adccb829c       1f55eae51bf24       About a minute ago   Running             gadget                                   0                   d87fae9793da0       gadget-w4pb9
	515e5a3a39f01       8e22bf689cda7       About a minute ago   Running             metrics-server                           0                   866753479f5ea       metrics-server-844d8db974-rgqwg
	2666fbb2a5534       4d1e5c3e97420       About a minute ago   Running             volume-snapshot-controller               0                   d25e5513227f0       snapshot-controller-75bbb956b9-frrlr
	4f2de59b0c090       4d1e5c3e97420       About a minute ago   Running             volume-snapshot-controller               0                   60f8002f76df9       snapshot-controller-75bbb956b9-x6brx
	656325e68f00f       97e04611ad434       About a minute ago   Running             coredns                                  0                   934e67cd87d8d       coredns-5d78c9869d-wqt5f
	8a798ba588719       ba04bb24b9575       About a minute ago   Running             storage-provisioner                      0                   f8d12420aca20       storage-provisioner
	00785b60065b8       b18bf71b941ba       About a minute ago   Running             kindnet-cni                              0                   67ae5c4433208       kindnet-kxgbd
	4136f14d84958       fb73e92641fd5       About a minute ago   Running             kube-proxy                               0                   bd358b7154978       kube-proxy-vjn2r
	8b635446134bc       39dfb036b0986       2 minutes ago        Running             kube-apiserver                           0                   667d11fe8aa63       kube-apiserver-addons-225437
	ed601b05253d4       bcb9e554eaab6       2 minutes ago        Running             kube-scheduler                           0                   04d6872741b1b       kube-scheduler-addons-225437
	8063430f3d8bb       ab3683b584ae5       2 minutes ago        Running             kube-controller-manager                  0                   b076ef4474a96       kube-controller-manager-addons-225437
	f7ad0e9dc046b       24bc64e911039       2 minutes ago        Running             etcd                                     0                   303f4cd5733a3       etcd-addons-225437
	
	* 
	* ==> containerd <==
	* Jul 17 23:36:09 addons-225437 containerd[747]: time="2023-07-17T23:36:09.547641645Z" level=info msg="cleaning up dead shim"
	Jul 17 23:36:09 addons-225437 containerd[747]: time="2023-07-17T23:36:09.596135571Z" level=warning msg="cleanup warnings time=\"2023-07-17T23:36:09Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=7260 runtime=io.containerd.runc.v2\n"
	Jul 17 23:36:09 addons-225437 containerd[747]: time="2023-07-17T23:36:09.624860203Z" level=info msg="TearDown network for sandbox \"058330c3230fd70778e0f5c2d673d80469fbbad258565d6c9fe2b0d6b66b9429\" successfully"
	Jul 17 23:36:09 addons-225437 containerd[747]: time="2023-07-17T23:36:09.625042217Z" level=info msg="StopPodSandbox for \"058330c3230fd70778e0f5c2d673d80469fbbad258565d6c9fe2b0d6b66b9429\" returns successfully"
	Jul 17 23:36:10 addons-225437 containerd[747]: time="2023-07-17T23:36:10.603700996Z" level=info msg="RemoveContainer for \"d7eeacdbc60cb2b3abf737b4ddea79f688c2a1ba90d3c1d04316eca397465f5a\""
	Jul 17 23:36:10 addons-225437 containerd[747]: time="2023-07-17T23:36:10.612823060Z" level=info msg="RemoveContainer for \"d7eeacdbc60cb2b3abf737b4ddea79f688c2a1ba90d3c1d04316eca397465f5a\" returns successfully"
	Jul 17 23:36:10 addons-225437 containerd[747]: time="2023-07-17T23:36:10.814164993Z" level=info msg="CreateContainer within sandbox \"89d7eea1dbcae533b22a388b6c316847fb49567683de6988dedb28f169e507bb\" for container &ContainerMetadata{Name:hello-world-app,Attempt:2,}"
	Jul 17 23:36:10 addons-225437 containerd[747]: time="2023-07-17T23:36:10.878495633Z" level=info msg="CreateContainer within sandbox \"89d7eea1dbcae533b22a388b6c316847fb49567683de6988dedb28f169e507bb\" for &ContainerMetadata{Name:hello-world-app,Attempt:2,} returns container id \"81c6385d5251f785355caf233a83e2a224b007d53cd39ea6f07e8e5253c84250\""
	Jul 17 23:36:10 addons-225437 containerd[747]: time="2023-07-17T23:36:10.879666758Z" level=info msg="StartContainer for \"81c6385d5251f785355caf233a83e2a224b007d53cd39ea6f07e8e5253c84250\""
	Jul 17 23:36:10 addons-225437 containerd[747]: time="2023-07-17T23:36:10.993926958Z" level=info msg="StartContainer for \"81c6385d5251f785355caf233a83e2a224b007d53cd39ea6f07e8e5253c84250\" returns successfully"
	Jul 17 23:36:11 addons-225437 containerd[747]: time="2023-07-17T23:36:11.042733877Z" level=info msg="shim disconnected" id=81c6385d5251f785355caf233a83e2a224b007d53cd39ea6f07e8e5253c84250
	Jul 17 23:36:11 addons-225437 containerd[747]: time="2023-07-17T23:36:11.042997113Z" level=warning msg="cleaning up after shim disconnected" id=81c6385d5251f785355caf233a83e2a224b007d53cd39ea6f07e8e5253c84250 namespace=k8s.io
	Jul 17 23:36:11 addons-225437 containerd[747]: time="2023-07-17T23:36:11.043088173Z" level=info msg="cleaning up dead shim"
	Jul 17 23:36:11 addons-225437 containerd[747]: time="2023-07-17T23:36:11.058901667Z" level=warning msg="cleanup warnings time=\"2023-07-17T23:36:11Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=7355 runtime=io.containerd.runc.v2\n"
	Jul 17 23:36:11 addons-225437 containerd[747]: time="2023-07-17T23:36:11.076013513Z" level=info msg="ImageCreate event &ImageCreate{Name:docker.io/library/nginx:latest,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
	Jul 17 23:36:11 addons-225437 containerd[747]: time="2023-07-17T23:36:11.079780786Z" level=info msg="ImageCreate event &ImageCreate{Name:sha256:2002d33a54f72d1333751d4d1b4793a60a635eac6e94a98daf0acea501580c4f,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
	Jul 17 23:36:11 addons-225437 containerd[747]: time="2023-07-17T23:36:11.084644050Z" level=info msg="ImageUpdate event &ImageUpdate{Name:docker.io/library/nginx:latest,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
	Jul 17 23:36:11 addons-225437 containerd[747]: time="2023-07-17T23:36:11.087640148Z" level=info msg="ImageCreate event &ImageCreate{Name:docker.io/library/nginx@sha256:08bc36ad52474e528cc1ea3426b5e3f4bad8a130318e3140d6cfe29c8892c7ef,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
	Jul 17 23:36:11 addons-225437 containerd[747]: time="2023-07-17T23:36:11.088652438Z" level=info msg="PullImage \"docker.io/nginx:latest\" returns image reference \"sha256:2002d33a54f72d1333751d4d1b4793a60a635eac6e94a98daf0acea501580c4f\""
	Jul 17 23:36:11 addons-225437 containerd[747]: time="2023-07-17T23:36:11.094721690Z" level=info msg="CreateContainer within sandbox \"5d9492997d9f31dae293041ecec5c17f9d39b5f2aef76106d0c9de20e8374dbd\" for container &ContainerMetadata{Name:task-pv-container,Attempt:0,}"
	Jul 17 23:36:11 addons-225437 containerd[747]: time="2023-07-17T23:36:11.111491596Z" level=info msg="CreateContainer within sandbox \"5d9492997d9f31dae293041ecec5c17f9d39b5f2aef76106d0c9de20e8374dbd\" for &ContainerMetadata{Name:task-pv-container,Attempt:0,} returns container id \"3e96197283cba2b01b98ca045815362af28168fa3eca98fa0eec8578e182ee8c\""
	Jul 17 23:36:11 addons-225437 containerd[747]: time="2023-07-17T23:36:11.112775016Z" level=info msg="StartContainer for \"3e96197283cba2b01b98ca045815362af28168fa3eca98fa0eec8578e182ee8c\""
	Jul 17 23:36:11 addons-225437 containerd[747]: time="2023-07-17T23:36:11.194083538Z" level=info msg="StartContainer for \"3e96197283cba2b01b98ca045815362af28168fa3eca98fa0eec8578e182ee8c\" returns successfully"
	Jul 17 23:36:11 addons-225437 containerd[747]: time="2023-07-17T23:36:11.674248853Z" level=info msg="RemoveContainer for \"3071a166cedb5d785e2eb587b068f0b5433b2b6ce8f0c6f5a93579edc14f527e\""
	Jul 17 23:36:11 addons-225437 containerd[747]: time="2023-07-17T23:36:11.681870185Z" level=info msg="RemoveContainer for \"3071a166cedb5d785e2eb587b068f0b5433b2b6ce8f0c6f5a93579edc14f527e\" returns successfully"
	
	* 
	* ==> coredns [656325e68f00f807644ce9a6a8e1be60ede04c1e480d8b13d6e2e753c157b4b9] <==
	* [INFO] 10.244.0.16:43089 - 25887 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000078621s
	[INFO] 10.244.0.16:43089 - 60662 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000056271s
	[INFO] 10.244.0.16:43089 - 37852 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000050937s
	[INFO] 10.244.0.16:43089 - 3178 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000054187s
	[INFO] 10.244.0.16:43089 - 47420 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001362804s
	[INFO] 10.244.0.16:43089 - 19284 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.00097023s
	[INFO] 10.244.0.16:43089 - 62480 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000096919s
	[INFO] 10.244.0.16:47439 - 26211 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000130256s
	[INFO] 10.244.0.16:60348 - 21448 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000079934s
	[INFO] 10.244.0.16:47439 - 55931 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000059955s
	[INFO] 10.244.0.16:47439 - 46741 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.00008091s
	[INFO] 10.244.0.16:47439 - 14609 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000064927s
	[INFO] 10.244.0.16:47439 - 54306 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000250863s
	[INFO] 10.244.0.16:47439 - 20428 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000173119s
	[INFO] 10.244.0.16:60348 - 5887 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000101752s
	[INFO] 10.244.0.16:60348 - 3675 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000053309s
	[INFO] 10.244.0.16:60348 - 52918 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000068225s
	[INFO] 10.244.0.16:60348 - 53530 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000069669s
	[INFO] 10.244.0.16:60348 - 45801 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000083717s
	[INFO] 10.244.0.16:47439 - 42924 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.006174926s
	[INFO] 10.244.0.16:60348 - 53630 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001127498s
	[INFO] 10.244.0.16:47439 - 37190 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001382382s
	[INFO] 10.244.0.16:60348 - 36804 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001174645s
	[INFO] 10.244.0.16:47439 - 41560 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000175384s
	[INFO] 10.244.0.16:60348 - 8936 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000082322s
	
	* 
	* ==> describe nodes <==
	* Name:               addons-225437
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=addons-225437
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=b76e7e219387ed29a8027b03764cb35e04d80ac8
	                    minikube.k8s.io/name=addons-225437
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_07_17T23_34_18_0700
	                    minikube.k8s.io/version=v1.31.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-225437
	Annotations:        csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-225437"}
	                    kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 17 Jul 2023 23:34:14 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-225437
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 17 Jul 2023 23:36:09 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 17 Jul 2023 23:35:50 +0000   Mon, 17 Jul 2023 23:34:11 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 17 Jul 2023 23:35:50 +0000   Mon, 17 Jul 2023 23:34:11 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 17 Jul 2023 23:35:50 +0000   Mon, 17 Jul 2023 23:34:11 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 17 Jul 2023 23:35:50 +0000   Mon, 17 Jul 2023 23:34:28 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-225437
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022632Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022632Ki
	  pods:               110
	System Info:
	  Machine ID:                 55aa1f9cb3e54339ae22fdb22a2dd4a5
	  System UUID:                7c039b5f-72fd-4fb6-bece-7c201edc83d4
	  Boot ID:                    30727b23-eda1-49fe-8b46-0f11c052162c
	  Kernel Version:             5.15.0-1039-aws
	  OS Image:                   Ubuntu 22.04.2 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  containerd://1.6.21
	  Kubelet Version:            v1.27.3
	  Kube-Proxy Version:         v1.27.3
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (21 in total)
	  Namespace                   Name                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                         ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-65bdb79f98-674bb             0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         19s
	  default                     nginx                                        0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         27s
	  default                     task-pv-pod                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6s
	  gadget                      gadget-w4pb9                                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         96s
	  gcp-auth                    gcp-auth-58478865f7-xjwdq                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         92s
	  headlamp                    headlamp-66f6498c69-bmv7z                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         37s
	  ingress-nginx               ingress-nginx-controller-7799c6795f-pkpcx    100m (5%!)(MISSING)     0 (0%!)(MISSING)      90Mi (1%!)(MISSING)        0 (0%!)(MISSING)         95s
	  kube-system                 coredns-5d78c9869d-wqt5f                     100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     102s
	  kube-system                 csi-hostpath-attacher-0                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         93s
	  kube-system                 csi-hostpath-resizer-0                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         93s
	  kube-system                 csi-hostpathplugin-pbglb                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         93s
	  kube-system                 etcd-addons-225437                           100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         116s
	  kube-system                 kindnet-kxgbd                                100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      102s
	  kube-system                 kube-apiserver-addons-225437                 250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         114s
	  kube-system                 kube-controller-manager-addons-225437        200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         116s
	  kube-system                 kube-proxy-vjn2r                             0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         102s
	  kube-system                 kube-scheduler-addons-225437                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         114s
	  kube-system                 metrics-server-844d8db974-rgqwg              100m (5%!)(MISSING)     0 (0%!)(MISSING)      200Mi (2%!)(MISSING)       0 (0%!)(MISSING)         97s
	  kube-system                 snapshot-controller-75bbb956b9-frrlr         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         97s
	  kube-system                 snapshot-controller-75bbb956b9-x6brx         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         97s
	  kube-system                 storage-provisioner                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         97s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests     Limits
	  --------           --------     ------
	  cpu                1050m (52%!)(MISSING)  100m (5%!)(MISSING)
	  memory             510Mi (6%!)(MISSING)   220Mi (2%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)       0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)       0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)       0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                  From             Message
	  ----    ------                   ----                 ----             -------
	  Normal  Starting                 101s                 kube-proxy       
	  Normal  Starting                 2m3s                 kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  2m3s (x8 over 2m3s)  kubelet          Node addons-225437 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m3s (x8 over 2m3s)  kubelet          Node addons-225437 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     2m3s (x7 over 2m3s)  kubelet          Node addons-225437 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  2m3s                 kubelet          Updated Node Allocatable limit across pods
	  Normal  Starting                 115s                 kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  115s                 kubelet          Node addons-225437 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    115s                 kubelet          Node addons-225437 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     115s                 kubelet          Node addons-225437 status is now: NodeHasSufficientPID
	  Normal  NodeNotReady             115s                 kubelet          Node addons-225437 status is now: NodeNotReady
	  Normal  NodeAllocatableEnforced  114s                 kubelet          Updated Node Allocatable limit across pods
	  Normal  NodeReady                104s                 kubelet          Node addons-225437 status is now: NodeReady
	  Normal  RegisteredNode           103s                 node-controller  Node addons-225437 event: Registered Node addons-225437 in Controller
	
	* 
	* ==> dmesg <==
	* [  +0.001142] FS-Cache: N-key=[8] '88d8c90000000000'
	[  +0.002699] FS-Cache: Duplicate cookie detected
	[  +0.000745] FS-Cache: O-cookie c=00000060 [p=0000005d fl=226 nc=0 na=1]
	[  +0.000943] FS-Cache: O-cookie d=00000000ec1ea241{9p.inode} n=00000000f0261605
	[  +0.001056] FS-Cache: O-key=[8] '88d8c90000000000'
	[  +0.000714] FS-Cache: N-cookie c=00000067 [p=0000005d fl=2 nc=0 na=1]
	[  +0.000983] FS-Cache: N-cookie d=00000000ec1ea241{9p.inode} n=000000005e1b5df0
	[  +0.001057] FS-Cache: N-key=[8] '88d8c90000000000'
	[  +2.060214] FS-Cache: Duplicate cookie detected
	[  +0.000755] FS-Cache: O-cookie c=0000005e [p=0000005d fl=226 nc=0 na=1]
	[  +0.000999] FS-Cache: O-cookie d=00000000ec1ea241{9p.inode} n=00000000245e0dd5
	[  +0.001101] FS-Cache: O-key=[8] '87d8c90000000000'
	[  +0.000695] FS-Cache: N-cookie c=00000069 [p=0000005d fl=2 nc=0 na=1]
	[  +0.000915] FS-Cache: N-cookie d=00000000ec1ea241{9p.inode} n=0000000038d60fbf
	[  +0.001020] FS-Cache: N-key=[8] '87d8c90000000000'
	[  +0.287034] FS-Cache: Duplicate cookie detected
	[  +0.000736] FS-Cache: O-cookie c=00000063 [p=0000005d fl=226 nc=0 na=1]
	[  +0.000933] FS-Cache: O-cookie d=00000000ec1ea241{9p.inode} n=000000007798c562
	[  +0.001157] FS-Cache: O-key=[8] '8dd8c90000000000'
	[  +0.000692] FS-Cache: N-cookie c=0000006a [p=0000005d fl=2 nc=0 na=1]
	[  +0.000938] FS-Cache: N-cookie d=00000000ec1ea241{9p.inode} n=00000000e27303ae
	[  +0.001021] FS-Cache: N-key=[8] '8dd8c90000000000'
	[Jul17 23:02] systemd-journald[228]: Failed to send stream file descriptor to service manager: Connection refused
	[Jul17 23:31] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	[  +0.061581] overlayfs: lowerdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.
	
	* 
	* ==> etcd [f7ad0e9dc046b642c6cfa72d58aed55c2d89530a4a6e8dddb7ae1be7d46b3407] <==
	* {"level":"info","ts":"2023-07-17T23:34:10.631Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}
	{"level":"info","ts":"2023-07-17T23:34:10.631Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
	{"level":"info","ts":"2023-07-17T23:34:10.637Z","caller":"embed/etcd.go:687","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
	{"level":"info","ts":"2023-07-17T23:34:10.637Z","caller":"embed/etcd.go:275","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
	{"level":"info","ts":"2023-07-17T23:34:10.637Z","caller":"embed/etcd.go:762","msg":"serving metrics","address":"http://127.0.0.1:2381"}
	{"level":"info","ts":"2023-07-17T23:34:10.637Z","caller":"embed/etcd.go:586","msg":"serving peer traffic","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-07-17T23:34:10.637Z","caller":"embed/etcd.go:558","msg":"cmux::serve","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2023-07-17T23:34:10.817Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
	{"level":"info","ts":"2023-07-17T23:34:10.817Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
	{"level":"info","ts":"2023-07-17T23:34:10.817Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
	{"level":"info","ts":"2023-07-17T23:34:10.817Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
	{"level":"info","ts":"2023-07-17T23:34:10.817Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-07-17T23:34:10.817Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
	{"level":"info","ts":"2023-07-17T23:34:10.817Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
	{"level":"info","ts":"2023-07-17T23:34:10.821Z","caller":"etcdserver/server.go:2571","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
	{"level":"info","ts":"2023-07-17T23:34:10.829Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-225437 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
	{"level":"info","ts":"2023-07-17T23:34:10.829Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-07-17T23:34:10.831Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"127.0.0.1:2379"}
	{"level":"info","ts":"2023-07-17T23:34:10.831Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
	{"level":"info","ts":"2023-07-17T23:34:10.831Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
	{"level":"info","ts":"2023-07-17T23:34:10.831Z","caller":"etcdserver/server.go:2595","msg":"cluster version is updated","cluster-version":"3.5"}
	{"level":"info","ts":"2023-07-17T23:34:10.831Z","caller":"embed/serve.go:100","msg":"ready to serve client requests"}
	{"level":"info","ts":"2023-07-17T23:34:10.833Z","caller":"embed/serve.go:198","msg":"serving client traffic securely","address":"192.168.49.2:2379"}
	{"level":"info","ts":"2023-07-17T23:34:10.837Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
	{"level":"info","ts":"2023-07-17T23:34:10.837Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
	
	* 
	* ==> gcp-auth [51e690ec388b2c75ca136d069dd1d8b52d262f9b53b0e65269d8f7b343e8d580] <==
	* 2023/07/17 23:35:20 GCP Auth Webhook started!
	2023/07/17 23:35:35 Ready to marshal response ...
	2023/07/17 23:35:35 Ready to write response ...
	2023/07/17 23:35:35 Ready to marshal response ...
	2023/07/17 23:35:35 Ready to write response ...
	2023/07/17 23:35:35 Ready to marshal response ...
	2023/07/17 23:35:35 Ready to write response ...
	2023/07/17 23:35:38 Ready to marshal response ...
	2023/07/17 23:35:38 Ready to write response ...
	2023/07/17 23:35:45 Ready to marshal response ...
	2023/07/17 23:35:45 Ready to write response ...
	2023/07/17 23:35:53 Ready to marshal response ...
	2023/07/17 23:35:53 Ready to write response ...
	2023/07/17 23:36:06 Ready to marshal response ...
	2023/07/17 23:36:06 Ready to write response ...
	
	* 
	* ==> kernel <==
	*  23:36:13 up  8:18,  0 users,  load average: 2.98, 3.38, 3.68
	Linux addons-225437 5.15.0-1039-aws #44~20.04.1-Ubuntu SMP Thu Jun 22 12:21:08 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.2 LTS"
	
	* 
	* ==> kindnet [00785b60065b85dfe5cee9027495a352b65548cf006006edc289d7f8bb955f14] <==
	* I0717 23:34:31.534688       1 main.go:116] setting mtu 1500 for CNI 
	I0717 23:34:31.534728       1 main.go:146] kindnetd IP family: "ipv4"
	I0717 23:34:31.534752       1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
	I0717 23:34:32.042532       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:34:32.042570       1 main.go:227] handling current node
	I0717 23:34:42.070745       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:34:42.070776       1 main.go:227] handling current node
	I0717 23:34:52.085632       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:34:52.085661       1 main.go:227] handling current node
	I0717 23:35:02.090464       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:35:02.090498       1 main.go:227] handling current node
	I0717 23:35:12.100896       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:35:12.100925       1 main.go:227] handling current node
	I0717 23:35:22.110481       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:35:22.110507       1 main.go:227] handling current node
	I0717 23:35:32.114192       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:35:32.114224       1 main.go:227] handling current node
	I0717 23:35:42.127306       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:35:42.127346       1 main.go:227] handling current node
	I0717 23:35:52.138166       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:35:52.138196       1 main.go:227] handling current node
	I0717 23:36:02.142230       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:36:02.142263       1 main.go:227] handling current node
	I0717 23:36:12.153225       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:36:12.153256       1 main.go:227] handling current node
	
	* 
	* ==> kube-apiserver [8b635446134bc52967f7cb3bc6b522eef40a1a9b1ecaa36f6cd479b0191c764e] <==
	* W0717 23:34:36.657884       1 handler_proxy.go:100] no RequestInfo found in the context
	E0717 23:34:36.657893       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
	I0717 23:34:36.658966       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0717 23:34:36.965416       1 handler_discovery.go:325] DiscoveryManager: Failed to download discovery for kube-system/metrics-server:443: 503 error trying to reach service: dial tcp 10.100.255.1:443: connect: connection refused
	I0717 23:34:36.965440       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I0717 23:34:36.965678       1 handler_discovery.go:325] DiscoveryManager: Failed to download discovery for kube-system/metrics-server:443: 503 error trying to reach service: dial tcp 10.100.255.1:443: connect: connection refused
	I0717 23:34:36.965700       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I0717 23:34:37.012976       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller" clusterIPs=map[IPv4:10.102.238.255]
	I0717 23:34:37.066944       1 alloc.go:330] "allocated clusterIPs" service="ingress-nginx/ingress-nginx-controller-admission" clusterIPs=map[IPv4:10.108.153.88]
	I0717 23:34:37.280520       1 controller.go:624] quota admission added evaluator for: jobs.batch
	I0717 23:34:39.113727       1 alloc.go:330] "allocated clusterIPs" service="kube-system/csi-hostpath-attacher" clusterIPs=map[IPv4:10.106.102.98]
	I0717 23:34:39.134077       1 controller.go:624] quota admission added evaluator for: statefulsets.apps
	I0717 23:34:39.276849       1 alloc.go:330] "allocated clusterIPs" service="kube-system/csi-hostpath-resizer" clusterIPs=map[IPv4:10.100.198.252]
	I0717 23:34:40.621763       1 alloc.go:330] "allocated clusterIPs" service="gcp-auth/gcp-auth" clusterIPs=map[IPv4:10.97.88.201]
	I0717 23:35:06.508733       1 handler_discovery.go:325] DiscoveryManager: Failed to download discovery for kube-system/metrics-server:443: 503 error trying to reach service: dial tcp 10.100.255.1:443: connect: connection refused
	I0717 23:35:06.509092       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	E0717 23:35:06.511021       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.100.255.1:443/apis/metrics.k8s.io/v1beta1: Get "https://10.100.255.1:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.100.255.1:443: connect: connection refused
	E0717 23:35:06.512442       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.100.255.1:443/apis/metrics.k8s.io/v1beta1: Get "https://10.100.255.1:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.100.255.1:443: connect: connection refused
	E0717 23:35:06.519441       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.100.255.1:443/apis/metrics.k8s.io/v1beta1: Get "https://10.100.255.1:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.100.255.1:443: connect: connection refused
	I0717 23:35:06.611694       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I0717 23:35:14.334412       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I0717 23:35:35.397445       1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs=map[IPv4:10.108.33.13]
	I0717 23:35:44.988774       1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io
	I0717 23:35:45.581425       1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs=map[IPv4:10.104.203.35]
	I0717 23:35:53.404119       1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs=map[IPv4:10.99.68.161]
	
	* 
	* ==> kube-controller-manager [8063430f3d8bb17fefeac2495eb5c8d20fd8344967fe802a867e1bb9b29fa2ff] <==
	* I0717 23:35:13.519532       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create
	I0717 23:35:14.337316       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch
	I0717 23:35:14.353432       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create
	I0717 23:35:14.504967       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch
	I0717 23:35:14.531934       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch
	I0717 23:35:14.538379       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create
	I0717 23:35:14.551497       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch
	I0717 23:35:14.556359       1 event.go:307] "Event occurred" object="gcp-auth/gcp-auth-certs-patch" fieldPath="" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed"
	I0717 23:35:14.562071       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create
	I0717 23:35:14.594389       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create
	I0717 23:35:14.595581       1 event.go:307] "Event occurred" object="gcp-auth/gcp-auth-certs-create" fieldPath="" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed"
	I0717 23:35:35.427604       1 event.go:307] "Event occurred" object="headlamp/headlamp" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set headlamp-66f6498c69 to 1"
	I0717 23:35:35.444961       1 event.go:307] "Event occurred" object="headlamp/headlamp-66f6498c69" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Warning" reason="FailedCreate" message="Error creating: pods \"headlamp-66f6498c69-\" is forbidden: error looking up service account headlamp/headlamp: serviceaccount \"headlamp\" not found"
	E0717 23:35:35.461606       1 replica_set.go:544] sync "headlamp/headlamp-66f6498c69" failed with pods "headlamp-66f6498c69-" is forbidden: error looking up service account headlamp/headlamp: serviceaccount "headlamp" not found
	I0717 23:35:35.504825       1 event.go:307] "Event occurred" object="headlamp/headlamp-66f6498c69" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: headlamp-66f6498c69-bmv7z"
	I0717 23:35:43.383770       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	I0717 23:35:44.027629       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch
	I0717 23:35:44.031410       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create
	I0717 23:35:44.068908       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-create
	I0717 23:35:44.069206       1 job_controller.go:523] enqueueing job gcp-auth/gcp-auth-certs-patch
	I0717 23:35:44.478094       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	I0717 23:35:53.145758       1 event.go:307] "Event occurred" object="default/hello-world-app" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set hello-world-app-65bdb79f98 to 1"
	I0717 23:35:53.238076       1 event.go:307] "Event occurred" object="default/hello-world-app-65bdb79f98" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: hello-world-app-65bdb79f98-674bb"
	I0717 23:35:59.478490       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	I0717 23:36:06.423903       1 event.go:307] "Event occurred" object="default/hpvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"hostpath.csi.k8s.io\" or manually created by system administrator"
	
	* 
	* ==> kube-proxy [4136f14d84958d5592a3b23632a3620015c54ae510c73ebcc2aba5dea573dfd9] <==
	* I0717 23:34:31.320797       1 node.go:141] Successfully retrieved node IP: 192.168.49.2
	I0717 23:34:31.320908       1 server_others.go:110] "Detected node IP" address="192.168.49.2"
	I0717 23:34:31.320928       1 server_others.go:554] "Using iptables proxy"
	I0717 23:34:31.368164       1 server_others.go:192] "Using iptables Proxier"
	I0717 23:34:31.368209       1 server_others.go:199] "kube-proxy running in dual-stack mode" ipFamily=IPv4
	I0717 23:34:31.368218       1 server_others.go:200] "Creating dualStackProxier for iptables"
	I0717 23:34:31.368269       1 server_others.go:484] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, defaulting to no-op detect-local for IPv6"
	I0717 23:34:31.368360       1 proxier.go:253] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I0717 23:34:31.374471       1 server.go:658] "Version info" version="v1.27.3"
	I0717 23:34:31.374493       1 server.go:660] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0717 23:34:31.376582       1 config.go:188] "Starting service config controller"
	I0717 23:34:31.376612       1 shared_informer.go:311] Waiting for caches to sync for service config
	I0717 23:34:31.376648       1 config.go:97] "Starting endpoint slice config controller"
	I0717 23:34:31.376652       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
	I0717 23:34:31.378401       1 config.go:315] "Starting node config controller"
	I0717 23:34:31.378426       1 shared_informer.go:311] Waiting for caches to sync for node config
	I0717 23:34:31.477521       1 shared_informer.go:318] Caches are synced for endpoint slice config
	I0717 23:34:31.477580       1 shared_informer.go:318] Caches are synced for service config
	I0717 23:34:31.478786       1 shared_informer.go:318] Caches are synced for node config
	
	* 
	* ==> kube-scheduler [ed601b05253d4c1ed2c740f7b66a1b334c35fe0bd1c76e396aaed58cd98da640] <==
	* W0717 23:34:14.554567       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0717 23:34:14.555070       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	W0717 23:34:14.554616       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0717 23:34:14.555275       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0717 23:34:14.554689       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0717 23:34:14.555462       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	W0717 23:34:14.554722       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0717 23:34:14.554755       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0717 23:34:14.554765       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0717 23:34:14.559653       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0717 23:34:14.559892       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0717 23:34:14.560025       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0717 23:34:15.487647       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0717 23:34:15.487903       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	W0717 23:34:15.506357       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0717 23:34:15.506569       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	W0717 23:34:15.506746       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0717 23:34:15.506844       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0717 23:34:15.603102       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0717 23:34:15.603350       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0717 23:34:15.622665       1 reflector.go:533] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0717 23:34:15.622926       1 reflector.go:148] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0717 23:34:15.808305       1 reflector.go:533] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0717 23:34:15.808544       1 reflector.go:148] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0717 23:34:18.335087       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	* 
	* ==> kubelet <==
	* Jul 17 23:35:53 addons-225437 kubelet[1356]: I0717 23:35:53.377946    1356 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldw44\" (UniqueName: \"kubernetes.io/projected/0b610285-88ad-4de4-8ae1-f379cbc0bb8f-kube-api-access-ldw44\") pod \"hello-world-app-65bdb79f98-674bb\" (UID: \"0b610285-88ad-4de4-8ae1-f379cbc0bb8f\") " pod="default/hello-world-app-65bdb79f98-674bb"
	Jul 17 23:35:53 addons-225437 kubelet[1356]: I0717 23:35:53.378262    1356 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/0b610285-88ad-4de4-8ae1-f379cbc0bb8f-gcp-creds\") pod \"hello-world-app-65bdb79f98-674bb\" (UID: \"0b610285-88ad-4de4-8ae1-f379cbc0bb8f\") " pod="default/hello-world-app-65bdb79f98-674bb"
	Jul 17 23:35:56 addons-225437 kubelet[1356]: I0717 23:35:56.544488    1356 scope.go:115] "RemoveContainer" containerID="a844739b04ddaef82006334d18d7da5d545b514ca6d7dca844f13fb2054531fa"
	Jul 17 23:35:57 addons-225437 kubelet[1356]: I0717 23:35:57.549369    1356 scope.go:115] "RemoveContainer" containerID="a844739b04ddaef82006334d18d7da5d545b514ca6d7dca844f13fb2054531fa"
	Jul 17 23:35:57 addons-225437 kubelet[1356]: I0717 23:35:57.549806    1356 scope.go:115] "RemoveContainer" containerID="3071a166cedb5d785e2eb587b068f0b5433b2b6ce8f0c6f5a93579edc14f527e"
	Jul 17 23:35:57 addons-225437 kubelet[1356]: E0717 23:35:57.550076    1356 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"hello-world-app\" with CrashLoopBackOff: \"back-off 10s restarting failed container=hello-world-app pod=hello-world-app-65bdb79f98-674bb_default(0b610285-88ad-4de4-8ae1-f379cbc0bb8f)\"" pod="default/hello-world-app-65bdb79f98-674bb" podUID=0b610285-88ad-4de4-8ae1-f379cbc0bb8f
	Jul 17 23:35:58 addons-225437 kubelet[1356]: I0717 23:35:58.554385    1356 scope.go:115] "RemoveContainer" containerID="3071a166cedb5d785e2eb587b068f0b5433b2b6ce8f0c6f5a93579edc14f527e"
	Jul 17 23:35:58 addons-225437 kubelet[1356]: E0717 23:35:58.555137    1356 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"hello-world-app\" with CrashLoopBackOff: \"back-off 10s restarting failed container=hello-world-app pod=hello-world-app-65bdb79f98-674bb_default(0b610285-88ad-4de4-8ae1-f379cbc0bb8f)\"" pod="default/hello-world-app-65bdb79f98-674bb" podUID=0b610285-88ad-4de4-8ae1-f379cbc0bb8f
	Jul 17 23:36:02 addons-225437 kubelet[1356]: I0717 23:36:02.808449    1356 scope.go:115] "RemoveContainer" containerID="d7eeacdbc60cb2b3abf737b4ddea79f688c2a1ba90d3c1d04316eca397465f5a"
	Jul 17 23:36:02 addons-225437 kubelet[1356]: E0717 23:36:02.808758    1356 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"minikube-ingress-dns\" with CrashLoopBackOff: \"back-off 40s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(e7dbf71c-9669-4ff8-a4d9-3551afafa6ec)\"" pod="kube-system/kube-ingress-dns-minikube" podUID=e7dbf71c-9669-4ff8-a4d9-3551afafa6ec
	Jul 17 23:36:06 addons-225437 kubelet[1356]: I0717 23:36:06.921303    1356 topology_manager.go:212] "Topology Admit Handler"
	Jul 17 23:36:07 addons-225437 kubelet[1356]: I0717 23:36:07.070400    1356 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/fa555e20-1244-410c-923f-953f2ac00d22-gcp-creds\") pod \"task-pv-pod\" (UID: \"fa555e20-1244-410c-923f-953f2ac00d22\") " pod="default/task-pv-pod"
	Jul 17 23:36:07 addons-225437 kubelet[1356]: I0717 23:36:07.070632    1356 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-6a8ef3be-40c3-4a2e-90bd-38430e9c4561\" (UniqueName: \"kubernetes.io/csi/hostpath.csi.k8s.io^b357946d-24fa-11ee-ac66-5af2e93acb6c\") pod \"task-pv-pod\" (UID: \"fa555e20-1244-410c-923f-953f2ac00d22\") " pod="default/task-pv-pod"
	Jul 17 23:36:07 addons-225437 kubelet[1356]: I0717 23:36:07.070757    1356 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw5j2\" (UniqueName: \"kubernetes.io/projected/fa555e20-1244-410c-923f-953f2ac00d22-kube-api-access-mw5j2\") pod \"task-pv-pod\" (UID: \"fa555e20-1244-410c-923f-953f2ac00d22\") " pod="default/task-pv-pod"
	Jul 17 23:36:07 addons-225437 kubelet[1356]: I0717 23:36:07.184319    1356 operation_generator.go:661] "MountVolume.MountDevice succeeded for volume \"pvc-6a8ef3be-40c3-4a2e-90bd-38430e9c4561\" (UniqueName: \"kubernetes.io/csi/hostpath.csi.k8s.io^b357946d-24fa-11ee-ac66-5af2e93acb6c\") pod \"task-pv-pod\" (UID: \"fa555e20-1244-410c-923f-953f2ac00d22\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/hostpath.csi.k8s.io/f47de99b4da74e9a679ff274752853608522c14063690ef96ee77dabf2464c39/globalmount\"" pod="default/task-pv-pod"
	Jul 17 23:36:09 addons-225437 kubelet[1356]: I0717 23:36:09.692538    1356 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fldvx\" (UniqueName: \"kubernetes.io/projected/e7dbf71c-9669-4ff8-a4d9-3551afafa6ec-kube-api-access-fldvx\") pod \"e7dbf71c-9669-4ff8-a4d9-3551afafa6ec\" (UID: \"e7dbf71c-9669-4ff8-a4d9-3551afafa6ec\") "
	Jul 17 23:36:09 addons-225437 kubelet[1356]: I0717 23:36:09.697834    1356 operation_generator.go:878] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7dbf71c-9669-4ff8-a4d9-3551afafa6ec-kube-api-access-fldvx" (OuterVolumeSpecName: "kube-api-access-fldvx") pod "e7dbf71c-9669-4ff8-a4d9-3551afafa6ec" (UID: "e7dbf71c-9669-4ff8-a4d9-3551afafa6ec"). InnerVolumeSpecName "kube-api-access-fldvx". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Jul 17 23:36:09 addons-225437 kubelet[1356]: I0717 23:36:09.793406    1356 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-fldvx\" (UniqueName: \"kubernetes.io/projected/e7dbf71c-9669-4ff8-a4d9-3551afafa6ec-kube-api-access-fldvx\") on node \"addons-225437\" DevicePath \"\""
	Jul 17 23:36:10 addons-225437 kubelet[1356]: I0717 23:36:10.596848    1356 scope.go:115] "RemoveContainer" containerID="d7eeacdbc60cb2b3abf737b4ddea79f688c2a1ba90d3c1d04316eca397465f5a"
	Jul 17 23:36:10 addons-225437 kubelet[1356]: I0717 23:36:10.808913    1356 scope.go:115] "RemoveContainer" containerID="3071a166cedb5d785e2eb587b068f0b5433b2b6ce8f0c6f5a93579edc14f527e"
	Jul 17 23:36:11 addons-225437 kubelet[1356]: I0717 23:36:11.649516    1356 scope.go:115] "RemoveContainer" containerID="3071a166cedb5d785e2eb587b068f0b5433b2b6ce8f0c6f5a93579edc14f527e"
	Jul 17 23:36:11 addons-225437 kubelet[1356]: I0717 23:36:11.650217    1356 scope.go:115] "RemoveContainer" containerID="81c6385d5251f785355caf233a83e2a224b007d53cd39ea6f07e8e5253c84250"
	Jul 17 23:36:11 addons-225437 kubelet[1356]: E0717 23:36:11.650643    1356 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"hello-world-app\" with CrashLoopBackOff: \"back-off 20s restarting failed container=hello-world-app pod=hello-world-app-65bdb79f98-674bb_default(0b610285-88ad-4de4-8ae1-f379cbc0bb8f)\"" pod="default/hello-world-app-65bdb79f98-674bb" podUID=0b610285-88ad-4de4-8ae1-f379cbc0bb8f
	Jul 17 23:36:11 addons-225437 kubelet[1356]: I0717 23:36:11.673526    1356 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="default/task-pv-pod" podStartSLOduration=1.955680353 podCreationTimestamp="2023-07-17 23:36:06 +0000 UTC" firstStartedPulling="2023-07-17 23:36:07.372337441 +0000 UTC m=+109.769045608" lastFinishedPulling="2023-07-17 23:36:11.090136752 +0000 UTC m=+113.486844919" observedRunningTime="2023-07-17 23:36:11.65153502 +0000 UTC m=+114.048243179" watchObservedRunningTime="2023-07-17 23:36:11.673479664 +0000 UTC m=+114.070187971"
	Jul 17 23:36:11 addons-225437 kubelet[1356]: I0717 23:36:11.825938    1356 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID=e7dbf71c-9669-4ff8-a4d9-3551afafa6ec path="/var/lib/kubelet/pods/e7dbf71c-9669-4ff8-a4d9-3551afafa6ec/volumes"
	
	* 
	* ==> storage-provisioner [8a798ba588719fdd2d7d1c10f91de7b52190159b5b60acb86168ae6919820310] <==
	* I0717 23:34:37.196933       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0717 23:34:37.274714       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0717 23:34:37.274815       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0717 23:34:37.372735       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0717 23:34:37.372925       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-225437_947b3efc-01eb-4d46-a160-a56cb8984cb7!
	I0717 23:34:37.390578       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"61e25398-c49d-4df6-bb2b-af0f546aef04", APIVersion:"v1", ResourceVersion:"652", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-225437_947b3efc-01eb-4d46-a160-a56cb8984cb7 became leader
	I0717 23:34:37.473945       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-225437_947b3efc-01eb-4d46-a160-a56cb8984cb7!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-225437 -n addons-225437
helpers_test.go:261: (dbg) Run:  kubectl --context addons-225437 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-jj6fw ingress-nginx-admission-patch-tn2j7
helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Ingress]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context addons-225437 describe pod ingress-nginx-admission-create-jj6fw ingress-nginx-admission-patch-tn2j7
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-225437 describe pod ingress-nginx-admission-create-jj6fw ingress-nginx-admission-patch-tn2j7: exit status 1 (90.796657ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "ingress-nginx-admission-create-jj6fw" not found
	Error from server (NotFound): pods "ingress-nginx-admission-patch-tn2j7" not found

                                                
                                                
** /stderr **
helpers_test.go:279: kubectl --context addons-225437 describe pod ingress-nginx-admission-create-jj6fw ingress-nginx-admission-patch-tn2j7: exit status 1
--- FAIL: TestAddons/parallel/Ingress (29.65s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-linux-arm64 license
functional_test.go:2284: (dbg) Non-zero exit: out/minikube-linux-arm64 license: exit status 40 (260.930926ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to INET_LICENSES: Failed to download licenses: download request did not return a 200, received: 404
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_license_42713f820c0ac68901ecf7b12bfdf24c2cafe65d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2285: command "\n\n" failed: exit status 40
--- FAIL: TestFunctional/parallel/License (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (3.9s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image load --daemon gcr.io/google-containers/addon-resizer:functional-128534 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-linux-arm64 -p functional-128534 image load --daemon gcr.io/google-containers/addon-resizer:functional-128534 --alsologtostderr: (3.623170644s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-128534" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (3.90s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (3.49s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image load --daemon gcr.io/google-containers/addon-resizer:functional-128534 --alsologtostderr
functional_test.go:364: (dbg) Done: out/minikube-linux-arm64 -p functional-128534 image load --daemon gcr.io/google-containers/addon-resizer:functional-128534 --alsologtostderr: (3.248313196s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-128534" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (3.49s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (6.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:234: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (2.448015538s)
functional_test.go:239: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-128534
functional_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image load --daemon gcr.io/google-containers/addon-resizer:functional-128534 --alsologtostderr
functional_test.go:244: (dbg) Done: out/minikube-linux-arm64 -p functional-128534 image load --daemon gcr.io/google-containers/addon-resizer:functional-128534 --alsologtostderr: (3.619962344s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-128534" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (6.39s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image save gcr.io/google-containers/addon-resizer:functional-128534 /home/jenkins/workspace/Docker_Linux_containerd_arm64/addon-resizer-save.tar --alsologtostderr
functional_test.go:385: expected "/home/jenkins/workspace/Docker_Linux_containerd_arm64/addon-resizer-save.tar" to exist after `image save`, but doesn't exist
--- FAIL: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.70s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image load /home/jenkins/workspace/Docker_Linux_containerd_arm64/addon-resizer-save.tar --alsologtostderr
functional_test.go:410: loading image into minikube from file: <nil>

                                                
                                                
** stderr ** 
	I0717 23:42:31.991060 1806683 out.go:296] Setting OutFile to fd 1 ...
	I0717 23:42:32.002436 1806683 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:42:32.002461 1806683 out.go:309] Setting ErrFile to fd 2...
	I0717 23:42:32.002468 1806683 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:42:32.002990 1806683 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
	I0717 23:42:32.004257 1806683 config.go:182] Loaded profile config "functional-128534": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
	I0717 23:42:32.004392 1806683 config.go:182] Loaded profile config "functional-128534": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
	I0717 23:42:32.005070 1806683 cli_runner.go:164] Run: docker container inspect functional-128534 --format={{.State.Status}}
	I0717 23:42:32.029501 1806683 ssh_runner.go:195] Run: systemctl --version
	I0717 23:42:32.029735 1806683 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-128534
	I0717 23:42:32.052224 1806683 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34673 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/functional-128534/id_rsa Username:docker}
	I0717 23:42:32.151636 1806683 cache_images.go:286] Loading image from: /home/jenkins/workspace/Docker_Linux_containerd_arm64/addon-resizer-save.tar
	W0717 23:42:32.151722 1806683 cache_images.go:254] Failed to load cached images for profile functional-128534. make sure the profile is running. loading images: stat /home/jenkins/workspace/Docker_Linux_containerd_arm64/addon-resizer-save.tar: no such file or directory
	I0717 23:42:32.151747 1806683 cache_images.go:262] succeeded pushing to: 
	I0717 23:42:32.151752 1806683 cache_images.go:263] failed pushing to: functional-128534

                                                
                                                
** /stderr **
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.23s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddons (51.66s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons
addons_test.go:183: (dbg) Run:  kubectl --context ingress-addon-legacy-804572 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:183: (dbg) Done: kubectl --context ingress-addon-legacy-804572 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: (8.288052473s)
addons_test.go:208: (dbg) Run:  kubectl --context ingress-addon-legacy-804572 replace --force -f testdata/nginx-ingress-v1beta1.yaml
addons_test.go:221: (dbg) Run:  kubectl --context ingress-addon-legacy-804572 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:226: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [3596dd04-4fed-4d47-9adc-5921d6e13566] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [3596dd04-4fed-4d47-9adc-5921d6e13566] Running
addons_test.go:226: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: run=nginx healthy within 10.009828399s
addons_test.go:238: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-804572 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Run:  kubectl --context ingress-addon-legacy-804572 replace --force -f testdata/ingress-dns-example-v1beta1.yaml
addons_test.go:267: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-804572 ip
addons_test.go:273: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:273: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.018682335s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:275: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:279: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:282: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-804572 addons disable ingress-dns --alsologtostderr -v=1
E0717 23:45:28.028671 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
addons_test.go:282: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-804572 addons disable ingress-dns --alsologtostderr -v=1: (6.998794189s)
addons_test.go:287: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-804572 addons disable ingress --alsologtostderr -v=1
addons_test.go:287: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-804572 addons disable ingress --alsologtostderr -v=1: (7.546946239s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect ingress-addon-legacy-804572
helpers_test.go:235: (dbg) docker inspect ingress-addon-legacy-804572:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "8be8d38497f76801a04ac6512874e7c0f37aa64c6aa58c54f61a3d70f0f0d811",
	        "Created": "2023-07-17T23:43:28.861706889Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 1810966,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-07-17T23:43:29.177746994Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:f52519afe5f6d6f3ce84cbd7f651b1292638d32ca98ee43d88f2d69e113e44de",
	        "ResolvConfPath": "/var/lib/docker/containers/8be8d38497f76801a04ac6512874e7c0f37aa64c6aa58c54f61a3d70f0f0d811/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/8be8d38497f76801a04ac6512874e7c0f37aa64c6aa58c54f61a3d70f0f0d811/hostname",
	        "HostsPath": "/var/lib/docker/containers/8be8d38497f76801a04ac6512874e7c0f37aa64c6aa58c54f61a3d70f0f0d811/hosts",
	        "LogPath": "/var/lib/docker/containers/8be8d38497f76801a04ac6512874e7c0f37aa64c6aa58c54f61a3d70f0f0d811/8be8d38497f76801a04ac6512874e7c0f37aa64c6aa58c54f61a3d70f0f0d811-json.log",
	        "Name": "/ingress-addon-legacy-804572",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "ingress-addon-legacy-804572:/var",
	                "/lib/modules:/lib/modules:ro"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "ingress-addon-legacy-804572",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4294967296,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8589934592,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/5aeb99bace584830d40fc688dd6422cfa78e461a9f00676db1ce7eb5c958f553-init/diff:/var/lib/docker/overlay2/35c7dfa0dd79ade1d127735ea1c2fdf1590faeb4a5550d4cf4092ab5865caa24/diff",
	                "MergedDir": "/var/lib/docker/overlay2/5aeb99bace584830d40fc688dd6422cfa78e461a9f00676db1ce7eb5c958f553/merged",
	                "UpperDir": "/var/lib/docker/overlay2/5aeb99bace584830d40fc688dd6422cfa78e461a9f00676db1ce7eb5c958f553/diff",
	                "WorkDir": "/var/lib/docker/overlay2/5aeb99bace584830d40fc688dd6422cfa78e461a9f00676db1ce7eb5c958f553/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "ingress-addon-legacy-804572",
	                "Source": "/var/lib/docker/volumes/ingress-addon-legacy-804572/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "ingress-addon-legacy-804572",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ingress-addon-legacy-804572",
	                "name.minikube.sigs.k8s.io": "ingress-addon-legacy-804572",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "eec6f95d8295f2ef63a06183a216eb9749485a6b849db09c7d258a05b1ba5b51",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34678"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34677"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34674"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34676"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34675"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/eec6f95d8295",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ingress-addon-legacy-804572": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "8be8d38497f7",
	                        "ingress-addon-legacy-804572"
	                    ],
	                    "NetworkID": "86b8c4cd613c03c7f37b2dc8c4a172527204f2c3f4504ee552a877f721af9b99",
	                    "EndpointID": "6b345614486c7c94e0e923e8d55d0977459214af158bfd355ff6fdab9eb6fe5f",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p ingress-addon-legacy-804572 -n ingress-addon-legacy-804572
helpers_test.go:244: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-804572 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-804572 logs -n 25: (1.418024115s)
helpers_test.go:252: TestIngressAddonLegacy/serial/ValidateIngressAddons logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |----------------|------------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	|    Command     |                                  Args                                  |           Profile           |  User   | Version |     Start Time      |      End Time       |
	|----------------|------------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	| mount          | -p functional-128534                                                   | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC |                     |
	|                | /tmp/TestFunctionalparallelMountCmdVerifyCleanup3782811430/001:/mount1 |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	| mount          | -p functional-128534                                                   | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC |                     |
	|                | /tmp/TestFunctionalparallelMountCmdVerifyCleanup3782811430/001:/mount2 |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	| mount          | -p functional-128534                                                   | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC |                     |
	|                | /tmp/TestFunctionalparallelMountCmdVerifyCleanup3782811430/001:/mount3 |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	| ssh            | functional-128534 ssh findmnt                                          | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC | 17 Jul 23 23:43 UTC |
	|                | -T /mount1                                                             |                             |         |         |                     |                     |
	| ssh            | functional-128534 ssh findmnt                                          | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC | 17 Jul 23 23:43 UTC |
	|                | -T /mount2                                                             |                             |         |         |                     |                     |
	| ssh            | functional-128534 ssh findmnt                                          | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC | 17 Jul 23 23:43 UTC |
	|                | -T /mount3                                                             |                             |         |         |                     |                     |
	| mount          | -p functional-128534                                                   | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC |                     |
	|                | --kill=true                                                            |                             |         |         |                     |                     |
	| update-context | functional-128534                                                      | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC | 17 Jul 23 23:43 UTC |
	|                | update-context                                                         |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=2                                                 |                             |         |         |                     |                     |
	| update-context | functional-128534                                                      | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC | 17 Jul 23 23:43 UTC |
	|                | update-context                                                         |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=2                                                 |                             |         |         |                     |                     |
	| update-context | functional-128534                                                      | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC | 17 Jul 23 23:43 UTC |
	|                | update-context                                                         |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=2                                                 |                             |         |         |                     |                     |
	| image          | functional-128534                                                      | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC | 17 Jul 23 23:43 UTC |
	|                | image ls --format short                                                |                             |         |         |                     |                     |
	|                | --alsologtostderr                                                      |                             |         |         |                     |                     |
	| image          | functional-128534                                                      | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC | 17 Jul 23 23:43 UTC |
	|                | image ls --format yaml                                                 |                             |         |         |                     |                     |
	|                | --alsologtostderr                                                      |                             |         |         |                     |                     |
	| ssh            | functional-128534 ssh pgrep                                            | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC |                     |
	|                | buildkitd                                                              |                             |         |         |                     |                     |
	| image          | functional-128534 image build -t                                       | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC | 17 Jul 23 23:43 UTC |
	|                | localhost/my-image:functional-128534                                   |                             |         |         |                     |                     |
	|                | testdata/build --alsologtostderr                                       |                             |         |         |                     |                     |
	| image          | functional-128534 image ls                                             | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC | 17 Jul 23 23:43 UTC |
	| image          | functional-128534                                                      | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC | 17 Jul 23 23:43 UTC |
	|                | image ls --format json                                                 |                             |         |         |                     |                     |
	|                | --alsologtostderr                                                      |                             |         |         |                     |                     |
	| image          | functional-128534                                                      | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC | 17 Jul 23 23:43 UTC |
	|                | image ls --format table                                                |                             |         |         |                     |                     |
	|                | --alsologtostderr                                                      |                             |         |         |                     |                     |
	| delete         | -p functional-128534                                                   | functional-128534           | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC | 17 Jul 23 23:43 UTC |
	| start          | -p ingress-addon-legacy-804572                                         | ingress-addon-legacy-804572 | jenkins | v1.31.0 | 17 Jul 23 23:43 UTC | 17 Jul 23 23:44 UTC |
	|                | --kubernetes-version=v1.18.20                                          |                             |         |         |                     |                     |
	|                | --memory=4096 --wait=true                                              |                             |         |         |                     |                     |
	|                | --alsologtostderr                                                      |                             |         |         |                     |                     |
	|                | -v=5 --driver=docker                                                   |                             |         |         |                     |                     |
	|                | --container-runtime=containerd                                         |                             |         |         |                     |                     |
	| addons         | ingress-addon-legacy-804572                                            | ingress-addon-legacy-804572 | jenkins | v1.31.0 | 17 Jul 23 23:44 UTC | 17 Jul 23 23:44 UTC |
	|                | addons enable ingress                                                  |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=5                                                 |                             |         |         |                     |                     |
	| addons         | ingress-addon-legacy-804572                                            | ingress-addon-legacy-804572 | jenkins | v1.31.0 | 17 Jul 23 23:44 UTC | 17 Jul 23 23:44 UTC |
	|                | addons enable ingress-dns                                              |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=5                                                 |                             |         |         |                     |                     |
	| ssh            | ingress-addon-legacy-804572                                            | ingress-addon-legacy-804572 | jenkins | v1.31.0 | 17 Jul 23 23:45 UTC | 17 Jul 23 23:45 UTC |
	|                | ssh curl -s http://127.0.0.1/                                          |                             |         |         |                     |                     |
	|                | -H 'Host: nginx.example.com'                                           |                             |         |         |                     |                     |
	| ip             | ingress-addon-legacy-804572 ip                                         | ingress-addon-legacy-804572 | jenkins | v1.31.0 | 17 Jul 23 23:45 UTC | 17 Jul 23 23:45 UTC |
	| addons         | ingress-addon-legacy-804572                                            | ingress-addon-legacy-804572 | jenkins | v1.31.0 | 17 Jul 23 23:45 UTC | 17 Jul 23 23:45 UTC |
	|                | addons disable ingress-dns                                             |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	| addons         | ingress-addon-legacy-804572                                            | ingress-addon-legacy-804572 | jenkins | v1.31.0 | 17 Jul 23 23:45 UTC | 17 Jul 23 23:45 UTC |
	|                | addons disable ingress                                                 |                             |         |         |                     |                     |
	|                | --alsologtostderr -v=1                                                 |                             |         |         |                     |                     |
	|----------------|------------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/17 23:43:12
	Running on machine: ip-172-31-29-130
	Binary: Built with gc go1.20.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0717 23:43:12.019493 1810503 out.go:296] Setting OutFile to fd 1 ...
	I0717 23:43:12.019763 1810503 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:43:12.019792 1810503 out.go:309] Setting ErrFile to fd 2...
	I0717 23:43:12.019810 1810503 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:43:12.020136 1810503 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
	I0717 23:43:12.020631 1810503 out.go:303] Setting JSON to false
	I0717 23:43:12.021787 1810503 start.go:128] hostinfo: {"hostname":"ip-172-31-29-130","uptime":30335,"bootTime":1689607057,"procs":271,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0717 23:43:12.021913 1810503 start.go:138] virtualization:  
	I0717 23:43:12.025014 1810503 out.go:177] * [ingress-addon-legacy-804572] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	I0717 23:43:12.027511 1810503 notify.go:220] Checking for updates...
	I0717 23:43:12.028218 1810503 out.go:177]   - MINIKUBE_LOCATION=16899
	I0717 23:43:12.030287 1810503 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 23:43:12.032474 1810503 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig
	I0717 23:43:12.034583 1810503 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube
	I0717 23:43:12.036434 1810503 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0717 23:43:12.038351 1810503 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0717 23:43:12.041021 1810503 driver.go:373] Setting default libvirt URI to qemu:///system
	I0717 23:43:12.069082 1810503 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0717 23:43:12.069224 1810503 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 23:43:12.168211 1810503 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:23 OomKillDisable:true NGoroutines:35 SystemTime:2023-07-17 23:43:12.158496704 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215175168 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 23:43:12.168318 1810503 docker.go:294] overlay module found
	I0717 23:43:12.170177 1810503 out.go:177] * Using the docker driver based on user configuration
	I0717 23:43:12.171826 1810503 start.go:298] selected driver: docker
	I0717 23:43:12.171846 1810503 start.go:880] validating driver "docker" against <nil>
	I0717 23:43:12.171861 1810503 start.go:891] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0717 23:43:12.172492 1810503 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 23:43:12.253918 1810503 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:23 OomKillDisable:true NGoroutines:35 SystemTime:2023-07-17 23:43:12.244352584 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215175168 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 23:43:12.254091 1810503 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0717 23:43:12.254328 1810503 start_flags.go:919] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0717 23:43:12.256117 1810503 out.go:177] * Using Docker driver with root privileges
	I0717 23:43:12.257819 1810503 cni.go:84] Creating CNI manager for ""
	I0717 23:43:12.257837 1810503 cni.go:149] "docker" driver + "containerd" runtime found, recommending kindnet
	I0717 23:43:12.257847 1810503 start_flags.go:314] Found "CNI" CNI - setting NetworkPlugin=cni
	I0717 23:43:12.257857 1810503 start_flags.go:319] config:
	{Name:ingress-addon-legacy-804572 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-804572 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:con
tainerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 23:43:12.259881 1810503 out.go:177] * Starting control plane node ingress-addon-legacy-804572 in cluster ingress-addon-legacy-804572
	I0717 23:43:12.261312 1810503 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0717 23:43:12.262823 1810503 out.go:177] * Pulling base image ...
	I0717 23:43:12.264388 1810503 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime containerd
	I0717 23:43:12.264450 1810503 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0717 23:43:12.282262 1810503 image.go:83] Found gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon, skipping pull
	I0717 23:43:12.282287 1810503 cache.go:145] gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 exists in daemon, skipping load
	I0717 23:43:12.334694 1810503 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4
	I0717 23:43:12.334716 1810503 cache.go:57] Caching tarball of preloaded images
	I0717 23:43:12.334864 1810503 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime containerd
	I0717 23:43:12.336856 1810503 out.go:177] * Downloading Kubernetes v1.18.20 preload ...
	I0717 23:43:12.338750 1810503 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4 ...
	I0717 23:43:12.452346 1810503 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4?checksum=md5:9e505be2989b8c051b1372c317471064 -> /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4
	I0717 23:43:21.008358 1810503 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4 ...
	I0717 23:43:21.008510 1810503 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4 ...
	I0717 23:43:22.169475 1810503 cache.go:60] Finished verifying existence of preloaded tar for  v1.18.20 on containerd
	I0717 23:43:22.169841 1810503 profile.go:148] Saving config to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/config.json ...
	I0717 23:43:22.169876 1810503 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/config.json: {Name:mk284546c3ec3c4de2f4733e8b109b56ad153bdb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:43:22.170071 1810503 cache.go:195] Successfully downloaded all kic artifacts
	I0717 23:43:22.170132 1810503 start.go:365] acquiring machines lock for ingress-addon-legacy-804572: {Name:mk5188a966faf611772f911ffa349f70263537d6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0717 23:43:22.170191 1810503 start.go:369] acquired machines lock for "ingress-addon-legacy-804572" in 44.702µs
	I0717 23:43:22.170216 1810503 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-804572 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-804572 Namespace:default APIServerName:minikub
eCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimiza
tions:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0717 23:43:22.170290 1810503 start.go:125] createHost starting for "" (driver="docker")
	I0717 23:43:22.172405 1810503 out.go:204] * Creating docker container (CPUs=2, Memory=4096MB) ...
	I0717 23:43:22.172616 1810503 start.go:159] libmachine.API.Create for "ingress-addon-legacy-804572" (driver="docker")
	I0717 23:43:22.172662 1810503 client.go:168] LocalClient.Create starting
	I0717 23:43:22.172768 1810503 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem
	I0717 23:43:22.172805 1810503 main.go:141] libmachine: Decoding PEM data...
	I0717 23:43:22.172824 1810503 main.go:141] libmachine: Parsing certificate...
	I0717 23:43:22.172884 1810503 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem
	I0717 23:43:22.172906 1810503 main.go:141] libmachine: Decoding PEM data...
	I0717 23:43:22.172921 1810503 main.go:141] libmachine: Parsing certificate...
	I0717 23:43:22.173318 1810503 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-804572 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0717 23:43:22.190742 1810503 cli_runner.go:211] docker network inspect ingress-addon-legacy-804572 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0717 23:43:22.190824 1810503 network_create.go:281] running [docker network inspect ingress-addon-legacy-804572] to gather additional debugging logs...
	I0717 23:43:22.190844 1810503 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-804572
	W0717 23:43:22.207597 1810503 cli_runner.go:211] docker network inspect ingress-addon-legacy-804572 returned with exit code 1
	I0717 23:43:22.207630 1810503 network_create.go:284] error running [docker network inspect ingress-addon-legacy-804572]: docker network inspect ingress-addon-legacy-804572: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network ingress-addon-legacy-804572 not found
	I0717 23:43:22.207645 1810503 network_create.go:286] output of [docker network inspect ingress-addon-legacy-804572]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network ingress-addon-legacy-804572 not found
	
	** /stderr **
	I0717 23:43:22.207711 1810503 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0717 23:43:22.225010 1810503 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001215700}
	I0717 23:43:22.225053 1810503 network_create.go:123] attempt to create docker network ingress-addon-legacy-804572 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0717 23:43:22.225116 1810503 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=ingress-addon-legacy-804572 ingress-addon-legacy-804572
	I0717 23:43:22.294789 1810503 network_create.go:107] docker network ingress-addon-legacy-804572 192.168.49.0/24 created
	I0717 23:43:22.294822 1810503 kic.go:117] calculated static IP "192.168.49.2" for the "ingress-addon-legacy-804572" container
	I0717 23:43:22.294900 1810503 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0717 23:43:22.312073 1810503 cli_runner.go:164] Run: docker volume create ingress-addon-legacy-804572 --label name.minikube.sigs.k8s.io=ingress-addon-legacy-804572 --label created_by.minikube.sigs.k8s.io=true
	I0717 23:43:22.335666 1810503 oci.go:103] Successfully created a docker volume ingress-addon-legacy-804572
	I0717 23:43:22.335753 1810503 cli_runner.go:164] Run: docker run --rm --name ingress-addon-legacy-804572-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-804572 --entrypoint /usr/bin/test -v ingress-addon-legacy-804572:/var gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -d /var/lib
	I0717 23:43:23.807024 1810503 cli_runner.go:217] Completed: docker run --rm --name ingress-addon-legacy-804572-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-804572 --entrypoint /usr/bin/test -v ingress-addon-legacy-804572:/var gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -d /var/lib: (1.471225129s)
	I0717 23:43:23.807052 1810503 oci.go:107] Successfully prepared a docker volume ingress-addon-legacy-804572
	I0717 23:43:23.807074 1810503 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime containerd
	I0717 23:43:23.807093 1810503 kic.go:190] Starting extracting preloaded images to volume ...
	I0717 23:43:23.807182 1810503 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-804572:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -I lz4 -xf /preloaded.tar -C /extractDir
	I0717 23:43:28.780292 1810503 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-804572:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 -I lz4 -xf /preloaded.tar -C /extractDir: (4.973051874s)
	I0717 23:43:28.780324 1810503 kic.go:199] duration metric: took 4.973227 seconds to extract preloaded images to volume
	W0717 23:43:28.780477 1810503 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0717 23:43:28.780591 1810503 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0717 23:43:28.845984 1810503 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ingress-addon-legacy-804572 --name ingress-addon-legacy-804572 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-804572 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ingress-addon-legacy-804572 --network ingress-addon-legacy-804572 --ip 192.168.49.2 --volume ingress-addon-legacy-804572:/var --security-opt apparmor=unconfined --memory=4096mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631
	I0717 23:43:29.184961 1810503 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-804572 --format={{.State.Running}}
	I0717 23:43:29.211883 1810503 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-804572 --format={{.State.Status}}
	I0717 23:43:29.239419 1810503 cli_runner.go:164] Run: docker exec ingress-addon-legacy-804572 stat /var/lib/dpkg/alternatives/iptables
	I0717 23:43:29.329541 1810503 oci.go:144] the created container "ingress-addon-legacy-804572" has a running status.
	I0717 23:43:29.329566 1810503 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/ingress-addon-legacy-804572/id_rsa...
	I0717 23:43:29.773899 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/ingress-addon-legacy-804572/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0717 23:43:29.773984 1810503 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/ingress-addon-legacy-804572/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0717 23:43:29.814317 1810503 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-804572 --format={{.State.Status}}
	I0717 23:43:29.841216 1810503 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0717 23:43:29.841238 1810503 kic_runner.go:114] Args: [docker exec --privileged ingress-addon-legacy-804572 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0717 23:43:29.942731 1810503 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-804572 --format={{.State.Status}}
	I0717 23:43:29.967954 1810503 machine.go:88] provisioning docker machine ...
	I0717 23:43:29.967982 1810503 ubuntu.go:169] provisioning hostname "ingress-addon-legacy-804572"
	I0717 23:43:29.968051 1810503 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-804572
	I0717 23:43:29.998658 1810503 main.go:141] libmachine: Using SSH client type: native
	I0717 23:43:29.999504 1810503 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34678 <nil> <nil>}
	I0717 23:43:29.999529 1810503 main.go:141] libmachine: About to run SSH command:
	sudo hostname ingress-addon-legacy-804572 && echo "ingress-addon-legacy-804572" | sudo tee /etc/hostname
	I0717 23:43:30.240059 1810503 main.go:141] libmachine: SSH cmd err, output: <nil>: ingress-addon-legacy-804572
	
	I0717 23:43:30.240178 1810503 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-804572
	I0717 23:43:30.265198 1810503 main.go:141] libmachine: Using SSH client type: native
	I0717 23:43:30.265634 1810503 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34678 <nil> <nil>}
	I0717 23:43:30.265656 1810503 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\singress-addon-legacy-804572' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ingress-addon-legacy-804572/g' /etc/hosts;
				else 
					echo '127.0.1.1 ingress-addon-legacy-804572' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0717 23:43:30.410624 1810503 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0717 23:43:30.410796 1810503 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/16899-1773963/.minikube CaCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/16899-1773963/.minikube}
	I0717 23:43:30.410841 1810503 ubuntu.go:177] setting up certificates
	I0717 23:43:30.410864 1810503 provision.go:83] configureAuth start
	I0717 23:43:30.410941 1810503 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-804572
	I0717 23:43:30.431405 1810503 provision.go:138] copyHostCerts
	I0717 23:43:30.431444 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem
	I0717 23:43:30.431474 1810503 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem, removing ...
	I0717 23:43:30.431485 1810503 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem
	I0717 23:43:30.431806 1810503 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem (1078 bytes)
	I0717 23:43:30.431894 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem
	I0717 23:43:30.431911 1810503 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem, removing ...
	I0717 23:43:30.431915 1810503 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem
	I0717 23:43:30.431945 1810503 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem (1123 bytes)
	I0717 23:43:30.431984 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem
	I0717 23:43:30.432000 1810503 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem, removing ...
	I0717 23:43:30.432004 1810503 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem
	I0717 23:43:30.432031 1810503 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem (1679 bytes)
	I0717 23:43:30.432075 1810503 provision.go:112] generating server cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem org=jenkins.ingress-addon-legacy-804572 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube ingress-addon-legacy-804572]
	I0717 23:43:31.116822 1810503 provision.go:172] copyRemoteCerts
	I0717 23:43:31.116970 1810503 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0717 23:43:31.117029 1810503 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-804572
	I0717 23:43:31.139351 1810503 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34678 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/ingress-addon-legacy-804572/id_rsa Username:docker}
	I0717 23:43:31.235846 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0717 23:43:31.235901 1810503 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0717 23:43:31.264716 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0717 23:43:31.264782 1810503 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem --> /etc/docker/server.pem (1253 bytes)
	I0717 23:43:31.293901 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0717 23:43:31.293970 1810503 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0717 23:43:31.323663 1810503 provision.go:86] duration metric: configureAuth took 912.771481ms
	I0717 23:43:31.323692 1810503 ubuntu.go:193] setting minikube options for container-runtime
	I0717 23:43:31.323878 1810503 config.go:182] Loaded profile config "ingress-addon-legacy-804572": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.18.20
	I0717 23:43:31.323892 1810503 machine.go:91] provisioned docker machine in 1.355921697s
	I0717 23:43:31.323898 1810503 client.go:171] LocalClient.Create took 9.151224913s
	I0717 23:43:31.323911 1810503 start.go:167] duration metric: libmachine.API.Create for "ingress-addon-legacy-804572" took 9.151294533s
	I0717 23:43:31.323918 1810503 start.go:300] post-start starting for "ingress-addon-legacy-804572" (driver="docker")
	I0717 23:43:31.323931 1810503 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0717 23:43:31.323986 1810503 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0717 23:43:31.324041 1810503 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-804572
	I0717 23:43:31.341825 1810503 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34678 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/ingress-addon-legacy-804572/id_rsa Username:docker}
	I0717 23:43:31.437223 1810503 ssh_runner.go:195] Run: cat /etc/os-release
	I0717 23:43:31.441650 1810503 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0717 23:43:31.441688 1810503 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0717 23:43:31.441700 1810503 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0717 23:43:31.441706 1810503 info.go:137] Remote host: Ubuntu 22.04.2 LTS
	I0717 23:43:31.441715 1810503 filesync.go:126] Scanning /home/jenkins/minikube-integration/16899-1773963/.minikube/addons for local assets ...
	I0717 23:43:31.441776 1810503 filesync.go:126] Scanning /home/jenkins/minikube-integration/16899-1773963/.minikube/files for local assets ...
	I0717 23:43:31.441854 1810503 filesync.go:149] local asset: /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem -> 17793502.pem in /etc/ssl/certs
	I0717 23:43:31.441862 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem -> /etc/ssl/certs/17793502.pem
	I0717 23:43:31.441967 1810503 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0717 23:43:31.452550 1810503 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem --> /etc/ssl/certs/17793502.pem (1708 bytes)
	I0717 23:43:31.482416 1810503 start.go:303] post-start completed in 158.479712ms
	I0717 23:43:31.482810 1810503 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-804572
	I0717 23:43:31.500642 1810503 profile.go:148] Saving config to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/config.json ...
	I0717 23:43:31.500926 1810503 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0717 23:43:31.500978 1810503 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-804572
	I0717 23:43:31.519590 1810503 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34678 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/ingress-addon-legacy-804572/id_rsa Username:docker}
	I0717 23:43:31.612101 1810503 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0717 23:43:31.619302 1810503 start.go:128] duration metric: createHost completed in 9.448996406s
	I0717 23:43:31.619394 1810503 start.go:83] releasing machines lock for "ingress-addon-legacy-804572", held for 9.449180627s
	I0717 23:43:31.619505 1810503 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-804572
	I0717 23:43:31.637357 1810503 ssh_runner.go:195] Run: cat /version.json
	I0717 23:43:31.637403 1810503 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0717 23:43:31.637412 1810503 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-804572
	I0717 23:43:31.637496 1810503 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-804572
	I0717 23:43:31.665090 1810503 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34678 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/ingress-addon-legacy-804572/id_rsa Username:docker}
	I0717 23:43:31.677299 1810503 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34678 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/ingress-addon-legacy-804572/id_rsa Username:docker}
	I0717 23:43:31.757843 1810503 ssh_runner.go:195] Run: systemctl --version
	I0717 23:43:31.897866 1810503 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0717 23:43:31.903830 1810503 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0717 23:43:31.936341 1810503 cni.go:236] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0717 23:43:31.936418 1810503 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0717 23:43:31.971956 1810503 cni.go:268] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0717 23:43:31.971983 1810503 start.go:466] detecting cgroup driver to use...
	I0717 23:43:31.972037 1810503 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0717 23:43:31.972123 1810503 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0717 23:43:31.987351 1810503 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0717 23:43:32.002387 1810503 docker.go:196] disabling cri-docker service (if available) ...
	I0717 23:43:32.002482 1810503 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0717 23:43:32.019840 1810503 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0717 23:43:32.038671 1810503 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0717 23:43:32.129463 1810503 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0717 23:43:32.226785 1810503 docker.go:212] disabling docker service ...
	I0717 23:43:32.226887 1810503 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0717 23:43:32.249648 1810503 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0717 23:43:32.263396 1810503 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0717 23:43:32.359174 1810503 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0717 23:43:32.459624 1810503 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0717 23:43:32.473094 1810503 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0717 23:43:32.492564 1810503 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.2"|' /etc/containerd/config.toml"
	I0717 23:43:32.504601 1810503 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0717 23:43:32.516591 1810503 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0717 23:43:32.516681 1810503 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0717 23:43:32.528591 1810503 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0717 23:43:32.540405 1810503 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0717 23:43:32.552517 1810503 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0717 23:43:32.564386 1810503 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0717 23:43:32.575541 1810503 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0717 23:43:32.587047 1810503 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0717 23:43:32.597136 1810503 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0717 23:43:32.607402 1810503 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0717 23:43:32.698080 1810503 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0717 23:43:32.782288 1810503 start.go:513] Will wait 60s for socket path /run/containerd/containerd.sock
	I0717 23:43:32.782398 1810503 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0717 23:43:32.787271 1810503 start.go:534] Will wait 60s for crictl version
	I0717 23:43:32.787398 1810503 ssh_runner.go:195] Run: which crictl
	I0717 23:43:32.791956 1810503 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0717 23:43:32.841560 1810503 start.go:550] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.21
	RuntimeApiVersion:  v1
	I0717 23:43:32.841682 1810503 ssh_runner.go:195] Run: containerd --version
	I0717 23:43:32.869652 1810503 ssh_runner.go:195] Run: containerd --version
	I0717 23:43:32.900253 1810503 out.go:177] * Preparing Kubernetes v1.18.20 on containerd 1.6.21 ...
	I0717 23:43:32.902014 1810503 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-804572 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0717 23:43:32.919579 1810503 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0717 23:43:32.924342 1810503 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0717 23:43:32.938287 1810503 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime containerd
	I0717 23:43:32.938368 1810503 ssh_runner.go:195] Run: sudo crictl images --output json
	I0717 23:43:32.978611 1810503 containerd.go:600] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.18.20". assuming images are not preloaded.
	I0717 23:43:32.978692 1810503 ssh_runner.go:195] Run: which lz4
	I0717 23:43:32.983313 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4 -> /preloaded.tar.lz4
	I0717 23:43:32.983424 1810503 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
	I0717 23:43:32.988099 1810503 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I0717 23:43:32.988136 1810503 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-containerd-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (489149349 bytes)
	I0717 23:43:35.155834 1810503 containerd.go:547] Took 2.172454 seconds to copy over tarball
	I0717 23:43:35.155948 1810503 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
	I0717 23:43:37.801570 1810503 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (2.645573959s)
	I0717 23:43:37.801594 1810503 containerd.go:554] Took 2.645694 seconds to extract the tarball
	I0717 23:43:37.801604 1810503 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I0717 23:43:38.015270 1810503 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0717 23:43:38.120129 1810503 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0717 23:43:38.216492 1810503 ssh_runner.go:195] Run: sudo crictl images --output json
	I0717 23:43:38.266440 1810503 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.18.20 registry.k8s.io/kube-controller-manager:v1.18.20 registry.k8s.io/kube-scheduler:v1.18.20 registry.k8s.io/kube-proxy:v1.18.20 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.3-0 registry.k8s.io/coredns:1.6.7 gcr.io/k8s-minikube/storage-provisioner:v5]
	I0717 23:43:38.266509 1810503 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0717 23:43:38.266711 1810503 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.18.20
	I0717 23:43:38.266801 1810503 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0717 23:43:38.266872 1810503 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.18.20
	I0717 23:43:38.266952 1810503 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.18.20
	I0717 23:43:38.267018 1810503 image.go:134] retrieving image: registry.k8s.io/pause:3.2
	I0717 23:43:38.267088 1810503 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.3-0
	I0717 23:43:38.267153 1810503 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.7
	I0717 23:43:38.268324 1810503 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0717 23:43:38.268862 1810503 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0717 23:43:38.269199 1810503 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
	I0717 23:43:38.269441 1810503 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.18.20
	I0717 23:43:38.269755 1810503 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.7: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.7
	I0717 23:43:38.270130 1810503 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.3-0
	I0717 23:43:38.270386 1810503 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.18.20
	I0717 23:43:38.270551 1810503 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.18.20
	I0717 23:43:38.714337 1810503 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep registry.k8s.io/pause:3.2"
	W0717 23:43:38.722194 1810503 image.go:265] image registry.k8s.io/kube-proxy:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0717 23:43:38.722447 1810503 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep registry.k8s.io/kube-proxy:v1.18.20"
	W0717 23:43:38.724738 1810503 image.go:265] image registry.k8s.io/kube-controller-manager:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0717 23:43:38.724866 1810503 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep registry.k8s.io/kube-controller-manager:v1.18.20"
	W0717 23:43:38.732470 1810503 image.go:265] image registry.k8s.io/kube-apiserver:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0717 23:43:38.732595 1810503 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep registry.k8s.io/kube-apiserver:v1.18.20"
	W0717 23:43:38.735168 1810503 image.go:265] image registry.k8s.io/kube-scheduler:v1.18.20 arch mismatch: want arm64 got amd64. fixing
	I0717 23:43:38.735289 1810503 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep registry.k8s.io/kube-scheduler:v1.18.20"
	W0717 23:43:38.780115 1810503 image.go:265] image registry.k8s.io/etcd:3.4.3-0 arch mismatch: want arm64 got amd64. fixing
	I0717 23:43:38.780270 1810503 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep registry.k8s.io/etcd:3.4.3-0"
	W0717 23:43:38.787043 1810503 image.go:265] image registry.k8s.io/coredns:1.6.7 arch mismatch: want arm64 got amd64. fixing
	I0717 23:43:38.787199 1810503 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep registry.k8s.io/coredns:1.6.7"
	W0717 23:43:38.934800 1810503 image.go:265] image gcr.io/k8s-minikube/storage-provisioner:v5 arch mismatch: want arm64 got amd64. fixing
	I0717 23:43:38.934920 1810503 ssh_runner.go:195] Run: /bin/bash -c "sudo ctr -n=k8s.io images check | grep gcr.io/k8s-minikube/storage-provisioner:v5"
	I0717 23:43:39.313505 1810503 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "2a060e2e7101d419352bf82c613158587400be743482d9a537ec4a9d1b4eb93c" in container runtime
	I0717 23:43:39.313545 1810503 cri.go:218] Removing image: registry.k8s.io/pause:3.2
	I0717 23:43:39.313593 1810503 ssh_runner.go:195] Run: which crictl
	I0717 23:43:39.475876 1810503 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.18.20" needs transfer: "registry.k8s.io/kube-proxy:v1.18.20" does not exist at hash "b11cdc97ac6ac4ef2b3b0662edbe16597084b17cbc8e3d61fcaf4ef827a7ed18" in container runtime
	I0717 23:43:39.475916 1810503 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.18.20
	I0717 23:43:39.475968 1810503 ssh_runner.go:195] Run: which crictl
	I0717 23:43:39.476031 1810503 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.18.20" needs transfer: "registry.k8s.io/kube-controller-manager:v1.18.20" does not exist at hash "297c79afbdb81ceb4cf857e0c54a0de7b6ce7ebe01e6cab68fc8baf342be3ea7" in container runtime
	I0717 23:43:39.476046 1810503 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0717 23:43:39.476069 1810503 ssh_runner.go:195] Run: which crictl
	I0717 23:43:39.476126 1810503 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.18.20" needs transfer: "registry.k8s.io/kube-apiserver:v1.18.20" does not exist at hash "d353007847ec85700463981309a5846c8d9c93fbcd1323104266212926d68257" in container runtime
	I0717 23:43:39.476142 1810503 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.18.20
	I0717 23:43:39.476160 1810503 ssh_runner.go:195] Run: which crictl
	I0717 23:43:39.476209 1810503 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.18.20" needs transfer: "registry.k8s.io/kube-scheduler:v1.18.20" does not exist at hash "177548d745cb87f773d02f41d453af2f2a1479dbe3c32e749cf6d8145c005e79" in container runtime
	I0717 23:43:39.476223 1810503 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.18.20
	I0717 23:43:39.476241 1810503 ssh_runner.go:195] Run: which crictl
	I0717 23:43:39.476285 1810503 cache_images.go:116] "registry.k8s.io/etcd:3.4.3-0" needs transfer: "registry.k8s.io/etcd:3.4.3-0" does not exist at hash "29dd247b2572efbe28fcaea3fef1c5d72593da59f7350e3f6d2e6618983f9c03" in container runtime
	I0717 23:43:39.476297 1810503 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.3-0
	I0717 23:43:39.476320 1810503 ssh_runner.go:195] Run: which crictl
	I0717 23:43:39.482339 1810503 cache_images.go:116] "registry.k8s.io/coredns:1.6.7" needs transfer: "registry.k8s.io/coredns:1.6.7" does not exist at hash "ff3af22d8878afc6985d3fec3e066d00ef431aa166c3a01ac58f1990adc92a2c" in container runtime
	I0717 23:43:39.482426 1810503 cri.go:218] Removing image: registry.k8s.io/coredns:1.6.7
	I0717 23:43:39.482513 1810503 ssh_runner.go:195] Run: which crictl
	I0717 23:43:39.549704 1810503 cache_images.go:116] "gcr.io/k8s-minikube/storage-provisioner:v5" needs transfer: "gcr.io/k8s-minikube/storage-provisioner:v5" does not exist at hash "66749159455b3f08c8318fe0233122f54d0f5889f9c5fdfb73c3fd9d99895b51" in container runtime
	I0717 23:43:39.549794 1810503 cri.go:218] Removing image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0717 23:43:39.549879 1810503 ssh_runner.go:195] Run: which crictl
	I0717 23:43:39.550034 1810503 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
	I0717 23:43:39.550195 1810503 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.3-0
	I0717 23:43:39.550290 1810503 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.18.20
	I0717 23:43:39.550379 1810503 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.18.20
	I0717 23:43:39.550467 1810503 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.18.20
	I0717 23:43:39.550556 1810503 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.18.20
	I0717 23:43:39.550650 1810503 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.6.7
	I0717 23:43:39.736651 1810503 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/images/arm64/registry.k8s.io/coredns_1.6.7
	I0717 23:43:39.736770 1810503 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi gcr.io/k8s-minikube/storage-provisioner:v5
	I0717 23:43:39.736804 1810503 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/images/arm64/registry.k8s.io/pause_3.2
	I0717 23:43:39.736836 1810503 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/images/arm64/registry.k8s.io/etcd_3.4.3-0
	I0717 23:43:39.736874 1810503 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/images/arm64/registry.k8s.io/kube-proxy_v1.18.20
	I0717 23:43:39.736904 1810503 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/images/arm64/registry.k8s.io/kube-controller-manager_v1.18.20
	I0717 23:43:39.736931 1810503 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/images/arm64/registry.k8s.io/kube-apiserver_v1.18.20
	I0717 23:43:39.736960 1810503 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/images/arm64/registry.k8s.io/kube-scheduler_v1.18.20
	I0717 23:43:39.794734 1810503 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/images/arm64/gcr.io/k8s-minikube/storage-provisioner_v5
	I0717 23:43:39.794836 1810503 cache_images.go:92] LoadImages completed in 1.528369867s
	W0717 23:43:39.794903 1810503 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/images/arm64/registry.k8s.io/coredns_1.6.7: no such file or directory
	I0717 23:43:39.794960 1810503 ssh_runner.go:195] Run: sudo crictl info
	I0717 23:43:39.838107 1810503 cni.go:84] Creating CNI manager for ""
	I0717 23:43:39.838133 1810503 cni.go:149] "docker" driver + "containerd" runtime found, recommending kindnet
	I0717 23:43:39.838145 1810503 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0717 23:43:39.838162 1810503 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.18.20 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ingress-addon-legacy-804572 NodeName:ingress-addon-legacy-804572 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/ce
rts/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
	I0717 23:43:39.838293 1810503 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /run/containerd/containerd.sock
	  name: "ingress-addon-legacy-804572"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.18.20
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0717 23:43:39.838378 1810503 kubeadm.go:976] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.18.20/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=ingress-addon-legacy-804572 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-804572 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0717 23:43:39.838443 1810503 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.18.20
	I0717 23:43:39.849547 1810503 binaries.go:44] Found k8s binaries, skipping transfer
	I0717 23:43:39.849685 1810503 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0717 23:43:39.860598 1810503 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (448 bytes)
	I0717 23:43:39.882379 1810503 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (353 bytes)
	I0717 23:43:39.904353 1810503 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2131 bytes)
	I0717 23:43:39.925587 1810503 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0717 23:43:39.930023 1810503 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0717 23:43:39.943663 1810503 certs.go:56] Setting up /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572 for IP: 192.168.49.2
	I0717 23:43:39.943700 1810503 certs.go:190] acquiring lock for shared ca certs: {Name:mk1a0756f7f2633b530348b8dc6aa0086e9260f7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:43:39.943843 1810503 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.key
	I0717 23:43:39.943898 1810503 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/16899-1773963/.minikube/proxy-client-ca.key
	I0717 23:43:39.943948 1810503 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.key
	I0717 23:43:39.943964 1810503 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt with IP's: []
	I0717 23:43:40.164387 1810503 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt ...
	I0717 23:43:40.164425 1810503 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: {Name:mkecf3244a4c066907ea4c2ef48167bb4c09d02d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:43:40.164633 1810503 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.key ...
	I0717 23:43:40.164654 1810503 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.key: {Name:mk5a6d5526e2eaff3dd9134a45a8c3db20b2ed73 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:43:40.164757 1810503 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/apiserver.key.dd3b5fb2
	I0717 23:43:40.164776 1810503 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0717 23:43:40.573022 1810503 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/apiserver.crt.dd3b5fb2 ...
	I0717 23:43:40.573055 1810503 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/apiserver.crt.dd3b5fb2: {Name:mkee9ac90439424d047413bd1a9cbda622999ed6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:43:40.573248 1810503 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/apiserver.key.dd3b5fb2 ...
	I0717 23:43:40.573264 1810503 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/apiserver.key.dd3b5fb2: {Name:mk6736526e2c3482a6c432fa300e454effb6c82b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:43:40.573345 1810503 certs.go:337] copying /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/apiserver.crt
	I0717 23:43:40.573423 1810503 certs.go:341] copying /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/apiserver.key
	I0717 23:43:40.573482 1810503 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/proxy-client.key
	I0717 23:43:40.573499 1810503 crypto.go:68] Generating cert /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/proxy-client.crt with IP's: []
	I0717 23:43:40.799987 1810503 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/proxy-client.crt ...
	I0717 23:43:40.800018 1810503 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/proxy-client.crt: {Name:mk20210afe9ae026afa07151a08517988623f9f3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:43:40.800205 1810503 crypto.go:164] Writing key to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/proxy-client.key ...
	I0717 23:43:40.800223 1810503 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/proxy-client.key: {Name:mk2a051e8e198df7f66b96872536b4a76e501287 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:43:40.800305 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0717 23:43:40.800326 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0717 23:43:40.800341 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0717 23:43:40.800356 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0717 23:43:40.800367 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0717 23:43:40.800383 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0717 23:43:40.800394 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0717 23:43:40.800405 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0717 23:43:40.800465 1810503 certs.go:437] found cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/1779350.pem (1338 bytes)
	W0717 23:43:40.800505 1810503 certs.go:433] ignoring /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/1779350_empty.pem, impossibly tiny 0 bytes
	I0717 23:43:40.800519 1810503 certs.go:437] found cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem (1679 bytes)
	I0717 23:43:40.800549 1810503 certs.go:437] found cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem (1078 bytes)
	I0717 23:43:40.800579 1810503 certs.go:437] found cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem (1123 bytes)
	I0717 23:43:40.800610 1810503 certs.go:437] found cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem (1679 bytes)
	I0717 23:43:40.800666 1810503 certs.go:437] found cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem (1708 bytes)
	I0717 23:43:40.800702 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/1779350.pem -> /usr/share/ca-certificates/1779350.pem
	I0717 23:43:40.800723 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem -> /usr/share/ca-certificates/17793502.pem
	I0717 23:43:40.800741 1810503 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0717 23:43:40.801354 1810503 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0717 23:43:40.831234 1810503 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0717 23:43:40.859478 1810503 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0717 23:43:40.887954 1810503 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0717 23:43:40.915905 1810503 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0717 23:43:40.944268 1810503 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0717 23:43:40.972508 1810503 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0717 23:43:41.002382 1810503 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0717 23:43:41.031457 1810503 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/1779350.pem --> /usr/share/ca-certificates/1779350.pem (1338 bytes)
	I0717 23:43:41.059653 1810503 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem --> /usr/share/ca-certificates/17793502.pem (1708 bytes)
	I0717 23:43:41.088671 1810503 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0717 23:43:41.117484 1810503 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0717 23:43:41.138783 1810503 ssh_runner.go:195] Run: openssl version
	I0717 23:43:41.145967 1810503 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/17793502.pem && ln -fs /usr/share/ca-certificates/17793502.pem /etc/ssl/certs/17793502.pem"
	I0717 23:43:41.158041 1810503 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/17793502.pem
	I0717 23:43:41.162794 1810503 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Jul 17 23:39 /usr/share/ca-certificates/17793502.pem
	I0717 23:43:41.162860 1810503 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/17793502.pem
	I0717 23:43:41.171448 1810503 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/17793502.pem /etc/ssl/certs/3ec20f2e.0"
	I0717 23:43:41.183011 1810503 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0717 23:43:41.194776 1810503 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0717 23:43:41.199321 1810503 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Jul 17 23:33 /usr/share/ca-certificates/minikubeCA.pem
	I0717 23:43:41.199398 1810503 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0717 23:43:41.207927 1810503 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0717 23:43:41.219517 1810503 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1779350.pem && ln -fs /usr/share/ca-certificates/1779350.pem /etc/ssl/certs/1779350.pem"
	I0717 23:43:41.231227 1810503 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1779350.pem
	I0717 23:43:41.235837 1810503 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Jul 17 23:39 /usr/share/ca-certificates/1779350.pem
	I0717 23:43:41.235900 1810503 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1779350.pem
	I0717 23:43:41.244576 1810503 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1779350.pem /etc/ssl/certs/51391683.0"
	I0717 23:43:41.255791 1810503 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0717 23:43:41.260102 1810503 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0717 23:43:41.260171 1810503 kubeadm.go:404] StartCluster: {Name:ingress-addon-legacy-804572 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-804572 Namespace:default APIServerName:minikubeCA APIServerNames:[]
APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:fals
e DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 23:43:41.260273 1810503 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0717 23:43:41.260337 1810503 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0717 23:43:41.302572 1810503 cri.go:89] found id: ""
	I0717 23:43:41.302685 1810503 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0717 23:43:41.313337 1810503 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0717 23:43:41.324105 1810503 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0717 23:43:41.324179 1810503 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0717 23:43:41.336879 1810503 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0717 23:43:41.336924 1810503 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0717 23:43:41.393900 1810503 kubeadm.go:322] [init] Using Kubernetes version: v1.18.20
	I0717 23:43:41.394004 1810503 kubeadm.go:322] [preflight] Running pre-flight checks
	I0717 23:43:41.447048 1810503 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0717 23:43:41.447140 1810503 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1039-aws
	I0717 23:43:41.447188 1810503 kubeadm.go:322] OS: Linux
	I0717 23:43:41.447233 1810503 kubeadm.go:322] CGROUPS_CPU: enabled
	I0717 23:43:41.447284 1810503 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0717 23:43:41.447332 1810503 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0717 23:43:41.447388 1810503 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0717 23:43:41.447436 1810503 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0717 23:43:41.447488 1810503 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0717 23:43:41.543135 1810503 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0717 23:43:41.543241 1810503 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0717 23:43:41.543333 1810503 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0717 23:43:41.777617 1810503 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0717 23:43:41.779562 1810503 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0717 23:43:41.779643 1810503 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0717 23:43:41.886146 1810503 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0717 23:43:41.890261 1810503 out.go:204]   - Generating certificates and keys ...
	I0717 23:43:41.890424 1810503 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0717 23:43:41.890490 1810503 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0717 23:43:42.403947 1810503 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0717 23:43:43.043265 1810503 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0717 23:43:43.864246 1810503 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0717 23:43:44.359259 1810503 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0717 23:43:44.820916 1810503 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0717 23:43:44.821281 1810503 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-804572 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0717 23:43:45.415782 1810503 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0717 23:43:45.416202 1810503 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-804572 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0717 23:43:45.759763 1810503 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0717 23:43:46.174738 1810503 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0717 23:43:46.477625 1810503 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0717 23:43:46.477988 1810503 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0717 23:43:46.853712 1810503 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0717 23:43:47.192300 1810503 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0717 23:43:47.708590 1810503 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0717 23:43:48.252306 1810503 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0717 23:43:48.253212 1810503 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0717 23:43:48.256171 1810503 out.go:204]   - Booting up control plane ...
	I0717 23:43:48.256285 1810503 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0717 23:43:48.267992 1810503 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0717 23:43:48.268086 1810503 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0717 23:43:48.268175 1810503 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0717 23:43:48.268322 1810503 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0717 23:43:59.770314 1810503 kubeadm.go:322] [apiclient] All control plane components are healthy after 11.502824 seconds
	I0717 23:43:59.770444 1810503 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0717 23:43:59.784966 1810503 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config-1.18" in namespace kube-system with the configuration for the kubelets in the cluster
	I0717 23:44:00.332433 1810503 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0717 23:44:00.333026 1810503 kubeadm.go:322] [mark-control-plane] Marking the node ingress-addon-legacy-804572 as control-plane by adding the label "node-role.kubernetes.io/master=''"
	I0717 23:44:00.851871 1810503 kubeadm.go:322] [bootstrap-token] Using token: 4upcco.ii739ea5bvvelqxf
	I0717 23:44:00.855073 1810503 out.go:204]   - Configuring RBAC rules ...
	I0717 23:44:00.855196 1810503 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0717 23:44:00.867779 1810503 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0717 23:44:00.877518 1810503 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0717 23:44:00.881117 1810503 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0717 23:44:00.887569 1810503 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0717 23:44:00.891590 1810503 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0717 23:44:00.907237 1810503 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0717 23:44:01.203100 1810503 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0717 23:44:01.277875 1810503 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0717 23:44:01.279588 1810503 kubeadm.go:322] 
	I0717 23:44:01.279667 1810503 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0717 23:44:01.279678 1810503 kubeadm.go:322] 
	I0717 23:44:01.279751 1810503 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0717 23:44:01.279771 1810503 kubeadm.go:322] 
	I0717 23:44:01.279798 1810503 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0717 23:44:01.280348 1810503 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0717 23:44:01.280432 1810503 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0717 23:44:01.280443 1810503 kubeadm.go:322] 
	I0717 23:44:01.280492 1810503 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0717 23:44:01.280566 1810503 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0717 23:44:01.280636 1810503 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0717 23:44:01.280644 1810503 kubeadm.go:322] 
	I0717 23:44:01.280949 1810503 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0717 23:44:01.281033 1810503 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0717 23:44:01.281043 1810503 kubeadm.go:322] 
	I0717 23:44:01.281470 1810503 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 4upcco.ii739ea5bvvelqxf \
	I0717 23:44:01.281582 1810503 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:24e6e85287b2ebc7031b3b104d990fde329a6ed6ae7e93d24f1e459f7a5f641f \
	I0717 23:44:01.281881 1810503 kubeadm.go:322]     --control-plane 
	I0717 23:44:01.281896 1810503 kubeadm.go:322] 
	I0717 23:44:01.282188 1810503 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0717 23:44:01.282207 1810503 kubeadm.go:322] 
	I0717 23:44:01.282559 1810503 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 4upcco.ii739ea5bvvelqxf \
	I0717 23:44:01.282881 1810503 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:24e6e85287b2ebc7031b3b104d990fde329a6ed6ae7e93d24f1e459f7a5f641f 
	I0717 23:44:01.287013 1810503 kubeadm.go:322] W0717 23:43:41.393149    1105 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]
	I0717 23:44:01.287223 1810503 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1039-aws\n", err: exit status 1
	I0717 23:44:01.287323 1810503 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0717 23:44:01.287475 1810503 kubeadm.go:322] W0717 23:43:48.262666    1105 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I0717 23:44:01.287592 1810503 kubeadm.go:322] W0717 23:43:48.263930    1105 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I0717 23:44:01.287607 1810503 cni.go:84] Creating CNI manager for ""
	I0717 23:44:01.287618 1810503 cni.go:149] "docker" driver + "containerd" runtime found, recommending kindnet
	I0717 23:44:01.289499 1810503 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0717 23:44:01.291353 1810503 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0717 23:44:01.299529 1810503 cni.go:188] applying CNI manifest using /var/lib/minikube/binaries/v1.18.20/kubectl ...
	I0717 23:44:01.299550 1810503 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
	I0717 23:44:01.336717 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0717 23:44:01.779431 1810503 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0717 23:44:01.779567 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:01.779635 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl label nodes minikube.k8s.io/version=v1.31.0 minikube.k8s.io/commit=b76e7e219387ed29a8027b03764cb35e04d80ac8 minikube.k8s.io/name=ingress-addon-legacy-804572 minikube.k8s.io/updated_at=2023_07_17T23_44_01_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:01.792331 1810503 ops.go:34] apiserver oom_adj: -16
	I0717 23:44:01.947359 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:02.553453 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:03.053554 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:03.553804 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:04.053730 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:04.553519 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:05.053559 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:05.553737 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:06.053517 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:06.553239 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:07.052899 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:07.552980 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:08.053018 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:08.552886 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:09.053835 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:09.553581 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:10.053464 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:10.553606 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:11.053858 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:11.552975 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:12.053201 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:12.553263 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:13.053892 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:13.552935 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:14.053851 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:14.553042 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:15.052944 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:15.553284 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:16.052841 1810503 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0717 23:44:16.279686 1810503 kubeadm.go:1081] duration metric: took 14.500163797s to wait for elevateKubeSystemPrivileges.
	I0717 23:44:16.279714 1810503 kubeadm.go:406] StartCluster complete in 35.019564986s
	I0717 23:44:16.279730 1810503 settings.go:142] acquiring lock: {Name:mk76776fb395317efa56a4deef1ca709888670e3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:44:16.279788 1810503 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/16899-1773963/kubeconfig
	I0717 23:44:16.280456 1810503 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/kubeconfig: {Name:mk030404123fbc4983ca7ea10e5affac98840d29 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:44:16.281129 1810503 kapi.go:59] client config for ingress-addon-legacy-804572: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt", KeyFile:"/home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.key", CAFile:"/home/jenkins/minikube-integration/16899-1773963/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[
]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x13e6910), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0717 23:44:16.282542 1810503 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0717 23:44:16.282821 1810503 config.go:182] Loaded profile config "ingress-addon-legacy-804572": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.18.20
	I0717 23:44:16.282851 1810503 addons.go:499] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false]
	I0717 23:44:16.282906 1810503 addons.go:69] Setting storage-provisioner=true in profile "ingress-addon-legacy-804572"
	I0717 23:44:16.282918 1810503 addons.go:231] Setting addon storage-provisioner=true in "ingress-addon-legacy-804572"
	I0717 23:44:16.282971 1810503 host.go:66] Checking if "ingress-addon-legacy-804572" exists ...
	I0717 23:44:16.283417 1810503 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-804572 --format={{.State.Status}}
	I0717 23:44:16.284018 1810503 cert_rotation.go:137] Starting client certificate rotation controller
	I0717 23:44:16.284051 1810503 addons.go:69] Setting default-storageclass=true in profile "ingress-addon-legacy-804572"
	I0717 23:44:16.284065 1810503 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ingress-addon-legacy-804572"
	I0717 23:44:16.284350 1810503 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-804572 --format={{.State.Status}}
	I0717 23:44:16.325330 1810503 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0717 23:44:16.327170 1810503 addons.go:423] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0717 23:44:16.327194 1810503 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0717 23:44:16.327257 1810503 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-804572
	I0717 23:44:16.326259 1810503 kapi.go:59] client config for ingress-addon-legacy-804572: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt", KeyFile:"/home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.key", CAFile:"/home/jenkins/minikube-integration/16899-1773963/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[
]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x13e6910), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0717 23:44:16.366048 1810503 addons.go:231] Setting addon default-storageclass=true in "ingress-addon-legacy-804572"
	I0717 23:44:16.366089 1810503 host.go:66] Checking if "ingress-addon-legacy-804572" exists ...
	I0717 23:44:16.366535 1810503 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-804572 --format={{.State.Status}}
	I0717 23:44:16.376820 1810503 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34678 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/ingress-addon-legacy-804572/id_rsa Username:docker}
	I0717 23:44:16.401098 1810503 addons.go:423] installing /etc/kubernetes/addons/storageclass.yaml
	I0717 23:44:16.401122 1810503 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0717 23:44:16.401285 1810503 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-804572
	I0717 23:44:16.433734 1810503 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34678 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/ingress-addon-legacy-804572/id_rsa Username:docker}
	I0717 23:44:16.565124 1810503 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0717 23:44:16.649609 1810503 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0717 23:44:16.762751 1810503 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0717 23:44:16.886534 1810503 kapi.go:248] "coredns" deployment in "kube-system" namespace and "ingress-addon-legacy-804572" context rescaled to 1 replicas
	I0717 23:44:16.886626 1810503 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:containerd ControlPlane:true Worker:true}
	I0717 23:44:16.891945 1810503 out.go:177] * Verifying Kubernetes components...
	I0717 23:44:16.893951 1810503 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 23:44:17.216760 1810503 start.go:901] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0717 23:44:17.336583 1810503 kapi.go:59] client config for ingress-addon-legacy-804572: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt", KeyFile:"/home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.key", CAFile:"/home/jenkins/minikube-integration/16899-1773963/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[
]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x13e6910), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0717 23:44:17.337006 1810503 node_ready.go:35] waiting up to 6m0s for node "ingress-addon-legacy-804572" to be "Ready" ...
	I0717 23:44:17.347429 1810503 out.go:177] * Enabled addons: default-storageclass, storage-provisioner
	I0717 23:44:17.346540 1810503 node_ready.go:49] node "ingress-addon-legacy-804572" has status "Ready":"True"
	I0717 23:44:17.349984 1810503 node_ready.go:38] duration metric: took 12.9018ms waiting for node "ingress-addon-legacy-804572" to be "Ready" ...
	I0717 23:44:17.350018 1810503 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0717 23:44:17.350252 1810503 addons.go:502] enable addons completed in 1.067395715s: enabled=[default-storageclass storage-provisioner]
	I0717 23:44:17.368801 1810503 pod_ready.go:78] waiting up to 6m0s for pod "coredns-66bff467f8-n69pg" in "kube-system" namespace to be "Ready" ...
	I0717 23:44:19.378226 1810503 pod_ready.go:102] pod "coredns-66bff467f8-n69pg" in "kube-system" namespace has status "Ready":"False"
	I0717 23:44:21.878107 1810503 pod_ready.go:102] pod "coredns-66bff467f8-n69pg" in "kube-system" namespace has status "Ready":"False"
	I0717 23:44:24.377319 1810503 pod_ready.go:102] pod "coredns-66bff467f8-n69pg" in "kube-system" namespace has status "Ready":"False"
	I0717 23:44:26.377554 1810503 pod_ready.go:102] pod "coredns-66bff467f8-n69pg" in "kube-system" namespace has status "Ready":"False"
	I0717 23:44:28.378161 1810503 pod_ready.go:102] pod "coredns-66bff467f8-n69pg" in "kube-system" namespace has status "Ready":"False"
	I0717 23:44:30.877894 1810503 pod_ready.go:102] pod "coredns-66bff467f8-n69pg" in "kube-system" namespace has status "Ready":"False"
	I0717 23:44:33.377409 1810503 pod_ready.go:102] pod "coredns-66bff467f8-n69pg" in "kube-system" namespace has status "Ready":"False"
	I0717 23:44:35.377862 1810503 pod_ready.go:102] pod "coredns-66bff467f8-n69pg" in "kube-system" namespace has status "Ready":"False"
	I0717 23:44:37.879581 1810503 pod_ready.go:102] pod "coredns-66bff467f8-n69pg" in "kube-system" namespace has status "Ready":"False"
	I0717 23:44:40.377796 1810503 pod_ready.go:102] pod "coredns-66bff467f8-n69pg" in "kube-system" namespace has status "Ready":"False"
	I0717 23:44:40.879777 1810503 pod_ready.go:92] pod "coredns-66bff467f8-n69pg" in "kube-system" namespace has status "Ready":"True"
	I0717 23:44:40.879803 1810503 pod_ready.go:81] duration metric: took 23.510921644s waiting for pod "coredns-66bff467f8-n69pg" in "kube-system" namespace to be "Ready" ...
	I0717 23:44:40.879815 1810503 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ingress-addon-legacy-804572" in "kube-system" namespace to be "Ready" ...
	I0717 23:44:40.885613 1810503 pod_ready.go:92] pod "etcd-ingress-addon-legacy-804572" in "kube-system" namespace has status "Ready":"True"
	I0717 23:44:40.885682 1810503 pod_ready.go:81] duration metric: took 5.858487ms waiting for pod "etcd-ingress-addon-legacy-804572" in "kube-system" namespace to be "Ready" ...
	I0717 23:44:40.885712 1810503 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ingress-addon-legacy-804572" in "kube-system" namespace to be "Ready" ...
	I0717 23:44:40.893688 1810503 pod_ready.go:92] pod "kube-apiserver-ingress-addon-legacy-804572" in "kube-system" namespace has status "Ready":"True"
	I0717 23:44:40.893717 1810503 pod_ready.go:81] duration metric: took 7.982291ms waiting for pod "kube-apiserver-ingress-addon-legacy-804572" in "kube-system" namespace to be "Ready" ...
	I0717 23:44:40.893730 1810503 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ingress-addon-legacy-804572" in "kube-system" namespace to be "Ready" ...
	I0717 23:44:40.899158 1810503 pod_ready.go:92] pod "kube-controller-manager-ingress-addon-legacy-804572" in "kube-system" namespace has status "Ready":"True"
	I0717 23:44:40.899185 1810503 pod_ready.go:81] duration metric: took 5.445564ms waiting for pod "kube-controller-manager-ingress-addon-legacy-804572" in "kube-system" namespace to be "Ready" ...
	I0717 23:44:40.899197 1810503 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-l2jsx" in "kube-system" namespace to be "Ready" ...
	I0717 23:44:40.904550 1810503 pod_ready.go:92] pod "kube-proxy-l2jsx" in "kube-system" namespace has status "Ready":"True"
	I0717 23:44:40.904575 1810503 pod_ready.go:81] duration metric: took 5.370512ms waiting for pod "kube-proxy-l2jsx" in "kube-system" namespace to be "Ready" ...
	I0717 23:44:40.904586 1810503 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ingress-addon-legacy-804572" in "kube-system" namespace to be "Ready" ...
	I0717 23:44:41.072920 1810503 request.go:628] Waited for 168.235145ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ingress-addon-legacy-804572
	I0717 23:44:41.272912 1810503 request.go:628] Waited for 197.222537ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes/ingress-addon-legacy-804572
	I0717 23:44:41.276039 1810503 pod_ready.go:92] pod "kube-scheduler-ingress-addon-legacy-804572" in "kube-system" namespace has status "Ready":"True"
	I0717 23:44:41.276065 1810503 pod_ready.go:81] duration metric: took 371.470761ms waiting for pod "kube-scheduler-ingress-addon-legacy-804572" in "kube-system" namespace to be "Ready" ...
	I0717 23:44:41.276077 1810503 pod_ready.go:38] duration metric: took 23.926016103s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0717 23:44:41.276092 1810503 api_server.go:52] waiting for apiserver process to appear ...
	I0717 23:44:41.276150 1810503 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0717 23:44:41.289279 1810503 api_server.go:72] duration metric: took 24.402603323s to wait for apiserver process to appear ...
	I0717 23:44:41.289306 1810503 api_server.go:88] waiting for apiserver healthz status ...
	I0717 23:44:41.289326 1810503 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0717 23:44:41.298402 1810503 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0717 23:44:41.299304 1810503 api_server.go:141] control plane version: v1.18.20
	I0717 23:44:41.299328 1810503 api_server.go:131] duration metric: took 10.015536ms to wait for apiserver health ...
	I0717 23:44:41.299337 1810503 system_pods.go:43] waiting for kube-system pods to appear ...
	I0717 23:44:41.473709 1810503 request.go:628] Waited for 174.301549ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I0717 23:44:41.479734 1810503 system_pods.go:59] 8 kube-system pods found
	I0717 23:44:41.479769 1810503 system_pods.go:61] "coredns-66bff467f8-n69pg" [7c71fcae-38d8-4fff-82a9-7f95f17b3a0f] Running
	I0717 23:44:41.479776 1810503 system_pods.go:61] "etcd-ingress-addon-legacy-804572" [78666a04-8779-4667-bd95-15c858a6321c] Running
	I0717 23:44:41.479783 1810503 system_pods.go:61] "kindnet-tmrn5" [aeeafde0-3b6d-41c6-95ac-7ae3cd7da3d8] Running
	I0717 23:44:41.479789 1810503 system_pods.go:61] "kube-apiserver-ingress-addon-legacy-804572" [a8a2b1cb-b8da-44bb-b969-4a8bc364042f] Running
	I0717 23:44:41.479794 1810503 system_pods.go:61] "kube-controller-manager-ingress-addon-legacy-804572" [c8343d7c-bcf0-4e1f-848d-881b63ac5e6a] Running
	I0717 23:44:41.479800 1810503 system_pods.go:61] "kube-proxy-l2jsx" [11166680-e5ee-4469-8d7f-990addff1e10] Running
	I0717 23:44:41.479806 1810503 system_pods.go:61] "kube-scheduler-ingress-addon-legacy-804572" [4a208949-fd5b-42a2-8a36-52d483d6f081] Running
	I0717 23:44:41.479817 1810503 system_pods.go:61] "storage-provisioner" [a25dffe6-7e7b-4fb4-b5c7-b449c13a44fb] Running
	I0717 23:44:41.479826 1810503 system_pods.go:74] duration metric: took 180.483646ms to wait for pod list to return data ...
	I0717 23:44:41.479834 1810503 default_sa.go:34] waiting for default service account to be created ...
	I0717 23:44:41.673310 1810503 request.go:628] Waited for 193.360979ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/default/serviceaccounts
	I0717 23:44:41.675936 1810503 default_sa.go:45] found service account: "default"
	I0717 23:44:41.675961 1810503 default_sa.go:55] duration metric: took 196.118095ms for default service account to be created ...
	I0717 23:44:41.675974 1810503 system_pods.go:116] waiting for k8s-apps to be running ...
	I0717 23:44:41.873476 1810503 request.go:628] Waited for 197.389142ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I0717 23:44:41.880132 1810503 system_pods.go:86] 8 kube-system pods found
	I0717 23:44:41.880164 1810503 system_pods.go:89] "coredns-66bff467f8-n69pg" [7c71fcae-38d8-4fff-82a9-7f95f17b3a0f] Running
	I0717 23:44:41.880172 1810503 system_pods.go:89] "etcd-ingress-addon-legacy-804572" [78666a04-8779-4667-bd95-15c858a6321c] Running
	I0717 23:44:41.880177 1810503 system_pods.go:89] "kindnet-tmrn5" [aeeafde0-3b6d-41c6-95ac-7ae3cd7da3d8] Running
	I0717 23:44:41.880182 1810503 system_pods.go:89] "kube-apiserver-ingress-addon-legacy-804572" [a8a2b1cb-b8da-44bb-b969-4a8bc364042f] Running
	I0717 23:44:41.880187 1810503 system_pods.go:89] "kube-controller-manager-ingress-addon-legacy-804572" [c8343d7c-bcf0-4e1f-848d-881b63ac5e6a] Running
	I0717 23:44:41.880192 1810503 system_pods.go:89] "kube-proxy-l2jsx" [11166680-e5ee-4469-8d7f-990addff1e10] Running
	I0717 23:44:41.880198 1810503 system_pods.go:89] "kube-scheduler-ingress-addon-legacy-804572" [4a208949-fd5b-42a2-8a36-52d483d6f081] Running
	I0717 23:44:41.880202 1810503 system_pods.go:89] "storage-provisioner" [a25dffe6-7e7b-4fb4-b5c7-b449c13a44fb] Running
	I0717 23:44:41.880209 1810503 system_pods.go:126] duration metric: took 204.229707ms to wait for k8s-apps to be running ...
	I0717 23:44:41.880220 1810503 system_svc.go:44] waiting for kubelet service to be running ....
	I0717 23:44:41.880281 1810503 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 23:44:41.894603 1810503 system_svc.go:56] duration metric: took 14.373175ms WaitForService to wait for kubelet.
	I0717 23:44:41.894631 1810503 kubeadm.go:581] duration metric: took 25.007962551s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0717 23:44:41.894650 1810503 node_conditions.go:102] verifying NodePressure condition ...
	I0717 23:44:42.073480 1810503 request.go:628] Waited for 178.746254ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes
	I0717 23:44:42.076799 1810503 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
	I0717 23:44:42.076834 1810503 node_conditions.go:123] node cpu capacity is 2
	I0717 23:44:42.076849 1810503 node_conditions.go:105] duration metric: took 182.193732ms to run NodePressure ...
	I0717 23:44:42.076865 1810503 start.go:228] waiting for startup goroutines ...
	I0717 23:44:42.076885 1810503 start.go:233] waiting for cluster config update ...
	I0717 23:44:42.076904 1810503 start.go:242] writing updated cluster config ...
	I0717 23:44:42.077313 1810503 ssh_runner.go:195] Run: rm -f paused
	I0717 23:44:42.146462 1810503 start.go:578] kubectl: 1.27.3, cluster: 1.18.20 (minor skew: 9)
	I0717 23:44:42.148608 1810503 out.go:177] 
	W0717 23:44:42.150591 1810503 out.go:239] ! /usr/local/bin/kubectl is version 1.27.3, which may have incompatibilities with Kubernetes 1.18.20.
	I0717 23:44:42.152270 1810503 out.go:177]   - Want kubectl v1.18.20? Try 'minikube kubectl -- get pods -A'
	I0717 23:44:42.154546 1810503 out.go:177] * Done! kubectl is now configured to use "ingress-addon-legacy-804572" cluster and "default" namespace by default
	
	* 
	* ==> container status <==
	* CONTAINER           IMAGE               CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	10b88e0150614       13753a81eccfd       13 seconds ago       Exited              hello-world-app           2                   f33bd4cb66bcc       hello-world-app-5f5d8b66bb-fgr5s
	d2fdb08fe64f6       66bf2c914bf4d       39 seconds ago       Running             nginx                     0                   c2a8889247446       nginx
	d6a1691e40d75       d7f0cba3aa5bf       52 seconds ago       Exited              controller                0                   9706a5202b87e       ingress-nginx-controller-7fcf777cb7-4kspf
	ae014aedf58a4       a883f7fc35610       56 seconds ago       Exited              patch                     0                   d2dd8cdee688d       ingress-nginx-admission-patch-2s668
	17bf2304308df       a883f7fc35610       56 seconds ago       Exited              create                    0                   2a1bb35b168d2       ingress-nginx-admission-create-gl2gz
	d3bd69f161f5c       6e17ba78cf3eb       About a minute ago   Running             coredns                   0                   1f192fb64364c       coredns-66bff467f8-n69pg
	115544c720bb9       ba04bb24b9575       About a minute ago   Running             storage-provisioner       0                   e6fa41685cd69       storage-provisioner
	5b71acd38427a       b18bf71b941ba       About a minute ago   Running             kindnet-cni               0                   3cf26ff1f8ece       kindnet-tmrn5
	0c45dc692f826       565297bc6f7d4       About a minute ago   Running             kube-proxy                0                   4a84828bc082b       kube-proxy-l2jsx
	6201eecad2c45       2694cf044d665       About a minute ago   Running             kube-apiserver            0                   6d8d7a0448ccd       kube-apiserver-ingress-addon-legacy-804572
	eb1c5d368af87       68a4fac29a865       About a minute ago   Running             kube-controller-manager   0                   7197bfc943746       kube-controller-manager-ingress-addon-legacy-804572
	1a10c5f34dfd7       ab707b0a0ea33       About a minute ago   Running             etcd                      0                   5dbe172c212ec       etcd-ingress-addon-legacy-804572
	2abc090581d8e       095f37015706d       About a minute ago   Running             kube-scheduler            0                   09d49b6df5139       kube-scheduler-ingress-addon-legacy-804572
	
	* 
	* ==> containerd <==
	* Jul 17 23:45:29 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:29.936849637Z" level=info msg="RemoveContainer for \"e578c4260b2366aabe5280d72cdec7ffc69d18447df062870447e722ddba1283\" returns successfully"
	Jul 17 23:45:35 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:35.500016870Z" level=info msg="StopContainer for \"d6a1691e40d75f3220b06165ece496750ed09e601a50fd95520387f07659f16b\" with timeout 2 (s)"
	Jul 17 23:45:35 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:35.500554477Z" level=info msg="Stop container \"d6a1691e40d75f3220b06165ece496750ed09e601a50fd95520387f07659f16b\" with signal terminated"
	Jul 17 23:45:35 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:35.525873739Z" level=info msg="StopContainer for \"d6a1691e40d75f3220b06165ece496750ed09e601a50fd95520387f07659f16b\" with timeout 2 (s)"
	Jul 17 23:45:35 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:35.529478403Z" level=info msg="Skipping the sending of signal terminated to container \"d6a1691e40d75f3220b06165ece496750ed09e601a50fd95520387f07659f16b\" because a prior stop with timeout>0 request already sent the signal"
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.526915106Z" level=info msg="Kill container \"d6a1691e40d75f3220b06165ece496750ed09e601a50fd95520387f07659f16b\""
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.530568984Z" level=info msg="Kill container \"d6a1691e40d75f3220b06165ece496750ed09e601a50fd95520387f07659f16b\""
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.618237416Z" level=info msg="shim disconnected" id=d6a1691e40d75f3220b06165ece496750ed09e601a50fd95520387f07659f16b
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.618301252Z" level=warning msg="cleaning up after shim disconnected" id=d6a1691e40d75f3220b06165ece496750ed09e601a50fd95520387f07659f16b namespace=k8s.io
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.618312657Z" level=info msg="cleaning up dead shim"
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.629755251Z" level=warning msg="cleanup warnings time=\"2023-07-17T23:45:37Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=4589 runtime=io.containerd.runc.v2\n"
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.632544285Z" level=info msg="StopContainer for \"d6a1691e40d75f3220b06165ece496750ed09e601a50fd95520387f07659f16b\" returns successfully"
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.632575514Z" level=info msg="StopContainer for \"d6a1691e40d75f3220b06165ece496750ed09e601a50fd95520387f07659f16b\" returns successfully"
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.633149265Z" level=info msg="StopPodSandbox for \"9706a5202b87ece5f0e308894d907a1c124e29567f2924df093727ea7f5bbade\""
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.633278701Z" level=info msg="Container to stop \"d6a1691e40d75f3220b06165ece496750ed09e601a50fd95520387f07659f16b\" must be in running or unknown state, current state \"CONTAINER_EXITED\""
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.635518050Z" level=info msg="StopPodSandbox for \"9706a5202b87ece5f0e308894d907a1c124e29567f2924df093727ea7f5bbade\""
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.635582977Z" level=info msg="Container to stop \"d6a1691e40d75f3220b06165ece496750ed09e601a50fd95520387f07659f16b\" must be in running or unknown state, current state \"CONTAINER_EXITED\""
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.672772532Z" level=info msg="shim disconnected" id=9706a5202b87ece5f0e308894d907a1c124e29567f2924df093727ea7f5bbade
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.672934748Z" level=warning msg="cleaning up after shim disconnected" id=9706a5202b87ece5f0e308894d907a1c124e29567f2924df093727ea7f5bbade namespace=k8s.io
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.672998378Z" level=info msg="cleaning up dead shim"
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.686129126Z" level=warning msg="cleanup warnings time=\"2023-07-17T23:45:37Z\" level=info msg=\"starting signal loop\" namespace=k8s.io pid=4627 runtime=io.containerd.runc.v2\n"
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.747329785Z" level=info msg="TearDown network for sandbox \"9706a5202b87ece5f0e308894d907a1c124e29567f2924df093727ea7f5bbade\" successfully"
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.747387992Z" level=info msg="StopPodSandbox for \"9706a5202b87ece5f0e308894d907a1c124e29567f2924df093727ea7f5bbade\" returns successfully"
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.753938696Z" level=info msg="TearDown network for sandbox \"9706a5202b87ece5f0e308894d907a1c124e29567f2924df093727ea7f5bbade\" successfully"
	Jul 17 23:45:37 ingress-addon-legacy-804572 containerd[826]: time="2023-07-17T23:45:37.753986892Z" level=info msg="StopPodSandbox for \"9706a5202b87ece5f0e308894d907a1c124e29567f2924df093727ea7f5bbade\" returns successfully"
	
	* 
	* ==> coredns [d3bd69f161f5cf143cb2646e39289803192b5abba185d8bbc0d9ba2bb029d547] <==
	* [INFO] 10.244.0.5:35841 - 7493 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000032188s
	[INFO] 10.244.0.5:35841 - 35167 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.0000315s
	[INFO] 10.244.0.5:35841 - 52082 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000031098s
	[INFO] 10.244.0.5:35841 - 19369 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000031853s
	[INFO] 10.244.0.5:35841 - 10326 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.00146454s
	[INFO] 10.244.0.5:35841 - 60400 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001988256s
	[INFO] 10.244.0.5:35841 - 54698 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000046769s
	[INFO] 10.244.0.5:57557 - 46194 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.00014665s
	[INFO] 10.244.0.5:57557 - 60234 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000078285s
	[INFO] 10.244.0.5:57557 - 11329 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000050634s
	[INFO] 10.244.0.5:57557 - 15352 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000058339s
	[INFO] 10.244.0.5:41197 - 21934 "A IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000050822s
	[INFO] 10.244.0.5:57557 - 43130 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000030999s
	[INFO] 10.244.0.5:41197 - 59083 "AAAA IN hello-world-app.default.svc.cluster.local.ingress-nginx.svc.cluster.local. udp 91 false 512" NXDOMAIN qr,aa,rd 184 0.000037309s
	[INFO] 10.244.0.5:41197 - 31521 "A IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000050585s
	[INFO] 10.244.0.5:57557 - 10770 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000030162s
	[INFO] 10.244.0.5:41197 - 43757 "AAAA IN hello-world-app.default.svc.cluster.local.svc.cluster.local. udp 77 false 512" NXDOMAIN qr,aa,rd 170 0.000032591s
	[INFO] 10.244.0.5:41197 - 17526 "A IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.00006345s
	[INFO] 10.244.0.5:41197 - 21480 "AAAA IN hello-world-app.default.svc.cluster.local.cluster.local. udp 73 false 512" NXDOMAIN qr,aa,rd 166 0.000282281s
	[INFO] 10.244.0.5:57557 - 19251 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001820396s
	[INFO] 10.244.0.5:41197 - 24685 "A IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001375728s
	[INFO] 10.244.0.5:41197 - 16639 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001375071s
	[INFO] 10.244.0.5:57557 - 25353 "AAAA IN hello-world-app.default.svc.cluster.local.us-east-2.compute.internal. udp 86 false 512" NXDOMAIN qr,rd,ra 86 0.001475502s
	[INFO] 10.244.0.5:41197 - 58267 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000045096s
	[INFO] 10.244.0.5:57557 - 21263 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000079073s
	
	* 
	* ==> describe nodes <==
	* Name:               ingress-addon-legacy-804572
	Roles:              master
	Labels:             beta.kubernetes.io/arch=arm64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=arm64
	                    kubernetes.io/hostname=ingress-addon-legacy-804572
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=b76e7e219387ed29a8027b03764cb35e04d80ac8
	                    minikube.k8s.io/name=ingress-addon-legacy-804572
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2023_07_17T23_44_01_0700
	                    minikube.k8s.io/version=v1.31.0
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /run/containerd/containerd.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 17 Jul 2023 23:43:58 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ingress-addon-legacy-804572
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 17 Jul 2023 23:45:34 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 17 Jul 2023 23:45:34 +0000   Mon, 17 Jul 2023 23:43:53 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 17 Jul 2023 23:45:34 +0000   Mon, 17 Jul 2023 23:43:53 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 17 Jul 2023 23:45:34 +0000   Mon, 17 Jul 2023 23:43:53 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 17 Jul 2023 23:45:34 +0000   Mon, 17 Jul 2023 23:44:14 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ingress-addon-legacy-804572
	Capacity:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022632Ki
	  pods:               110
	Allocatable:
	  cpu:                2
	  ephemeral-storage:  203034800Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  hugepages-32Mi:     0
	  hugepages-64Ki:     0
	  memory:             8022632Ki
	  pods:               110
	System Info:
	  Machine ID:                 e75d69db676b452f9e8c3ab8a8a6e80b
	  System UUID:                d9a99874-340a-449c-a8b3-f83b570c5932
	  Boot ID:                    30727b23-eda1-49fe-8b46-0f11c052162c
	  Kernel Version:             5.15.0-1039-aws
	  OS Image:                   Ubuntu 22.04.2 LTS
	  Operating System:           linux
	  Architecture:               arm64
	  Container Runtime Version:  containerd://1.6.21
	  Kubelet Version:            v1.18.20
	  Kube-Proxy Version:         v1.18.20
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (10 in total)
	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-5f5d8b66bb-fgr5s                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         31s
	  default                     nginx                                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         42s
	  kube-system                 coredns-66bff467f8-n69pg                               100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     87s
	  kube-system                 etcd-ingress-addon-legacy-804572                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         99s
	  kube-system                 kindnet-tmrn5                                          100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      87s
	  kube-system                 kube-apiserver-ingress-addon-legacy-804572             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         98s
	  kube-system                 kube-controller-manager-ingress-addon-legacy-804572    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         99s
	  kube-system                 kube-proxy-l2jsx                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         87s
	  kube-system                 kube-scheduler-ingress-addon-legacy-804572             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         99s
	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         86s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)
	  memory             120Mi (1%!)(MISSING)  220Mi (2%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                  From        Message
	  ----    ------                   ----                 ----        -------
	  Normal  NodeHasSufficientMemory  113s (x5 over 113s)  kubelet     Node ingress-addon-legacy-804572 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    113s (x4 over 113s)  kubelet     Node ingress-addon-legacy-804572 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     113s (x4 over 113s)  kubelet     Node ingress-addon-legacy-804572 status is now: NodeHasSufficientPID
	  Normal  Starting                 99s                  kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  99s                  kubelet     Node ingress-addon-legacy-804572 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    99s                  kubelet     Node ingress-addon-legacy-804572 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     99s                  kubelet     Node ingress-addon-legacy-804572 status is now: NodeHasSufficientPID
	  Normal  NodeAllocatableEnforced  99s                  kubelet     Updated Node Allocatable limit across pods
	  Normal  NodeReady                89s                  kubelet     Node ingress-addon-legacy-804572 status is now: NodeReady
	  Normal  Starting                 86s                  kube-proxy  Starting kube-proxy.
	
	* 
	* ==> dmesg <==
	* [  +0.001039] FS-Cache: O-key=[8] '7adac90000000000'
	[  +0.000715] FS-Cache: N-cookie c=00000078 [p=0000006f fl=2 nc=0 na=1]
	[  +0.000979] FS-Cache: N-cookie d=00000000ec1ea241{9p.inode} n=000000001063103b
	[  +0.001165] FS-Cache: N-key=[8] '7adac90000000000'
	[  +0.003300] FS-Cache: Duplicate cookie detected
	[  +0.000852] FS-Cache: O-cookie c=00000072 [p=0000006f fl=226 nc=0 na=1]
	[  +0.001110] FS-Cache: O-cookie d=00000000ec1ea241{9p.inode} n=00000000a1180baf
	[  +0.001034] FS-Cache: O-key=[8] '7adac90000000000'
	[  +0.000744] FS-Cache: N-cookie c=00000079 [p=0000006f fl=2 nc=0 na=1]
	[  +0.000963] FS-Cache: N-cookie d=00000000ec1ea241{9p.inode} n=000000007798c562
	[  +0.001030] FS-Cache: N-key=[8] '7adac90000000000'
	[  +2.831459] FS-Cache: Duplicate cookie detected
	[  +0.000706] FS-Cache: O-cookie c=00000070 [p=0000006f fl=226 nc=0 na=1]
	[  +0.000943] FS-Cache: O-cookie d=00000000ec1ea241{9p.inode} n=00000000ab96e722
	[  +0.001064] FS-Cache: O-key=[8] '79dac90000000000'
	[  +0.000696] FS-Cache: N-cookie c=0000007b [p=0000006f fl=2 nc=0 na=1]
	[  +0.000952] FS-Cache: N-cookie d=00000000ec1ea241{9p.inode} n=000000001063103b
	[  +0.001024] FS-Cache: N-key=[8] '79dac90000000000'
	[  +0.430829] FS-Cache: Duplicate cookie detected
	[  +0.000815] FS-Cache: O-cookie c=00000075 [p=0000006f fl=226 nc=0 na=1]
	[  +0.000987] FS-Cache: O-cookie d=00000000ec1ea241{9p.inode} n=00000000e8aca9c4
	[  +0.001165] FS-Cache: O-key=[8] '7fdac90000000000'
	[  +0.000718] FS-Cache: N-cookie c=0000007c [p=0000006f fl=2 nc=0 na=1]
	[  +0.000975] FS-Cache: N-cookie d=00000000ec1ea241{9p.inode} n=00000000b6fac530
	[  +0.001034] FS-Cache: N-key=[8] '7fdac90000000000'
	
	* 
	* ==> etcd [1a10c5f34dfd7a7c3eeb1773120e988262cba17010ceb88e6455b07f2c5e59ba] <==
	* raft2023/07/17 23:43:52 INFO: newRaft aec36adc501070cc [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]
	raft2023/07/17 23:43:52 INFO: aec36adc501070cc became follower at term 1
	raft2023/07/17 23:43:52 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2023-07-17 23:43:52.147520 W | auth: simple token is not cryptographically signed
	2023-07-17 23:43:52.155572 I | etcdserver: starting server... [version: 3.4.3, cluster version: to_be_decided]
	2023-07-17 23:43:52.166315 I | etcdserver: aec36adc501070cc as single-node; fast-forwarding 9 ticks (election ticks 10)
	raft2023/07/17 23:43:52 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2023-07-17 23:43:52.176285 I | etcdserver/membership: added member aec36adc501070cc [https://192.168.49.2:2380] to cluster fa54960ea34d58be
	2023-07-17 23:43:52.178191 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 
	2023-07-17 23:43:52.178338 I | embed: listening for metrics on http://127.0.0.1:2381
	2023-07-17 23:43:52.178536 I | embed: listening for peers on 192.168.49.2:2380
	raft2023/07/17 23:43:52 INFO: aec36adc501070cc is starting a new election at term 1
	raft2023/07/17 23:43:52 INFO: aec36adc501070cc became candidate at term 2
	raft2023/07/17 23:43:52 INFO: aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2
	raft2023/07/17 23:43:52 INFO: aec36adc501070cc became leader at term 2
	raft2023/07/17 23:43:52 INFO: raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2
	2023-07-17 23:43:52.961209 I | etcdserver: setting up the initial cluster version to 3.4
	2023-07-17 23:43:53.096199 I | etcdserver: published {Name:ingress-addon-legacy-804572 ClientURLs:[https://192.168.49.2:2379]} to cluster fa54960ea34d58be
	2023-07-17 23:43:53.129188 I | embed: ready to serve client requests
	2023-07-17 23:43:53.168781 I | embed: ready to serve client requests
	2023-07-17 23:43:53.214451 I | embed: serving client requests on 192.168.49.2:2379
	2023-07-17 23:43:53.214675 N | etcdserver/membership: set the initial cluster version to 3.4
	2023-07-17 23:43:53.633670 I | embed: serving client requests on 127.0.0.1:2379
	2023-07-17 23:43:53.981235 I | etcdserver/api: enabled capabilities for version 3.4
	2023-07-17 23:43:53.981556 W | etcdserver: request "ID:8128022499702820356 Method:\"PUT\" Path:\"/0/version\" Val:\"3.4.0\" " with result "" took too long (868.223363ms) to execute
	
	* 
	* ==> kernel <==
	*  23:45:43 up  8:28,  0 users,  load average: 0.68, 1.85, 2.86
	Linux ingress-addon-legacy-804572 5.15.0-1039-aws #44~20.04.1-Ubuntu SMP Thu Jun 22 12:21:08 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.2 LTS"
	
	* 
	* ==> kindnet [5b71acd38427a0c437d3785f0f4d95b177f6d1ebb5aaab1382b40f02a2fb6266] <==
	* I0717 23:44:19.229949       1 main.go:102] connected to apiserver: https://10.96.0.1:443
	I0717 23:44:19.230013       1 main.go:107] hostIP = 192.168.49.2
	podIP = 192.168.49.2
	I0717 23:44:19.230170       1 main.go:116] setting mtu 1500 for CNI 
	I0717 23:44:19.230238       1 main.go:146] kindnetd IP family: "ipv4"
	I0717 23:44:19.230260       1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
	I0717 23:44:19.631506       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:44:19.631542       1 main.go:227] handling current node
	I0717 23:44:29.739921       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:44:29.739951       1 main.go:227] handling current node
	I0717 23:44:39.751248       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:44:39.751295       1 main.go:227] handling current node
	I0717 23:44:49.761476       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:44:49.761505       1 main.go:227] handling current node
	I0717 23:44:59.765396       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:44:59.765426       1 main.go:227] handling current node
	I0717 23:45:09.775974       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:45:09.776004       1 main.go:227] handling current node
	I0717 23:45:19.779983       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:45:19.780010       1 main.go:227] handling current node
	I0717 23:45:29.792840       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:45:29.792870       1 main.go:227] handling current node
	I0717 23:45:39.804426       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0717 23:45:39.804455       1 main.go:227] handling current node
	
	* 
	* ==> kube-apiserver [6201eecad2c4537cec40d25814e1edf3d613b6b1e7f2cbe22fa1d4bae29dff96] <==
	* I0717 23:43:58.183156       1 dynamic_cafile_content.go:167] Starting request-header::/var/lib/minikube/certs/front-proxy-ca.crt
	I0717 23:43:58.269233       1 cache.go:39] Caches are synced for autoregister controller
	I0717 23:43:58.269784       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0717 23:43:58.274824       1 shared_informer.go:230] Caches are synced for cluster_authentication_trust_controller 
	I0717 23:43:58.283871       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I0717 23:43:58.284049       1 shared_informer.go:230] Caches are synced for crd-autoregister 
	I0717 23:43:59.065330       1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
	I0717 23:43:59.065372       1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0717 23:43:59.074890       1 storage_scheduling.go:134] created PriorityClass system-node-critical with value 2000001000
	I0717 23:43:59.081218       1 storage_scheduling.go:134] created PriorityClass system-cluster-critical with value 2000000000
	I0717 23:43:59.081413       1 storage_scheduling.go:143] all system priority classes are created successfully or already exist.
	I0717 23:43:59.494094       1 controller.go:609] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0717 23:43:59.539393       1 controller.go:609] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W0717 23:43:59.677079       1 lease.go:224] Resetting endpoints for master service "kubernetes" to [192.168.49.2]
	I0717 23:43:59.678184       1 controller.go:609] quota admission added evaluator for: endpoints
	I0717 23:43:59.681808       1 controller.go:609] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0717 23:44:00.510647       1 controller.go:609] quota admission added evaluator for: serviceaccounts
	I0717 23:44:01.178563       1 controller.go:609] quota admission added evaluator for: deployments.apps
	I0717 23:44:01.260059       1 controller.go:609] quota admission added evaluator for: daemonsets.apps
	I0717 23:44:04.534667       1 controller.go:609] quota admission added evaluator for: leases.coordination.k8s.io
	I0717 23:44:16.128998       1 controller.go:609] quota admission added evaluator for: replicasets.apps
	I0717 23:44:16.631069       1 controller.go:609] quota admission added evaluator for: controllerrevisions.apps
	I0717 23:44:43.050714       1 controller.go:609] quota admission added evaluator for: jobs.batch
	I0717 23:45:01.583684       1 controller.go:609] quota admission added evaluator for: ingresses.networking.k8s.io
	E0717 23:45:35.510589       1 authentication.go:53] Unable to authenticate the request due to an error: [invalid bearer token, Token has been invalidated]
	
	* 
	* ==> kube-controller-manager [eb1c5d368af874bb69e8854562e851f5f69eebb8df709a84830fb3b957e0750b] <==
	* I0717 23:44:16.510291       1 shared_informer.go:230] Caches are synced for certificate-csrsigning 
	I0717 23:44:16.535342       1 shared_informer.go:230] Caches are synced for certificate-csrapproving 
	I0717 23:44:16.557109       1 request.go:621] Throttling request took 1.050173468s, request: GET:https://control-plane.minikube.internal:8443/apis/rbac.authorization.k8s.io/v1?timeout=32s
	I0717 23:44:16.592294       1 shared_informer.go:230] Caches are synced for expand 
	I0717 23:44:16.621362       1 shared_informer.go:230] Caches are synced for PVC protection 
	I0717 23:44:16.625400       1 shared_informer.go:230] Caches are synced for attach detach 
	I0717 23:44:16.627056       1 shared_informer.go:230] Caches are synced for daemon sets 
	I0717 23:44:16.649129       1 event.go:278] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kube-proxy", UID:"6d0231fc-152e-429a-b503-1e1d020afcaa", APIVersion:"apps/v1", ResourceVersion:"216", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kube-proxy-l2jsx
	I0717 23:44:16.658854       1 event.go:278] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kindnet", UID:"3592865e-05b0-4ad7-9f65-5d61906e608c", APIVersion:"apps/v1", ResourceVersion:"230", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kindnet-tmrn5
	I0717 23:44:16.660087       1 shared_informer.go:230] Caches are synced for persistent volume 
	I0717 23:44:16.706666       1 shared_informer.go:230] Caches are synced for stateful set 
	I0717 23:44:16.708509       1 shared_informer.go:230] Caches are synced for resource quota 
	I0717 23:44:16.711966       1 shared_informer.go:230] Caches are synced for garbage collector 
	I0717 23:44:16.711985       1 garbagecollector.go:142] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0717 23:44:16.721585       1 shared_informer.go:230] Caches are synced for garbage collector 
	I0717 23:44:17.157103       1 shared_informer.go:223] Waiting for caches to sync for resource quota
	I0717 23:44:17.157150       1 shared_informer.go:230] Caches are synced for resource quota 
	I0717 23:44:43.040650       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"d552c9eb-e896-4b15-8bad-0b6eccc9b898", APIVersion:"apps/v1", ResourceVersion:"477", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set ingress-nginx-controller-7fcf777cb7 to 1
	I0717 23:44:43.067045       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7", UID:"f98257bd-00c8-463f-ace5-5ec2b9136b0d", APIVersion:"apps/v1", ResourceVersion:"478", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-controller-7fcf777cb7-4kspf
	I0717 23:44:43.067545       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"74e071a6-abea-4f2a-84ac-df01dae0ea11", APIVersion:"batch/v1", ResourceVersion:"479", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-create-gl2gz
	I0717 23:44:43.127594       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"33ccf32c-ded7-4a9d-b711-e45fb1a15eb3", APIVersion:"batch/v1", ResourceVersion:"485", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-patch-2s668
	I0717 23:44:47.779380       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"74e071a6-abea-4f2a-84ac-df01dae0ea11", APIVersion:"batch/v1", ResourceVersion:"492", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I0717 23:44:47.793782       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"33ccf32c-ded7-4a9d-b711-e45fb1a15eb3", APIVersion:"batch/v1", ResourceVersion:"501", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I0717 23:45:12.353125       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"default", Name:"hello-world-app", UID:"c45fdcd3-4ef1-4f70-989b-26250df832d5", APIVersion:"apps/v1", ResourceVersion:"610", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set hello-world-app-5f5d8b66bb to 1
	I0717 23:45:12.359756       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"default", Name:"hello-world-app-5f5d8b66bb", UID:"180c689e-5063-4b15-a463-b9d0e48e51b9", APIVersion:"apps/v1", ResourceVersion:"611", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: hello-world-app-5f5d8b66bb-fgr5s
	
	* 
	* ==> kube-proxy [0c45dc692f82693ac648fcd6447572d51f0dff08ff6a0cefe4be84904c8a2279] <==
	* W0717 23:44:17.442302       1 server_others.go:559] Unknown proxy mode "", assuming iptables proxy
	I0717 23:44:17.454266       1 node.go:136] Successfully retrieved node IP: 192.168.49.2
	I0717 23:44:17.454497       1 server_others.go:186] Using iptables Proxier.
	I0717 23:44:17.454916       1 server.go:583] Version: v1.18.20
	I0717 23:44:17.456059       1 config.go:315] Starting service config controller
	I0717 23:44:17.456119       1 shared_informer.go:223] Waiting for caches to sync for service config
	I0717 23:44:17.456277       1 config.go:133] Starting endpoints config controller
	I0717 23:44:17.456288       1 shared_informer.go:223] Waiting for caches to sync for endpoints config
	I0717 23:44:17.556394       1 shared_informer.go:230] Caches are synced for endpoints config 
	I0717 23:44:17.556405       1 shared_informer.go:230] Caches are synced for service config 
	
	* 
	* ==> kube-scheduler [2abc090581d8e46ff0f54eae22cd75809692f52a546b7f402c5db06eb1f50aa4] <==
	* I0717 23:43:58.282942       1 registry.go:150] Registering EvenPodsSpread predicate and priority function
	I0717 23:43:58.287715       1 secure_serving.go:178] Serving securely on 127.0.0.1:10259
	I0717 23:43:58.289979       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0717 23:43:58.290125       1 shared_informer.go:223] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0717 23:43:58.290245       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	E0717 23:43:58.294205       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0717 23:43:58.294701       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0717 23:43:58.295627       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0717 23:43:58.295775       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0717 23:43:58.295853       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0717 23:43:58.295926       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0717 23:43:58.296000       1 reflector.go:178] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:233: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0717 23:43:58.294714       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0717 23:43:58.296097       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0717 23:43:58.296274       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0717 23:43:58.296352       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0717 23:43:58.296283       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0717 23:43:59.138920       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0717 23:43:59.171233       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0717 23:43:59.254379       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0717 23:43:59.260875       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0717 23:43:59.281676       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	I0717 23:44:01.790360       1 shared_informer.go:230] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	E0717 23:44:16.204995       1 factory.go:503] pod: kube-system/coredns-66bff467f8-x8994 is already present in the active queue
	E0717 23:44:16.266088       1 factory.go:503] pod: kube-system/coredns-66bff467f8-n69pg is already present in the active queue
	
	* 
	* ==> kubelet <==
	* Jul 17 23:45:15 ingress-addon-legacy-804572 kubelet[1652]: E0717 23:45:15.886976    1652 pod_workers.go:191] Error syncing pod e01c0088-b4c4-4136-9e7c-028200ce80f8 ("hello-world-app-5f5d8b66bb-fgr5s_default(e01c0088-b4c4-4136-9e7c-028200ce80f8)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 10s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-fgr5s_default(e01c0088-b4c4-4136-9e7c-028200ce80f8)"
	Jul 17 23:45:16 ingress-addon-legacy-804572 kubelet[1652]: I0717 23:45:16.889527    1652 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: e578c4260b2366aabe5280d72cdec7ffc69d18447df062870447e722ddba1283
	Jul 17 23:45:16 ingress-addon-legacy-804572 kubelet[1652]: E0717 23:45:16.890234    1652 pod_workers.go:191] Error syncing pod e01c0088-b4c4-4136-9e7c-028200ce80f8 ("hello-world-app-5f5d8b66bb-fgr5s_default(e01c0088-b4c4-4136-9e7c-028200ce80f8)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 10s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-fgr5s_default(e01c0088-b4c4-4136-9e7c-028200ce80f8)"
	Jul 17 23:45:27 ingress-addon-legacy-804572 kubelet[1652]: I0717 23:45:27.607821    1652 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 1880e62db2db0e98e466c927f78f9c351a71d94f5d6bc46256b4253251f4524e
	Jul 17 23:45:27 ingress-addon-legacy-804572 kubelet[1652]: E0717 23:45:27.608173    1652 pod_workers.go:191] Error syncing pod ca1df07c-bb4a-4f90-b652-53a7834db2df ("kube-ingress-dns-minikube_kube-system(ca1df07c-bb4a-4f90-b652-53a7834db2df)"), skipping: failed to "StartContainer" for "minikube-ingress-dns" with CrashLoopBackOff: "back-off 20s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(ca1df07c-bb4a-4f90-b652-53a7834db2df)"
	Jul 17 23:45:28 ingress-addon-legacy-804572 kubelet[1652]: I0717 23:45:28.265142    1652 reconciler.go:196] operationExecutor.UnmountVolume started for volume "minikube-ingress-dns-token-nlxlp" (UniqueName: "kubernetes.io/secret/ca1df07c-bb4a-4f90-b652-53a7834db2df-minikube-ingress-dns-token-nlxlp") pod "ca1df07c-bb4a-4f90-b652-53a7834db2df" (UID: "ca1df07c-bb4a-4f90-b652-53a7834db2df")
	Jul 17 23:45:28 ingress-addon-legacy-804572 kubelet[1652]: I0717 23:45:28.271763    1652 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca1df07c-bb4a-4f90-b652-53a7834db2df-minikube-ingress-dns-token-nlxlp" (OuterVolumeSpecName: "minikube-ingress-dns-token-nlxlp") pod "ca1df07c-bb4a-4f90-b652-53a7834db2df" (UID: "ca1df07c-bb4a-4f90-b652-53a7834db2df"). InnerVolumeSpecName "minikube-ingress-dns-token-nlxlp". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jul 17 23:45:28 ingress-addon-legacy-804572 kubelet[1652]: I0717 23:45:28.365685    1652 reconciler.go:319] Volume detached for volume "minikube-ingress-dns-token-nlxlp" (UniqueName: "kubernetes.io/secret/ca1df07c-bb4a-4f90-b652-53a7834db2df-minikube-ingress-dns-token-nlxlp") on node "ingress-addon-legacy-804572" DevicePath ""
	Jul 17 23:45:28 ingress-addon-legacy-804572 kubelet[1652]: I0717 23:45:28.912366    1652 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 1880e62db2db0e98e466c927f78f9c351a71d94f5d6bc46256b4253251f4524e
	Jul 17 23:45:29 ingress-addon-legacy-804572 kubelet[1652]: I0717 23:45:29.607929    1652 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: e578c4260b2366aabe5280d72cdec7ffc69d18447df062870447e722ddba1283
	Jul 17 23:45:29 ingress-addon-legacy-804572 kubelet[1652]: I0717 23:45:29.916329    1652 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: e578c4260b2366aabe5280d72cdec7ffc69d18447df062870447e722ddba1283
	Jul 17 23:45:29 ingress-addon-legacy-804572 kubelet[1652]: I0717 23:45:29.917194    1652 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 10b88e0150614832301e45f5cbb578532c0b07ebab5adad7ed4da8cd322c298d
	Jul 17 23:45:29 ingress-addon-legacy-804572 kubelet[1652]: E0717 23:45:29.917715    1652 pod_workers.go:191] Error syncing pod e01c0088-b4c4-4136-9e7c-028200ce80f8 ("hello-world-app-5f5d8b66bb-fgr5s_default(e01c0088-b4c4-4136-9e7c-028200ce80f8)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-fgr5s_default(e01c0088-b4c4-4136-9e7c-028200ce80f8)"
	Jul 17 23:45:35 ingress-addon-legacy-804572 kubelet[1652]: E0717 23:45:35.509273    1652 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-4kspf.1772cc62ee9e43d3", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-4kspf", UID:"bf4553c0-a950-4c30-b2c2-f41614b3c4e8", APIVersion:"v1", ResourceVersion:"484", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-804572"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc1259287ddc6cdd3, ext:94383163028, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc1259287ddc6cdd3, ext:94383163028, loc:(*time.Location)(0x6a0ef20)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-4kspf.1772cc62ee9e43d3" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Jul 17 23:45:35 ingress-addon-legacy-804572 kubelet[1652]: E0717 23:45:35.525024    1652 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-4kspf.1772cc62ee9e43d3", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-4kspf", UID:"bf4553c0-a950-4c30-b2c2-f41614b3c4e8", APIVersion:"v1", ResourceVersion:"484", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-804572"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc1259287ddc6cdd3, ext:94383163028, loc:(*time.Location)(0x6a0ef20)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc1259287def8b5ef, ext:94403210928, loc:(*time.Location)(0x6a0ef20)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-4kspf.1772cc62ee9e43d3" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Jul 17 23:45:37 ingress-addon-legacy-804572 kubelet[1652]: W0717 23:45:37.949256    1652 pod_container_deletor.go:77] Container "9706a5202b87ece5f0e308894d907a1c124e29567f2924df093727ea7f5bbade" not found in pod's containers
	Jul 17 23:45:39 ingress-addon-legacy-804572 kubelet[1652]: I0717 23:45:39.698224    1652 reconciler.go:196] operationExecutor.UnmountVolume started for volume "ingress-nginx-token-gtm5s" (UniqueName: "kubernetes.io/secret/bf4553c0-a950-4c30-b2c2-f41614b3c4e8-ingress-nginx-token-gtm5s") pod "bf4553c0-a950-4c30-b2c2-f41614b3c4e8" (UID: "bf4553c0-a950-4c30-b2c2-f41614b3c4e8")
	Jul 17 23:45:39 ingress-addon-legacy-804572 kubelet[1652]: I0717 23:45:39.698296    1652 reconciler.go:196] operationExecutor.UnmountVolume started for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/bf4553c0-a950-4c30-b2c2-f41614b3c4e8-webhook-cert") pod "bf4553c0-a950-4c30-b2c2-f41614b3c4e8" (UID: "bf4553c0-a950-4c30-b2c2-f41614b3c4e8")
	Jul 17 23:45:39 ingress-addon-legacy-804572 kubelet[1652]: I0717 23:45:39.704701    1652 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf4553c0-a950-4c30-b2c2-f41614b3c4e8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bf4553c0-a950-4c30-b2c2-f41614b3c4e8" (UID: "bf4553c0-a950-4c30-b2c2-f41614b3c4e8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jul 17 23:45:39 ingress-addon-legacy-804572 kubelet[1652]: I0717 23:45:39.707574    1652 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf4553c0-a950-4c30-b2c2-f41614b3c4e8-ingress-nginx-token-gtm5s" (OuterVolumeSpecName: "ingress-nginx-token-gtm5s") pod "bf4553c0-a950-4c30-b2c2-f41614b3c4e8" (UID: "bf4553c0-a950-4c30-b2c2-f41614b3c4e8"). InnerVolumeSpecName "ingress-nginx-token-gtm5s". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Jul 17 23:45:39 ingress-addon-legacy-804572 kubelet[1652]: I0717 23:45:39.798710    1652 reconciler.go:319] Volume detached for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/bf4553c0-a950-4c30-b2c2-f41614b3c4e8-webhook-cert") on node "ingress-addon-legacy-804572" DevicePath ""
	Jul 17 23:45:39 ingress-addon-legacy-804572 kubelet[1652]: I0717 23:45:39.798760    1652 reconciler.go:319] Volume detached for volume "ingress-nginx-token-gtm5s" (UniqueName: "kubernetes.io/secret/bf4553c0-a950-4c30-b2c2-f41614b3c4e8-ingress-nginx-token-gtm5s") on node "ingress-addon-legacy-804572" DevicePath ""
	Jul 17 23:45:40 ingress-addon-legacy-804572 kubelet[1652]: W0717 23:45:40.614214    1652 kubelet_getters.go:297] Path "/var/lib/kubelet/pods/bf4553c0-a950-4c30-b2c2-f41614b3c4e8/volumes" does not exist
	Jul 17 23:45:42 ingress-addon-legacy-804572 kubelet[1652]: I0717 23:45:42.607801    1652 topology_manager.go:221] [topologymanager] RemoveContainer - Container ID: 10b88e0150614832301e45f5cbb578532c0b07ebab5adad7ed4da8cd322c298d
	Jul 17 23:45:42 ingress-addon-legacy-804572 kubelet[1652]: E0717 23:45:42.608117    1652 pod_workers.go:191] Error syncing pod e01c0088-b4c4-4136-9e7c-028200ce80f8 ("hello-world-app-5f5d8b66bb-fgr5s_default(e01c0088-b4c4-4136-9e7c-028200ce80f8)"), skipping: failed to "StartContainer" for "hello-world-app" with CrashLoopBackOff: "back-off 20s restarting failed container=hello-world-app pod=hello-world-app-5f5d8b66bb-fgr5s_default(e01c0088-b4c4-4136-9e7c-028200ce80f8)"
	
	* 
	* ==> storage-provisioner [115544c720bb9669bf9ab84f93e00838388315a0ca5c3b306db50c92b87173c2] <==
	* I0717 23:44:20.510933       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0717 23:44:20.524506       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0717 23:44:20.524596       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0717 23:44:20.532146       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0717 23:44:20.532443       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-804572_32f3d08b-35be-4a10-8267-6d724f5a643b!
	I0717 23:44:20.533713       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"b8817e50-e77a-4507-be83-31828544f8bd", APIVersion:"v1", ResourceVersion:"414", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' ingress-addon-legacy-804572_32f3d08b-35be-4a10-8267-6d724f5a643b became leader
	I0717 23:44:20.633450       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-804572_32f3d08b-35be-4a10-8267-6d724f5a643b!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p ingress-addon-legacy-804572 -n ingress-addon-legacy-804572
helpers_test.go:261: (dbg) Run:  kubectl --context ingress-addon-legacy-804572 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddons (51.66s)

                                                
                                    
x
+
TestMissingContainerUpgrade (228.17s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:321: (dbg) Run:  /tmp/minikube-v1.22.0.2992713297.exe start -p missing-upgrade-650274 --memory=2200 --driver=docker  --container-runtime=containerd
E0718 00:04:52.890230 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0718 00:05:28.029004 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
version_upgrade_test.go:321: (dbg) Done: /tmp/minikube-v1.22.0.2992713297.exe start -p missing-upgrade-650274 --memory=2200 --driver=docker  --container-runtime=containerd: (1m46.239980071s)
version_upgrade_test.go:330: (dbg) Run:  docker stop missing-upgrade-650274
version_upgrade_test.go:330: (dbg) Done: docker stop missing-upgrade-650274: (12.076979326s)
version_upgrade_test.go:335: (dbg) Run:  docker rm missing-upgrade-650274
version_upgrade_test.go:341: (dbg) Run:  out/minikube-linux-arm64 start -p missing-upgrade-650274 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
E0718 00:07:17.922273 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
version_upgrade_test.go:341: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p missing-upgrade-650274 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: exit status 90 (1m44.316888146s)

                                                
                                                
-- stdout --
	* [missing-upgrade-650274] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16899
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.27.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.27.3
	* Using the docker driver based on existing profile
	* Starting control plane node missing-upgrade-650274 in cluster missing-upgrade-650274
	* Pulling base image ...
	* Downloading Kubernetes v1.21.2 preload ...
	* docker "missing-upgrade-650274" container is missing, will recreate.
	* Creating docker container (CPUs=2, Memory=2200MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0718 00:06:44.991678 1893072 out.go:296] Setting OutFile to fd 1 ...
	I0718 00:06:44.991886 1893072 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0718 00:06:44.991911 1893072 out.go:309] Setting ErrFile to fd 2...
	I0718 00:06:44.991930 1893072 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0718 00:06:44.992234 1893072 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
	I0718 00:06:44.992655 1893072 out.go:303] Setting JSON to false
	I0718 00:06:44.993782 1893072 start.go:128] hostinfo: {"hostname":"ip-172-31-29-130","uptime":31748,"bootTime":1689607057,"procs":280,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0718 00:06:44.997969 1893072 start.go:138] virtualization:  
	I0718 00:06:45.002736 1893072 out.go:177] * [missing-upgrade-650274] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	I0718 00:06:45.004941 1893072 out.go:177]   - MINIKUBE_LOCATION=16899
	I0718 00:06:45.005079 1893072 notify.go:220] Checking for updates...
	I0718 00:06:45.007614 1893072 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0718 00:06:45.014345 1893072 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig
	I0718 00:06:45.018787 1893072 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube
	I0718 00:06:45.021318 1893072 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0718 00:06:45.023235 1893072 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0718 00:06:45.025696 1893072 config.go:182] Loaded profile config "missing-upgrade-650274": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.21.2
	I0718 00:06:45.029124 1893072 out.go:177] * Kubernetes 1.27.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.27.3
	I0718 00:06:45.031897 1893072 driver.go:373] Setting default libvirt URI to qemu:///system
	I0718 00:06:45.074953 1893072 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0718 00:06:45.075056 1893072 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0718 00:06:45.224226 1893072 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:41 OomKillDisable:true NGoroutines:53 SystemTime:2023-07-18 00:06:45.211271526 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215175168 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0718 00:06:45.224344 1893072 docker.go:294] overlay module found
	I0718 00:06:45.226753 1893072 out.go:177] * Using the docker driver based on existing profile
	I0718 00:06:45.228834 1893072 start.go:298] selected driver: docker
	I0718 00:06:45.228875 1893072 start.go:880] validating driver "docker" against &{Name:missing-upgrade-650274 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:missing-upgrade-650274 Namespace:default APIServerName:minikubeCA APIServer
Names:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.21.2 ContainerRuntime: ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString: Mount9PVersion: MountGID: MountIP: MountMSize:0 MountOptions:[] MountPort:0 MountType: MountUID: BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0718 00:06:45.229025 1893072 start.go:891] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0718 00:06:45.229836 1893072 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0718 00:06:45.362898 1893072 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:41 OomKillDisable:true NGoroutines:53 SystemTime:2023-07-18 00:06:45.346560356 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215175168 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0718 00:06:45.363264 1893072 cni.go:84] Creating CNI manager for ""
	I0718 00:06:45.363276 1893072 cni.go:149] "docker" driver + "containerd" runtime found, recommending kindnet
	I0718 00:06:45.363288 1893072 start_flags.go:319] config:
	{Name:missing-upgrade-650274 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.21.2 ClusterName:missing-upgrade-650274 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubelet Key:cni-conf-dir Value:/etc/cni/net.mk}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.76.2 Port:8443 KubernetesVersion:v1.21.2 ContainerRuntime: ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString: Mount9PVersion: MountGID: MountIP: MountMSize:0 MountOptions:[] MountPort:0 MountType: MountUID: BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAut
hSock: SSHAgentPID:0}
	I0718 00:06:45.365963 1893072 out.go:177] * Starting control plane node missing-upgrade-650274 in cluster missing-upgrade-650274
	I0718 00:06:45.368164 1893072 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0718 00:06:45.369876 1893072 out.go:177] * Pulling base image ...
	I0718 00:06:45.371527 1893072 preload.go:132] Checking if preload exists for k8s version v1.21.2 and runtime containerd
	I0718 00:06:45.371717 1893072 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 in local docker daemon
	I0718 00:06:45.404950 1893072 image.go:83] Found gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 in local docker daemon, skipping pull
	I0718 00:06:45.404973 1893072 cache.go:145] gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 exists in daemon, skipping load
	I0718 00:06:45.444575 1893072 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.21.2/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4
	I0718 00:06:45.444597 1893072 cache.go:57] Caching tarball of preloaded images
	I0718 00:06:45.444740 1893072 preload.go:132] Checking if preload exists for k8s version v1.21.2 and runtime containerd
	I0718 00:06:45.446818 1893072 out.go:177] * Downloading Kubernetes v1.21.2 preload ...
	I0718 00:06:45.448643 1893072 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4 ...
	I0718 00:06:45.578092 1893072 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.21.2/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4?checksum=md5:f1e1f7bdb5d08690c839f70306158850 -> /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4
	I0718 00:06:58.399177 1893072 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4 ...
	I0718 00:06:58.399363 1893072 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4 ...
	I0718 00:06:59.599076 1893072 cache.go:60] Finished verifying existence of preloaded tar for  v1.21.2 on containerd
	I0718 00:06:59.599308 1893072 profile.go:148] Saving config to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/missing-upgrade-650274/config.json ...
	I0718 00:06:59.599572 1893072 cache.go:195] Successfully downloaded all kic artifacts
	I0718 00:06:59.599653 1893072 start.go:365] acquiring machines lock for missing-upgrade-650274: {Name:mke2b47a03062fc08065eb2a2d2caf5695ba6250 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0718 00:06:59.599763 1893072 start.go:369] acquired machines lock for "missing-upgrade-650274" in 53.103µs
	I0718 00:06:59.599807 1893072 start.go:96] Skipping create...Using existing machine configuration
	I0718 00:06:59.599830 1893072 fix.go:54] fixHost starting: 
	I0718 00:06:59.600143 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	W0718 00:06:59.633239 1893072 cli_runner.go:211] docker container inspect missing-upgrade-650274 --format={{.State.Status}} returned with exit code 1
	I0718 00:06:59.633344 1893072 fix.go:102] recreateIfNeeded on missing-upgrade-650274: state= err=unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:06:59.633372 1893072 fix.go:107] machineExists: false. err=machine does not exist
	I0718 00:06:59.637055 1893072 out.go:177] * docker "missing-upgrade-650274" container is missing, will recreate.
	I0718 00:06:59.638632 1893072 delete.go:124] DEMOLISHING missing-upgrade-650274 ...
	I0718 00:06:59.638761 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	W0718 00:06:59.678954 1893072 cli_runner.go:211] docker container inspect missing-upgrade-650274 --format={{.State.Status}} returned with exit code 1
	W0718 00:06:59.679031 1893072 stop.go:75] unable to get state: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:06:59.679056 1893072 delete.go:128] stophost failed (probably ok): ssh power off: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:06:59.679662 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	W0718 00:06:59.713914 1893072 cli_runner.go:211] docker container inspect missing-upgrade-650274 --format={{.State.Status}} returned with exit code 1
	I0718 00:06:59.713998 1893072 delete.go:82] Unable to get host status for missing-upgrade-650274, assuming it has already been deleted: state: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:06:59.714073 1893072 cli_runner.go:164] Run: docker container inspect -f {{.Id}} missing-upgrade-650274
	W0718 00:06:59.734449 1893072 cli_runner.go:211] docker container inspect -f {{.Id}} missing-upgrade-650274 returned with exit code 1
	I0718 00:06:59.734481 1893072 kic.go:367] could not find the container missing-upgrade-650274 to remove it. will try anyways
	I0718 00:06:59.734537 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	W0718 00:06:59.753063 1893072 cli_runner.go:211] docker container inspect missing-upgrade-650274 --format={{.State.Status}} returned with exit code 1
	W0718 00:06:59.753134 1893072 oci.go:84] error getting container status, will try to delete anyways: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:06:59.753253 1893072 cli_runner.go:164] Run: docker exec --privileged -t missing-upgrade-650274 /bin/bash -c "sudo init 0"
	W0718 00:06:59.773249 1893072 cli_runner.go:211] docker exec --privileged -t missing-upgrade-650274 /bin/bash -c "sudo init 0" returned with exit code 1
	I0718 00:06:59.773282 1893072 oci.go:647] error shutdown missing-upgrade-650274: docker exec --privileged -t missing-upgrade-650274 /bin/bash -c "sudo init 0": exit status 1
	stdout:
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:07:00.773556 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	W0718 00:07:00.791108 1893072 cli_runner.go:211] docker container inspect missing-upgrade-650274 --format={{.State.Status}} returned with exit code 1
	I0718 00:07:00.791212 1893072 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:07:00.791227 1893072 oci.go:661] temporary error: container missing-upgrade-650274 status is  but expect it to be exited
	I0718 00:07:00.791255 1893072 retry.go:31] will retry after 309.351508ms: couldn't verify container is exited. %v: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:07:01.101765 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	W0718 00:07:01.125937 1893072 cli_runner.go:211] docker container inspect missing-upgrade-650274 --format={{.State.Status}} returned with exit code 1
	I0718 00:07:01.126006 1893072 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:07:01.126016 1893072 oci.go:661] temporary error: container missing-upgrade-650274 status is  but expect it to be exited
	I0718 00:07:01.126039 1893072 retry.go:31] will retry after 855.587396ms: couldn't verify container is exited. %v: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:07:01.981825 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	W0718 00:07:02.009071 1893072 cli_runner.go:211] docker container inspect missing-upgrade-650274 --format={{.State.Status}} returned with exit code 1
	I0718 00:07:02.009171 1893072 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:07:02.009181 1893072 oci.go:661] temporary error: container missing-upgrade-650274 status is  but expect it to be exited
	I0718 00:07:02.009206 1893072 retry.go:31] will retry after 1.518197617s: couldn't verify container is exited. %v: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:07:03.527590 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	W0718 00:07:03.566889 1893072 cli_runner.go:211] docker container inspect missing-upgrade-650274 --format={{.State.Status}} returned with exit code 1
	I0718 00:07:03.566946 1893072 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:07:03.566954 1893072 oci.go:661] temporary error: container missing-upgrade-650274 status is  but expect it to be exited
	I0718 00:07:03.566984 1893072 retry.go:31] will retry after 1.277454472s: couldn't verify container is exited. %v: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:07:04.845285 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	W0718 00:07:04.866834 1893072 cli_runner.go:211] docker container inspect missing-upgrade-650274 --format={{.State.Status}} returned with exit code 1
	I0718 00:07:04.866912 1893072 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:07:04.866923 1893072 oci.go:661] temporary error: container missing-upgrade-650274 status is  but expect it to be exited
	I0718 00:07:04.866949 1893072 retry.go:31] will retry after 2.220401955s: couldn't verify container is exited. %v: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:07:07.087554 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	W0718 00:07:07.110641 1893072 cli_runner.go:211] docker container inspect missing-upgrade-650274 --format={{.State.Status}} returned with exit code 1
	I0718 00:07:07.110703 1893072 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:07:07.110717 1893072 oci.go:661] temporary error: container missing-upgrade-650274 status is  but expect it to be exited
	I0718 00:07:07.110741 1893072 retry.go:31] will retry after 3.47213077s: couldn't verify container is exited. %v: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:07:10.583685 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	W0718 00:07:10.603797 1893072 cli_runner.go:211] docker container inspect missing-upgrade-650274 --format={{.State.Status}} returned with exit code 1
	I0718 00:07:10.603862 1893072 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:07:10.603872 1893072 oci.go:661] temporary error: container missing-upgrade-650274 status is  but expect it to be exited
	I0718 00:07:10.603902 1893072 retry.go:31] will retry after 6.626760689s: couldn't verify container is exited. %v: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:07:17.230927 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	W0718 00:07:17.247764 1893072 cli_runner.go:211] docker container inspect missing-upgrade-650274 --format={{.State.Status}} returned with exit code 1
	I0718 00:07:17.247826 1893072 oci.go:659] temporary error verifying shutdown: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	I0718 00:07:17.247842 1893072 oci.go:661] temporary error: container missing-upgrade-650274 status is  but expect it to be exited
	I0718 00:07:17.247879 1893072 oci.go:88] couldn't shut down missing-upgrade-650274 (might be okay): verify shutdown: couldn't verify container is exited. %v: unknown state "missing-upgrade-650274": docker container inspect missing-upgrade-650274 --format={{.State.Status}}: exit status 1
	stdout:
	
	
	stderr:
	Error response from daemon: No such container: missing-upgrade-650274
	 
	I0718 00:07:17.247939 1893072 cli_runner.go:164] Run: docker rm -f -v missing-upgrade-650274
	I0718 00:07:17.267605 1893072 cli_runner.go:164] Run: docker container inspect -f {{.Id}} missing-upgrade-650274
	W0718 00:07:17.287107 1893072 cli_runner.go:211] docker container inspect -f {{.Id}} missing-upgrade-650274 returned with exit code 1
	I0718 00:07:17.287207 1893072 cli_runner.go:164] Run: docker network inspect missing-upgrade-650274 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0718 00:07:17.308088 1893072 cli_runner.go:164] Run: docker network rm missing-upgrade-650274
	I0718 00:07:17.409432 1893072 fix.go:114] Sleeping 1 second for extra luck!
	I0718 00:07:18.409608 1893072 start.go:125] createHost starting for "" (driver="docker")
	I0718 00:07:18.411944 1893072 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...
	I0718 00:07:18.412088 1893072 start.go:159] libmachine.API.Create for "missing-upgrade-650274" (driver="docker")
	I0718 00:07:18.412114 1893072 client.go:168] LocalClient.Create starting
	I0718 00:07:18.412208 1893072 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem
	I0718 00:07:18.412248 1893072 main.go:141] libmachine: Decoding PEM data...
	I0718 00:07:18.412270 1893072 main.go:141] libmachine: Parsing certificate...
	I0718 00:07:18.412333 1893072 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem
	I0718 00:07:18.412356 1893072 main.go:141] libmachine: Decoding PEM data...
	I0718 00:07:18.412369 1893072 main.go:141] libmachine: Parsing certificate...
	I0718 00:07:18.412653 1893072 cli_runner.go:164] Run: docker network inspect missing-upgrade-650274 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0718 00:07:18.434769 1893072 cli_runner.go:211] docker network inspect missing-upgrade-650274 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0718 00:07:18.434849 1893072 network_create.go:281] running [docker network inspect missing-upgrade-650274] to gather additional debugging logs...
	I0718 00:07:18.434873 1893072 cli_runner.go:164] Run: docker network inspect missing-upgrade-650274
	W0718 00:07:18.456021 1893072 cli_runner.go:211] docker network inspect missing-upgrade-650274 returned with exit code 1
	I0718 00:07:18.456055 1893072 network_create.go:284] error running [docker network inspect missing-upgrade-650274]: docker network inspect missing-upgrade-650274: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network missing-upgrade-650274 not found
	I0718 00:07:18.456070 1893072 network_create.go:286] output of [docker network inspect missing-upgrade-650274]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network missing-upgrade-650274 not found
	
	** /stderr **
	I0718 00:07:18.456135 1893072 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0718 00:07:18.473721 1893072 network.go:214] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-9ccdbdf11ba1 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:35:0d:c5:6f} reservation:<nil>}
	I0718 00:07:18.474096 1893072 network.go:214] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-5191a770f413 IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:02:42:1a:9a:73:fb} reservation:<nil>}
	I0718 00:07:18.474472 1893072 network.go:214] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-fc11e76a84d2 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:02:42:be:f2:04:1d} reservation:<nil>}
	I0718 00:07:18.474919 1893072 network.go:209] using free private subnet 192.168.76.0/24: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40001e53d0}
	I0718 00:07:18.474941 1893072 network_create.go:123] attempt to create docker network missing-upgrade-650274 192.168.76.0/24 with gateway 192.168.76.1 and MTU of 1500 ...
	I0718 00:07:18.474999 1893072 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.76.0/24 --gateway=192.168.76.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=missing-upgrade-650274 missing-upgrade-650274
	I0718 00:07:18.552956 1893072 network_create.go:107] docker network missing-upgrade-650274 192.168.76.0/24 created
	I0718 00:07:18.552989 1893072 kic.go:117] calculated static IP "192.168.76.2" for the "missing-upgrade-650274" container
	I0718 00:07:18.553070 1893072 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0718 00:07:18.572135 1893072 cli_runner.go:164] Run: docker volume create missing-upgrade-650274 --label name.minikube.sigs.k8s.io=missing-upgrade-650274 --label created_by.minikube.sigs.k8s.io=true
	I0718 00:07:18.593637 1893072 oci.go:103] Successfully created a docker volume missing-upgrade-650274
	I0718 00:07:18.593742 1893072 cli_runner.go:164] Run: docker run --rm --name missing-upgrade-650274-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-650274 --entrypoint /usr/bin/test -v missing-upgrade-650274:/var gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -d /var/lib
	I0718 00:07:20.022461 1893072 cli_runner.go:217] Completed: docker run --rm --name missing-upgrade-650274-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-650274 --entrypoint /usr/bin/test -v missing-upgrade-650274:/var gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -d /var/lib: (1.428674442s)
	I0718 00:07:20.022490 1893072 oci.go:107] Successfully prepared a docker volume missing-upgrade-650274
	I0718 00:07:20.022514 1893072 preload.go:132] Checking if preload exists for k8s version v1.21.2 and runtime containerd
	I0718 00:07:20.022534 1893072 kic.go:190] Starting extracting preloaded images to volume ...
	I0718 00:07:20.022643 1893072 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v missing-upgrade-650274:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -I lz4 -xf /preloaded.tar -C /extractDir
	I0718 00:07:25.032755 1893072 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v missing-upgrade-650274:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -I lz4 -xf /preloaded.tar -C /extractDir: (5.010059088s)
	I0718 00:07:25.032793 1893072 kic.go:199] duration metric: took 5.010254 seconds to extract preloaded images to volume
	W0718 00:07:25.032945 1893072 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0718 00:07:25.033060 1893072 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0718 00:07:25.112462 1893072 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname missing-upgrade-650274 --name missing-upgrade-650274 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-650274 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=missing-upgrade-650274 --network missing-upgrade-650274 --ip 192.168.76.2 --volume missing-upgrade-650274:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79
	I0718 00:07:25.541705 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Running}}
	I0718 00:07:25.566512 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	I0718 00:07:25.587726 1893072 cli_runner.go:164] Run: docker exec missing-upgrade-650274 stat /var/lib/dpkg/alternatives/iptables
	I0718 00:07:25.674247 1893072 oci.go:144] the created container "missing-upgrade-650274" has a running status.
	I0718 00:07:25.674278 1893072 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa...
	I0718 00:07:25.970689 1893072 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0718 00:07:26.004056 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	I0718 00:07:26.046432 1893072 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0718 00:07:26.046450 1893072 kic_runner.go:114] Args: [docker exec --privileged missing-upgrade-650274 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0718 00:07:26.138973 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	I0718 00:07:26.176206 1893072 machine.go:88] provisioning docker machine ...
	I0718 00:07:26.176235 1893072 ubuntu.go:169] provisioning hostname "missing-upgrade-650274"
	I0718 00:07:26.176298 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:26.200416 1893072 main.go:141] libmachine: Using SSH client type: native
	I0718 00:07:26.200886 1893072 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34833 <nil> <nil>}
	I0718 00:07:26.200898 1893072 main.go:141] libmachine: About to run SSH command:
	sudo hostname missing-upgrade-650274 && echo "missing-upgrade-650274" | sudo tee /etc/hostname
	I0718 00:07:26.201495 1893072 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50834->127.0.0.1:34833: read: connection reset by peer
	I0718 00:07:29.376925 1893072 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-650274
	
	I0718 00:07:29.377006 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:29.401558 1893072 main.go:141] libmachine: Using SSH client type: native
	I0718 00:07:29.402135 1893072 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34833 <nil> <nil>}
	I0718 00:07:29.402162 1893072 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\smissing-upgrade-650274' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-650274/g' /etc/hosts;
				else 
					echo '127.0.1.1 missing-upgrade-650274' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0718 00:07:29.545025 1893072 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0718 00:07:29.545054 1893072 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/16899-1773963/.minikube CaCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/16899-1773963/.minikube}
	I0718 00:07:29.545075 1893072 ubuntu.go:177] setting up certificates
	I0718 00:07:29.545083 1893072 provision.go:83] configureAuth start
	I0718 00:07:29.545151 1893072 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-650274
	I0718 00:07:29.570249 1893072 provision.go:138] copyHostCerts
	I0718 00:07:29.570327 1893072 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem, removing ...
	I0718 00:07:29.570340 1893072 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem
	I0718 00:07:29.570426 1893072 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem (1078 bytes)
	I0718 00:07:29.570579 1893072 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem, removing ...
	I0718 00:07:29.570590 1893072 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem
	I0718 00:07:29.570620 1893072 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem (1123 bytes)
	I0718 00:07:29.570679 1893072 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem, removing ...
	I0718 00:07:29.570689 1893072 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem
	I0718 00:07:29.570713 1893072 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem (1679 bytes)
	I0718 00:07:29.570760 1893072 provision.go:112] generating server cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem org=jenkins.missing-upgrade-650274 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube missing-upgrade-650274]
	I0718 00:07:30.357392 1893072 provision.go:172] copyRemoteCerts
	I0718 00:07:30.357530 1893072 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0718 00:07:30.357596 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:30.383153 1893072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34833 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa Username:docker}
	I0718 00:07:30.483889 1893072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
	I0718 00:07:30.519848 1893072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0718 00:07:30.570242 1893072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0718 00:07:30.609404 1893072 provision.go:86] duration metric: configureAuth took 1.064306689s
	I0718 00:07:30.609434 1893072 ubuntu.go:193] setting minikube options for container-runtime
	I0718 00:07:30.609625 1893072 config.go:182] Loaded profile config "missing-upgrade-650274": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.21.2
	I0718 00:07:30.609639 1893072 machine.go:91] provisioned docker machine in 4.433418115s
	I0718 00:07:30.609649 1893072 client.go:171] LocalClient.Create took 12.197519923s
	I0718 00:07:30.609665 1893072 start.go:167] duration metric: libmachine.API.Create for "missing-upgrade-650274" took 12.197577761s
	I0718 00:07:30.609684 1893072 start.go:300] post-start starting for "missing-upgrade-650274" (driver="docker")
	I0718 00:07:30.609694 1893072 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0718 00:07:30.609748 1893072 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0718 00:07:30.609813 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:30.640071 1893072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34833 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa Username:docker}
	I0718 00:07:30.747579 1893072 ssh_runner.go:195] Run: cat /etc/os-release
	I0718 00:07:30.753310 1893072 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0718 00:07:30.753383 1893072 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0718 00:07:30.753419 1893072 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0718 00:07:30.753453 1893072 info.go:137] Remote host: Ubuntu 20.04.2 LTS
	I0718 00:07:30.753480 1893072 filesync.go:126] Scanning /home/jenkins/minikube-integration/16899-1773963/.minikube/addons for local assets ...
	I0718 00:07:30.753561 1893072 filesync.go:126] Scanning /home/jenkins/minikube-integration/16899-1773963/.minikube/files for local assets ...
	I0718 00:07:30.753720 1893072 filesync.go:149] local asset: /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem -> 17793502.pem in /etc/ssl/certs
	I0718 00:07:30.753922 1893072 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0718 00:07:30.765401 1893072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem --> /etc/ssl/certs/17793502.pem (1708 bytes)
	I0718 00:07:30.799677 1893072 start.go:303] post-start completed in 189.977688ms
	I0718 00:07:30.800084 1893072 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-650274
	I0718 00:07:30.819809 1893072 profile.go:148] Saving config to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/missing-upgrade-650274/config.json ...
	I0718 00:07:30.820088 1893072 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0718 00:07:30.820140 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:30.838893 1893072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34833 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa Username:docker}
	I0718 00:07:30.929335 1893072 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0718 00:07:30.935186 1893072 start.go:128] duration metric: createHost completed in 12.525531456s
	I0718 00:07:30.935287 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	W0718 00:07:30.954155 1893072 fix.go:128] unexpected machine state, will restart: <nil>
	I0718 00:07:30.954185 1893072 machine.go:88] provisioning docker machine ...
	I0718 00:07:30.954202 1893072 ubuntu.go:169] provisioning hostname "missing-upgrade-650274"
	I0718 00:07:30.954268 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:30.973486 1893072 main.go:141] libmachine: Using SSH client type: native
	I0718 00:07:30.973931 1893072 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34833 <nil> <nil>}
	I0718 00:07:30.973949 1893072 main.go:141] libmachine: About to run SSH command:
	sudo hostname missing-upgrade-650274 && echo "missing-upgrade-650274" | sudo tee /etc/hostname
	I0718 00:07:31.119476 1893072 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-650274
	
	I0718 00:07:31.119596 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:31.138623 1893072 main.go:141] libmachine: Using SSH client type: native
	I0718 00:07:31.139057 1893072 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34833 <nil> <nil>}
	I0718 00:07:31.139083 1893072 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\smissing-upgrade-650274' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-650274/g' /etc/hosts;
				else 
					echo '127.0.1.1 missing-upgrade-650274' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0718 00:07:31.266210 1893072 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0718 00:07:31.266234 1893072 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/16899-1773963/.minikube CaCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/16899-1773963/.minikube}
	I0718 00:07:31.266250 1893072 ubuntu.go:177] setting up certificates
	I0718 00:07:31.266259 1893072 provision.go:83] configureAuth start
	I0718 00:07:31.266321 1893072 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-650274
	I0718 00:07:31.285829 1893072 provision.go:138] copyHostCerts
	I0718 00:07:31.285905 1893072 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem, removing ...
	I0718 00:07:31.285917 1893072 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem
	I0718 00:07:31.285995 1893072 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem (1679 bytes)
	I0718 00:07:31.286089 1893072 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem, removing ...
	I0718 00:07:31.286099 1893072 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem
	I0718 00:07:31.286131 1893072 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem (1078 bytes)
	I0718 00:07:31.286188 1893072 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem, removing ...
	I0718 00:07:31.286198 1893072 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem
	I0718 00:07:31.286222 1893072 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem (1123 bytes)
	I0718 00:07:31.286270 1893072 provision.go:112] generating server cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem org=jenkins.missing-upgrade-650274 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube missing-upgrade-650274]
	I0718 00:07:31.821561 1893072 provision.go:172] copyRemoteCerts
	I0718 00:07:31.821638 1893072 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0718 00:07:31.821714 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:31.842988 1893072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34833 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa Username:docker}
	I0718 00:07:31.934999 1893072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0718 00:07:31.959827 1893072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
	I0718 00:07:31.984690 1893072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0718 00:07:32.012365 1893072 provision.go:86] duration metric: configureAuth took 746.091474ms
	I0718 00:07:32.012398 1893072 ubuntu.go:193] setting minikube options for container-runtime
	I0718 00:07:32.012613 1893072 config.go:182] Loaded profile config "missing-upgrade-650274": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.21.2
	I0718 00:07:32.012635 1893072 machine.go:91] provisioned docker machine in 1.058435698s
	I0718 00:07:32.012643 1893072 start.go:300] post-start starting for "missing-upgrade-650274" (driver="docker")
	I0718 00:07:32.012652 1893072 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0718 00:07:32.012709 1893072 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0718 00:07:32.012761 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:32.032905 1893072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34833 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa Username:docker}
	I0718 00:07:32.123146 1893072 ssh_runner.go:195] Run: cat /etc/os-release
	I0718 00:07:32.127249 1893072 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0718 00:07:32.127276 1893072 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0718 00:07:32.127289 1893072 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0718 00:07:32.127296 1893072 info.go:137] Remote host: Ubuntu 20.04.2 LTS
	I0718 00:07:32.127306 1893072 filesync.go:126] Scanning /home/jenkins/minikube-integration/16899-1773963/.minikube/addons for local assets ...
	I0718 00:07:32.127373 1893072 filesync.go:126] Scanning /home/jenkins/minikube-integration/16899-1773963/.minikube/files for local assets ...
	I0718 00:07:32.127456 1893072 filesync.go:149] local asset: /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem -> 17793502.pem in /etc/ssl/certs
	I0718 00:07:32.127565 1893072 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0718 00:07:32.137050 1893072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem --> /etc/ssl/certs/17793502.pem (1708 bytes)
	I0718 00:07:32.161517 1893072 start.go:303] post-start completed in 148.859159ms
	I0718 00:07:32.161594 1893072 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0718 00:07:32.161672 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:32.179478 1893072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34833 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa Username:docker}
	I0718 00:07:32.267174 1893072 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0718 00:07:32.272889 1893072 fix.go:56] fixHost completed within 32.673050628s
	I0718 00:07:32.272910 1893072 start.go:83] releasing machines lock for "missing-upgrade-650274", held for 32.673111846s
	I0718 00:07:32.272981 1893072 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-650274
	I0718 00:07:32.291011 1893072 ssh_runner.go:195] Run: cat /version.json
	I0718 00:07:32.291070 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:32.291333 1893072 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0718 00:07:32.291390 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:32.311896 1893072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34833 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa Username:docker}
	I0718 00:07:32.325842 1893072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34833 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa Username:docker}
	W0718 00:07:32.401828 1893072 start.go:419] Unable to open version.json: cat /version.json: Process exited with status 1
	stdout:
	
	stderr:
	cat: /version.json: No such file or directory
	I0718 00:07:32.401941 1893072 ssh_runner.go:195] Run: systemctl --version
	I0718 00:07:32.553834 1893072 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0718 00:07:32.559646 1893072 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0718 00:07:32.587605 1893072 cni.go:236] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0718 00:07:32.587695 1893072 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0718 00:07:32.619604 1893072 cni.go:268] disabled [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I0718 00:07:32.619629 1893072 start.go:466] detecting cgroup driver to use...
	I0718 00:07:32.619662 1893072 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0718 00:07:32.619725 1893072 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0718 00:07:32.635133 1893072 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0718 00:07:32.647853 1893072 docker.go:196] disabling cri-docker service (if available) ...
	I0718 00:07:32.647948 1893072 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0718 00:07:32.660733 1893072 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0718 00:07:32.673713 1893072 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	W0718 00:07:32.688431 1893072 docker.go:206] Failed to disable socket "cri-docker.socket" (might be ok): sudo systemctl disable cri-docker.socket: Process exited with status 1
	stdout:
	
	stderr:
	Failed to disable unit: Unit file cri-docker.socket does not exist.
	I0718 00:07:32.688501 1893072 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0718 00:07:32.795457 1893072 docker.go:212] disabling docker service ...
	I0718 00:07:32.795524 1893072 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0718 00:07:32.825894 1893072 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0718 00:07:32.838403 1893072 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0718 00:07:32.945507 1893072 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0718 00:07:33.049601 1893072 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0718 00:07:33.067449 1893072 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0718 00:07:33.086559 1893072 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.4.1"|' /etc/containerd/config.toml"
	I0718 00:07:33.098324 1893072 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0718 00:07:33.110214 1893072 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0718 00:07:33.110298 1893072 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0718 00:07:33.121884 1893072 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0718 00:07:33.133104 1893072 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0718 00:07:33.144256 1893072 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0718 00:07:33.155923 1893072 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0718 00:07:33.166485 1893072 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0718 00:07:33.176934 1893072 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0718 00:07:33.186810 1893072 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0718 00:07:33.196073 1893072 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0718 00:07:33.313053 1893072 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0718 00:07:33.473657 1893072 start.go:513] Will wait 60s for socket path /run/containerd/containerd.sock
	I0718 00:07:33.473726 1893072 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0718 00:07:33.479061 1893072 start.go:534] Will wait 60s for crictl version
	I0718 00:07:33.479127 1893072 ssh_runner.go:195] Run: which crictl
	I0718 00:07:33.483882 1893072 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0718 00:07:33.517328 1893072 retry.go:31] will retry after 10.020476344s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:07:33Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	I0718 00:07:43.540117 1893072 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0718 00:07:43.602752 1893072 retry.go:31] will retry after 19.919690775s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:07:43Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	I0718 00:08:03.522699 1893072 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0718 00:08:03.559327 1893072 retry.go:31] will retry after 25.615660848s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:08:03Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	I0718 00:08:29.178193 1893072 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0718 00:08:29.210316 1893072 out.go:177] 
	W0718 00:08:29.212020 1893072 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to start container runtime: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:08:29Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	
	X Exiting due to RUNTIME_ENABLE: Failed to start container runtime: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:08:29Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	
	W0718 00:08:29.212038 1893072 out.go:239] * 
	* 
	W0718 00:08:29.212982 1893072 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0718 00:08:29.214288 1893072 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:343: failed missing container upgrade from v1.22.0. args: out/minikube-linux-arm64 start -p missing-upgrade-650274 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd : exit status 90
version_upgrade_test.go:345: *** TestMissingContainerUpgrade FAILED at 2023-07-18 00:08:29.263602096 +0000 UTC m=+2120.657416392
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestMissingContainerUpgrade]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect missing-upgrade-650274
helpers_test.go:235: (dbg) docker inspect missing-upgrade-650274:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "46e06f32d9b9afa5b3d0ae46d65bdfa15036fd9947df58a6df264cc39cf2d2a0",
	        "Created": "2023-07-18T00:07:25.130478909Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 1894548,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2023-07-18T00:07:25.532187295Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:ba5ae658d5b3f017bdb597cc46a1912d5eed54239e31b777788d204fdcbc4445",
	        "ResolvConfPath": "/var/lib/docker/containers/46e06f32d9b9afa5b3d0ae46d65bdfa15036fd9947df58a6df264cc39cf2d2a0/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/46e06f32d9b9afa5b3d0ae46d65bdfa15036fd9947df58a6df264cc39cf2d2a0/hostname",
	        "HostsPath": "/var/lib/docker/containers/46e06f32d9b9afa5b3d0ae46d65bdfa15036fd9947df58a6df264cc39cf2d2a0/hosts",
	        "LogPath": "/var/lib/docker/containers/46e06f32d9b9afa5b3d0ae46d65bdfa15036fd9947df58a6df264cc39cf2d2a0/46e06f32d9b9afa5b3d0ae46d65bdfa15036fd9947df58a6df264cc39cf2d2a0-json.log",
	        "Name": "/missing-upgrade-650274",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "missing-upgrade-650274:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {}
	            },
	            "NetworkMode": "missing-upgrade-650274",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 2306867200,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 4613734400,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": null,
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/9195b51164d626697dcf0de294fa740e98556ae327572ba62201103a632594ca-init/diff:/var/lib/docker/overlay2/4949857344cbb5a460a95368db26db1e85b10d844843a377d4066837108a93ae/diff:/var/lib/docker/overlay2/082afdc1ba22eddfb368074758b6e3db82704f5ce917a59a5d9fa4bf7e093da0/diff:/var/lib/docker/overlay2/590a44580cf07bf8015bc5cb0d1884ca339859d5a48339bee4b07e5081484acc/diff:/var/lib/docker/overlay2/0b91920db19fa8b22ae13736ad6e006d8cac7102721b3bdd6c1aa673bb44895d/diff:/var/lib/docker/overlay2/806d214e7f55d6870c76f2539021081f84a744adba2adf293853cb1b432777d6/diff:/var/lib/docker/overlay2/e7c71410a79228a5fb6f5c22a55fc69685091c4008362a1f2ff22da0fdf6409e/diff:/var/lib/docker/overlay2/704cd5d13f577a456cf5ea0389110b3db70bb14b61150eab4f904d4cc27b3745/diff:/var/lib/docker/overlay2/2f4bd0f8b183fc77e74e544c303ed857fc682e5ba50731c5bc6db936f0188d1c/diff:/var/lib/docker/overlay2/331b090d8e6b704fe2c6014e1972be4932888e36e4af6a9956e1d263a7e5cf43/diff:/var/lib/docker/overlay2/ba142b
1cf31058b5df2959cd8cfe9f041083bd6c3c024503e41b52611900d7ed/diff:/var/lib/docker/overlay2/8dbda2dc51dea749d294f9a9daa01c4070a5b7bfcfef950b4e2c094b2bdfa6ab/diff:/var/lib/docker/overlay2/b77df02c4c0808d4428a6cee556aaba3e036e686deb6da88725406b08de87e31/diff:/var/lib/docker/overlay2/eb36c643df4df6905eca45b2f7c188330364894107001f6d484be8d114fb7cfa/diff:/var/lib/docker/overlay2/af45634aa0590dfb6095f0785a02d7f4b9565cb67dc60d1f45d723cbf7f7cb35/diff:/var/lib/docker/overlay2/2e3eaea8fa567a2d5b1c825c5380083c5721e71a98499afecf48a99419fb0f87/diff:/var/lib/docker/overlay2/b21fff85d80289857a504beb0dfdc5a7965e625cb0c61e2b8ee3b7094af7852a/diff:/var/lib/docker/overlay2/6aa43432cb929c413bdf67a9bdd1c97277f110c5a7af6d45b219f4b22512745a/diff:/var/lib/docker/overlay2/dd6428171d4b0934df8efaf5e6a1d748279adc3c243e2de2c43818aee14afbfd/diff:/var/lib/docker/overlay2/0a0e18b52fd7ac792626a3a37d1eae7203547ac279bd98836fd8962844d0e9eb/diff:/var/lib/docker/overlay2/550edac514ebe00a024fdd5f386721b543f6d0cd389b0b7eb283d7c3805ac8d9/diff:/var/lib/d
ocker/overlay2/db7a4818e1c64162b057e1897242014847bacf03da47bd8f666cfdc2a9cc1d41/diff:/var/lib/docker/overlay2/94972a0dac8ea143ec0008d295094a8b82d7bb3914dcaf0e3d2dc9eb6da0040e/diff:/var/lib/docker/overlay2/c7587606caa62b7a91321036496ef90aec75f874bea223a0729c6a3c21b49fea/diff:/var/lib/docker/overlay2/b2c2edac40a898ec3dc1dd7fd7398c5c74da2bbcf545faa8e4a02648c834fc2f/diff:/var/lib/docker/overlay2/1532aa24a659c306927e6b511869d3730cc30e79a2d218d6f0de403b2968b4e3/diff:/var/lib/docker/overlay2/51af38e2f33de9890779eaf1858c442780373b49dafc077d03a839bed21a3421/diff:/var/lib/docker/overlay2/ed35649dd14f60a4769d6f82330a96a4136577778a8659bb3e44ee2f8b5d2c05/diff:/var/lib/docker/overlay2/9efe1912d17b8695a657bfeaca3d54991a8f741213f59c40a4800335230e708c/diff:/var/lib/docker/overlay2/a16b6dfbaca89076037734916904035c673922723405b86943c9d5ee0f649e22/diff:/var/lib/docker/overlay2/a537b7146cb7f6a9dd2d3de2eade7f91eca039ecc3342c730d59e3dcfbb88ad9/diff:/var/lib/docker/overlay2/938a92b265cbcdc354aa8d52a39df60df56e4885291a307b4af3e9e389c
9827b/diff:/var/lib/docker/overlay2/d831030dacac1bc9d3e9fde20b6595833ba12839c5a807855ac439ae6999443c/diff:/var/lib/docker/overlay2/18269e0909496b8b523d4889674a0d8fe90131ab77e14cb3b7636ff02dd3f8e3/diff:/var/lib/docker/overlay2/2e769477d6cf781767bedafbfb6f3cb7b70738476f8cc3c7ac48e9a0c31a762a/diff:/var/lib/docker/overlay2/0905f13489f0fccb7545f8ea064b97cf8e8be3a3ee0d6097977b8b683cbd9621/diff:/var/lib/docker/overlay2/f6b249932b30b8831bbff4e75c64b0095e689a3dc051a8e5738ed490331838f7/diff",
	                "MergedDir": "/var/lib/docker/overlay2/9195b51164d626697dcf0de294fa740e98556ae327572ba62201103a632594ca/merged",
	                "UpperDir": "/var/lib/docker/overlay2/9195b51164d626697dcf0de294fa740e98556ae327572ba62201103a632594ca/diff",
	                "WorkDir": "/var/lib/docker/overlay2/9195b51164d626697dcf0de294fa740e98556ae327572ba62201103a632594ca/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "missing-upgrade-650274",
	                "Source": "/var/lib/docker/volumes/missing-upgrade-650274/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "missing-upgrade-650274",
	            "Domainname": "",
	            "User": "root",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79",
	            "Volumes": null,
	            "WorkingDir": "",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "missing-upgrade-650274",
	                "name.minikube.sigs.k8s.io": "missing-upgrade-650274",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "af64f870e3cb006ddbb3881415d311883157eeef5a76665102562161f1f03ce1",
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34833"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34832"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34829"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34831"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "34830"
	                    }
	                ]
	            },
	            "SandboxKey": "/var/run/docker/netns/af64f870e3cb",
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "missing-upgrade-650274": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.76.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "46e06f32d9b9",
	                        "missing-upgrade-650274"
	                    ],
	                    "NetworkID": "b50c39bbc08f8f838400aadb26d7dfbfa7561714ad1ccc5675463601cf84491b",
	                    "EndpointID": "fa0b628d3eacdae25c27d0ba3f13b9316cc8242d3896e7a016c187c91fed37c4",
	                    "Gateway": "192.168.76.1",
	                    "IPAddress": "192.168.76.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "MacAddress": "02:42:c0:a8:4c:02",
	                    "DriverOpts": null
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p missing-upgrade-650274 -n missing-upgrade-650274
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p missing-upgrade-650274 -n missing-upgrade-650274: exit status 2 (354.749507ms)

                                                
                                                
-- stdout --
	Running

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 2 (may be ok)
helpers_test.go:244: <<< TestMissingContainerUpgrade FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestMissingContainerUpgrade]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p missing-upgrade-650274 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p missing-upgrade-650274 logs -n 25: (1.341182132s)
helpers_test.go:252: TestMissingContainerUpgrade logs: 
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|-----------------------------|---------|---------|-------------------------------|-------------------------------|
	| Command |              Args              |           Profile           |  User   | Version |          Start Time           |           End Time            |
	|---------|--------------------------------|-----------------------------|---------|---------|-------------------------------|-------------------------------|
	| stop    | -p scheduled-stop-874347       | scheduled-stop-874347       | jenkins | v1.31.0 | 18 Jul 23 00:03 UTC           |                               |
	|         | --schedule 15s                 |                             |         |         |                               |                               |
	| stop    | -p scheduled-stop-874347       | scheduled-stop-874347       | jenkins | v1.31.0 | 18 Jul 23 00:03 UTC           |                               |
	|         | --schedule 15s                 |                             |         |         |                               |                               |
	| stop    | -p scheduled-stop-874347       | scheduled-stop-874347       | jenkins | v1.31.0 | 18 Jul 23 00:03 UTC           |                               |
	|         | --schedule 15s                 |                             |         |         |                               |                               |
	| stop    | -p scheduled-stop-874347       | scheduled-stop-874347       | jenkins | v1.31.0 | 18 Jul 23 00:03 UTC           | 18 Jul 23 00:03 UTC           |
	|         | --cancel-scheduled             |                             |         |         |                               |                               |
	| stop    | -p scheduled-stop-874347       | scheduled-stop-874347       | jenkins | v1.31.0 | 18 Jul 23 00:03 UTC           |                               |
	|         | --schedule 15s                 |                             |         |         |                               |                               |
	| stop    | -p scheduled-stop-874347       | scheduled-stop-874347       | jenkins | v1.31.0 | 18 Jul 23 00:03 UTC           |                               |
	|         | --schedule 15s                 |                             |         |         |                               |                               |
	| stop    | -p scheduled-stop-874347       | scheduled-stop-874347       | jenkins | v1.31.0 | 18 Jul 23 00:03 UTC           | 18 Jul 23 00:04 UTC           |
	|         | --schedule 15s                 |                             |         |         |                               |                               |
	| delete  | -p scheduled-stop-874347       | scheduled-stop-874347       | jenkins | v1.31.0 | 18 Jul 23 00:04 UTC           | 18 Jul 23 00:04 UTC           |
	| start   | -p insufficient-storage-719807 | insufficient-storage-719807 | jenkins | v1.31.0 | 18 Jul 23 00:04 UTC           |                               |
	|         | --memory=2048 --output=json    |                             |         |         |                               |                               |
	|         | --wait=true --driver=docker    |                             |         |         |                               |                               |
	|         | --container-runtime=containerd |                             |         |         |                               |                               |
	| delete  | -p insufficient-storage-719807 | insufficient-storage-719807 | jenkins | v1.31.0 | 18 Jul 23 00:04 UTC           | 18 Jul 23 00:04 UTC           |
	| start   | -p NoKubernetes-353370         | NoKubernetes-353370         | jenkins | v1.31.0 | 18 Jul 23 00:04 UTC           |                               |
	|         | --no-kubernetes                |                             |         |         |                               |                               |
	|         | --kubernetes-version=1.20      |                             |         |         |                               |                               |
	|         | --driver=docker                |                             |         |         |                               |                               |
	|         | --container-runtime=containerd |                             |         |         |                               |                               |
	| start   | -p NoKubernetes-353370         | NoKubernetes-353370         | jenkins | v1.31.0 | 18 Jul 23 00:04 UTC           | 18 Jul 23 00:05 UTC           |
	|         | --driver=docker                |                             |         |         |                               |                               |
	|         | --container-runtime=containerd |                             |         |         |                               |                               |
	| start   | -p NoKubernetes-353370         | NoKubernetes-353370         | jenkins | v1.31.0 | 18 Jul 23 00:05 UTC           | 18 Jul 23 00:06 UTC           |
	|         | --no-kubernetes                |                             |         |         |                               |                               |
	|         | --driver=docker                |                             |         |         |                               |                               |
	|         | --container-runtime=containerd |                             |         |         |                               |                               |
	| delete  | -p NoKubernetes-353370         | NoKubernetes-353370         | jenkins | v1.31.0 | 18 Jul 23 00:06 UTC           | 18 Jul 23 00:06 UTC           |
	| start   | -p NoKubernetes-353370         | NoKubernetes-353370         | jenkins | v1.31.0 | 18 Jul 23 00:06 UTC           | 18 Jul 23 00:06 UTC           |
	|         | --no-kubernetes                |                             |         |         |                               |                               |
	|         | --driver=docker                |                             |         |         |                               |                               |
	|         | --container-runtime=containerd |                             |         |         |                               |                               |
	| ssh     | -p NoKubernetes-353370 sudo    | NoKubernetes-353370         | jenkins | v1.31.0 | 18 Jul 23 00:06 UTC           |                               |
	|         | systemctl is-active --quiet    |                             |         |         |                               |                               |
	|         | service kubelet                |                             |         |         |                               |                               |
	| stop    | -p NoKubernetes-353370         | NoKubernetes-353370         | jenkins | v1.31.0 | 18 Jul 23 00:06 UTC           | 18 Jul 23 00:06 UTC           |
	| start   | -p NoKubernetes-353370         | NoKubernetes-353370         | jenkins | v1.31.0 | 18 Jul 23 00:06 UTC           | 18 Jul 23 00:06 UTC           |
	|         | --driver=docker                |                             |         |         |                               |                               |
	|         | --container-runtime=containerd |                             |         |         |                               |                               |
	| ssh     | -p NoKubernetes-353370 sudo    | NoKubernetes-353370         | jenkins | v1.31.0 | 18 Jul 23 00:06 UTC           |                               |
	|         | systemctl is-active --quiet    |                             |         |         |                               |                               |
	|         | service kubelet                |                             |         |         |                               |                               |
	| delete  | -p NoKubernetes-353370         | NoKubernetes-353370         | jenkins | v1.31.0 | 18 Jul 23 00:06 UTC           | 18 Jul 23 00:06 UTC           |
	| start   | -p kubernetes-upgrade-557855   | kubernetes-upgrade-557855   | jenkins | v1.31.0 | 18 Jul 23 00:06 UTC           | 18 Jul 23 00:07 UTC           |
	|         | --memory=2200                  |                             |         |         |                               |                               |
	|         | --kubernetes-version=v1.16.0   |                             |         |         |                               |                               |
	|         | --alsologtostderr              |                             |         |         |                               |                               |
	|         | -v=1 --driver=docker           |                             |         |         |                               |                               |
	|         | --container-runtime=containerd |                             |         |         |                               |                               |
	| start   | -p missing-upgrade-650274      | missing-upgrade-650274      | jenkins | v1.22.0 | Tue, 18 Jul 2023 00:04:46 UTC | Tue, 18 Jul 2023 00:06:32 UTC |
	|         | --memory=2200 --driver=docker  |                             |         |         |                               |                               |
	|         | --container-runtime=containerd |                             |         |         |                               |                               |
	| start   | -p missing-upgrade-650274      | missing-upgrade-650274      | jenkins | v1.31.0 | 18 Jul 23 00:06 UTC           |                               |
	|         | --memory=2200                  |                             |         |         |                               |                               |
	|         | --alsologtostderr              |                             |         |         |                               |                               |
	|         | -v=1 --driver=docker           |                             |         |         |                               |                               |
	|         | --container-runtime=containerd |                             |         |         |                               |                               |
	| stop    | -p kubernetes-upgrade-557855   | kubernetes-upgrade-557855   | jenkins | v1.31.0 | 18 Jul 23 00:07 UTC           | 18 Jul 23 00:07 UTC           |
	| start   | -p kubernetes-upgrade-557855   | kubernetes-upgrade-557855   | jenkins | v1.31.0 | 18 Jul 23 00:07 UTC           |                               |
	|         | --memory=2200                  |                             |         |         |                               |                               |
	|         | --kubernetes-version=v1.27.3   |                             |         |         |                               |                               |
	|         | --alsologtostderr              |                             |         |         |                               |                               |
	|         | -v=1 --driver=docker           |                             |         |         |                               |                               |
	|         | --container-runtime=containerd |                             |         |         |                               |                               |
	|---------|--------------------------------|-----------------------------|---------|---------|-------------------------------|-------------------------------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/18 00:07:29
	Running on machine: ip-172-31-29-130
	Binary: Built with gc go1.20.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0718 00:07:29.212151 1895213 out.go:296] Setting OutFile to fd 1 ...
	I0718 00:07:29.212407 1895213 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0718 00:07:29.212440 1895213 out.go:309] Setting ErrFile to fd 2...
	I0718 00:07:29.212469 1895213 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0718 00:07:29.212808 1895213 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
	I0718 00:07:29.213345 1895213 out.go:303] Setting JSON to false
	I0718 00:07:29.214461 1895213 start.go:128] hostinfo: {"hostname":"ip-172-31-29-130","uptime":31793,"bootTime":1689607057,"procs":245,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0718 00:07:29.214569 1895213 start.go:138] virtualization:  
	I0718 00:07:29.218273 1895213 out.go:177] * [kubernetes-upgrade-557855] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	I0718 00:07:29.220233 1895213 out.go:177]   - MINIKUBE_LOCATION=16899
	I0718 00:07:29.220334 1895213 notify.go:220] Checking for updates...
	I0718 00:07:29.223443 1895213 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0718 00:07:29.226314 1895213 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig
	I0718 00:07:29.228050 1895213 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube
	I0718 00:07:29.229825 1895213 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0718 00:07:29.231820 1895213 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0718 00:07:29.234102 1895213 config.go:182] Loaded profile config "kubernetes-upgrade-557855": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	I0718 00:07:29.234732 1895213 driver.go:373] Setting default libvirt URI to qemu:///system
	I0718 00:07:29.303542 1895213 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0718 00:07:29.303660 1895213 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0718 00:07:29.398990 1895213 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:34 OomKillDisable:true NGoroutines:45 SystemTime:2023-07-18 00:07:29.388746776 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215175168 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0718 00:07:29.399095 1895213 docker.go:294] overlay module found
	I0718 00:07:29.401934 1895213 out.go:177] * Using the docker driver based on existing profile
	I0718 00:07:29.405228 1895213 start.go:298] selected driver: docker
	I0718 00:07:29.405246 1895213 start.go:880] validating driver "docker" against &{Name:kubernetes-upgrade-557855 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-557855 Namespace:default APIServerName:minikubeCA API
ServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableM
etrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0718 00:07:29.405363 1895213 start.go:891] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0718 00:07:29.405947 1895213 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0718 00:07:29.506899 1895213 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:34 OomKillDisable:true NGoroutines:45 SystemTime:2023-07-18 00:07:29.497280766 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215175168 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0718 00:07:29.507265 1895213 cni.go:84] Creating CNI manager for ""
	I0718 00:07:29.507276 1895213 cni.go:149] "docker" driver + "containerd" runtime found, recommending kindnet
	I0718 00:07:29.507288 1895213 start_flags.go:319] config:
	{Name:kubernetes-upgrade-557855 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:kubernetes-upgrade-557855 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containe
rd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Sta
ticIP: SSHAuthSock: SSHAgentPID:0}
	I0718 00:07:29.510309 1895213 out.go:177] * Starting control plane node kubernetes-upgrade-557855 in cluster kubernetes-upgrade-557855
	I0718 00:07:29.513068 1895213 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0718 00:07:29.516054 1895213 out.go:177] * Pulling base image ...
	I0718 00:07:29.518298 1895213 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime containerd
	I0718 00:07:29.518360 1895213 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0718 00:07:29.518366 1895213 preload.go:148] Found local preload: /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-containerd-overlay2-arm64.tar.lz4
	I0718 00:07:29.518459 1895213 cache.go:57] Caching tarball of preloaded images
	I0718 00:07:29.518533 1895213 preload.go:174] Found /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
	I0718 00:07:29.518542 1895213 cache.go:60] Finished verifying existence of preloaded tar for  v1.27.3 on containerd
	I0718 00:07:29.518663 1895213 profile.go:148] Saving config to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kubernetes-upgrade-557855/config.json ...
	I0718 00:07:29.536870 1895213 image.go:83] Found gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon, skipping pull
	I0718 00:07:29.536911 1895213 cache.go:145] gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 exists in daemon, skipping load
	I0718 00:07:29.536929 1895213 cache.go:195] Successfully downloaded all kic artifacts
	I0718 00:07:29.536996 1895213 start.go:365] acquiring machines lock for kubernetes-upgrade-557855: {Name:mk04202eff75047099074cd934fdd7267b912f49 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0718 00:07:29.537066 1895213 start.go:369] acquired machines lock for "kubernetes-upgrade-557855" in 43.135µs
	I0718 00:07:29.537087 1895213 start.go:96] Skipping create...Using existing machine configuration
	I0718 00:07:29.537092 1895213 fix.go:54] fixHost starting: 
	I0718 00:07:29.537395 1895213 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-557855 --format={{.State.Status}}
	I0718 00:07:29.562328 1895213 fix.go:102] recreateIfNeeded on kubernetes-upgrade-557855: state=Stopped err=<nil>
	W0718 00:07:29.562359 1895213 fix.go:128] unexpected machine state, will restart: <nil>
	I0718 00:07:29.564519 1895213 out.go:177] * Restarting existing docker container for "kubernetes-upgrade-557855" ...
	I0718 00:07:25.032755 1893072 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.21.2-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v missing-upgrade-650274:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79 -I lz4 -xf /preloaded.tar -C /extractDir: (5.010059088s)
	I0718 00:07:25.032793 1893072 kic.go:199] duration metric: took 5.010254 seconds to extract preloaded images to volume
	W0718 00:07:25.032945 1893072 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0718 00:07:25.033060 1893072 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0718 00:07:25.112462 1893072 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname missing-upgrade-650274 --name missing-upgrade-650274 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=missing-upgrade-650274 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=missing-upgrade-650274 --network missing-upgrade-650274 --ip 192.168.76.2 --volume missing-upgrade-650274:/var --security-opt apparmor=unconfined --memory=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.25@sha256:6f936e3443b95cd918d77623bf7b595653bb382766e280290a02b4a349e88b79
	I0718 00:07:25.541705 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Running}}
	I0718 00:07:25.566512 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	I0718 00:07:25.587726 1893072 cli_runner.go:164] Run: docker exec missing-upgrade-650274 stat /var/lib/dpkg/alternatives/iptables
	I0718 00:07:25.674247 1893072 oci.go:144] the created container "missing-upgrade-650274" has a running status.
	I0718 00:07:25.674278 1893072 kic.go:221] Creating ssh key for kic: /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa...
	I0718 00:07:25.970689 1893072 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0718 00:07:26.004056 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	I0718 00:07:26.046432 1893072 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0718 00:07:26.046450 1893072 kic_runner.go:114] Args: [docker exec --privileged missing-upgrade-650274 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0718 00:07:26.138973 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	I0718 00:07:26.176206 1893072 machine.go:88] provisioning docker machine ...
	I0718 00:07:26.176235 1893072 ubuntu.go:169] provisioning hostname "missing-upgrade-650274"
	I0718 00:07:26.176298 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:26.200416 1893072 main.go:141] libmachine: Using SSH client type: native
	I0718 00:07:26.200886 1893072 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34833 <nil> <nil>}
	I0718 00:07:26.200898 1893072 main.go:141] libmachine: About to run SSH command:
	sudo hostname missing-upgrade-650274 && echo "missing-upgrade-650274" | sudo tee /etc/hostname
	I0718 00:07:26.201495 1893072 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:50834->127.0.0.1:34833: read: connection reset by peer
	I0718 00:07:29.376925 1893072 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-650274
	
	I0718 00:07:29.377006 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:29.401558 1893072 main.go:141] libmachine: Using SSH client type: native
	I0718 00:07:29.402135 1893072 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34833 <nil> <nil>}
	I0718 00:07:29.402162 1893072 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\smissing-upgrade-650274' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-650274/g' /etc/hosts;
				else 
					echo '127.0.1.1 missing-upgrade-650274' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0718 00:07:29.545025 1893072 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0718 00:07:29.545054 1893072 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/16899-1773963/.minikube CaCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/16899-1773963/.minikube}
	I0718 00:07:29.545075 1893072 ubuntu.go:177] setting up certificates
	I0718 00:07:29.545083 1893072 provision.go:83] configureAuth start
	I0718 00:07:29.545151 1893072 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-650274
	I0718 00:07:29.570249 1893072 provision.go:138] copyHostCerts
	I0718 00:07:29.570327 1893072 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem, removing ...
	I0718 00:07:29.570340 1893072 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem
	I0718 00:07:29.570426 1893072 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem (1078 bytes)
	I0718 00:07:29.570579 1893072 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem, removing ...
	I0718 00:07:29.570590 1893072 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem
	I0718 00:07:29.570620 1893072 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem (1123 bytes)
	I0718 00:07:29.570679 1893072 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem, removing ...
	I0718 00:07:29.570689 1893072 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem
	I0718 00:07:29.570713 1893072 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem (1679 bytes)
	I0718 00:07:29.570760 1893072 provision.go:112] generating server cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem org=jenkins.missing-upgrade-650274 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube missing-upgrade-650274]
	I0718 00:07:29.566647 1895213 cli_runner.go:164] Run: docker start kubernetes-upgrade-557855
	I0718 00:07:30.023642 1895213 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-557855 --format={{.State.Status}}
	I0718 00:07:30.080406 1895213 kic.go:426] container "kubernetes-upgrade-557855" state is running.
	I0718 00:07:30.080901 1895213 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-557855
	I0718 00:07:30.130719 1895213 profile.go:148] Saving config to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kubernetes-upgrade-557855/config.json ...
	I0718 00:07:30.130989 1895213 machine.go:88] provisioning docker machine ...
	I0718 00:07:30.131037 1895213 ubuntu.go:169] provisioning hostname "kubernetes-upgrade-557855"
	I0718 00:07:30.131106 1895213 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-557855
	I0718 00:07:30.175935 1895213 main.go:141] libmachine: Using SSH client type: native
	I0718 00:07:30.178958 1895213 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34838 <nil> <nil>}
	I0718 00:07:30.178984 1895213 main.go:141] libmachine: About to run SSH command:
	sudo hostname kubernetes-upgrade-557855 && echo "kubernetes-upgrade-557855" | sudo tee /etc/hostname
	I0718 00:07:30.179734 1895213 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: EOF
	I0718 00:07:33.354181 1895213 main.go:141] libmachine: SSH cmd err, output: <nil>: kubernetes-upgrade-557855
	
	I0718 00:07:33.354321 1895213 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-557855
	I0718 00:07:33.382170 1895213 main.go:141] libmachine: Using SSH client type: native
	I0718 00:07:33.382653 1895213 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34838 <nil> <nil>}
	I0718 00:07:33.382671 1895213 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\skubernetes-upgrade-557855' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 kubernetes-upgrade-557855/g' /etc/hosts;
				else 
					echo '127.0.1.1 kubernetes-upgrade-557855' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0718 00:07:33.542634 1895213 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0718 00:07:33.542660 1895213 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/16899-1773963/.minikube CaCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/16899-1773963/.minikube}
	I0718 00:07:33.542682 1895213 ubuntu.go:177] setting up certificates
	I0718 00:07:33.542706 1895213 provision.go:83] configureAuth start
	I0718 00:07:33.542769 1895213 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-557855
	I0718 00:07:33.560689 1895213 provision.go:138] copyHostCerts
	I0718 00:07:33.560755 1895213 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem, removing ...
	I0718 00:07:33.560779 1895213 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem
	I0718 00:07:33.560842 1895213 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem (1078 bytes)
	I0718 00:07:33.561007 1895213 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem, removing ...
	I0718 00:07:33.561017 1895213 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem
	I0718 00:07:33.561040 1895213 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem (1123 bytes)
	I0718 00:07:33.561099 1895213 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem, removing ...
	I0718 00:07:33.561108 1895213 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem
	I0718 00:07:33.561128 1895213 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem (1679 bytes)
	I0718 00:07:33.561316 1895213 provision.go:112] generating server cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem org=jenkins.kubernetes-upgrade-557855 san=[192.168.67.2 127.0.0.1 localhost 127.0.0.1 minikube kubernetes-upgrade-557855]
	I0718 00:07:33.727905 1895213 provision.go:172] copyRemoteCerts
	I0718 00:07:33.728019 1895213 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0718 00:07:33.728084 1895213 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-557855
	I0718 00:07:33.748468 1895213 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34838 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/kubernetes-upgrade-557855/id_rsa Username:docker}
	I0718 00:07:33.843933 1895213 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0718 00:07:33.872602 1895213 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
	I0718 00:07:33.902536 1895213 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0718 00:07:33.932179 1895213 provision.go:86] duration metric: configureAuth took 389.460282ms
	I0718 00:07:33.932203 1895213 ubuntu.go:193] setting minikube options for container-runtime
	I0718 00:07:33.932382 1895213 config.go:182] Loaded profile config "kubernetes-upgrade-557855": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
	I0718 00:07:33.932389 1895213 machine.go:91] provisioned docker machine in 3.801391176s
	I0718 00:07:33.932395 1895213 start.go:300] post-start starting for "kubernetes-upgrade-557855" (driver="docker")
	I0718 00:07:33.932404 1895213 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0718 00:07:33.932467 1895213 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0718 00:07:33.932505 1895213 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-557855
	I0718 00:07:33.951330 1895213 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34838 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/kubernetes-upgrade-557855/id_rsa Username:docker}
	I0718 00:07:34.053714 1895213 ssh_runner.go:195] Run: cat /etc/os-release
	I0718 00:07:34.059573 1895213 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0718 00:07:34.059609 1895213 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0718 00:07:34.059624 1895213 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0718 00:07:34.059631 1895213 info.go:137] Remote host: Ubuntu 22.04.2 LTS
	I0718 00:07:34.059641 1895213 filesync.go:126] Scanning /home/jenkins/minikube-integration/16899-1773963/.minikube/addons for local assets ...
	I0718 00:07:34.059696 1895213 filesync.go:126] Scanning /home/jenkins/minikube-integration/16899-1773963/.minikube/files for local assets ...
	I0718 00:07:34.059784 1895213 filesync.go:149] local asset: /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem -> 17793502.pem in /etc/ssl/certs
	I0718 00:07:34.059894 1895213 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0718 00:07:34.071204 1895213 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem --> /etc/ssl/certs/17793502.pem (1708 bytes)
	I0718 00:07:34.101931 1895213 start.go:303] post-start completed in 169.51969ms
	I0718 00:07:34.102034 1895213 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0718 00:07:34.102088 1895213 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-557855
	I0718 00:07:34.120680 1895213 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34838 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/kubernetes-upgrade-557855/id_rsa Username:docker}
	I0718 00:07:30.357392 1893072 provision.go:172] copyRemoteCerts
	I0718 00:07:30.357530 1893072 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0718 00:07:30.357596 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:30.383153 1893072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34833 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa Username:docker}
	I0718 00:07:30.483889 1893072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
	I0718 00:07:30.519848 1893072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0718 00:07:30.570242 1893072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0718 00:07:30.609404 1893072 provision.go:86] duration metric: configureAuth took 1.064306689s
	I0718 00:07:30.609434 1893072 ubuntu.go:193] setting minikube options for container-runtime
	I0718 00:07:30.609625 1893072 config.go:182] Loaded profile config "missing-upgrade-650274": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.21.2
	I0718 00:07:30.609639 1893072 machine.go:91] provisioned docker machine in 4.433418115s
	I0718 00:07:30.609649 1893072 client.go:171] LocalClient.Create took 12.197519923s
	I0718 00:07:30.609665 1893072 start.go:167] duration metric: libmachine.API.Create for "missing-upgrade-650274" took 12.197577761s
	I0718 00:07:30.609684 1893072 start.go:300] post-start starting for "missing-upgrade-650274" (driver="docker")
	I0718 00:07:30.609694 1893072 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0718 00:07:30.609748 1893072 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0718 00:07:30.609813 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:30.640071 1893072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34833 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa Username:docker}
	I0718 00:07:30.747579 1893072 ssh_runner.go:195] Run: cat /etc/os-release
	I0718 00:07:30.753310 1893072 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0718 00:07:30.753383 1893072 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0718 00:07:30.753419 1893072 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0718 00:07:30.753453 1893072 info.go:137] Remote host: Ubuntu 20.04.2 LTS
	I0718 00:07:30.753480 1893072 filesync.go:126] Scanning /home/jenkins/minikube-integration/16899-1773963/.minikube/addons for local assets ...
	I0718 00:07:30.753561 1893072 filesync.go:126] Scanning /home/jenkins/minikube-integration/16899-1773963/.minikube/files for local assets ...
	I0718 00:07:30.753720 1893072 filesync.go:149] local asset: /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem -> 17793502.pem in /etc/ssl/certs
	I0718 00:07:30.753922 1893072 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0718 00:07:30.765401 1893072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem --> /etc/ssl/certs/17793502.pem (1708 bytes)
	I0718 00:07:30.799677 1893072 start.go:303] post-start completed in 189.977688ms
	I0718 00:07:30.800084 1893072 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-650274
	I0718 00:07:30.819809 1893072 profile.go:148] Saving config to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/missing-upgrade-650274/config.json ...
	I0718 00:07:30.820088 1893072 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0718 00:07:30.820140 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:30.838893 1893072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34833 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa Username:docker}
	I0718 00:07:30.929335 1893072 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0718 00:07:30.935186 1893072 start.go:128] duration metric: createHost completed in 12.525531456s
	I0718 00:07:30.935287 1893072 cli_runner.go:164] Run: docker container inspect missing-upgrade-650274 --format={{.State.Status}}
	W0718 00:07:30.954155 1893072 fix.go:128] unexpected machine state, will restart: <nil>
	I0718 00:07:30.954185 1893072 machine.go:88] provisioning docker machine ...
	I0718 00:07:30.954202 1893072 ubuntu.go:169] provisioning hostname "missing-upgrade-650274"
	I0718 00:07:30.954268 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:30.973486 1893072 main.go:141] libmachine: Using SSH client type: native
	I0718 00:07:30.973931 1893072 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34833 <nil> <nil>}
	I0718 00:07:30.973949 1893072 main.go:141] libmachine: About to run SSH command:
	sudo hostname missing-upgrade-650274 && echo "missing-upgrade-650274" | sudo tee /etc/hostname
	I0718 00:07:31.119476 1893072 main.go:141] libmachine: SSH cmd err, output: <nil>: missing-upgrade-650274
	
	I0718 00:07:31.119596 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:31.138623 1893072 main.go:141] libmachine: Using SSH client type: native
	I0718 00:07:31.139057 1893072 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x39f610] 0x3a1fa0 <nil>  [] 0s} 127.0.0.1 34833 <nil> <nil>}
	I0718 00:07:31.139083 1893072 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\smissing-upgrade-650274' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 missing-upgrade-650274/g' /etc/hosts;
				else 
					echo '127.0.1.1 missing-upgrade-650274' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0718 00:07:31.266210 1893072 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0718 00:07:31.266234 1893072 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/16899-1773963/.minikube CaCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/16899-1773963/.minikube}
	I0718 00:07:31.266250 1893072 ubuntu.go:177] setting up certificates
	I0718 00:07:31.266259 1893072 provision.go:83] configureAuth start
	I0718 00:07:31.266321 1893072 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-650274
	I0718 00:07:31.285829 1893072 provision.go:138] copyHostCerts
	I0718 00:07:31.285905 1893072 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem, removing ...
	I0718 00:07:31.285917 1893072 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem
	I0718 00:07:31.285995 1893072 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/key.pem (1679 bytes)
	I0718 00:07:31.286089 1893072 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem, removing ...
	I0718 00:07:31.286099 1893072 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem
	I0718 00:07:31.286131 1893072 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.pem (1078 bytes)
	I0718 00:07:31.286188 1893072 exec_runner.go:144] found /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem, removing ...
	I0718 00:07:31.286198 1893072 exec_runner.go:203] rm: /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem
	I0718 00:07:31.286222 1893072 exec_runner.go:151] cp: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/16899-1773963/.minikube/cert.pem (1123 bytes)
	I0718 00:07:31.286270 1893072 provision.go:112] generating server cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem org=jenkins.missing-upgrade-650274 san=[192.168.76.2 127.0.0.1 localhost 127.0.0.1 minikube missing-upgrade-650274]
	I0718 00:07:31.821561 1893072 provision.go:172] copyRemoteCerts
	I0718 00:07:31.821638 1893072 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0718 00:07:31.821714 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:31.842988 1893072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34833 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa Username:docker}
	I0718 00:07:31.934999 1893072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0718 00:07:31.959827 1893072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server.pem --> /etc/docker/server.pem (1241 bytes)
	I0718 00:07:31.984690 1893072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0718 00:07:32.012365 1893072 provision.go:86] duration metric: configureAuth took 746.091474ms
	I0718 00:07:32.012398 1893072 ubuntu.go:193] setting minikube options for container-runtime
	I0718 00:07:32.012613 1893072 config.go:182] Loaded profile config "missing-upgrade-650274": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.21.2
	I0718 00:07:32.012635 1893072 machine.go:91] provisioned docker machine in 1.058435698s
	I0718 00:07:32.012643 1893072 start.go:300] post-start starting for "missing-upgrade-650274" (driver="docker")
	I0718 00:07:32.012652 1893072 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0718 00:07:32.012709 1893072 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0718 00:07:32.012761 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:32.032905 1893072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34833 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa Username:docker}
	I0718 00:07:32.123146 1893072 ssh_runner.go:195] Run: cat /etc/os-release
	I0718 00:07:32.127249 1893072 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0718 00:07:32.127276 1893072 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0718 00:07:32.127289 1893072 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0718 00:07:32.127296 1893072 info.go:137] Remote host: Ubuntu 20.04.2 LTS
	I0718 00:07:32.127306 1893072 filesync.go:126] Scanning /home/jenkins/minikube-integration/16899-1773963/.minikube/addons for local assets ...
	I0718 00:07:32.127373 1893072 filesync.go:126] Scanning /home/jenkins/minikube-integration/16899-1773963/.minikube/files for local assets ...
	I0718 00:07:32.127456 1893072 filesync.go:149] local asset: /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem -> 17793502.pem in /etc/ssl/certs
	I0718 00:07:32.127565 1893072 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0718 00:07:32.137050 1893072 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem --> /etc/ssl/certs/17793502.pem (1708 bytes)
	I0718 00:07:32.161517 1893072 start.go:303] post-start completed in 148.859159ms
	I0718 00:07:32.161594 1893072 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0718 00:07:32.161672 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:32.179478 1893072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34833 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa Username:docker}
	I0718 00:07:32.267174 1893072 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0718 00:07:32.272889 1893072 fix.go:56] fixHost completed within 32.673050628s
	I0718 00:07:32.272910 1893072 start.go:83] releasing machines lock for "missing-upgrade-650274", held for 32.673111846s
	I0718 00:07:32.272981 1893072 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" missing-upgrade-650274
	I0718 00:07:32.291011 1893072 ssh_runner.go:195] Run: cat /version.json
	I0718 00:07:32.291070 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:32.291333 1893072 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0718 00:07:32.291390 1893072 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" missing-upgrade-650274
	I0718 00:07:32.311896 1893072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34833 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa Username:docker}
	I0718 00:07:32.325842 1893072 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34833 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/missing-upgrade-650274/id_rsa Username:docker}
	W0718 00:07:32.401828 1893072 start.go:419] Unable to open version.json: cat /version.json: Process exited with status 1
	stdout:
	
	stderr:
	cat: /version.json: No such file or directory
	I0718 00:07:32.401941 1893072 ssh_runner.go:195] Run: systemctl --version
	I0718 00:07:32.553834 1893072 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0718 00:07:32.559646 1893072 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0718 00:07:32.587605 1893072 cni.go:236] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0718 00:07:32.587695 1893072 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0718 00:07:32.619604 1893072 cni.go:268] disabled [/etc/cni/net.d/100-crio-bridge.conf, /etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)
	I0718 00:07:32.619629 1893072 start.go:466] detecting cgroup driver to use...
	I0718 00:07:32.619662 1893072 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0718 00:07:32.619725 1893072 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0718 00:07:32.635133 1893072 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0718 00:07:32.647853 1893072 docker.go:196] disabling cri-docker service (if available) ...
	I0718 00:07:32.647948 1893072 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0718 00:07:32.660733 1893072 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0718 00:07:32.673713 1893072 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	W0718 00:07:32.688431 1893072 docker.go:206] Failed to disable socket "cri-docker.socket" (might be ok): sudo systemctl disable cri-docker.socket: Process exited with status 1
	stdout:
	
	stderr:
	Failed to disable unit: Unit file cri-docker.socket does not exist.
	I0718 00:07:32.688501 1893072 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0718 00:07:32.795457 1893072 docker.go:212] disabling docker service ...
	I0718 00:07:32.795524 1893072 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0718 00:07:32.825894 1893072 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0718 00:07:32.838403 1893072 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0718 00:07:32.945507 1893072 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0718 00:07:33.049601 1893072 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0718 00:07:33.067449 1893072 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0718 00:07:33.086559 1893072 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.4.1"|' /etc/containerd/config.toml"
	I0718 00:07:33.098324 1893072 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0718 00:07:33.110214 1893072 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0718 00:07:33.110298 1893072 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0718 00:07:33.121884 1893072 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0718 00:07:33.133104 1893072 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0718 00:07:33.144256 1893072 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0718 00:07:33.155923 1893072 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0718 00:07:33.166485 1893072 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0718 00:07:33.176934 1893072 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0718 00:07:33.186810 1893072 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0718 00:07:33.196073 1893072 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0718 00:07:33.313053 1893072 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0718 00:07:33.473657 1893072 start.go:513] Will wait 60s for socket path /run/containerd/containerd.sock
	I0718 00:07:33.473726 1893072 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0718 00:07:33.479061 1893072 start.go:534] Will wait 60s for crictl version
	I0718 00:07:33.479127 1893072 ssh_runner.go:195] Run: which crictl
	I0718 00:07:33.483882 1893072 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0718 00:07:33.517328 1893072 retry.go:31] will retry after 10.020476344s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:07:33Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	I0718 00:07:34.216026 1895213 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0718 00:07:34.222084 1895213 fix.go:56] fixHost completed within 4.684982629s
	I0718 00:07:34.222108 1895213 start.go:83] releasing machines lock for "kubernetes-upgrade-557855", held for 4.685034083s
	I0718 00:07:34.222178 1895213 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-557855
	I0718 00:07:34.240653 1895213 ssh_runner.go:195] Run: cat /version.json
	I0718 00:07:34.240714 1895213 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-557855
	I0718 00:07:34.240969 1895213 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0718 00:07:34.241032 1895213 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-557855
	I0718 00:07:34.260258 1895213 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34838 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/kubernetes-upgrade-557855/id_rsa Username:docker}
	I0718 00:07:34.269496 1895213 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34838 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/kubernetes-upgrade-557855/id_rsa Username:docker}
	I0718 00:07:34.350062 1895213 ssh_runner.go:195] Run: systemctl --version
	I0718 00:07:34.498640 1895213 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0718 00:07:34.504691 1895213 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
	I0718 00:07:34.528148 1895213 cni.go:236] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
	I0718 00:07:34.528301 1895213 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0718 00:07:34.540276 1895213 cni.go:265] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0718 00:07:34.540300 1895213 start.go:466] detecting cgroup driver to use...
	I0718 00:07:34.540333 1895213 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0718 00:07:34.540386 1895213 ssh_runner.go:195] Run: sudo systemctl stop -f crio
	I0718 00:07:34.556981 1895213 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
	I0718 00:07:34.571160 1895213 docker.go:196] disabling cri-docker service (if available) ...
	I0718 00:07:34.571250 1895213 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0718 00:07:34.586612 1895213 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0718 00:07:34.600215 1895213 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0718 00:07:34.698041 1895213 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0718 00:07:34.796482 1895213 docker.go:212] disabling docker service ...
	I0718 00:07:34.796587 1895213 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0718 00:07:34.811443 1895213 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0718 00:07:34.825253 1895213 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0718 00:07:34.929009 1895213 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0718 00:07:35.023389 1895213 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0718 00:07:35.037706 1895213 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock
	" | sudo tee /etc/crictl.yaml"
	I0718 00:07:35.058463 1895213 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"
	I0718 00:07:35.071615 1895213 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
	I0718 00:07:35.085914 1895213 containerd.go:145] configuring containerd to use "cgroupfs" as cgroup driver...
	I0718 00:07:35.085995 1895213 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
	I0718 00:07:35.101851 1895213 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0718 00:07:35.116377 1895213 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
	I0718 00:07:35.128802 1895213 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
	I0718 00:07:35.141625 1895213 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0718 00:07:35.152982 1895213 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
	I0718 00:07:35.166028 1895213 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0718 00:07:35.178187 1895213 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0718 00:07:35.189891 1895213 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0718 00:07:35.282442 1895213 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0718 00:07:35.375429 1895213 start.go:513] Will wait 60s for socket path /run/containerd/containerd.sock
	I0718 00:07:35.375559 1895213 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
	I0718 00:07:35.381237 1895213 start.go:534] Will wait 60s for crictl version
	I0718 00:07:35.381341 1895213 ssh_runner.go:195] Run: which crictl
	I0718 00:07:35.385889 1895213 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0718 00:07:35.454193 1895213 start.go:550] Version:  0.1.0
	RuntimeName:  containerd
	RuntimeVersion:  1.6.21
	RuntimeApiVersion:  v1
	I0718 00:07:35.454313 1895213 ssh_runner.go:195] Run: containerd --version
	I0718 00:07:35.484322 1895213 ssh_runner.go:195] Run: containerd --version
	I0718 00:07:35.515512 1895213 out.go:177] * Preparing Kubernetes v1.27.3 on containerd 1.6.21 ...
	I0718 00:07:35.517139 1895213 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-557855 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0718 00:07:35.533921 1895213 ssh_runner.go:195] Run: grep 192.168.67.1	host.minikube.internal$ /etc/hosts
	I0718 00:07:35.538519 1895213 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.67.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0718 00:07:35.551752 1895213 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime containerd
	I0718 00:07:35.551813 1895213 ssh_runner.go:195] Run: sudo crictl images --output json
	I0718 00:07:35.593558 1895213 containerd.go:600] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.27.3". assuming images are not preloaded.
	I0718 00:07:35.593631 1895213 ssh_runner.go:195] Run: which lz4
	I0718 00:07:35.598092 1895213 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
	I0718 00:07:35.602593 1895213 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I0718 00:07:35.602631 1895213 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-containerd-overlay2-arm64.tar.lz4 --> /preloaded.tar.lz4 (366036177 bytes)
	I0718 00:07:37.751511 1895213 containerd.go:547] Took 2.153460 seconds to copy over tarball
	I0718 00:07:37.751634 1895213 ssh_runner.go:195] Run: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4
	I0718 00:07:40.049834 1895213 ssh_runner.go:235] Completed: sudo tar -I lz4 -C /var -xf /preloaded.tar.lz4: (2.298146272s)
	I0718 00:07:40.049861 1895213 containerd.go:554] Took 2.298274 seconds to extract the tarball
	I0718 00:07:40.049872 1895213 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I0718 00:07:40.119234 1895213 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0718 00:07:40.215241 1895213 ssh_runner.go:195] Run: sudo systemctl restart containerd
	I0718 00:07:40.340125 1895213 ssh_runner.go:195] Run: sudo crictl images --output json
	I0718 00:07:40.406730 1895213 containerd.go:604] all images are preloaded for containerd runtime.
	I0718 00:07:40.406752 1895213 cache_images.go:84] Images are preloaded, skipping loading
	I0718 00:07:40.406813 1895213 ssh_runner.go:195] Run: sudo crictl info
	I0718 00:07:40.449314 1895213 cni.go:84] Creating CNI manager for ""
	I0718 00:07:40.449340 1895213 cni.go:149] "docker" driver + "containerd" runtime found, recommending kindnet
	I0718 00:07:40.449369 1895213 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0718 00:07:40.449386 1895213 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.67.2 APIServerPort:8443 KubernetesVersion:v1.27.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:kubernetes-upgrade-557855 NodeName:kubernetes-upgrade-557855 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.67.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.67.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/c
a.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0718 00:07:40.449513 1895213 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.67.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///run/containerd/containerd.sock
	  name: "kubernetes-upgrade-557855"
	  kubeletExtraArgs:
	    node-ip: 192.168.67.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.27.3
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0718 00:07:40.449619 1895213 kubeadm.go:976] kubelet [Unit]
	Wants=containerd.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.27.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///run/containerd/containerd.sock --hostname-override=kubernetes-upgrade-557855 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.67.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.27.3 ClusterName:kubernetes-upgrade-557855 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0718 00:07:40.449694 1895213 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.27.3
	I0718 00:07:40.460881 1895213 binaries.go:44] Found k8s binaries, skipping transfer
	I0718 00:07:40.460994 1895213 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0718 00:07:40.472414 1895213 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (397 bytes)
	I0718 00:07:40.493818 1895213 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0718 00:07:40.514806 1895213 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2114 bytes)
	I0718 00:07:40.536102 1895213 ssh_runner.go:195] Run: grep 192.168.67.2	control-plane.minikube.internal$ /etc/hosts
	I0718 00:07:40.544107 1895213 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0718 00:07:40.558943 1895213 certs.go:56] Setting up /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kubernetes-upgrade-557855 for IP: 192.168.67.2
	I0718 00:07:40.558975 1895213 certs.go:190] acquiring lock for shared ca certs: {Name:mk1a0756f7f2633b530348b8dc6aa0086e9260f7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0718 00:07:40.559121 1895213 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.key
	I0718 00:07:40.559174 1895213 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/16899-1773963/.minikube/proxy-client-ca.key
	I0718 00:07:40.559262 1895213 certs.go:315] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kubernetes-upgrade-557855/client.key
	I0718 00:07:40.559317 1895213 certs.go:315] skipping minikube signed cert generation: /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kubernetes-upgrade-557855/apiserver.key.c7fa3a9e
	I0718 00:07:40.559361 1895213 certs.go:315] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kubernetes-upgrade-557855/proxy-client.key
	I0718 00:07:40.559474 1895213 certs.go:437] found cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/1779350.pem (1338 bytes)
	W0718 00:07:40.559511 1895213 certs.go:433] ignoring /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/1779350_empty.pem, impossibly tiny 0 bytes
	I0718 00:07:40.559528 1895213 certs.go:437] found cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca-key.pem (1679 bytes)
	I0718 00:07:40.559560 1895213 certs.go:437] found cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/ca.pem (1078 bytes)
	I0718 00:07:40.559593 1895213 certs.go:437] found cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/cert.pem (1123 bytes)
	I0718 00:07:40.559628 1895213 certs.go:437] found cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/certs/key.pem (1679 bytes)
	I0718 00:07:40.559674 1895213 certs.go:437] found cert: /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem (1708 bytes)
	I0718 00:07:40.560396 1895213 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kubernetes-upgrade-557855/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0718 00:07:40.588836 1895213 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kubernetes-upgrade-557855/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0718 00:07:40.619125 1895213 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kubernetes-upgrade-557855/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0718 00:07:40.649739 1895213 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kubernetes-upgrade-557855/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0718 00:07:40.678788 1895213 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0718 00:07:40.707936 1895213 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0718 00:07:40.736468 1895213 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0718 00:07:40.767192 1895213 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0718 00:07:40.796906 1895213 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/certs/1779350.pem --> /usr/share/ca-certificates/1779350.pem (1338 bytes)
	I0718 00:07:40.826314 1895213 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/ssl/certs/17793502.pem --> /usr/share/ca-certificates/17793502.pem (1708 bytes)
	I0718 00:07:40.855248 1895213 ssh_runner.go:362] scp /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0718 00:07:40.884930 1895213 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0718 00:07:40.906844 1895213 ssh_runner.go:195] Run: openssl version
	I0718 00:07:40.914150 1895213 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/1779350.pem && ln -fs /usr/share/ca-certificates/1779350.pem /etc/ssl/certs/1779350.pem"
	I0718 00:07:40.925880 1895213 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/1779350.pem
	I0718 00:07:40.930592 1895213 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Jul 17 23:39 /usr/share/ca-certificates/1779350.pem
	I0718 00:07:40.930660 1895213 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/1779350.pem
	I0718 00:07:40.939636 1895213 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/1779350.pem /etc/ssl/certs/51391683.0"
	I0718 00:07:40.951051 1895213 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/17793502.pem && ln -fs /usr/share/ca-certificates/17793502.pem /etc/ssl/certs/17793502.pem"
	I0718 00:07:40.963307 1895213 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/17793502.pem
	I0718 00:07:40.967993 1895213 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Jul 17 23:39 /usr/share/ca-certificates/17793502.pem
	I0718 00:07:40.968108 1895213 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/17793502.pem
	I0718 00:07:40.976905 1895213 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/17793502.pem /etc/ssl/certs/3ec20f2e.0"
	I0718 00:07:40.988010 1895213 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0718 00:07:41.000084 1895213 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0718 00:07:41.007658 1895213 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Jul 17 23:33 /usr/share/ca-certificates/minikubeCA.pem
	I0718 00:07:41.007725 1895213 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0718 00:07:41.016653 1895213 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0718 00:07:41.029085 1895213 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0718 00:07:41.033769 1895213 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0718 00:07:41.042177 1895213 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0718 00:07:41.050684 1895213 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0718 00:07:41.059415 1895213 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0718 00:07:41.067888 1895213 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0718 00:07:41.076256 1895213 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0718 00:07:41.084676 1895213 kubeadm.go:404] StartCluster: {Name:kubernetes-upgrade-557855 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:kubernetes-upgrade-557855 Namespace:default APIServerName:minikubeCA APIServerNames:[] APISe
rverIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.27.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQ
emuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0718 00:07:41.084776 1895213 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
	I0718 00:07:41.084834 1895213 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0718 00:07:41.126805 1895213 cri.go:89] found id: ""
	I0718 00:07:41.126907 1895213 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0718 00:07:41.137580 1895213 kubeadm.go:419] found existing configuration files, will attempt cluster restart
	I0718 00:07:41.138086 1895213 kubeadm.go:636] restartCluster start
	I0718 00:07:41.138181 1895213 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0718 00:07:41.148702 1895213 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0718 00:07:41.149370 1895213 kubeconfig.go:135] verify returned: extract IP: "kubernetes-upgrade-557855" does not appear in /home/jenkins/minikube-integration/16899-1773963/kubeconfig
	I0718 00:07:41.149632 1895213 kubeconfig.go:146] "kubernetes-upgrade-557855" context is missing from /home/jenkins/minikube-integration/16899-1773963/kubeconfig - will repair!
	I0718 00:07:41.150109 1895213 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/kubeconfig: {Name:mk030404123fbc4983ca7ea10e5affac98840d29 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0718 00:07:41.150959 1895213 kapi.go:59] client config for kubernetes-upgrade-557855: &rest.Config{Host:"https://192.168.67.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kubernetes-upgrade-557855/client.crt", KeyFile:"/home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kubernetes-upgrade-557855/client.key", CAFile:"/home/jenkins/minikube-integration/16899-1773963/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8
(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x13e6910), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0718 00:07:41.151876 1895213 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0718 00:07:41.163361 1895213 kubeadm.go:602] needs reconfigure: configs differ:
	-- stdout --
	--- /var/tmp/minikube/kubeadm.yaml	2023-07-18 00:06:48.530434363 +0000
	+++ /var/tmp/minikube/kubeadm.yaml.new	2023-07-18 00:07:40.530359570 +0000
	@@ -1,4 +1,4 @@
	-apiVersion: kubeadm.k8s.io/v1beta1
	+apiVersion: kubeadm.k8s.io/v1beta3
	 kind: InitConfiguration
	 localAPIEndpoint:
	   advertiseAddress: 192.168.67.2
	@@ -11,13 +11,13 @@
	       - signing
	       - authentication
	 nodeRegistration:
	-  criSocket: /run/containerd/containerd.sock
	+  criSocket: unix:///run/containerd/containerd.sock
	   name: "kubernetes-upgrade-557855"
	   kubeletExtraArgs:
	     node-ip: 192.168.67.2
	   taints: []
	 ---
	-apiVersion: kubeadm.k8s.io/v1beta1
	+apiVersion: kubeadm.k8s.io/v1beta3
	 kind: ClusterConfiguration
	 apiServer:
	   certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]
	@@ -31,16 +31,14 @@
	   extraArgs:
	     leader-elect: "false"
	 certificatesDir: /var/lib/minikube/certs
	-clusterName: kubernetes-upgrade-557855
	+clusterName: mk
	 controlPlaneEndpoint: control-plane.minikube.internal:8443
	-dns:
	-  type: CoreDNS
	 etcd:
	   local:
	     dataDir: /var/lib/minikube/etcd
	     extraArgs:
	-      listen-metrics-urls: http://127.0.0.1:2381,http://192.168.67.2:2381
	-kubernetesVersion: v1.16.0
	+      proxy-refresh-interval: "70000"
	+kubernetesVersion: v1.27.3
	 networking:
	   dnsDomain: cluster.local
	   podSubnet: "10.244.0.0/16"
	
	-- /stdout --
	I0718 00:07:41.163391 1895213 kubeadm.go:1128] stopping kube-system containers ...
	I0718 00:07:41.163424 1895213 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:all Name: Namespaces:[kube-system]}
	I0718 00:07:41.163504 1895213 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0718 00:07:41.208698 1895213 cri.go:89] found id: ""
	I0718 00:07:41.208803 1895213 ssh_runner.go:195] Run: sudo systemctl stop kubelet
	I0718 00:07:41.223460 1895213 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0718 00:07:41.234434 1895213 kubeadm.go:155] found existing configuration files:
	-rw------- 1 root root 5707 Jul 18 00:06 /etc/kubernetes/admin.conf
	-rw------- 1 root root 5743 Jul 18 00:06 /etc/kubernetes/controller-manager.conf
	-rw------- 1 root root 5819 Jul 18 00:06 /etc/kubernetes/kubelet.conf
	-rw------- 1 root root 5691 Jul 18 00:07 /etc/kubernetes/scheduler.conf
	
	I0718 00:07:41.234548 1895213 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0718 00:07:41.245250 1895213 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0718 00:07:41.256093 1895213 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0718 00:07:41.266915 1895213 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0718 00:07:41.277446 1895213 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0718 00:07:41.288310 1895213 kubeadm.go:713] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml
	I0718 00:07:41.288331 1895213 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.3:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"
	I0718 00:07:41.347150 1895213 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.3:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"
	I0718 00:07:42.241883 1895213 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.3:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"
	I0718 00:07:42.433591 1895213 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.3:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"
	I0718 00:07:42.515344 1895213 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.27.3:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"
	I0718 00:07:42.616588 1895213 api_server.go:52] waiting for apiserver process to appear ...
	I0718 00:07:42.616707 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:43.135465 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:43.634939 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:44.135629 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:43.540117 1893072 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0718 00:07:43.602752 1893072 retry.go:31] will retry after 19.919690775s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:07:43Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	I0718 00:07:44.635883 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:45.135884 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:45.635130 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:46.135239 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:46.635343 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:47.134895 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:47.634991 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:48.135732 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:48.635678 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:49.134998 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:49.635522 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:50.135589 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:50.635686 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:51.134990 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:51.635069 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:52.135521 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:52.635833 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:53.134886 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:53.634982 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:54.135350 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:54.635247 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:55.134929 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:55.635482 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:56.134921 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:56.634958 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:57.134980 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:57.635008 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:58.135079 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:58.635574 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:59.135024 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:07:59.635495 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:08:00.134966 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:08:00.635019 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:08:01.135165 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:08:01.634995 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:08:02.134951 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:08:02.635654 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:08:03.134989 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:08:03.635823 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:08:04.135016 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:08:03.522699 1893072 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0718 00:08:03.559327 1893072 retry.go:31] will retry after 25.615660848s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:08:03Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	I0718 00:08:04.634896 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:08:05.134986 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:08:05.635883 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:08:06.134891 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:08:06.635333 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:08:07.135770 1895213 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0718 00:08:07.150522 1895213 api_server.go:72] duration metric: took 24.533932673s to wait for apiserver process to appear ...
	I0718 00:08:07.150543 1895213 api_server.go:88] waiting for apiserver healthz status ...
	I0718 00:08:07.150586 1895213 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0718 00:08:12.151175 1895213 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0718 00:08:12.651882 1895213 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0718 00:08:17.652658 1895213 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0718 00:08:17.652699 1895213 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0718 00:08:22.653676 1895213 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
	I0718 00:08:22.653717 1895213 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0718 00:08:29.178193 1893072 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0718 00:08:29.210316 1893072 out.go:177] 
	I0718 00:08:27.296289 1895213 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": read tcp 192.168.67.1:33378->192.168.67.2:8443: read: connection reset by peer
	I0718 00:08:27.296328 1895213 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0718 00:08:27.296604 1895213 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0718 00:08:27.652191 1895213 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0718 00:08:27.652638 1895213 api_server.go:269] stopped: https://192.168.67.2:8443/healthz: Get "https://192.168.67.2:8443/healthz": dial tcp 192.168.67.2:8443: connect: connection refused
	I0718 00:08:28.151273 1895213 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	W0718 00:08:29.212020 1893072 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to start container runtime: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:08:29Z" level=fatal msg="getting the runtime version: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	
	W0718 00:08:29.212038 1893072 out.go:239] * 
	W0718 00:08:29.212982 1893072 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0718 00:08:29.214288 1893072 out.go:177] 
	
	* 
	* ==> container status <==
	* 
	* ==> containerd <==
	* -- Logs begin at Tue 2023-07-18 00:07:26 UTC, end at Tue 2023-07-18 00:08:30 UTC. --
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.468061647Z" level=info msg="loading plugin \"io.containerd.service.v1.leases-service\"..." type=io.containerd.service.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.468127707Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.468188392Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.468247493Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.468355645Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.468459571Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.469205908Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.469317654Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.469405768Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.469469194Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.469531988Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.469616394Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.469677702Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.469748636Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.469810141Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.469870998Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.469934358Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.470066182Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.470133497Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.470198908Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.470257624Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.470537328Z" level=info msg=serving... address=/run/containerd/containerd.sock.ttrpc
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.470639490Z" level=info msg=serving... address=/run/containerd/containerd.sock
	Jul 18 00:07:33 missing-upgrade-650274 systemd[1]: Started containerd container runtime.
	Jul 18 00:07:33 missing-upgrade-650274 containerd[631]: time="2023-07-18T00:07:33.475652045Z" level=info msg="containerd successfully booted in 0.060715s"
	
	* 
	* ==> describe nodes <==
	* 
	* ==> dmesg <==
	* [  +0.001039] FS-Cache: O-key=[8] '7adac90000000000'
	[  +0.000715] FS-Cache: N-cookie c=00000078 [p=0000006f fl=2 nc=0 na=1]
	[  +0.000979] FS-Cache: N-cookie d=00000000ec1ea241{9p.inode} n=000000001063103b
	[  +0.001165] FS-Cache: N-key=[8] '7adac90000000000'
	[  +0.003300] FS-Cache: Duplicate cookie detected
	[  +0.000852] FS-Cache: O-cookie c=00000072 [p=0000006f fl=226 nc=0 na=1]
	[  +0.001110] FS-Cache: O-cookie d=00000000ec1ea241{9p.inode} n=00000000a1180baf
	[  +0.001034] FS-Cache: O-key=[8] '7adac90000000000'
	[  +0.000744] FS-Cache: N-cookie c=00000079 [p=0000006f fl=2 nc=0 na=1]
	[  +0.000963] FS-Cache: N-cookie d=00000000ec1ea241{9p.inode} n=000000007798c562
	[  +0.001030] FS-Cache: N-key=[8] '7adac90000000000'
	[  +2.831459] FS-Cache: Duplicate cookie detected
	[  +0.000706] FS-Cache: O-cookie c=00000070 [p=0000006f fl=226 nc=0 na=1]
	[  +0.000943] FS-Cache: O-cookie d=00000000ec1ea241{9p.inode} n=00000000ab96e722
	[  +0.001064] FS-Cache: O-key=[8] '79dac90000000000'
	[  +0.000696] FS-Cache: N-cookie c=0000007b [p=0000006f fl=2 nc=0 na=1]
	[  +0.000952] FS-Cache: N-cookie d=00000000ec1ea241{9p.inode} n=000000001063103b
	[  +0.001024] FS-Cache: N-key=[8] '79dac90000000000'
	[  +0.430829] FS-Cache: Duplicate cookie detected
	[  +0.000815] FS-Cache: O-cookie c=00000075 [p=0000006f fl=226 nc=0 na=1]
	[  +0.000987] FS-Cache: O-cookie d=00000000ec1ea241{9p.inode} n=00000000e8aca9c4
	[  +0.001165] FS-Cache: O-key=[8] '7fdac90000000000'
	[  +0.000718] FS-Cache: N-cookie c=0000007c [p=0000006f fl=2 nc=0 na=1]
	[  +0.000975] FS-Cache: N-cookie d=00000000ec1ea241{9p.inode} n=00000000b6fac530
	[  +0.001034] FS-Cache: N-key=[8] '7fdac90000000000'
	
	* 
	* ==> kernel <==
	*  00:08:30 up  8:50,  0 users,  load average: 1.67, 1.92, 2.01
	Linux missing-upgrade-650274 5.15.0-1039-aws #44~20.04.1-Ubuntu SMP Thu Jun 22 12:21:08 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
	PRETTY_NAME="Ubuntu 20.04.2 LTS"
	
	* 
	* ==> kubelet <==
	* -- Logs begin at Tue 2023-07-18 00:07:26 UTC, end at Tue 2023-07-18 00:08:30 UTC. --
	-- No entries --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	E0718 00:08:29.962690 1897309 logs.go:281] Failed to list containers for "kube-apiserver": crictl list: sudo crictl ps -a --quiet --name=kube-apiserver: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:08:29Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0718 00:08:29.990681 1897309 logs.go:281] Failed to list containers for "etcd": crictl list: sudo crictl ps -a --quiet --name=etcd: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:08:29Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0718 00:08:30.049747 1897309 logs.go:281] Failed to list containers for "coredns": crictl list: sudo crictl ps -a --quiet --name=coredns: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:08:30Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0718 00:08:30.094562 1897309 logs.go:281] Failed to list containers for "kube-scheduler": crictl list: sudo crictl ps -a --quiet --name=kube-scheduler: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:08:30Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0718 00:08:30.139606 1897309 logs.go:281] Failed to list containers for "kube-proxy": crictl list: sudo crictl ps -a --quiet --name=kube-proxy: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:08:30Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0718 00:08:30.179408 1897309 logs.go:281] Failed to list containers for "kube-controller-manager": crictl list: sudo crictl ps -a --quiet --name=kube-controller-manager: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:08:30Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0718 00:08:30.216457 1897309 logs.go:281] Failed to list containers for "kindnet": crictl list: sudo crictl ps -a --quiet --name=kindnet: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:08:30Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0718 00:08:30.249516 1897309 logs.go:281] Failed to list containers for "storage-provisioner": crictl list: sudo crictl ps -a --quiet --name=storage-provisioner: Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:08:30Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	E0718 00:08:30.572254 1897309 logs.go:195] command /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" failed with error: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a": Process exited with status 1
	stdout:
	
	stderr:
	time="2023-07-18T00:08:30Z" level=fatal msg="listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService"
	Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
	 output: "\n** stderr ** \ntime=\"2023-07-18T00:08:30Z\" level=fatal msg=\"listing containers: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService\"\nCannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?\n\n** /stderr **"
	E0718 00:08:30.908007 1897309 logs.go:195] command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.21.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1
	stdout:
	
	stderr:
	The connection to the server localhost:8443 was refused - did you specify the right host or port?
	 output: "\n** stderr ** \nThe connection to the server localhost:8443 was refused - did you specify the right host or port?\n\n** /stderr **"
	! unable to fetch logs for: container status, describe nodes

                                                
                                                
** /stderr **
helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p missing-upgrade-650274 -n missing-upgrade-650274
helpers_test.go:254: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p missing-upgrade-650274 -n missing-upgrade-650274: exit status 2 (356.667478ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:254: status error: exit status 2 (may be ok)
helpers_test.go:256: "missing-upgrade-650274" apiserver is not running, skipping kubectl commands (state="Stopped")
helpers_test.go:175: Cleaning up "missing-upgrade-650274" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p missing-upgrade-650274
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p missing-upgrade-650274: (2.136381447s)
--- FAIL: TestMissingContainerUpgrade (228.17s)

                                                
                                    

Test pass (267/304)

Order passed test Duration
3 TestDownloadOnly/v1.16.0/json-events 11.14
4 TestDownloadOnly/v1.16.0/preload-exists 0
8 TestDownloadOnly/v1.16.0/LogsDuration 0.38
10 TestDownloadOnly/v1.27.3/json-events 9.96
11 TestDownloadOnly/v1.27.3/preload-exists 0
15 TestDownloadOnly/v1.27.3/LogsDuration 0.08
16 TestDownloadOnly/DeleteAll 0.24
17 TestDownloadOnly/DeleteAlwaysSucceeds 0.15
19 TestBinaryMirror 0.62
22 TestAddons/Setup 116.1
24 TestAddons/parallel/Registry 14.86
26 TestAddons/parallel/InspektorGadget 10.89
27 TestAddons/parallel/MetricsServer 6.06
30 TestAddons/parallel/CSI 69
31 TestAddons/parallel/Headlamp 10.8
32 TestAddons/parallel/CloudSpanner 5.71
35 TestAddons/serial/GCPAuth/Namespaces 0.24
36 TestAddons/StoppedEnableDisable 12.33
37 TestCertOptions 35.5
38 TestCertExpiration 246.28
40 TestForceSystemdFlag 52.55
41 TestForceSystemdEnv 42.62
42 TestDockerEnvContainerd 49.51
47 TestErrorSpam/setup 43.65
48 TestErrorSpam/start 0.84
49 TestErrorSpam/status 1.1
50 TestErrorSpam/pause 1.84
51 TestErrorSpam/unpause 2.04
52 TestErrorSpam/stop 1.43
55 TestFunctional/serial/CopySyncFile 0
56 TestFunctional/serial/StartWithProxy 90.29
57 TestFunctional/serial/AuditLog 0
58 TestFunctional/serial/SoftStart 17.22
59 TestFunctional/serial/KubeContext 0.07
60 TestFunctional/serial/KubectlGetPods 0.1
63 TestFunctional/serial/CacheCmd/cache/add_remote 4.42
64 TestFunctional/serial/CacheCmd/cache/add_local 1.39
65 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.06
66 TestFunctional/serial/CacheCmd/cache/list 0.05
67 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.33
68 TestFunctional/serial/CacheCmd/cache/cache_reload 2.37
69 TestFunctional/serial/CacheCmd/cache/delete 0.12
70 TestFunctional/serial/MinikubeKubectlCmd 0.14
71 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.16
72 TestFunctional/serial/ExtraConfig 55.1
73 TestFunctional/serial/ComponentHealth 0.11
74 TestFunctional/serial/LogsCmd 1.8
75 TestFunctional/serial/LogsFileCmd 1.81
76 TestFunctional/serial/InvalidService 4.72
78 TestFunctional/parallel/ConfigCmd 0.52
79 TestFunctional/parallel/DashboardCmd 11
80 TestFunctional/parallel/DryRun 0.67
81 TestFunctional/parallel/InternationalLanguage 0.32
82 TestFunctional/parallel/StatusCmd 1.25
86 TestFunctional/parallel/ServiceCmdConnect 7.83
87 TestFunctional/parallel/AddonsCmd 0.21
88 TestFunctional/parallel/PersistentVolumeClaim 24.32
90 TestFunctional/parallel/SSHCmd 0.85
91 TestFunctional/parallel/CpCmd 1.61
93 TestFunctional/parallel/FileSync 0.41
94 TestFunctional/parallel/CertSync 2.22
98 TestFunctional/parallel/NodeLabels 0.09
100 TestFunctional/parallel/NonActiveRuntimeDisabled 0.75
103 TestFunctional/parallel/Version/short 0.07
104 TestFunctional/parallel/Version/components 1.23
105 TestFunctional/parallel/ImageCommands/ImageListShort 0.28
106 TestFunctional/parallel/ImageCommands/ImageListTable 0.26
107 TestFunctional/parallel/ImageCommands/ImageListJson 0.26
108 TestFunctional/parallel/ImageCommands/ImageListYaml 0.29
109 TestFunctional/parallel/ImageCommands/ImageBuild 3.38
110 TestFunctional/parallel/ImageCommands/Setup 1.93
111 TestFunctional/parallel/UpdateContextCmd/no_changes 0.21
112 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.23
113 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.25
115 TestFunctional/parallel/ServiceCmd/DeployApp 9.34
118 TestFunctional/parallel/ServiceCmd/List 0.53
119 TestFunctional/parallel/ServiceCmd/JSONOutput 0.43
120 TestFunctional/parallel/ServiceCmd/HTTPS 0.5
121 TestFunctional/parallel/ServiceCmd/Format 0.5
122 TestFunctional/parallel/ServiceCmd/URL 0.53
124 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.68
126 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
128 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 8.65
129 TestFunctional/parallel/ImageCommands/ImageRemove 0.7
131 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.55
132 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.15
133 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
137 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
138 TestFunctional/parallel/ProfileCmd/profile_not_create 0.47
139 TestFunctional/parallel/ProfileCmd/profile_list 0.5
140 TestFunctional/parallel/ProfileCmd/profile_json_output 0.48
141 TestFunctional/parallel/MountCmd/any-port 7.65
142 TestFunctional/parallel/MountCmd/specific-port 2.59
143 TestFunctional/parallel/MountCmd/VerifyCleanup 1.77
144 TestFunctional/delete_addon-resizer_images 0.09
145 TestFunctional/delete_my-image_image 0.02
146 TestFunctional/delete_minikube_cached_images 0.02
150 TestIngressAddonLegacy/StartLegacyK8sCluster 90.22
152 TestIngressAddonLegacy/serial/ValidateIngressAddonActivation 10.06
153 TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation 0.64
157 TestJSONOutput/start/Command 62.43
158 TestJSONOutput/start/Audit 0
160 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
161 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
163 TestJSONOutput/pause/Command 0.82
164 TestJSONOutput/pause/Audit 0
166 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
167 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
169 TestJSONOutput/unpause/Command 0.75
170 TestJSONOutput/unpause/Audit 0
172 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
173 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
175 TestJSONOutput/stop/Command 5.83
176 TestJSONOutput/stop/Audit 0
178 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
179 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
180 TestErrorJSONOutput 0.24
182 TestKicCustomNetwork/create_custom_network 41.67
183 TestKicCustomNetwork/use_default_bridge_network 33.22
184 TestKicExistingNetwork 34.21
185 TestKicCustomSubnet 35.61
186 TestKicStaticIP 38.88
187 TestMainNoArgs 0.06
188 TestMinikubeProfile 82.12
191 TestMountStart/serial/StartWithMountFirst 6.48
192 TestMountStart/serial/VerifyMountFirst 0.29
193 TestMountStart/serial/StartWithMountSecond 10.13
194 TestMountStart/serial/VerifyMountSecond 0.36
195 TestMountStart/serial/DeleteFirst 1.66
196 TestMountStart/serial/VerifyMountPostDelete 0.27
197 TestMountStart/serial/Stop 1.22
198 TestMountStart/serial/RestartStopped 7.43
199 TestMountStart/serial/VerifyMountPostStop 0.28
202 TestMultiNode/serial/FreshStart2Nodes 89.14
203 TestMultiNode/serial/DeployApp2Nodes 10.58
204 TestMultiNode/serial/PingHostFrom2Pods 1.15
205 TestMultiNode/serial/AddNode 18.87
206 TestMultiNode/serial/ProfileList 0.35
207 TestMultiNode/serial/CopyFile 10.87
208 TestMultiNode/serial/StopNode 2.32
209 TestMultiNode/serial/StartAfterStop 19.05
210 TestMultiNode/serial/RestartKeepsNodes 143.75
211 TestMultiNode/serial/DeleteNode 5.04
212 TestMultiNode/serial/StopMultiNode 24.13
213 TestMultiNode/serial/RestartMultiNode 101.14
214 TestMultiNode/serial/ValidateNameConflict 36.34
219 TestPreload 181.78
221 TestScheduledStopUnix 108.53
224 TestInsufficientStorage 10.23
225 TestRunningBinaryUpgrade 123.76
227 TestKubernetesUpgrade 411.63
230 TestNoKubernetes/serial/StartNoK8sWithVersion 0.09
231 TestNoKubernetes/serial/StartWithK8s 47.32
232 TestNoKubernetes/serial/StartWithStopK8s 30.07
233 TestNoKubernetes/serial/Start 6.2
234 TestNoKubernetes/serial/VerifyK8sNotRunning 0.3
235 TestNoKubernetes/serial/ProfileList 0.9
236 TestNoKubernetes/serial/Stop 1.24
237 TestNoKubernetes/serial/StartNoArgs 7.52
238 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.39
239 TestStoppedBinaryUpgrade/Setup 1.42
240 TestStoppedBinaryUpgrade/Upgrade 125.87
241 TestStoppedBinaryUpgrade/MinikubeLogs 1.04
250 TestPause/serial/Start 61.96
251 TestPause/serial/SecondStartNoReconfiguration 15.5
255 TestPause/serial/Pause 1.01
256 TestPause/serial/VerifyStatus 0.45
257 TestPause/serial/Unpause 0.91
258 TestPause/serial/PauseAgain 1.19
259 TestPause/serial/DeletePaused 3.07
264 TestNetworkPlugins/group/false 4.76
265 TestPause/serial/VerifyDeletedResources 0.16
270 TestStartStop/group/old-k8s-version/serial/FirstStart 128.51
271 TestStartStop/group/old-k8s-version/serial/DeployApp 8.58
272 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 1.21
273 TestStartStop/group/old-k8s-version/serial/Stop 12.2
274 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.2
275 TestStartStop/group/old-k8s-version/serial/SecondStart 670.44
277 TestStartStop/group/no-preload/serial/FirstStart 72.5
278 TestStartStop/group/no-preload/serial/DeployApp 7.56
279 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 1.25
280 TestStartStop/group/no-preload/serial/Stop 12.15
281 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.21
282 TestStartStop/group/no-preload/serial/SecondStart 349.07
283 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 14.03
284 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.12
285 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.4
286 TestStartStop/group/no-preload/serial/Pause 3.41
288 TestStartStop/group/embed-certs/serial/FirstStart 84.81
289 TestStartStop/group/embed-certs/serial/DeployApp 9.49
290 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 1.21
291 TestStartStop/group/embed-certs/serial/Stop 12.09
292 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.2
293 TestStartStop/group/embed-certs/serial/SecondStart 626
294 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 5.03
295 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 5.11
296 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.36
297 TestStartStop/group/old-k8s-version/serial/Pause 3.46
299 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 82.27
300 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 9.51
301 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 1.25
302 TestStartStop/group/default-k8s-diff-port/serial/Stop 12.2
303 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.2
304 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 355.48
305 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 13.03
306 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 5.11
307 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.34
308 TestStartStop/group/default-k8s-diff-port/serial/Pause 3.47
310 TestStartStop/group/newest-cni/serial/FirstStart 60.11
311 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 5.04
312 TestStartStop/group/newest-cni/serial/DeployApp 0
313 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 1.54
314 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.11
315 TestStartStop/group/newest-cni/serial/Stop 1.27
316 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.2
317 TestStartStop/group/newest-cni/serial/SecondStart 45.87
318 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.33
319 TestStartStop/group/embed-certs/serial/Pause 4.07
320 TestNetworkPlugins/group/auto/Start 92.49
321 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
322 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
323 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.43
324 TestStartStop/group/newest-cni/serial/Pause 4.94
325 TestNetworkPlugins/group/kindnet/Start 99.83
326 TestNetworkPlugins/group/auto/KubeletFlags 0.32
327 TestNetworkPlugins/group/auto/NetCatPod 9.36
328 TestNetworkPlugins/group/auto/DNS 0.3
329 TestNetworkPlugins/group/auto/Localhost 0.22
330 TestNetworkPlugins/group/auto/HairPin 0.32
331 TestNetworkPlugins/group/calico/Start 76.63
332 TestNetworkPlugins/group/kindnet/ControllerPod 5.03
333 TestNetworkPlugins/group/kindnet/KubeletFlags 0.49
334 TestNetworkPlugins/group/kindnet/NetCatPod 11.6
335 TestNetworkPlugins/group/kindnet/DNS 0.24
336 TestNetworkPlugins/group/kindnet/Localhost 0.2
337 TestNetworkPlugins/group/kindnet/HairPin 0.24
338 TestNetworkPlugins/group/custom-flannel/Start 70.88
339 TestNetworkPlugins/group/calico/ControllerPod 5.05
340 TestNetworkPlugins/group/calico/KubeletFlags 0.32
341 TestNetworkPlugins/group/calico/NetCatPod 10.43
342 TestNetworkPlugins/group/calico/DNS 0.38
343 TestNetworkPlugins/group/calico/Localhost 0.41
344 TestNetworkPlugins/group/calico/HairPin 0.28
345 TestNetworkPlugins/group/enable-default-cni/Start 102.07
346 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.31
347 TestNetworkPlugins/group/custom-flannel/NetCatPod 9.37
348 TestNetworkPlugins/group/custom-flannel/DNS 0.2
349 TestNetworkPlugins/group/custom-flannel/Localhost 0.19
350 TestNetworkPlugins/group/custom-flannel/HairPin 0.18
351 TestNetworkPlugins/group/flannel/Start 62.78
352 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.37
353 TestNetworkPlugins/group/enable-default-cni/NetCatPod 10.61
354 TestNetworkPlugins/group/enable-default-cni/DNS 0.22
355 TestNetworkPlugins/group/enable-default-cni/Localhost 0.2
356 TestNetworkPlugins/group/enable-default-cni/HairPin 0.19
357 TestNetworkPlugins/group/flannel/ControllerPod 5.03
358 TestNetworkPlugins/group/flannel/KubeletFlags 0.4
359 TestNetworkPlugins/group/flannel/NetCatPod 10.53
360 TestNetworkPlugins/group/flannel/DNS 0.35
361 TestNetworkPlugins/group/flannel/Localhost 0.26
362 TestNetworkPlugins/group/flannel/HairPin 0.23
363 TestNetworkPlugins/group/bridge/Start 102.51
364 TestNetworkPlugins/group/bridge/KubeletFlags 0.31
365 TestNetworkPlugins/group/bridge/NetCatPod 8.36
366 TestNetworkPlugins/group/bridge/DNS 0.21
367 TestNetworkPlugins/group/bridge/Localhost 0.18
368 TestNetworkPlugins/group/bridge/HairPin 0.19
x
+
TestDownloadOnly/v1.16.0/json-events (11.14s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-330878 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-330878 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (11.13987519s)
--- PASS: TestDownloadOnly/v1.16.0/json-events (11.14s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/preload-exists
--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/LogsDuration (0.38s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/LogsDuration
aaa_download_only_test.go:169: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-330878
aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-330878: exit status 85 (379.613323ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-330878 | jenkins | v1.31.0 | 17 Jul 23 23:33 UTC |          |
	|         | -p download-only-330878        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/17 23:33:08
	Running on machine: ip-172-31-29-130
	Binary: Built with gc go1.20.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0717 23:33:08.695432 1779355 out.go:296] Setting OutFile to fd 1 ...
	I0717 23:33:08.695724 1779355 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:33:08.695750 1779355 out.go:309] Setting ErrFile to fd 2...
	I0717 23:33:08.695769 1779355 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:33:08.697784 1779355 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
	W0717 23:33:08.697989 1779355 root.go:314] Error reading config file at /home/jenkins/minikube-integration/16899-1773963/.minikube/config/config.json: open /home/jenkins/minikube-integration/16899-1773963/.minikube/config/config.json: no such file or directory
	I0717 23:33:08.698462 1779355 out.go:303] Setting JSON to true
	I0717 23:33:08.699609 1779355 start.go:128] hostinfo: {"hostname":"ip-172-31-29-130","uptime":29732,"bootTime":1689607057,"procs":299,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0717 23:33:08.699750 1779355 start.go:138] virtualization:  
	I0717 23:33:08.702942 1779355 out.go:97] [download-only-330878] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	I0717 23:33:08.705218 1779355 out.go:169] MINIKUBE_LOCATION=16899
	W0717 23:33:08.703175 1779355 preload.go:295] Failed to list preload files: open /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball: no such file or directory
	I0717 23:33:08.703234 1779355 notify.go:220] Checking for updates...
	I0717 23:33:08.708659 1779355 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 23:33:08.710371 1779355 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig
	I0717 23:33:08.711886 1779355 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube
	I0717 23:33:08.713536 1779355 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0717 23:33:08.716717 1779355 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0717 23:33:08.716992 1779355 driver.go:373] Setting default libvirt URI to qemu:///system
	I0717 23:33:08.741913 1779355 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0717 23:33:08.741997 1779355 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 23:33:08.820171 1779355 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:42 SystemTime:2023-07-17 23:33:08.81003037 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archit
ecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215175168 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> Se
rverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 23:33:08.820275 1779355 docker.go:294] overlay module found
	I0717 23:33:08.822055 1779355 out.go:97] Using the docker driver based on user configuration
	I0717 23:33:08.822079 1779355 start.go:298] selected driver: docker
	I0717 23:33:08.822087 1779355 start.go:880] validating driver "docker" against <nil>
	I0717 23:33:08.822183 1779355 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 23:33:08.891513 1779355 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:42 SystemTime:2023-07-17 23:33:08.881883684 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215175168 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 23:33:08.891677 1779355 start_flags.go:305] no existing cluster config was found, will generate one from the flags 
	I0717 23:33:08.891966 1779355 start_flags.go:382] Using suggested 2200MB memory alloc based on sys=7834MB, container=7834MB
	I0717 23:33:08.892119 1779355 start_flags.go:901] Wait components to verify : map[apiserver:true system_pods:true]
	I0717 23:33:08.894057 1779355 out.go:169] Using Docker driver with root privileges
	I0717 23:33:08.895692 1779355 cni.go:84] Creating CNI manager for ""
	I0717 23:33:08.895713 1779355 cni.go:149] "docker" driver + "containerd" runtime found, recommending kindnet
	I0717 23:33:08.895725 1779355 start_flags.go:314] Found "CNI" CNI - setting NetworkPlugin=cni
	I0717 23:33:08.895740 1779355 start_flags.go:319] config:
	{Name:download-only-330878 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-330878 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISock
et: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 23:33:08.898005 1779355 out.go:97] Starting control plane node download-only-330878 in cluster download-only-330878
	I0717 23:33:08.898027 1779355 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0717 23:33:08.899404 1779355 out.go:97] Pulling base image ...
	I0717 23:33:08.899426 1779355 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0717 23:33:08.899598 1779355 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0717 23:33:08.916665 1779355 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 to local cache
	I0717 23:33:08.916834 1779355 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory
	I0717 23:33:08.916982 1779355 image.go:118] Writing gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 to local cache
	I0717 23:33:09.032210 1779355 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-arm64.tar.lz4
	I0717 23:33:09.032239 1779355 cache.go:57] Caching tarball of preloaded images
	I0717 23:33:09.033071 1779355 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0717 23:33:09.035569 1779355 out.go:97] Downloading Kubernetes v1.16.0 preload ...
	I0717 23:33:09.035595 1779355 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-arm64.tar.lz4 ...
	I0717 23:33:09.163419 1779355 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-arm64.tar.lz4?checksum=md5:1f1e2324dbd6e4f3d8734226d9194e9f -> /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-arm64.tar.lz4
	I0717 23:33:13.639747 1779355 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 as a tarball
	I0717 23:33:17.283647 1779355 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-arm64.tar.lz4 ...
	I0717 23:33:17.283748 1779355 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-containerd-overlay2-arm64.tar.lz4 ...
	I0717 23:33:18.327052 1779355 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on containerd
	I0717 23:33:18.327429 1779355 profile.go:148] Saving config to /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/download-only-330878/config.json ...
	I0717 23:33:18.327465 1779355 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/download-only-330878/config.json: {Name:mk27ab6102ae9bfbadb657fdc539c40cca2237e3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0717 23:33:18.327670 1779355 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime containerd
	I0717 23:33:18.328396 1779355 download.go:107] Downloading: https://dl.k8s.io/release/v1.16.0/bin/linux/arm64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/linux/arm64/kubectl.sha1 -> /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/linux/arm64/v1.16.0/kubectl
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-330878"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:170: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.38s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/json-events (9.96s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/json-events
aaa_download_only_test.go:69: (dbg) Run:  out/minikube-linux-arm64 start -o=json --download-only -p download-only-330878 --force --alsologtostderr --kubernetes-version=v1.27.3 --container-runtime=containerd --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:69: (dbg) Done: out/minikube-linux-arm64 start -o=json --download-only -p download-only-330878 --force --alsologtostderr --kubernetes-version=v1.27.3 --container-runtime=containerd --driver=docker  --container-runtime=containerd: (9.959704082s)
--- PASS: TestDownloadOnly/v1.27.3/json-events (9.96s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/preload-exists
--- PASS: TestDownloadOnly/v1.27.3/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/LogsDuration
aaa_download_only_test.go:169: (dbg) Run:  out/minikube-linux-arm64 logs -p download-only-330878
aaa_download_only_test.go:169: (dbg) Non-zero exit: out/minikube-linux-arm64 logs -p download-only-330878: exit status 85 (83.126611ms)

                                                
                                                
-- stdout --
	* 
	* ==> Audit <==
	* |---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-330878 | jenkins | v1.31.0 | 17 Jul 23 23:33 UTC |          |
	|         | -p download-only-330878        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	| start   | -o=json --download-only        | download-only-330878 | jenkins | v1.31.0 | 17 Jul 23 23:33 UTC |          |
	|         | -p download-only-330878        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.27.3   |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=containerd |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	* 
	* ==> Last Start <==
	* Log file created at: 2023/07/17 23:33:20
	Running on machine: ip-172-31-29-130
	Binary: Built with gc go1.20.5 for linux/arm64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0717 23:33:20.223728 1779435 out.go:296] Setting OutFile to fd 1 ...
	I0717 23:33:20.223884 1779435 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:33:20.223893 1779435 out.go:309] Setting ErrFile to fd 2...
	I0717 23:33:20.223899 1779435 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:33:20.224283 1779435 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
	W0717 23:33:20.224452 1779435 root.go:314] Error reading config file at /home/jenkins/minikube-integration/16899-1773963/.minikube/config/config.json: open /home/jenkins/minikube-integration/16899-1773963/.minikube/config/config.json: no such file or directory
	I0717 23:33:20.224729 1779435 out.go:303] Setting JSON to true
	I0717 23:33:20.226497 1779435 start.go:128] hostinfo: {"hostname":"ip-172-31-29-130","uptime":29744,"bootTime":1689607057,"procs":296,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0717 23:33:20.226569 1779435 start.go:138] virtualization:  
	I0717 23:33:20.265735 1779435 out.go:97] [download-only-330878] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	I0717 23:33:20.266043 1779435 notify.go:220] Checking for updates...
	I0717 23:33:20.297734 1779435 out.go:169] MINIKUBE_LOCATION=16899
	I0717 23:33:20.329338 1779435 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 23:33:20.361972 1779435 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig
	I0717 23:33:20.393961 1779435 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube
	I0717 23:33:20.425656 1779435 out.go:169] MINIKUBE_BIN=out/minikube-linux-arm64
	W0717 23:33:20.490551 1779435 out.go:272] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0717 23:33:20.491059 1779435 config.go:182] Loaded profile config "download-only-330878": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.16.0
	W0717 23:33:20.491108 1779435 start.go:788] api.Load failed for download-only-330878: filestore "download-only-330878": Docker machine "download-only-330878" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0717 23:33:20.491271 1779435 driver.go:373] Setting default libvirt URI to qemu:///system
	W0717 23:33:20.491304 1779435 start.go:788] api.Load failed for download-only-330878: filestore "download-only-330878": Docker machine "download-only-330878" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
	I0717 23:33:20.516126 1779435 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0717 23:33:20.516217 1779435 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 23:33:20.585186 1779435 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-07-17 23:33:20.575088164 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215175168 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 23:33:20.585286 1779435 docker.go:294] overlay module found
	I0717 23:33:20.617762 1779435 out.go:97] Using the docker driver based on existing profile
	I0717 23:33:20.617816 1779435 start.go:298] selected driver: docker
	I0717 23:33:20.617825 1779435 start.go:880] validating driver "docker" against &{Name:download-only-330878 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-330878 Namespace:default APIServerName:minikubeCA APIServerName
s:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetP
ath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 23:33:20.618040 1779435 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 23:33:20.691790 1779435 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-07-17 23:33:20.681289946 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215175168 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 23:33:20.692245 1779435 cni.go:84] Creating CNI manager for ""
	I0717 23:33:20.692263 1779435 cni.go:149] "docker" driver + "containerd" runtime found, recommending kindnet
	I0717 23:33:20.692276 1779435 start_flags.go:319] config:
	{Name:download-only-330878 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:download-only-330878 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISock
et: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 23:33:20.729783 1779435 out.go:97] Starting control plane node download-only-330878 in cluster download-only-330878
	I0717 23:33:20.729819 1779435 cache.go:122] Beginning downloading kic base image for docker with containerd
	I0717 23:33:20.778871 1779435 out.go:97] Pulling base image ...
	I0717 23:33:20.778929 1779435 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime containerd
	I0717 23:33:20.779113 1779435 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local docker daemon
	I0717 23:33:20.796553 1779435 cache.go:150] Downloading gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 to local cache
	I0717 23:33:20.796682 1779435 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory
	I0717 23:33:20.796700 1779435 image.go:66] Found gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 in local cache directory, skipping pull
	I0717 23:33:20.796705 1779435 image.go:105] gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 exists in cache, skipping pull
	I0717 23:33:20.796721 1779435 cache.go:153] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 as a tarball
	I0717 23:33:20.900915 1779435 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.27.3/preloaded-images-k8s-v18-v1.27.3-containerd-overlay2-arm64.tar.lz4
	I0717 23:33:20.900957 1779435 cache.go:57] Caching tarball of preloaded images
	I0717 23:33:20.901610 1779435 preload.go:132] Checking if preload exists for k8s version v1.27.3 and runtime containerd
	I0717 23:33:20.903698 1779435 out.go:97] Downloading Kubernetes v1.27.3 preload ...
	I0717 23:33:20.903724 1779435 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.27.3-containerd-overlay2-arm64.tar.lz4 ...
	I0717 23:33:21.024924 1779435 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.27.3/preloaded-images-k8s-v18-v1.27.3-containerd-overlay2-arm64.tar.lz4?checksum=md5:14a60dcdae19ae70139b18fd027fe33b -> /home/jenkins/minikube-integration/16899-1773963/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.27.3-containerd-overlay2-arm64.tar.lz4
	
	* 
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-330878"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:170: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.27.3/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAll (0.24s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAll
aaa_download_only_test.go:187: (dbg) Run:  out/minikube-linux-arm64 delete --all
--- PASS: TestDownloadOnly/DeleteAll (0.24s)

                                                
                                    
x
+
TestDownloadOnly/DeleteAlwaysSucceeds (0.15s)

                                                
                                                
=== RUN   TestDownloadOnly/DeleteAlwaysSucceeds
aaa_download_only_test.go:199: (dbg) Run:  out/minikube-linux-arm64 delete -p download-only-330878
--- PASS: TestDownloadOnly/DeleteAlwaysSucceeds (0.15s)

                                                
                                    
x
+
TestBinaryMirror (0.62s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:304: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p binary-mirror-124207 --alsologtostderr --binary-mirror http://127.0.0.1:37497 --driver=docker  --container-runtime=containerd
helpers_test.go:175: Cleaning up "binary-mirror-124207" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p binary-mirror-124207
--- PASS: TestBinaryMirror (0.62s)

                                                
                                    
x
+
TestAddons/Setup (116.1s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:88: (dbg) Run:  out/minikube-linux-arm64 start -p addons-225437 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns
addons_test.go:88: (dbg) Done: out/minikube-linux-arm64 start -p addons-225437 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --driver=docker  --container-runtime=containerd --addons=ingress --addons=ingress-dns: (1m56.096973589s)
--- PASS: TestAddons/Setup (116.10s)

                                                
                                    
x
+
TestAddons/parallel/Registry (14.86s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:306: registry stabilized in 41.143725ms
addons_test.go:308: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-mpd5g" [6d2458e5-2aa3-4a34-944f-b3156a771a51] Running
addons_test.go:308: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.025463931s
addons_test.go:311: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-mt8xb" [35338a9d-2f69-4958-9f69-ae884a7b90ec] Running
addons_test.go:311: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.013097932s
addons_test.go:316: (dbg) Run:  kubectl --context addons-225437 delete po -l run=registry-test --now
addons_test.go:321: (dbg) Run:  kubectl --context addons-225437 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:321: (dbg) Done: kubectl --context addons-225437 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (3.682245486s)
addons_test.go:335: (dbg) Run:  out/minikube-linux-arm64 -p addons-225437 ip
2023/07/17 23:35:42 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:364: (dbg) Run:  out/minikube-linux-arm64 -p addons-225437 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (14.86s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (10.89s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-w4pb9" [36f11301-9bc9-4ba5-bd87-be406424a43c] Running
addons_test.go:814: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.023302752s
addons_test.go:817: (dbg) Run:  out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-225437
addons_test.go:817: (dbg) Done: out/minikube-linux-arm64 addons disable inspektor-gadget -p addons-225437: (5.869903504s)
--- PASS: TestAddons/parallel/InspektorGadget (10.89s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (6.06s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:383: metrics-server stabilized in 5.683972ms
addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-844d8db974-rgqwg" [bdf7b9b1-aa0a-4a0b-ab1e-40b88314e21e] Running
addons_test.go:385: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.012219919s
addons_test.go:391: (dbg) Run:  kubectl --context addons-225437 top pods -n kube-system
addons_test.go:408: (dbg) Run:  out/minikube-linux-arm64 -p addons-225437 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (6.06s)

                                                
                                    
x
+
TestAddons/parallel/CSI (69s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:537: csi-hostpath-driver pods stabilized in 6.922642ms
addons_test.go:540: (dbg) Run:  kubectl --context addons-225437 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:545: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:550: (dbg) Run:  kubectl --context addons-225437 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:555: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [fa555e20-1244-410c-923f-953f2ac00d22] Pending
helpers_test.go:344: "task-pv-pod" [fa555e20-1244-410c-923f-953f2ac00d22] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [fa555e20-1244-410c-923f-953f2ac00d22] Running
addons_test.go:555: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 10.013163987s
addons_test.go:560: (dbg) Run:  kubectl --context addons-225437 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:565: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-225437 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-225437 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:570: (dbg) Run:  kubectl --context addons-225437 delete pod task-pv-pod
addons_test.go:570: (dbg) Done: kubectl --context addons-225437 delete pod task-pv-pod: (1.344087809s)
addons_test.go:576: (dbg) Run:  kubectl --context addons-225437 delete pvc hpvc
addons_test.go:582: (dbg) Run:  kubectl --context addons-225437 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:587: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-225437 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:592: (dbg) Run:  kubectl --context addons-225437 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:597: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [dc96cb53-54ae-47f1-8f4a-d655b66875b8] Pending
helpers_test.go:344: "task-pv-pod-restore" [dc96cb53-54ae-47f1-8f4a-d655b66875b8] Running
addons_test.go:597: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 7.014654301s
addons_test.go:602: (dbg) Run:  kubectl --context addons-225437 delete pod task-pv-pod-restore
addons_test.go:606: (dbg) Run:  kubectl --context addons-225437 delete pvc hpvc-restore
addons_test.go:610: (dbg) Run:  kubectl --context addons-225437 delete volumesnapshot new-snapshot-demo
addons_test.go:614: (dbg) Run:  out/minikube-linux-arm64 -p addons-225437 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:614: (dbg) Done: out/minikube-linux-arm64 -p addons-225437 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.825990513s)
addons_test.go:618: (dbg) Run:  out/minikube-linux-arm64 -p addons-225437 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (69.00s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (10.8s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:800: (dbg) Run:  out/minikube-linux-arm64 addons enable headlamp -p addons-225437 --alsologtostderr -v=1
addons_test.go:800: (dbg) Done: out/minikube-linux-arm64 addons enable headlamp -p addons-225437 --alsologtostderr -v=1: (1.763019981s)
addons_test.go:805: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-66f6498c69-bmv7z" [94756b58-8be1-4a1b-b7b3-fd7fb18117ba] Pending
helpers_test.go:344: "headlamp-66f6498c69-bmv7z" [94756b58-8be1-4a1b-b7b3-fd7fb18117ba] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-66f6498c69-bmv7z" [94756b58-8be1-4a1b-b7b3-fd7fb18117ba] Running
addons_test.go:805: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 9.038172789s
--- PASS: TestAddons/parallel/Headlamp (10.80s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.71s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:833: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-88647b4cb-ngcxb" [918e9ac7-1e55-46ed-900f-e0ea88b5a597] Running
addons_test.go:833: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.016319195s
addons_test.go:836: (dbg) Run:  out/minikube-linux-arm64 addons disable cloud-spanner -p addons-225437
--- PASS: TestAddons/parallel/CloudSpanner (5.71s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.24s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:626: (dbg) Run:  kubectl --context addons-225437 create ns new-namespace
addons_test.go:640: (dbg) Run:  kubectl --context addons-225437 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.24s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (12.33s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:148: (dbg) Run:  out/minikube-linux-arm64 stop -p addons-225437
addons_test.go:148: (dbg) Done: out/minikube-linux-arm64 stop -p addons-225437: (12.05840848s)
addons_test.go:152: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p addons-225437
addons_test.go:156: (dbg) Run:  out/minikube-linux-arm64 addons disable dashboard -p addons-225437
addons_test.go:161: (dbg) Run:  out/minikube-linux-arm64 addons disable gvisor -p addons-225437
--- PASS: TestAddons/StoppedEnableDisable (12.33s)

                                                
                                    
x
+
TestCertOptions (35.5s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-arm64 start -p cert-options-472020 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd
cert_options_test.go:49: (dbg) Done: out/minikube-linux-arm64 start -p cert-options-472020 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=containerd: (32.7914295s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-arm64 -p cert-options-472020 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
E0718 00:15:28.028453 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-472020 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-arm64 ssh -p cert-options-472020 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-472020" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-options-472020
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-options-472020: (2.023930311s)
--- PASS: TestCertOptions (35.50s)

                                                
                                    
x
+
TestCertExpiration (246.28s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-345940 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd
cert_options_test.go:123: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-345940 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=containerd: (41.760693013s)
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-arm64 start -p cert-expiration-345940 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd
cert_options_test.go:131: (dbg) Done: out/minikube-linux-arm64 start -p cert-expiration-345940 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=containerd: (22.101255245s)
helpers_test.go:175: Cleaning up "cert-expiration-345940" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cert-expiration-345940
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p cert-expiration-345940: (2.414640108s)
--- PASS: TestCertExpiration (246.28s)

                                                
                                    
x
+
TestForceSystemdFlag (52.55s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-flag-149093 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
E0718 00:13:31.073320 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
docker_test.go:91: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-flag-149093 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (49.990226286s)
docker_test.go:121: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-flag-149093 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-flag-149093" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-flag-149093
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-flag-149093: (2.111548232s)
--- PASS: TestForceSystemdFlag (52.55s)

                                                
                                    
x
+
TestForceSystemdEnv (42.62s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-arm64 start -p force-systemd-env-951130 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
docker_test.go:155: (dbg) Done: out/minikube-linux-arm64 start -p force-systemd-env-951130 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (39.806625431s)
docker_test.go:121: (dbg) Run:  out/minikube-linux-arm64 -p force-systemd-env-951130 ssh "cat /etc/containerd/config.toml"
helpers_test.go:175: Cleaning up "force-systemd-env-951130" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p force-systemd-env-951130
E0718 00:14:52.890617 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p force-systemd-env-951130: (2.309207603s)
--- PASS: TestForceSystemdEnv (42.62s)

                                                
                                    
x
+
TestDockerEnvContainerd (49.51s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with containerd true linux arm64
docker_test.go:181: (dbg) Run:  out/minikube-linux-arm64 start -p dockerenv-183962 --driver=docker  --container-runtime=containerd
docker_test.go:181: (dbg) Done: out/minikube-linux-arm64 start -p dockerenv-183962 --driver=docker  --container-runtime=containerd: (33.756273392s)
docker_test.go:189: (dbg) Run:  /bin/bash -c "out/minikube-linux-arm64 docker-env --ssh-host --ssh-add -p dockerenv-183962"
docker_test.go:189: (dbg) Done: /bin/bash -c "out/minikube-linux-arm64 docker-env --ssh-host --ssh-add -p dockerenv-183962": (1.046741611s)
docker_test.go:220: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-Zj5Gx6sEOJOG/agent.1793936" SSH_AGENT_PID="1793937" DOCKER_HOST=ssh://docker@127.0.0.1:34663 docker version"
docker_test.go:243: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-Zj5Gx6sEOJOG/agent.1793936" SSH_AGENT_PID="1793937" DOCKER_HOST=ssh://docker@127.0.0.1:34663 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env"
docker_test.go:243: (dbg) Done: /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-Zj5Gx6sEOJOG/agent.1793936" SSH_AGENT_PID="1793937" DOCKER_HOST=ssh://docker@127.0.0.1:34663 DOCKER_BUILDKIT=0 docker build -t local/minikube-dockerenv-containerd-test:latest testdata/docker-env": (1.599599157s)
docker_test.go:250: (dbg) Run:  /bin/bash -c "SSH_AUTH_SOCK="/tmp/ssh-Zj5Gx6sEOJOG/agent.1793936" SSH_AGENT_PID="1793937" DOCKER_HOST=ssh://docker@127.0.0.1:34663 docker image ls"
helpers_test.go:175: Cleaning up "dockerenv-183962" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p dockerenv-183962
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p dockerenv-183962: (1.978514257s)
--- PASS: TestDockerEnvContainerd (49.51s)

                                                
                                    
x
+
TestErrorSpam/setup (43.65s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-arm64 start -p nospam-312652 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-312652 --driver=docker  --container-runtime=containerd
error_spam_test.go:81: (dbg) Done: out/minikube-linux-arm64 start -p nospam-312652 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-312652 --driver=docker  --container-runtime=containerd: (43.648526222s)
--- PASS: TestErrorSpam/setup (43.65s)

                                                
                                    
x
+
TestErrorSpam/start (0.84s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-312652 --log_dir /tmp/nospam-312652 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-312652 --log_dir /tmp/nospam-312652 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-312652 --log_dir /tmp/nospam-312652 start --dry-run
--- PASS: TestErrorSpam/start (0.84s)

                                                
                                    
x
+
TestErrorSpam/status (1.1s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-312652 --log_dir /tmp/nospam-312652 status
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-312652 --log_dir /tmp/nospam-312652 status
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-312652 --log_dir /tmp/nospam-312652 status
--- PASS: TestErrorSpam/status (1.10s)

                                                
                                    
x
+
TestErrorSpam/pause (1.84s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-312652 --log_dir /tmp/nospam-312652 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-312652 --log_dir /tmp/nospam-312652 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-312652 --log_dir /tmp/nospam-312652 pause
--- PASS: TestErrorSpam/pause (1.84s)

                                                
                                    
x
+
TestErrorSpam/unpause (2.04s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-312652 --log_dir /tmp/nospam-312652 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-312652 --log_dir /tmp/nospam-312652 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-312652 --log_dir /tmp/nospam-312652 unpause
--- PASS: TestErrorSpam/unpause (2.04s)

                                                
                                    
x
+
TestErrorSpam/stop (1.43s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-312652 --log_dir /tmp/nospam-312652 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-arm64 -p nospam-312652 --log_dir /tmp/nospam-312652 stop: (1.228407919s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-arm64 -p nospam-312652 --log_dir /tmp/nospam-312652 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-arm64 -p nospam-312652 --log_dir /tmp/nospam-312652 stop
--- PASS: TestErrorSpam/stop (1.43s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /home/jenkins/minikube-integration/16899-1773963/.minikube/files/etc/test/nested/copy/1779350/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (90.29s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-linux-arm64 start -p functional-128534 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd
E0717 23:40:28.028494 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
E0717 23:40:28.034354 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
E0717 23:40:28.044778 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
E0717 23:40:28.065047 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
E0717 23:40:28.105346 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
E0717 23:40:28.185650 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
E0717 23:40:28.345980 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
E0717 23:40:28.666629 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
E0717 23:40:29.307098 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
E0717 23:40:30.587690 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
E0717 23:40:33.147942 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
E0717 23:40:38.268219 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
functional_test.go:2230: (dbg) Done: out/minikube-linux-arm64 start -p functional-128534 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=containerd: (1m30.289116715s)
--- PASS: TestFunctional/serial/StartWithProxy (90.29s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (17.22s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-linux-arm64 start -p functional-128534 --alsologtostderr -v=8
E0717 23:40:48.508996 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
functional_test.go:655: (dbg) Done: out/minikube-linux-arm64 start -p functional-128534 --alsologtostderr -v=8: (17.21835658s)
functional_test.go:659: soft start took 17.218818676s for "functional-128534" cluster.
--- PASS: TestFunctional/serial/SoftStart (17.22s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.07s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.1s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-128534 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.10s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (4.42s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-128534 cache add registry.k8s.io/pause:3.1: (1.443540988s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-128534 cache add registry.k8s.io/pause:3.3: (1.584111529s)
functional_test.go:1045: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 cache add registry.k8s.io/pause:latest
functional_test.go:1045: (dbg) Done: out/minikube-linux-arm64 -p functional-128534 cache add registry.k8s.io/pause:latest: (1.39384306s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (4.42s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.39s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-128534 /tmp/TestFunctionalserialCacheCmdcacheadd_local1836801800/001
functional_test.go:1085: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 cache add minikube-local-cache-test:functional-128534
functional_test.go:1090: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 cache delete minikube-local-cache-test:functional-128534
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-128534
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.39s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-linux-arm64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.05s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.33s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.33s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (2.37s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh sudo crictl rmi registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-128534 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (318.469477ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1154: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 cache reload
functional_test.go:1154: (dbg) Done: out/minikube-linux-arm64 -p functional-128534 cache reload: (1.356404043s)
functional_test.go:1159: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh sudo crictl inspecti registry.k8s.io/pause:latest
E0717 23:41:08.990031 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (2.37s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.12s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-linux-arm64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.12s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 kubectl -- --context functional-128534 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.14s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.16s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-128534 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.16s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (55.1s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-linux-arm64 start -p functional-128534 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
E0717 23:41:49.950292 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
functional_test.go:753: (dbg) Done: out/minikube-linux-arm64 start -p functional-128534 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (55.094880348s)
functional_test.go:757: restart took 55.09498845s for "functional-128534" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (55.10s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-128534 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:821: etcd phase: Running
functional_test.go:831: etcd status: Ready
functional_test.go:821: kube-apiserver phase: Running
functional_test.go:831: kube-apiserver status: Ready
functional_test.go:821: kube-controller-manager phase: Running
functional_test.go:831: kube-controller-manager status: Ready
functional_test.go:821: kube-scheduler phase: Running
functional_test.go:831: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.8s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 logs
functional_test.go:1232: (dbg) Done: out/minikube-linux-arm64 -p functional-128534 logs: (1.798943521s)
--- PASS: TestFunctional/serial/LogsCmd (1.80s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.81s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 logs --file /tmp/TestFunctionalserialLogsFileCmd2731573530/001/logs.txt
functional_test.go:1246: (dbg) Done: out/minikube-linux-arm64 -p functional-128534 logs --file /tmp/TestFunctionalserialLogsFileCmd2731573530/001/logs.txt: (1.805256112s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.81s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (4.72s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-128534 apply -f testdata/invalidsvc.yaml
functional_test.go:2331: (dbg) Run:  out/minikube-linux-arm64 service invalid-svc -p functional-128534
functional_test.go:2331: (dbg) Non-zero exit: out/minikube-linux-arm64 service invalid-svc -p functional-128534: exit status 115 (407.938029ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:31093 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2323: (dbg) Run:  kubectl --context functional-128534 delete -f testdata/invalidsvc.yaml
--- PASS: TestFunctional/serial/InvalidService (4.72s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.52s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-128534 config get cpus: exit status 14 (84.935413ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-128534 config get cpus: exit status 14 (80.862951ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.52s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (11s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-128534 --alsologtostderr -v=1]
functional_test.go:906: (dbg) stopping [out/minikube-linux-arm64 dashboard --url --port 36195 -p functional-128534 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 1809029: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (11.00s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.67s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-linux-arm64 start -p functional-128534 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:970: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-128534 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (286.220534ms)

                                                
                                                
-- stdout --
	* [functional-128534] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16899
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 23:42:57.128923 1808419 out.go:296] Setting OutFile to fd 1 ...
	I0717 23:42:57.129132 1808419 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:42:57.129146 1808419 out.go:309] Setting ErrFile to fd 2...
	I0717 23:42:57.129179 1808419 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:42:57.129518 1808419 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
	I0717 23:42:57.130039 1808419 out.go:303] Setting JSON to false
	I0717 23:42:57.131466 1808419 start.go:128] hostinfo: {"hostname":"ip-172-31-29-130","uptime":30321,"bootTime":1689607057,"procs":324,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0717 23:42:57.131545 1808419 start.go:138] virtualization:  
	I0717 23:42:57.135475 1808419 out.go:177] * [functional-128534] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	I0717 23:42:57.141423 1808419 out.go:177]   - MINIKUBE_LOCATION=16899
	I0717 23:42:57.143217 1808419 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 23:42:57.141593 1808419 notify.go:220] Checking for updates...
	I0717 23:42:57.147910 1808419 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig
	I0717 23:42:57.149759 1808419 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube
	I0717 23:42:57.152085 1808419 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0717 23:42:57.154087 1808419 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0717 23:42:57.156441 1808419 config.go:182] Loaded profile config "functional-128534": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
	I0717 23:42:57.156994 1808419 driver.go:373] Setting default libvirt URI to qemu:///system
	I0717 23:42:57.185381 1808419 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0717 23:42:57.185497 1808419 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 23:42:57.307119 1808419 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:46 SystemTime:2023-07-17 23:42:57.292827381 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215175168 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 23:42:57.307221 1808419 docker.go:294] overlay module found
	I0717 23:42:57.309360 1808419 out.go:177] * Using the docker driver based on existing profile
	I0717 23:42:57.311213 1808419 start.go:298] selected driver: docker
	I0717 23:42:57.311230 1808419 start.go:880] validating driver "docker" against &{Name:functional-128534 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:functional-128534 Namespace:default APIServerName:minikubeCA APIServerNames:[] A
PIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.27.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:doc
ker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 23:42:57.311349 1808419 start.go:891] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0717 23:42:57.313653 1808419 out.go:177] 
	W0717 23:42:57.315479 1808419 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0717 23:42:57.317303 1808419 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-linux-arm64 start -p functional-128534 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
--- PASS: TestFunctional/parallel/DryRun (0.67s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.32s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-linux-arm64 start -p functional-128534 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p functional-128534 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=containerd: exit status 23 (320.76293ms)

                                                
                                                
-- stdout --
	* [functional-128534] minikube v1.31.0 sur Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16899
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 23:42:57.792912 1808598 out.go:296] Setting OutFile to fd 1 ...
	I0717 23:42:57.793041 1808598 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:42:57.793069 1808598 out.go:309] Setting ErrFile to fd 2...
	I0717 23:42:57.793080 1808598 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:42:57.793519 1808598 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
	I0717 23:42:57.795338 1808598 out.go:303] Setting JSON to false
	I0717 23:42:57.796531 1808598 start.go:128] hostinfo: {"hostname":"ip-172-31-29-130","uptime":30321,"bootTime":1689607057,"procs":324,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0717 23:42:57.796610 1808598 start.go:138] virtualization:  
	I0717 23:42:57.800537 1808598 out.go:177] * [functional-128534] minikube v1.31.0 sur Ubuntu 20.04 (arm64)
	I0717 23:42:57.802944 1808598 out.go:177]   - MINIKUBE_LOCATION=16899
	I0717 23:42:57.806348 1808598 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0717 23:42:57.803122 1808598 notify.go:220] Checking for updates...
	I0717 23:42:57.810283 1808598 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig
	I0717 23:42:57.812235 1808598 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube
	I0717 23:42:57.814124 1808598 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0717 23:42:57.815627 1808598 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0717 23:42:57.817633 1808598 config.go:182] Loaded profile config "functional-128534": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
	I0717 23:42:57.818214 1808598 driver.go:373] Setting default libvirt URI to qemu:///system
	I0717 23:42:57.850824 1808598 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0717 23:42:57.850929 1808598 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 23:42:58.014545 1808598 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:31 OomKillDisable:true NGoroutines:46 SystemTime:2023-07-17 23:42:58.001278176 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215175168 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 23:42:58.014663 1808598 docker.go:294] overlay module found
	I0717 23:42:58.016732 1808598 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I0717 23:42:58.019656 1808598 start.go:298] selected driver: docker
	I0717 23:42:58.019676 1808598 start.go:880] validating driver "docker" against &{Name:functional-128534 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.40@sha256:8cadf23777709e43eca447c47a45f5a4635615129267ce025193040ec92a1631 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.27.3 ClusterName:functional-128534 Namespace:default APIServerName:minikubeCA APIServerNames:[] A
PIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.27.3 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:doc
ker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0}
	I0717 23:42:58.019790 1808598 start.go:891] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0717 23:42:58.021713 1808598 out.go:177] 
	W0717 23:42:58.023440 1808598 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0717 23:42:58.025374 1808598 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.32s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (1.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 status
functional_test.go:856: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:868: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.25s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (7.83s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1626: (dbg) Run:  kubectl --context functional-128534 create deployment hello-node-connect --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1634: (dbg) Run:  kubectl --context functional-128534 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-58d66798bb-hxzl2" [49421aa9-1211-4630-8c56-a509daed0476] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-connect-58d66798bb-hxzl2" [49421aa9-1211-4630-8c56-a509daed0476] Running
functional_test.go:1639: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 7.010875157s
functional_test.go:1648: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 service hello-node-connect --url
functional_test.go:1654: found endpoint for hello-node-connect: http://192.168.49.2:30102
functional_test.go:1674: http://192.168.49.2:30102: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-58d66798bb-hxzl2

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:30102
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (7.83s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1689: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 addons list
functional_test.go:1701: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.21s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (24.32s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [145f7bdb-9d58-4423-b42d-41f1e5082b40] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 5.012016261s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-128534 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-128534 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-128534 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-128534 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [6da04b37-c339-412f-95cd-22ef419cf229] Pending
helpers_test.go:344: "sp-pod" [6da04b37-c339-412f-95cd-22ef419cf229] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [6da04b37-c339-412f-95cd-22ef419cf229] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 9.010223356s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-128534 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-128534 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:106: (dbg) Done: kubectl --context functional-128534 delete -f testdata/storage-provisioner/pod.yaml: (1.755036534s)
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-128534 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [bf5f15e0-6ab6-4de5-9f36-7a38b75c4723] Pending
helpers_test.go:344: "sp-pod" [bf5f15e0-6ab6-4de5-9f36-7a38b75c4723] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [bf5f15e0-6ab6-4de5-9f36-7a38b75c4723] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 7.009871319s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-128534 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (24.32s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.85s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1724: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "echo hello"
functional_test.go:1741: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.85s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (1.61s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh -n functional-128534 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 cp functional-128534:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd2773520887/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh -n functional-128534 "sudo cat /home/docker/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.61s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/1779350/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "sudo cat /etc/test/nested/copy/1779350/hosts"
functional_test.go:1932: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.41s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (2.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/1779350.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "sudo cat /etc/ssl/certs/1779350.pem"
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/1779350.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "sudo cat /usr/share/ca-certificates/1779350.pem"
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/17793502.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "sudo cat /etc/ssl/certs/17793502.pem"
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/17793502.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "sudo cat /usr/share/ca-certificates/17793502.pem"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (2.22s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-128534 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.75s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "sudo systemctl is-active docker"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-128534 ssh "sudo systemctl is-active docker": exit status 1 (364.855033ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
functional_test.go:2023: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-128534 ssh "sudo systemctl is-active crio": exit status 1 (389.589367ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.75s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 version --short
--- PASS: TestFunctional/parallel/Version/short (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (1.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 version -o=json --components
functional_test.go:2266: (dbg) Done: out/minikube-linux-arm64 -p functional-128534 version -o=json --components: (1.226911183s)
--- PASS: TestFunctional/parallel/Version/components (1.23s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-128534 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.9
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.27.3
registry.k8s.io/kube-proxy:v1.27.3
registry.k8s.io/kube-controller-manager:v1.27.3
registry.k8s.io/kube-apiserver:v1.27.3
registry.k8s.io/etcd:3.5.7-0
registry.k8s.io/echoserver-arm:1.8
registry.k8s.io/coredns/coredns:v1.10.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/minikube-local-cache-test:functional-128534
docker.io/kindest/kindnetd:v20230511-dc714da8
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-128534 image ls --format short --alsologtostderr:
I0717 23:43:04.744823 1809834 out.go:296] Setting OutFile to fd 1 ...
I0717 23:43:04.745029 1809834 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 23:43:04.745035 1809834 out.go:309] Setting ErrFile to fd 2...
I0717 23:43:04.745040 1809834 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 23:43:04.745375 1809834 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
I0717 23:43:04.746004 1809834 config.go:182] Loaded profile config "functional-128534": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
I0717 23:43:04.746121 1809834 config.go:182] Loaded profile config "functional-128534": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
I0717 23:43:04.746697 1809834 cli_runner.go:164] Run: docker container inspect functional-128534 --format={{.State.Status}}
I0717 23:43:04.766821 1809834 ssh_runner.go:195] Run: systemctl --version
I0717 23:43:04.766878 1809834 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-128534
I0717 23:43:04.790225 1809834 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34673 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/functional-128534/id_rsa Username:docker}
I0717 23:43:04.887424 1809834 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-128534 image ls --format table --alsologtostderr:
|---------------------------------------------|--------------------|---------------|--------|
|                    Image                    |        Tag         |   Image ID    |  Size  |
|---------------------------------------------|--------------------|---------------|--------|
| docker.io/library/nginx                     | alpine             | sha256:66bf2c | 16.4MB |
| registry.k8s.io/coredns/coredns             | v1.10.1            | sha256:97e046 | 14.6MB |
| gcr.io/k8s-minikube/busybox                 | 1.28.4-glibc       | sha256:1611cd | 1.94MB |
| localhost/my-image                          | functional-128534  | sha256:795835 | 831kB  |
| registry.k8s.io/echoserver-arm              | 1.8                | sha256:72565b | 45.3MB |
| registry.k8s.io/kube-apiserver              | v1.27.3            | sha256:39dfb0 | 30.4MB |
| registry.k8s.io/pause                       | 3.1                | sha256:8057e0 | 262kB  |
| docker.io/library/minikube-local-cache-test | functional-128534  | sha256:2a72b9 | 1.01kB |
| registry.k8s.io/kube-controller-manager     | v1.27.3            | sha256:ab3683 | 28.2MB |
| registry.k8s.io/kube-proxy                  | v1.27.3            | sha256:fb73e9 | 21.4MB |
| registry.k8s.io/kube-scheduler              | v1.27.3            | sha256:bcb9e5 | 16.5MB |
| registry.k8s.io/pause                       | 3.3                | sha256:3d1873 | 249kB  |
| registry.k8s.io/pause                       | 3.9                | sha256:829e9d | 268kB  |
| registry.k8s.io/pause                       | latest             | sha256:8cb209 | 71.3kB |
| docker.io/kindest/kindnetd                  | v20230511-dc714da8 | sha256:b18bf7 | 25.3MB |
| docker.io/library/nginx                     | latest             | sha256:2002d3 | 67.3MB |
| gcr.io/k8s-minikube/storage-provisioner     | v5                 | sha256:ba04bb | 8.03MB |
| registry.k8s.io/etcd                        | 3.5.7-0            | sha256:24bc64 | 80.7MB |
|---------------------------------------------|--------------------|---------------|--------|
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-128534 image ls --format table --alsologtostderr:
I0717 23:43:08.942626 1810180 out.go:296] Setting OutFile to fd 1 ...
I0717 23:43:08.942913 1810180 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 23:43:08.942947 1810180 out.go:309] Setting ErrFile to fd 2...
I0717 23:43:08.942975 1810180 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 23:43:08.943341 1810180 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
I0717 23:43:08.944168 1810180 config.go:182] Loaded profile config "functional-128534": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
I0717 23:43:08.944370 1810180 config.go:182] Loaded profile config "functional-128534": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
I0717 23:43:08.945019 1810180 cli_runner.go:164] Run: docker container inspect functional-128534 --format={{.State.Status}}
I0717 23:43:08.963881 1810180 ssh_runner.go:195] Run: systemctl --version
I0717 23:43:08.963938 1810180 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-128534
I0717 23:43:08.984201 1810180 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34673 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/functional-128534/id_rsa Username:docker}
I0717 23:43:09.083355 1810180 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image ls --format json --alsologtostderr
2023/07/17 23:43:08 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-128534 image ls --format json --alsologtostderr:
[{"id":"sha256:fb73e92641fd5ab6e5494f0c583616af0bdcc20bc15e4ec7a2e456190f11909a","repoDigests":["registry.k8s.io/kube-proxy@sha256:fb2bd59aae959e9649cb34101b66bb3c65f61eee9f3f81e40ed1e2325c92e699"],"repoTags":["registry.k8s.io/kube-proxy:v1.27.3"],"size":"21369271"},{"id":"sha256:829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e","repoDigests":["registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097"],"repoTags":["registry.k8s.io/pause:3.9"],"size":"268051"},{"id":"sha256:8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a","repoDigests":[],"repoTags":["registry.k8s.io/pause:latest"],"size":"71300"},{"id":"sha256:b18bf71b941bae2e12db1c07e567ad14e4febbc778310a0fc64487f1ac877d79","repoDigests":["docker.io/kindest/kindnetd@sha256:6c00e28db008c2afa67d9ee085c86184ec9ae5281d5ae1bd15006746fb9a1974"],"repoTags":["docker.io/kindest/kindnetd:v20230511-dc714da8"],"size":"25334607"},{"id":"sha256:39dfb036b0986d18c80ba0cc45d2fd7256751d89ce9a477aac0
67fad9e14c473","repoDigests":["registry.k8s.io/kube-apiserver@sha256:fd03335dd2e7163e5e36e933a0c735d7fec6f42b33ddafad0bc54f333e4a23c0"],"repoTags":["registry.k8s.io/kube-apiserver:v1.27.3"],"size":"30386419"},{"id":"sha256:97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108","repoDigests":["registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e"],"repoTags":["registry.k8s.io/coredns/coredns:v1.10.1"],"size":"14557471"},{"id":"sha256:bcb9e554eaab606a5237b493a9a52ec01b8c29a4e49306184916b1bffca38540","repoDigests":["registry.k8s.io/kube-scheduler@sha256:77b8db7564e395328905beb74a0b9a5db3218a4b16ec19af174957e518df40c8"],"repoTags":["registry.k8s.io/kube-scheduler:v1.27.3"],"size":"16549864"},{"id":"sha256:66bf2c914bf4d0aac4b62f09f9f74ad35898d613024a0f2ec94dca9e79fac6ea","repoDigests":["docker.io/library/nginx@sha256:2d194184b067db3598771b4cf326cfe6ad5051937ba1132b8b7d4b0184e0d0a6"],"repoTags":["docker.io/library/nginx:alpine"],"size":"16359946"},{"id":
"sha256:7958356daf41bba0820c13a314661b47f5da9a8b66a96528a5a4f8f2bc533b4d","repoDigests":[],"repoTags":["localhost/my-image:functional-128534"],"size":"830916"},{"id":"sha256:2002d33a54f72d1333751d4d1b4793a60a635eac6e94a98daf0acea501580c4f","repoDigests":["docker.io/library/nginx@sha256:08bc36ad52474e528cc1ea3426b5e3f4bad8a130318e3140d6cfe29c8892c7ef"],"repoTags":["docker.io/library/nginx:latest"],"size":"67301964"},{"id":"sha256:1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e"],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"1935750"},{"id":"sha256:72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb","repoDigests":["registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5"],"repoTags":["registry.k8s.io/echoserver-arm:1.8"],"size":"45324675"},{"id":"sha256:ab3683b584ae5afe0953106b2d8e470280eda3375ccd715fe
b601acc2d0611b8","repoDigests":["registry.k8s.io/kube-controller-manager@sha256:1ad8df2b525e7270cbad6fd613c4f668e336edb4436f440e49b34c4cec4fac9e"],"repoTags":["registry.k8s.io/kube-controller-manager:v1.27.3"],"size":"28214546"},{"id":"sha256:8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.1"],"size":"262191"},{"id":"sha256:20b332c9a70d8516d849d1ac23eff5800cbb2f263d379f0ec11ee908db6b25a8","repoDigests":["docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93"],"repoTags":[],"size":"74084559"},{"id":"sha256:2a72b96361439270c85ec7c93efd5c7111050835d689a48dc3b23cccedd29f3f","repoDigests":[],"repoTags":["docker.io/library/minikube-local-cache-test:functional-128534"],"size":"1007"},{"id":"sha256:24bc64e911039ecf00e263be2161797c758b7d82403ca5516ab64047a477f737","repoDigests":["registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83"],"repoTags":["registry.k8
s.io/etcd:3.5.7-0"],"size":"80665728"},{"id":"sha256:3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300","repoDigests":[],"repoTags":["registry.k8s.io/pause:3.3"],"size":"249461"},{"id":"sha256:a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a","repoDigests":["docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"],"repoTags":[],"size":"18306114"},{"id":"sha256:ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","repoDigests":["gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944"],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"8034419"}]
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-128534 image ls --format json --alsologtostderr:
I0717 23:43:08.678640 1810153 out.go:296] Setting OutFile to fd 1 ...
I0717 23:43:08.678801 1810153 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 23:43:08.678811 1810153 out.go:309] Setting ErrFile to fd 2...
I0717 23:43:08.678816 1810153 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 23:43:08.679149 1810153 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
I0717 23:43:08.679916 1810153 config.go:182] Loaded profile config "functional-128534": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
I0717 23:43:08.680050 1810153 config.go:182] Loaded profile config "functional-128534": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
I0717 23:43:08.680636 1810153 cli_runner.go:164] Run: docker container inspect functional-128534 --format={{.State.Status}}
I0717 23:43:08.703260 1810153 ssh_runner.go:195] Run: systemctl --version
I0717 23:43:08.703343 1810153 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-128534
I0717 23:43:08.723709 1810153 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34673 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/functional-128534/id_rsa Username:docker}
I0717 23:43:08.815357 1810153 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.29s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-arm64 -p functional-128534 image ls --format yaml --alsologtostderr:
- id: sha256:66bf2c914bf4d0aac4b62f09f9f74ad35898d613024a0f2ec94dca9e79fac6ea
repoDigests:
- docker.io/library/nginx@sha256:2d194184b067db3598771b4cf326cfe6ad5051937ba1132b8b7d4b0184e0d0a6
repoTags:
- docker.io/library/nginx:alpine
size: "16359946"
- id: sha256:97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108
repoDigests:
- registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e
repoTags:
- registry.k8s.io/coredns/coredns:v1.10.1
size: "14557471"
- id: sha256:24bc64e911039ecf00e263be2161797c758b7d82403ca5516ab64047a477f737
repoDigests:
- registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83
repoTags:
- registry.k8s.io/etcd:3.5.7-0
size: "80665728"
- id: sha256:3d18732f8686cc3c878055d99a05fa80289502fa496b36b6a0fe0f77206a7300
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.3
size: "249461"
- id: sha256:8cb2091f603e75187e2f6226c5901d12e00b1d1f778c6471ae4578e8a1c4724a
repoDigests: []
repoTags:
- registry.k8s.io/pause:latest
size: "71300"
- id: sha256:8057e0500773a37cde2cff041eb13ebd68c748419a2fbfd1dfb5bf38696cc8e5
repoDigests: []
repoTags:
- registry.k8s.io/pause:3.1
size: "262191"
- id: sha256:b18bf71b941bae2e12db1c07e567ad14e4febbc778310a0fc64487f1ac877d79
repoDigests:
- docker.io/kindest/kindnetd@sha256:6c00e28db008c2afa67d9ee085c86184ec9ae5281d5ae1bd15006746fb9a1974
repoTags:
- docker.io/kindest/kindnetd:v20230511-dc714da8
size: "25334607"
- id: sha256:2a72b96361439270c85ec7c93efd5c7111050835d689a48dc3b23cccedd29f3f
repoDigests: []
repoTags:
- docker.io/library/minikube-local-cache-test:functional-128534
size: "1007"
- id: sha256:a422e0e982356f6c1cf0e5bb7b733363caae3992a07c99951fbcc73e58ed656a
repoDigests:
- docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c
repoTags: []
size: "18306114"
- id: sha256:2002d33a54f72d1333751d4d1b4793a60a635eac6e94a98daf0acea501580c4f
repoDigests:
- docker.io/library/nginx@sha256:08bc36ad52474e528cc1ea3426b5e3f4bad8a130318e3140d6cfe29c8892c7ef
repoTags:
- docker.io/library/nginx:latest
size: "67301964"
- id: sha256:ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "8034419"
- id: sha256:39dfb036b0986d18c80ba0cc45d2fd7256751d89ce9a477aac067fad9e14c473
repoDigests:
- registry.k8s.io/kube-apiserver@sha256:fd03335dd2e7163e5e36e933a0c735d7fec6f42b33ddafad0bc54f333e4a23c0
repoTags:
- registry.k8s.io/kube-apiserver:v1.27.3
size: "30386419"
- id: sha256:fb73e92641fd5ab6e5494f0c583616af0bdcc20bc15e4ec7a2e456190f11909a
repoDigests:
- registry.k8s.io/kube-proxy@sha256:fb2bd59aae959e9649cb34101b66bb3c65f61eee9f3f81e40ed1e2325c92e699
repoTags:
- registry.k8s.io/kube-proxy:v1.27.3
size: "21369271"
- id: sha256:72565bf5bbedfb62e9d21afa2b1221b2c7a5e05b746dae33430bc550d3f87beb
repoDigests:
- registry.k8s.io/echoserver-arm@sha256:b33d4cdf6ed097f4e9b77b135d83a596ab73c6268b0342648818eb85f5edfdb5
repoTags:
- registry.k8s.io/echoserver-arm:1.8
size: "45324675"
- id: sha256:1611cd07b61d57dbbfebe6db242513fd51e1c02d20ba08af17a45837d86a8a8c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "1935750"
- id: sha256:ab3683b584ae5afe0953106b2d8e470280eda3375ccd715feb601acc2d0611b8
repoDigests:
- registry.k8s.io/kube-controller-manager@sha256:1ad8df2b525e7270cbad6fd613c4f668e336edb4436f440e49b34c4cec4fac9e
repoTags:
- registry.k8s.io/kube-controller-manager:v1.27.3
size: "28214546"
- id: sha256:bcb9e554eaab606a5237b493a9a52ec01b8c29a4e49306184916b1bffca38540
repoDigests:
- registry.k8s.io/kube-scheduler@sha256:77b8db7564e395328905beb74a0b9a5db3218a4b16ec19af174957e518df40c8
repoTags:
- registry.k8s.io/kube-scheduler:v1.27.3
size: "16549864"
- id: sha256:829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e
repoDigests:
- registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097
repoTags:
- registry.k8s.io/pause:3.9
size: "268051"

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-linux-arm64 -p functional-128534 image ls --format yaml --alsologtostderr:
I0717 23:43:05.028180 1809863 out.go:296] Setting OutFile to fd 1 ...
I0717 23:43:05.028330 1809863 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 23:43:05.028336 1809863 out.go:309] Setting ErrFile to fd 2...
I0717 23:43:05.028341 1809863 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 23:43:05.028645 1809863 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
I0717 23:43:05.029296 1809863 config.go:182] Loaded profile config "functional-128534": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
I0717 23:43:05.029418 1809863 config.go:182] Loaded profile config "functional-128534": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
I0717 23:43:05.029912 1809863 cli_runner.go:164] Run: docker container inspect functional-128534 --format={{.State.Status}}
I0717 23:43:05.058256 1809863 ssh_runner.go:195] Run: systemctl --version
I0717 23:43:05.058316 1809863 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-128534
I0717 23:43:05.087326 1809863 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34673 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/functional-128534/id_rsa Username:docker}
I0717 23:43:05.183698 1809863 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.29s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (3.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-128534 ssh pgrep buildkitd: exit status 1 (360.222308ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image build -t localhost/my-image:functional-128534 testdata/build --alsologtostderr
functional_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p functional-128534 image build -t localhost/my-image:functional-128534 testdata/build --alsologtostderr: (2.774430383s)
functional_test.go:322: (dbg) Stderr: out/minikube-linux-arm64 -p functional-128534 image build -t localhost/my-image:functional-128534 testdata/build --alsologtostderr:
I0717 23:43:05.671576 1809940 out.go:296] Setting OutFile to fd 1 ...
I0717 23:43:05.672516 1809940 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 23:43:05.672531 1809940 out.go:309] Setting ErrFile to fd 2...
I0717 23:43:05.672537 1809940 out.go:343] TERM=,COLORTERM=, which probably does not support color
I0717 23:43:05.672825 1809940 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
I0717 23:43:05.673477 1809940 config.go:182] Loaded profile config "functional-128534": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
I0717 23:43:05.674078 1809940 config.go:182] Loaded profile config "functional-128534": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
I0717 23:43:05.674566 1809940 cli_runner.go:164] Run: docker container inspect functional-128534 --format={{.State.Status}}
I0717 23:43:05.702722 1809940 ssh_runner.go:195] Run: systemctl --version
I0717 23:43:05.702777 1809940 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-128534
I0717 23:43:05.728940 1809940 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34673 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/functional-128534/id_rsa Username:docker}
I0717 23:43:05.831228 1809940 build_images.go:151] Building image from path: /tmp/build.364642515.tar
I0717 23:43:05.831293 1809940 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0717 23:43:05.843602 1809940 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.364642515.tar
I0717 23:43:05.848926 1809940 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.364642515.tar: stat -c "%s %y" /var/lib/minikube/build/build.364642515.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.364642515.tar': No such file or directory
I0717 23:43:05.848967 1809940 ssh_runner.go:362] scp /tmp/build.364642515.tar --> /var/lib/minikube/build/build.364642515.tar (3072 bytes)
I0717 23:43:05.879214 1809940 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.364642515
I0717 23:43:05.891360 1809940 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.364642515 -xf /var/lib/minikube/build/build.364642515.tar
I0717 23:43:05.902713 1809940 containerd.go:378] Building image: /var/lib/minikube/build/build.364642515
I0717 23:43:05.902792 1809940 ssh_runner.go:195] Run: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.364642515 --local dockerfile=/var/lib/minikube/build/build.364642515 --output type=image,name=localhost/my-image:functional-128534
#1 [internal] load .dockerignore
#1 transferring context: 2B done
#1 DONE 0.1s

                                                
                                                
#2 [internal] load build definition from Dockerfile
#2 transferring dockerfile: 97B done
#2 DONE 0.1s

                                                
                                                
#3 [internal] load metadata for gcr.io/k8s-minikube/busybox:latest
#3 DONE 0.8s

                                                
                                                
#4 [internal] load build context
#4 transferring context: 62B done
#4 DONE 0.0s

                                                
                                                
#5 [1/3] FROM gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b
#5 resolve gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b 0.0s done
#5 sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 828.50kB / 828.50kB 0.2s done
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34
#5 extracting sha256:a01966dde7f8d5ba10b6d87e776c7c8fb5a5f6bfa678874bd28b33b1fc6dba34 0.2s done
#5 DONE 0.4s

                                                
                                                
#6 [2/3] RUN true
#6 DONE 0.8s

                                                
                                                
#7 [3/3] ADD content.txt /
#7 DONE 0.0s

                                                
                                                
#8 exporting to image
#8 exporting layers 0.1s done
#8 exporting manifest sha256:c0f8638c7b0456bb29ccfdf048ffc389a378a988cf4c8cc60ff3d35cb5495815 0.0s done
#8 exporting config sha256:7958356daf41bba0820c13a314661b47f5da9a8b66a96528a5a4f8f2bc533b4d
#8 exporting config sha256:7958356daf41bba0820c13a314661b47f5da9a8b66a96528a5a4f8f2bc533b4d 0.0s done
#8 naming to localhost/my-image:functional-128534 done
#8 DONE 0.1s
I0717 23:43:08.353022 1809940 ssh_runner.go:235] Completed: sudo buildctl build --frontend dockerfile.v0 --local context=/var/lib/minikube/build/build.364642515 --local dockerfile=/var/lib/minikube/build/build.364642515 --output type=image,name=localhost/my-image:functional-128534: (2.450199297s)
I0717 23:43:08.353094 1809940 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.364642515
I0717 23:43:08.364190 1809940 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.364642515.tar
I0717 23:43:08.375064 1809940 build_images.go:207] Built localhost/my-image:functional-128534 from /tmp/build.364642515.tar
I0717 23:43:08.375093 1809940 build_images.go:123] succeeded building to: functional-128534
I0717 23:43:08.375098 1809940 build_images.go:124] failed building to: 
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (3.38s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (1.93s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:341: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (1.897468972s)
functional_test.go:346: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-128534
--- PASS: TestFunctional/parallel/ImageCommands/Setup (1.93s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.21s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (9.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1436: (dbg) Run:  kubectl --context functional-128534 create deployment hello-node --image=registry.k8s.io/echoserver-arm:1.8
functional_test.go:1444: (dbg) Run:  kubectl --context functional-128534 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-7b684b55f9-rt7km" [7176d700-7c32-4ca8-9c46-19342148d0f4] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver-arm]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver-arm])
helpers_test.go:344: "hello-node-7b684b55f9-rt7km" [7176d700-7c32-4ca8-9c46-19342148d0f4] Running
functional_test.go:1449: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 9.043510205s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (9.34s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.53s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1458: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.53s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.43s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1488: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 service list -o json
functional_test.go:1493: Took "434.641609ms" to run "out/minikube-linux-arm64 -p functional-128534 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.43s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1508: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 service --namespace=default --https --url hello-node
functional_test.go:1521: found endpoint: https://192.168.49.2:31698
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1539: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.53s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1558: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 service hello-node --url
functional_test.go:1564: found endpoint for hello-node: http://192.168.49.2:31698
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.53s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.68s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-128534 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-arm64 -p functional-128534 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-128534 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-arm64 -p functional-128534 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 1806539: os: process already finished
helpers_test.go:502: unable to terminate pid 1806395: os: process already finished
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.68s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-arm64 -p functional-128534 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.65s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-128534 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [7d1ca3bd-2559-47e4-a6d4-9f31d24db968] Pending
helpers_test.go:344: "nginx-svc" [7d1ca3bd-2559-47e4-a6d4-9f31d24db968] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [7d1ca3bd-2559-47e4-a6d4-9f31d24db968] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 8.023705412s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.65s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image rm gcr.io/google-containers/addon-resizer:functional-128534 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.70s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.55s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-128534
functional_test.go:423: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 image save --daemon gcr.io/google-containers/addon-resizer:functional-128534 --alsologtostderr
functional_test.go:428: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-128534
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.55s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-128534 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.100.13.38 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-arm64 -p functional-128534 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.47s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1269: (dbg) Run:  out/minikube-linux-arm64 profile lis
functional_test.go:1274: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.47s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1309: (dbg) Run:  out/minikube-linux-arm64 profile list
functional_test.go:1314: Took "415.591762ms" to run "out/minikube-linux-arm64 profile list"
functional_test.go:1323: (dbg) Run:  out/minikube-linux-arm64 profile list -l
functional_test.go:1328: Took "83.309093ms" to run "out/minikube-linux-arm64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.48s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1360: (dbg) Run:  out/minikube-linux-arm64 profile list -o json
functional_test.go:1365: Took "421.748243ms" to run "out/minikube-linux-arm64 profile list -o json"
functional_test.go:1373: (dbg) Run:  out/minikube-linux-arm64 profile list -o json --light
functional_test.go:1378: Took "59.076346ms" to run "out/minikube-linux-arm64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.48s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (7.65s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-128534 /tmp/TestFunctionalparallelMountCmdany-port2021450533/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1689637370672707047" to /tmp/TestFunctionalparallelMountCmdany-port2021450533/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1689637370672707047" to /tmp/TestFunctionalparallelMountCmdany-port2021450533/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1689637370672707047" to /tmp/TestFunctionalparallelMountCmdany-port2021450533/001/test-1689637370672707047
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-128534 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (389.129102ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Jul 17 23:42 created-by-test
-rw-r--r-- 1 docker docker 24 Jul 17 23:42 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Jul 17 23:42 test-1689637370672707047
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh cat /mount-9p/test-1689637370672707047
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-128534 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [ce76046e-a016-42f8-8b25-194c900c6dd0] Pending
helpers_test.go:344: "busybox-mount" [ce76046e-a016-42f8-8b25-194c900c6dd0] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [ce76046e-a016-42f8-8b25-194c900c6dd0] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [ce76046e-a016-42f8-8b25-194c900c6dd0] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 4.014056724s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-128534 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-128534 /tmp/TestFunctionalparallelMountCmdany-port2021450533/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (7.65s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (2.59s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-128534 /tmp/TestFunctionalparallelMountCmdspecific-port691220701/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-128534 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (508.882054ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-128534 /tmp/TestFunctionalparallelMountCmdspecific-port691220701/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-arm64 -p functional-128534 ssh "sudo umount -f /mount-9p": exit status 1 (368.694815ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-arm64 -p functional-128534 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-128534 /tmp/TestFunctionalparallelMountCmdspecific-port691220701/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.59s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (1.77s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-128534 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3782811430/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-128534 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3782811430/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-arm64 mount -p functional-128534 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3782811430/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-arm64 -p functional-128534 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-arm64 mount -p functional-128534 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-128534 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3782811430/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-128534 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3782811430/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-arm64 mount -p functional-128534 /tmp/TestFunctionalparallelMountCmdVerifyCleanup3782811430/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (1.77s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.09s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-128534
--- PASS: TestFunctional/delete_addon-resizer_images (0.09s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-128534
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-128534
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestIngressAddonLegacy/StartLegacyK8sCluster (90.22s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/StartLegacyK8sCluster
ingress_addon_legacy_test.go:39: (dbg) Run:  out/minikube-linux-arm64 start -p ingress-addon-legacy-804572 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd
ingress_addon_legacy_test.go:39: (dbg) Done: out/minikube-linux-arm64 start -p ingress-addon-legacy-804572 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=containerd: (1m30.216432307s)
--- PASS: TestIngressAddonLegacy/StartLegacyK8sCluster (90.22s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (10.06s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddonActivation
ingress_addon_legacy_test.go:70: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-804572 addons enable ingress --alsologtostderr -v=5
ingress_addon_legacy_test.go:70: (dbg) Done: out/minikube-linux-arm64 -p ingress-addon-legacy-804572 addons enable ingress --alsologtostderr -v=5: (10.057828172s)
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (10.06s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.64s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation
ingress_addon_legacy_test.go:79: (dbg) Run:  out/minikube-linux-arm64 -p ingress-addon-legacy-804572 addons enable ingress-dns --alsologtostderr -v=5
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.64s)

                                                
                                    
x
+
TestJSONOutput/start/Command (62.43s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-219471 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd
E0717 23:45:55.711911 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 start -p json-output-219471 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=containerd: (1m2.427691596s)
--- PASS: TestJSONOutput/start/Command (62.43s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.82s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 pause -p json-output-219471 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.82s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.75s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 unpause -p json-output-219471 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.75s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (5.83s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-arm64 stop -p json-output-219471 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-arm64 stop -p json-output-219471 --output=json --user=testUser: (5.832905073s)
--- PASS: TestJSONOutput/stop/Command (5.83s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.24s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-arm64 start -p json-output-error-314403 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p json-output-error-314403 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (88.000353ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"8893a990-0a7c-48ac-ae30-10073604dee0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-314403] minikube v1.31.0 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"996c5c72-c0d7-4355-8e93-89b48b218d85","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=16899"}}
	{"specversion":"1.0","id":"84fb3e38-cc96-4905-b51e-1d28e80c0fe9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"62567e95-1203-442f-89c7-8587c2d601f8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig"}}
	{"specversion":"1.0","id":"1a93c6a3-ed50-450b-a7e5-40d4ded5fd87","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube"}}
	{"specversion":"1.0","id":"dfde4541-bc82-4fbd-86c3-13da09f4b607","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"05dc8672-747a-4307-9d60-bf7f1dbfd455","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"90e1bf6b-4682-4576-bfbc-3ab58faa8295","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/arm64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-314403" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p json-output-error-314403
--- PASS: TestErrorJSONOutput (0.24s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (41.67s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-531804 --network=
E0717 23:47:17.922525 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0717 23:47:17.927795 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0717 23:47:17.938054 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0717 23:47:17.958310 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0717 23:47:17.998552 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0717 23:47:18.079056 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0717 23:47:18.239398 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0717 23:47:18.559937 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0717 23:47:19.200148 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0717 23:47:20.480352 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0717 23:47:23.040810 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0717 23:47:28.161619 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0717 23:47:38.402662 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-531804 --network=: (39.4914718s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-531804" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-531804
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-531804: (2.159832028s)
--- PASS: TestKicCustomNetwork/create_custom_network (41.67s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (33.22s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-arm64 start -p docker-network-758171 --network=bridge
E0717 23:47:58.883238 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-arm64 start -p docker-network-758171 --network=bridge: (31.148461409s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-758171" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p docker-network-758171
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p docker-network-758171: (2.052536971s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (33.22s)

                                                
                                    
x
+
TestKicExistingNetwork (34.21s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-arm64 start -p existing-network-349910 --network=existing-network
E0717 23:48:39.844335 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-arm64 start -p existing-network-349910 --network=existing-network: (32.409041717s)
helpers_test.go:175: Cleaning up "existing-network-349910" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p existing-network-349910
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p existing-network-349910: (1.64176126s)
--- PASS: TestKicExistingNetwork (34.21s)

                                                
                                    
x
+
TestKicCustomSubnet (35.61s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-subnet-039144 --subnet=192.168.60.0/24
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-subnet-039144 --subnet=192.168.60.0/24: (33.375411274s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-039144 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-039144" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p custom-subnet-039144
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p custom-subnet-039144: (2.203381756s)
--- PASS: TestKicCustomSubnet (35.61s)

                                                
                                    
x
+
TestKicStaticIP (38.88s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-arm64 start -p static-ip-443410 --static-ip=192.168.200.200
E0717 23:49:52.889831 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0717 23:49:52.895106 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0717 23:49:52.905360 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0717 23:49:52.925663 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0717 23:49:52.965920 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0717 23:49:53.046176 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0717 23:49:53.206516 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0717 23:49:53.526794 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0717 23:49:54.167141 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0717 23:49:55.447400 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0717 23:49:58.007775 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0717 23:50:01.764734 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0717 23:50:03.128022 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-arm64 start -p static-ip-443410 --static-ip=192.168.200.200: (36.563043057s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-arm64 -p static-ip-443410 ip
helpers_test.go:175: Cleaning up "static-ip-443410" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p static-ip-443410
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p static-ip-443410: (2.133052967s)
--- PASS: TestKicStaticIP (38.88s)

                                                
                                    
x
+
TestMainNoArgs (0.06s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-arm64
--- PASS: TestMainNoArgs (0.06s)

                                                
                                    
x
+
TestMinikubeProfile (82.12s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p first-045745 --driver=docker  --container-runtime=containerd
E0717 23:50:13.368937 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0717 23:50:28.028686 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
E0717 23:50:33.849630 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p first-045745 --driver=docker  --container-runtime=containerd: (30.583191682s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p second-048797 --driver=docker  --container-runtime=containerd
E0717 23:51:14.810771 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p second-048797 --driver=docker  --container-runtime=containerd: (46.355347055s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile first-045745
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-arm64 profile second-048797
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-arm64 profile list -ojson
helpers_test.go:175: Cleaning up "second-048797" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p second-048797
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p second-048797: (1.916964805s)
helpers_test.go:175: Cleaning up "first-045745" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p first-045745
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p first-045745: (2.031349131s)
--- PASS: TestMinikubeProfile (82.12s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (6.48s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-1-076375 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-1-076375 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (5.474910987s)
--- PASS: TestMountStart/serial/StartWithMountFirst (6.48s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.29s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-1-076375 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.29s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (10.13s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-078230 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd
mount_start_test.go:98: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-078230 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=containerd: (9.131807913s)
--- PASS: TestMountStart/serial/StartWithMountSecond (10.13s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.36s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-078230 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.36s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.66s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p mount-start-1-076375 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p mount-start-1-076375 --alsologtostderr -v=5: (1.659983454s)
--- PASS: TestMountStart/serial/DeleteFirst (1.66s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.27s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-078230 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.27s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.22s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-arm64 stop -p mount-start-2-078230
mount_start_test.go:155: (dbg) Done: out/minikube-linux-arm64 stop -p mount-start-2-078230: (1.222118469s)
--- PASS: TestMountStart/serial/Stop (1.22s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (7.43s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-arm64 start -p mount-start-2-078230
mount_start_test.go:166: (dbg) Done: out/minikube-linux-arm64 start -p mount-start-2-078230: (6.430881032s)
--- PASS: TestMountStart/serial/RestartStopped (7.43s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.28s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-arm64 -p mount-start-2-078230 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.28s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (89.14s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:85: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-989295 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
E0717 23:52:17.923628 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0717 23:52:36.731736 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0717 23:52:45.604992 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
multinode_test.go:85: (dbg) Done: out/minikube-linux-arm64 start -p multinode-989295 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m28.584634591s)
multinode_test.go:91: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (89.14s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (10.58s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:481: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-989295 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:486: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-989295 -- rollout status deployment/busybox
multinode_test.go:486: (dbg) Done: out/minikube-linux-arm64 kubectl -p multinode-989295 -- rollout status deployment/busybox: (3.352939579s)
multinode_test.go:493: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-989295 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:516: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-989295 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:524: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-989295 -- exec busybox-67b7f59bb-4jhdq -- nslookup kubernetes.io
multinode_test.go:524: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-989295 -- exec busybox-67b7f59bb-p8npr -- nslookup kubernetes.io
multinode_test.go:524: (dbg) Done: out/minikube-linux-arm64 kubectl -p multinode-989295 -- exec busybox-67b7f59bb-p8npr -- nslookup kubernetes.io: (5.259277046s)
multinode_test.go:534: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-989295 -- exec busybox-67b7f59bb-4jhdq -- nslookup kubernetes.default
multinode_test.go:534: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-989295 -- exec busybox-67b7f59bb-p8npr -- nslookup kubernetes.default
multinode_test.go:542: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-989295 -- exec busybox-67b7f59bb-4jhdq -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:542: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-989295 -- exec busybox-67b7f59bb-p8npr -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (10.58s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (1.15s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:552: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-989295 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:560: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-989295 -- exec busybox-67b7f59bb-4jhdq -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-989295 -- exec busybox-67b7f59bb-4jhdq -- sh -c "ping -c 1 192.168.58.1"
multinode_test.go:560: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-989295 -- exec busybox-67b7f59bb-p8npr -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:571: (dbg) Run:  out/minikube-linux-arm64 kubectl -p multinode-989295 -- exec busybox-67b7f59bb-p8npr -- sh -c "ping -c 1 192.168.58.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (1.15s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (18.87s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:110: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-989295 -v 3 --alsologtostderr
multinode_test.go:110: (dbg) Done: out/minikube-linux-arm64 node add -p multinode-989295 -v 3 --alsologtostderr: (18.157634809s)
multinode_test.go:116: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (18.87s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.35s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:132: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.35s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (10.87s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:173: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 cp testdata/cp-test.txt multinode-989295:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 cp multinode-989295:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2476914705/001/cp-test_multinode-989295.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 cp multinode-989295:/home/docker/cp-test.txt multinode-989295-m02:/home/docker/cp-test_multinode-989295_multinode-989295-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295-m02 "sudo cat /home/docker/cp-test_multinode-989295_multinode-989295-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 cp multinode-989295:/home/docker/cp-test.txt multinode-989295-m03:/home/docker/cp-test_multinode-989295_multinode-989295-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295-m03 "sudo cat /home/docker/cp-test_multinode-989295_multinode-989295-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 cp testdata/cp-test.txt multinode-989295-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 cp multinode-989295-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2476914705/001/cp-test_multinode-989295-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 cp multinode-989295-m02:/home/docker/cp-test.txt multinode-989295:/home/docker/cp-test_multinode-989295-m02_multinode-989295.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295 "sudo cat /home/docker/cp-test_multinode-989295-m02_multinode-989295.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 cp multinode-989295-m02:/home/docker/cp-test.txt multinode-989295-m03:/home/docker/cp-test_multinode-989295-m02_multinode-989295-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295-m03 "sudo cat /home/docker/cp-test_multinode-989295-m02_multinode-989295-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 cp testdata/cp-test.txt multinode-989295-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 cp multinode-989295-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2476914705/001/cp-test_multinode-989295-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 cp multinode-989295-m03:/home/docker/cp-test.txt multinode-989295:/home/docker/cp-test_multinode-989295-m03_multinode-989295.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295 "sudo cat /home/docker/cp-test_multinode-989295-m03_multinode-989295.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 cp multinode-989295-m03:/home/docker/cp-test.txt multinode-989295-m02:/home/docker/cp-test_multinode-989295-m03_multinode-989295-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 ssh -n multinode-989295-m02 "sudo cat /home/docker/cp-test_multinode-989295-m03_multinode-989295-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (10.87s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.32s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:210: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 node stop m03
multinode_test.go:210: (dbg) Done: out/minikube-linux-arm64 -p multinode-989295 node stop m03: (1.228252012s)
multinode_test.go:216: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 status
multinode_test.go:216: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-989295 status: exit status 7 (553.025352ms)

                                                
                                                
-- stdout --
	multinode-989295
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-989295-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-989295-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:223: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 status --alsologtostderr
multinode_test.go:223: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-989295 status --alsologtostderr: exit status 7 (535.091459ms)

                                                
                                                
-- stdout --
	multinode-989295
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-989295-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-989295-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 23:54:10.958557 1857343 out.go:296] Setting OutFile to fd 1 ...
	I0717 23:54:10.958683 1857343 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:54:10.958696 1857343 out.go:309] Setting ErrFile to fd 2...
	I0717 23:54:10.958702 1857343 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:54:10.958954 1857343 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
	I0717 23:54:10.959134 1857343 out.go:303] Setting JSON to false
	I0717 23:54:10.959183 1857343 mustload.go:65] Loading cluster: multinode-989295
	I0717 23:54:10.959290 1857343 notify.go:220] Checking for updates...
	I0717 23:54:10.959565 1857343 config.go:182] Loaded profile config "multinode-989295": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
	I0717 23:54:10.959576 1857343 status.go:255] checking status of multinode-989295 ...
	I0717 23:54:10.960502 1857343 cli_runner.go:164] Run: docker container inspect multinode-989295 --format={{.State.Status}}
	I0717 23:54:10.979867 1857343 status.go:330] multinode-989295 host status = "Running" (err=<nil>)
	I0717 23:54:10.979891 1857343 host.go:66] Checking if "multinode-989295" exists ...
	I0717 23:54:10.980193 1857343 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-989295
	I0717 23:54:10.997842 1857343 host.go:66] Checking if "multinode-989295" exists ...
	I0717 23:54:10.998181 1857343 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0717 23:54:10.998228 1857343 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-989295
	I0717 23:54:11.025359 1857343 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34738 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/multinode-989295/id_rsa Username:docker}
	I0717 23:54:11.120592 1857343 ssh_runner.go:195] Run: systemctl --version
	I0717 23:54:11.126793 1857343 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 23:54:11.140817 1857343 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0717 23:54:11.210785 1857343 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:40 OomKillDisable:true NGoroutines:55 SystemTime:2023-07-17 23:54:11.200858838 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215175168 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0717 23:54:11.211396 1857343 kubeconfig.go:92] found "multinode-989295" server: "https://192.168.58.2:8443"
	I0717 23:54:11.211424 1857343 api_server.go:166] Checking apiserver status ...
	I0717 23:54:11.211471 1857343 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0717 23:54:11.224920 1857343 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1287/cgroup
	I0717 23:54:11.237018 1857343 api_server.go:182] apiserver freezer: "5:freezer:/docker/141727884d4f769457da801d6b32050cb9bfc00f1b0cbc662cf0406f751f5e13/kubepods/burstable/pod007745e2a7256f7770b4a7aadd01b92f/1be0e0a2cd9fb18a99056a09cd32944c2882312fc3aeba136ab3f307976931cd"
	I0717 23:54:11.237102 1857343 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/141727884d4f769457da801d6b32050cb9bfc00f1b0cbc662cf0406f751f5e13/kubepods/burstable/pod007745e2a7256f7770b4a7aadd01b92f/1be0e0a2cd9fb18a99056a09cd32944c2882312fc3aeba136ab3f307976931cd/freezer.state
	I0717 23:54:11.248090 1857343 api_server.go:204] freezer state: "THAWED"
	I0717 23:54:11.248118 1857343 api_server.go:253] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...
	I0717 23:54:11.257103 1857343 api_server.go:279] https://192.168.58.2:8443/healthz returned 200:
	ok
	I0717 23:54:11.257132 1857343 status.go:421] multinode-989295 apiserver status = Running (err=<nil>)
	I0717 23:54:11.257144 1857343 status.go:257] multinode-989295 status: &{Name:multinode-989295 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0717 23:54:11.257326 1857343 status.go:255] checking status of multinode-989295-m02 ...
	I0717 23:54:11.257631 1857343 cli_runner.go:164] Run: docker container inspect multinode-989295-m02 --format={{.State.Status}}
	I0717 23:54:11.275645 1857343 status.go:330] multinode-989295-m02 host status = "Running" (err=<nil>)
	I0717 23:54:11.275672 1857343 host.go:66] Checking if "multinode-989295-m02" exists ...
	I0717 23:54:11.275965 1857343 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-989295-m02
	I0717 23:54:11.294766 1857343 host.go:66] Checking if "multinode-989295-m02" exists ...
	I0717 23:54:11.295078 1857343 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0717 23:54:11.295126 1857343 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-989295-m02
	I0717 23:54:11.313779 1857343 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:34743 SSHKeyPath:/home/jenkins/minikube-integration/16899-1773963/.minikube/machines/multinode-989295-m02/id_rsa Username:docker}
	I0717 23:54:11.411457 1857343 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0717 23:54:11.425787 1857343 status.go:257] multinode-989295-m02 status: &{Name:multinode-989295-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0717 23:54:11.425818 1857343 status.go:255] checking status of multinode-989295-m03 ...
	I0717 23:54:11.426140 1857343 cli_runner.go:164] Run: docker container inspect multinode-989295-m03 --format={{.State.Status}}
	I0717 23:54:11.444029 1857343 status.go:330] multinode-989295-m03 host status = "Stopped" (err=<nil>)
	I0717 23:54:11.444058 1857343 status.go:343] host is not running, skipping remaining checks
	I0717 23:54:11.444065 1857343 status.go:257] multinode-989295-m03 status: &{Name:multinode-989295-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.32s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (19.05s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:244: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:254: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 node start m03 --alsologtostderr
multinode_test.go:254: (dbg) Done: out/minikube-linux-arm64 -p multinode-989295 node start m03 --alsologtostderr: (18.164007074s)
multinode_test.go:261: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 status
multinode_test.go:275: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (19.05s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (143.75s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:283: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-989295
multinode_test.go:290: (dbg) Run:  out/minikube-linux-arm64 stop -p multinode-989295
E0717 23:54:52.889880 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
multinode_test.go:290: (dbg) Done: out/minikube-linux-arm64 stop -p multinode-989295: (25.139777653s)
multinode_test.go:295: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-989295 --wait=true -v=8 --alsologtostderr
E0717 23:55:20.572847 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0717 23:55:28.028835 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
E0717 23:56:51.072125 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
multinode_test.go:295: (dbg) Done: out/minikube-linux-arm64 start -p multinode-989295 --wait=true -v=8 --alsologtostderr: (1m58.469692617s)
multinode_test.go:300: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-989295
--- PASS: TestMultiNode/serial/RestartKeepsNodes (143.75s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.04s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:394: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 node delete m03
multinode_test.go:394: (dbg) Done: out/minikube-linux-arm64 -p multinode-989295 node delete m03: (4.307177464s)
multinode_test.go:400: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 status --alsologtostderr
multinode_test.go:414: (dbg) Run:  docker volume ls
multinode_test.go:424: (dbg) Run:  kubectl get nodes
multinode_test.go:432: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.04s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (24.13s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:314: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 stop
E0717 23:57:17.922614 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
multinode_test.go:314: (dbg) Done: out/minikube-linux-arm64 -p multinode-989295 stop: (23.947163355s)
multinode_test.go:320: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 status
multinode_test.go:320: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-989295 status: exit status 7 (94.521352ms)

                                                
                                                
-- stdout --
	multinode-989295
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-989295-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:327: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 status --alsologtostderr
multinode_test.go:327: (dbg) Non-zero exit: out/minikube-linux-arm64 -p multinode-989295 status --alsologtostderr: exit status 7 (90.313475ms)

                                                
                                                
-- stdout --
	multinode-989295
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-989295-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0717 23:57:23.371767 1865909 out.go:296] Setting OutFile to fd 1 ...
	I0717 23:57:23.371964 1865909 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:57:23.371994 1865909 out.go:309] Setting ErrFile to fd 2...
	I0717 23:57:23.372014 1865909 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0717 23:57:23.372292 1865909 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
	I0717 23:57:23.372513 1865909 out.go:303] Setting JSON to false
	I0717 23:57:23.372623 1865909 mustload.go:65] Loading cluster: multinode-989295
	I0717 23:57:23.372674 1865909 notify.go:220] Checking for updates...
	I0717 23:57:23.373039 1865909 config.go:182] Loaded profile config "multinode-989295": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
	I0717 23:57:23.373067 1865909 status.go:255] checking status of multinode-989295 ...
	I0717 23:57:23.374471 1865909 cli_runner.go:164] Run: docker container inspect multinode-989295 --format={{.State.Status}}
	I0717 23:57:23.394175 1865909 status.go:330] multinode-989295 host status = "Stopped" (err=<nil>)
	I0717 23:57:23.394201 1865909 status.go:343] host is not running, skipping remaining checks
	I0717 23:57:23.394209 1865909 status.go:257] multinode-989295 status: &{Name:multinode-989295 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0717 23:57:23.394241 1865909 status.go:255] checking status of multinode-989295-m02 ...
	I0717 23:57:23.394542 1865909 cli_runner.go:164] Run: docker container inspect multinode-989295-m02 --format={{.State.Status}}
	I0717 23:57:23.412525 1865909 status.go:330] multinode-989295-m02 host status = "Stopped" (err=<nil>)
	I0717 23:57:23.412544 1865909 status.go:343] host is not running, skipping remaining checks
	I0717 23:57:23.412550 1865909 status.go:257] multinode-989295-m02 status: &{Name:multinode-989295-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (24.13s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (101.14s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:344: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:354: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-989295 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd
multinode_test.go:354: (dbg) Done: out/minikube-linux-arm64 start -p multinode-989295 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=containerd: (1m40.285770101s)
multinode_test.go:360: (dbg) Run:  out/minikube-linux-arm64 -p multinode-989295 status --alsologtostderr
multinode_test.go:374: (dbg) Run:  kubectl get nodes
multinode_test.go:382: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (101.14s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (36.34s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:443: (dbg) Run:  out/minikube-linux-arm64 node list -p multinode-989295
multinode_test.go:452: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-989295-m02 --driver=docker  --container-runtime=containerd
multinode_test.go:452: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p multinode-989295-m02 --driver=docker  --container-runtime=containerd: exit status 14 (79.798073ms)

                                                
                                                
-- stdout --
	* [multinode-989295-m02] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16899
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-989295-m02' is duplicated with machine name 'multinode-989295-m02' in profile 'multinode-989295'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:460: (dbg) Run:  out/minikube-linux-arm64 start -p multinode-989295-m03 --driver=docker  --container-runtime=containerd
multinode_test.go:460: (dbg) Done: out/minikube-linux-arm64 start -p multinode-989295-m03 --driver=docker  --container-runtime=containerd: (33.514130888s)
multinode_test.go:467: (dbg) Run:  out/minikube-linux-arm64 node add -p multinode-989295
multinode_test.go:467: (dbg) Non-zero exit: out/minikube-linux-arm64 node add -p multinode-989295: exit status 80 (348.761346ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-989295
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-989295-m03 already exists in multinode-989295-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-arm64 delete -p multinode-989295-m03
multinode_test.go:472: (dbg) Done: out/minikube-linux-arm64 delete -p multinode-989295-m03: (2.345387745s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (36.34s)

                                                
                                    
x
+
TestPreload (181.78s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-305309 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.4
E0717 23:59:52.890152 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0718 00:00:28.028675 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
preload_test.go:44: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-305309 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.24.4: (1m17.069876298s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-305309 image pull gcr.io/k8s-minikube/busybox
preload_test.go:52: (dbg) Done: out/minikube-linux-arm64 -p test-preload-305309 image pull gcr.io/k8s-minikube/busybox: (1.469550281s)
preload_test.go:58: (dbg) Run:  out/minikube-linux-arm64 stop -p test-preload-305309
preload_test.go:58: (dbg) Done: out/minikube-linux-arm64 stop -p test-preload-305309: (12.098279301s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-arm64 start -p test-preload-305309 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd
E0718 00:02:17.922561 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
preload_test.go:66: (dbg) Done: out/minikube-linux-arm64 start -p test-preload-305309 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=containerd: (1m28.558928986s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-arm64 -p test-preload-305309 image list
helpers_test.go:175: Cleaning up "test-preload-305309" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p test-preload-305309
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p test-preload-305309: (2.341795982s)
--- PASS: TestPreload (181.78s)

                                                
                                    
x
+
TestScheduledStopUnix (108.53s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-arm64 start -p scheduled-stop-874347 --memory=2048 --driver=docker  --container-runtime=containerd
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-arm64 start -p scheduled-stop-874347 --memory=2048 --driver=docker  --container-runtime=containerd: (32.198351127s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-874347 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-arm64 status --format={{.TimeToStop}} -p scheduled-stop-874347 -n scheduled-stop-874347
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-874347 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-874347 --cancel-scheduled
E0718 00:03:40.965372 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-874347 -n scheduled-stop-874347
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-874347
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-arm64 stop -p scheduled-stop-874347 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-arm64 status -p scheduled-stop-874347
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p scheduled-stop-874347: exit status 7 (71.732564ms)

                                                
                                                
-- stdout --
	scheduled-stop-874347
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-874347 -n scheduled-stop-874347
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p scheduled-stop-874347 -n scheduled-stop-874347: exit status 7 (68.446596ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-874347" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p scheduled-stop-874347
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p scheduled-stop-874347: (4.564304518s)
--- PASS: TestScheduledStopUnix (108.53s)

                                                
                                    
x
+
TestInsufficientStorage (10.23s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-arm64 start -p insufficient-storage-719807 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p insufficient-storage-719807 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=containerd: exit status 26 (7.583531678s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"d3092c0b-0488-4ada-872a-0c2e34f350d0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-719807] minikube v1.31.0 on Ubuntu 20.04 (arm64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"73e579d7-8cbf-4fb5-8bc3-beee8e20a5f9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=16899"}}
	{"specversion":"1.0","id":"431fac21-fc7b-4685-9622-33594bbe8bd4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"116c5119-12f1-4bc0-aec2-2e68eaf20e35","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig"}}
	{"specversion":"1.0","id":"75cbec65-2f29-413d-bc01-05e46d7c44b0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube"}}
	{"specversion":"1.0","id":"fee1e52a-35a1-44c4-ab47-91472a554f15","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-arm64"}}
	{"specversion":"1.0","id":"90136fdf-1afc-4275-b687-4d31555d7e9d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"092414b4-0f03-4e0b-84f1-f89bdf035f9f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"2f6f3242-c9d7-4377-b87b-ae8ea92a0c7e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"dbcf7e69-3069-48db-a804-a3c4b16ed072","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"34a5d52d-48d2-44b0-8a11-342c979d9476","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"66f61269-76b3-427e-bd51-e5279db90883","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node insufficient-storage-719807 in cluster insufficient-storage-719807","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"60a6167a-acf7-48ce-bf5d-cdcfd5718a1f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"b3f5cb59-0a85-419a-a22d-33b15c15ee2f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"e33d30d4-1473-49a3-9032-d015468bae58","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-719807 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-719807 --output=json --layout=cluster: exit status 7 (316.451607ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-719807","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.31.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-719807","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0718 00:04:42.991017 1883384 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-719807" does not appear in /home/jenkins/minikube-integration/16899-1773963/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p insufficient-storage-719807 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p insufficient-storage-719807 --output=json --layout=cluster: exit status 7 (317.351422ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-719807","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.31.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-719807","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0718 00:04:43.319031 1883439 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-719807" does not appear in /home/jenkins/minikube-integration/16899-1773963/kubeconfig
	E0718 00:04:43.330919 1883439 status.go:559] unable to read event log: stat: stat /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/insufficient-storage-719807/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-719807" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p insufficient-storage-719807
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p insufficient-storage-719807: (2.01063343s)
--- PASS: TestInsufficientStorage (10.23s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (123.76s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:132: (dbg) Run:  /tmp/minikube-v1.22.0.2992656367.exe start -p running-upgrade-703942 --memory=2200 --vm-driver=docker  --container-runtime=containerd
version_upgrade_test.go:132: (dbg) Done: /tmp/minikube-v1.22.0.2992656367.exe start -p running-upgrade-703942 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (1m20.602631493s)
version_upgrade_test.go:142: (dbg) Run:  out/minikube-linux-arm64 start -p running-upgrade-703942 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
E0718 00:12:17.921896 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
version_upgrade_test.go:142: (dbg) Done: out/minikube-linux-arm64 start -p running-upgrade-703942 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (38.868084265s)
helpers_test.go:175: Cleaning up "running-upgrade-703942" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p running-upgrade-703942
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p running-upgrade-703942: (2.817851284s)
--- PASS: TestRunningBinaryUpgrade (123.76s)

                                                
                                    
x
+
TestKubernetesUpgrade (411.63s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:234: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-557855 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:234: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-557855 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (1m6.568109904s)
version_upgrade_test.go:239: (dbg) Run:  out/minikube-linux-arm64 stop -p kubernetes-upgrade-557855
version_upgrade_test.go:239: (dbg) Done: out/minikube-linux-arm64 stop -p kubernetes-upgrade-557855: (1.312245261s)
version_upgrade_test.go:244: (dbg) Run:  out/minikube-linux-arm64 -p kubernetes-upgrade-557855 status --format={{.Host}}
version_upgrade_test.go:244: (dbg) Non-zero exit: out/minikube-linux-arm64 -p kubernetes-upgrade-557855 status --format={{.Host}}: exit status 7 (70.636896ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:246: status error: exit status 7 (may be ok)
version_upgrade_test.go:255: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-557855 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:255: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-557855 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (5m3.975381277s)
version_upgrade_test.go:260: (dbg) Run:  kubectl --context kubernetes-upgrade-557855 version --output=json
version_upgrade_test.go:279: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:281: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-557855 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:281: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p kubernetes-upgrade-557855 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=containerd: exit status 106 (131.056504ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-557855] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16899
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.27.3 cluster to v1.16.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.16.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-557855
	    minikube start -p kubernetes-upgrade-557855 --kubernetes-version=v1.16.0
	    
	    2) Create a second cluster with Kubernetes 1.16.0, by running:
	    
	    minikube start -p kubernetes-upgrade-5578552 --kubernetes-version=v1.16.0
	    
	    3) Use the existing cluster at version Kubernetes 1.27.3, by running:
	    
	    minikube start -p kubernetes-upgrade-557855 --kubernetes-version=v1.27.3
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:285: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:287: (dbg) Run:  out/minikube-linux-arm64 start -p kubernetes-upgrade-557855 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
version_upgrade_test.go:287: (dbg) Done: out/minikube-linux-arm64 start -p kubernetes-upgrade-557855 --memory=2200 --kubernetes-version=v1.27.3 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (36.77186252s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-557855" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubernetes-upgrade-557855
helpers_test.go:178: (dbg) Done: out/minikube-linux-arm64 delete -p kubernetes-upgrade-557855: (2.612965521s)
--- PASS: TestKubernetesUpgrade (411.63s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.09s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-353370 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p NoKubernetes-353370 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=containerd: exit status 14 (88.916925ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-353370] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16899
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.09s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (47.32s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-353370 --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-353370 --driver=docker  --container-runtime=containerd: (46.772107055s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-353370 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (47.32s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (30.07s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-353370 --no-kubernetes --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-353370 --no-kubernetes --driver=docker  --container-runtime=containerd: (27.55248517s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-arm64 -p NoKubernetes-353370 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-arm64 -p NoKubernetes-353370 status -o json: exit status 2 (501.315926ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-353370","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-arm64 delete -p NoKubernetes-353370
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-arm64 delete -p NoKubernetes-353370: (2.017016739s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (30.07s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (6.2s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-353370 --no-kubernetes --driver=docker  --container-runtime=containerd
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-353370 --no-kubernetes --driver=docker  --container-runtime=containerd: (6.204479169s)
--- PASS: TestNoKubernetes/serial/Start (6.20s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.3s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-353370 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-353370 "sudo systemctl is-active --quiet service kubelet": exit status 1 (297.310593ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.30s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (0.9s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-arm64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-arm64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (0.90s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.24s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-arm64 stop -p NoKubernetes-353370
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-arm64 stop -p NoKubernetes-353370: (1.235067333s)
--- PASS: TestNoKubernetes/serial/Stop (1.24s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (7.52s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-arm64 start -p NoKubernetes-353370 --driver=docker  --container-runtime=containerd
E0718 00:06:15.933265 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-arm64 start -p NoKubernetes-353370 --driver=docker  --container-runtime=containerd: (7.518453523s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (7.52s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.39s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-arm64 ssh -p NoKubernetes-353370 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-arm64 ssh -p NoKubernetes-353370 "sudo systemctl is-active --quiet service kubelet": exit status 1 (394.456103ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.39s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (1.42s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (1.42s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (125.87s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:195: (dbg) Run:  /tmp/minikube-v1.22.0.672065420.exe start -p stopped-upgrade-462879 --memory=2200 --vm-driver=docker  --container-runtime=containerd
version_upgrade_test.go:195: (dbg) Done: /tmp/minikube-v1.22.0.672065420.exe start -p stopped-upgrade-462879 --memory=2200 --vm-driver=docker  --container-runtime=containerd: (1m5.217424371s)
version_upgrade_test.go:204: (dbg) Run:  /tmp/minikube-v1.22.0.672065420.exe -p stopped-upgrade-462879 stop
E0718 00:09:52.890348 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
version_upgrade_test.go:204: (dbg) Done: /tmp/minikube-v1.22.0.672065420.exe -p stopped-upgrade-462879 stop: (12.825812725s)
version_upgrade_test.go:210: (dbg) Run:  out/minikube-linux-arm64 start -p stopped-upgrade-462879 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
E0718 00:10:28.028866 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
version_upgrade_test.go:210: (dbg) Done: out/minikube-linux-arm64 start -p stopped-upgrade-462879 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (47.829343339s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (125.87s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (1.04s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:218: (dbg) Run:  out/minikube-linux-arm64 logs -p stopped-upgrade-462879
version_upgrade_test.go:218: (dbg) Done: out/minikube-linux-arm64 logs -p stopped-upgrade-462879: (1.043234057s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.04s)

                                                
                                    
x
+
TestPause/serial/Start (61.96s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-arm64 start -p pause-661264 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd
pause_test.go:80: (dbg) Done: out/minikube-linux-arm64 start -p pause-661264 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=containerd: (1m1.958516111s)
--- PASS: TestPause/serial/Start (61.96s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (15.5s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-arm64 start -p pause-661264 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd
pause_test.go:92: (dbg) Done: out/minikube-linux-arm64 start -p pause-661264 --alsologtostderr -v=1 --driver=docker  --container-runtime=containerd: (15.485576873s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (15.50s)

                                                
                                    
x
+
TestPause/serial/Pause (1.01s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-661264 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-661264 --alsologtostderr -v=5: (1.004585354s)
--- PASS: TestPause/serial/Pause (1.01s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.45s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-arm64 status -p pause-661264 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-arm64 status -p pause-661264 --output=json --layout=cluster: exit status 2 (453.451409ms)

                                                
                                                
-- stdout --
	{"Name":"pause-661264","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 7 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.31.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-661264","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.45s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.91s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-arm64 unpause -p pause-661264 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.91s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (1.19s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-arm64 pause -p pause-661264 --alsologtostderr -v=5
pause_test.go:110: (dbg) Done: out/minikube-linux-arm64 pause -p pause-661264 --alsologtostderr -v=5: (1.192590876s)
--- PASS: TestPause/serial/PauseAgain (1.19s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (3.07s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-arm64 delete -p pause-661264 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-arm64 delete -p pause-661264 --alsologtostderr -v=5: (3.071469682s)
--- PASS: TestPause/serial/DeletePaused (3.07s)

                                                
                                    
x
+
TestNetworkPlugins/group/false (4.76s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false
net_test.go:246: (dbg) Run:  out/minikube-linux-arm64 start -p false-221906 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd
net_test.go:246: (dbg) Non-zero exit: out/minikube-linux-arm64 start -p false-221906 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=containerd: exit status 14 (278.477902ms)

                                                
                                                
-- stdout --
	* [false-221906] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	  - MINIKUBE_LOCATION=16899
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-arm64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on user configuration
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0718 00:14:10.519840 1920733 out.go:296] Setting OutFile to fd 1 ...
	I0718 00:14:10.519963 1920733 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0718 00:14:10.519969 1920733 out.go:309] Setting ErrFile to fd 2...
	I0718 00:14:10.519977 1920733 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0718 00:14:10.520240 1920733 root.go:338] Updating PATH: /home/jenkins/minikube-integration/16899-1773963/.minikube/bin
	I0718 00:14:10.520699 1920733 out.go:303] Setting JSON to false
	I0718 00:14:10.521787 1920733 start.go:128] hostinfo: {"hostname":"ip-172-31-29-130","uptime":32194,"bootTime":1689607057,"procs":304,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1039-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
	I0718 00:14:10.521854 1920733 start.go:138] virtualization:  
	I0718 00:14:10.524197 1920733 out.go:177] * [false-221906] minikube v1.31.0 on Ubuntu 20.04 (arm64)
	I0718 00:14:10.526254 1920733 out.go:177]   - MINIKUBE_LOCATION=16899
	I0718 00:14:10.527944 1920733 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0718 00:14:10.526475 1920733 notify.go:220] Checking for updates...
	I0718 00:14:10.531133 1920733 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/16899-1773963/kubeconfig
	I0718 00:14:10.532604 1920733 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/16899-1773963/.minikube
	I0718 00:14:10.534376 1920733 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64
	I0718 00:14:10.536210 1920733 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0718 00:14:10.538518 1920733 config.go:182] Loaded profile config "pause-661264": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.27.3
	I0718 00:14:10.538656 1920733 driver.go:373] Setting default libvirt URI to qemu:///system
	I0718 00:14:10.595198 1920733 docker.go:121] docker version: linux-24.0.4:Docker Engine - Community
	I0718 00:14:10.595326 1920733 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0718 00:14:10.689390 1920733 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:34 OomKillDisable:true NGoroutines:45 SystemTime:2023-07-18 00:14:10.676770191 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1039-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi
tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215175168 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:24.0.4 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dce8eb055cbb6872793272b4f20ed16117344f8 Expected:3dce8eb055cbb6872793272b4f20ed16117344f8} RuncCommit:{ID:v1.1.7-0-g860f061 Expected:v1.1.7-0-g860f061} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> S
erverErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.19.1]] Warnings:<nil>}}
	I0718 00:14:10.689500 1920733 docker.go:294] overlay module found
	I0718 00:14:10.692956 1920733 out.go:177] * Using the docker driver based on user configuration
	I0718 00:14:10.695066 1920733 start.go:298] selected driver: docker
	I0718 00:14:10.695086 1920733 start.go:880] validating driver "docker" against <nil>
	I0718 00:14:10.695100 1920733 start.go:891] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0718 00:14:10.697511 1920733 out.go:177] 
	W0718 00:14:10.699719 1920733 out.go:239] X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	X Exiting due to MK_USAGE: The "containerd" container runtime requires CNI
	I0718 00:14:10.701593 1920733 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:88: 
----------------------- debugLogs start: false-221906 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: false-221906

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: false-221906

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: false-221906

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: false-221906

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: false-221906

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: false-221906

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: false-221906

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: false-221906

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: false-221906

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: false-221906

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: false-221906

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "false-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "false-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "false-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "false-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "false-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "false-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "false-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "false-221906" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "false-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "false-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "false-221906" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: false-221906

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "false-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-221906"

                                                
                                                
----------------------- debugLogs end: false-221906 [took: 4.21639345s] --------------------------------
helpers_test.go:175: Cleaning up "false-221906" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p false-221906
--- PASS: TestNetworkPlugins/group/false (4.76s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (0.16s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-arm64 profile list --output json
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-661264
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-661264: exit status 1 (19.355165ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-661264: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (0.16s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (128.51s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-040698 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0
E0718 00:17:17.922723 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-040698 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0: (2m8.509318047s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (128.51s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (8.58s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-040698 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [d4141b44-d508-492d-aaec-efb23af85275] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [d4141b44-d508-492d-aaec-efb23af85275] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 8.034167416s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-040698 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (8.58s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.21s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p old-k8s-version-040698 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-040698 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (1.21s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (12.2s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p old-k8s-version-040698 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p old-k8s-version-040698 --alsologtostderr -v=3: (12.200414912s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (12.20s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-040698 -n old-k8s-version-040698
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-040698 -n old-k8s-version-040698: exit status 7 (79.179508ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p old-k8s-version-040698 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (670.44s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p old-k8s-version-040698 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p old-k8s-version-040698 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.16.0: (11m10.046589493s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p old-k8s-version-040698 -n old-k8s-version-040698
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (670.44s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (72.5s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-650223 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.3
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-650223 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.3: (1m12.50233461s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (72.50s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (7.56s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-650223 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [37d2fb1e-8d42-4757-8644-3bd4013b99a2] Pending
helpers_test.go:344: "busybox" [37d2fb1e-8d42-4757-8644-3bd4013b99a2] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [37d2fb1e-8d42-4757-8644-3bd4013b99a2] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 7.02574132s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-650223 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (7.56s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.25s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p no-preload-650223 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p no-preload-650223 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.130717484s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-650223 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (1.25s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (12.15s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p no-preload-650223 --alsologtostderr -v=3
E0718 00:19:52.890303 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p no-preload-650223 --alsologtostderr -v=3: (12.151988415s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (12.15s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.21s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-650223 -n no-preload-650223
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-650223 -n no-preload-650223: exit status 7 (79.595426ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p no-preload-650223 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.21s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (349.07s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p no-preload-650223 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.3
E0718 00:20:20.965995 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0718 00:20:28.028670 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
E0718 00:22:17.922281 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0718 00:22:55.933469 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0718 00:24:52.890386 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0718 00:25:28.028282 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p no-preload-650223 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.3: (5m48.662384708s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p no-preload-650223 -n no-preload-650223
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (349.07s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (14.03s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-r42ss" [e14afbe1-00d6-4f86-8131-ce7c1714f61d] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-r42ss" [e14afbe1-00d6-4f86-8131-ce7c1714f61d] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 14.030546018s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (14.03s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.12s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-r42ss" [e14afbe1-00d6-4f86-8131-ce7c1714f61d] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.008701522s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-650223 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.12s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.4s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p no-preload-650223 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.40s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (3.41s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p no-preload-650223 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-650223 -n no-preload-650223
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-650223 -n no-preload-650223: exit status 2 (349.604104ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-650223 -n no-preload-650223
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-650223 -n no-preload-650223: exit status 2 (381.280636ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p no-preload-650223 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p no-preload-650223 -n no-preload-650223
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p no-preload-650223 -n no-preload-650223
--- PASS: TestStartStop/group/no-preload/serial/Pause (3.41s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (84.81s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-782205 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.3
E0718 00:27:17.922554 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-782205 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.3: (1m24.814069866s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (84.81s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (9.49s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-782205 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [2d6e570b-a2da-4711-b835-efbe3d16614f] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [2d6e570b-a2da-4711-b835-efbe3d16614f] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 9.033886548s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-782205 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (9.49s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.21s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-782205 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p embed-certs-782205 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.081472566s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-782205 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (1.21s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (12.09s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p embed-certs-782205 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p embed-certs-782205 --alsologtostderr -v=3: (12.089943959s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (12.09s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-782205 -n embed-certs-782205
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-782205 -n embed-certs-782205: exit status 7 (85.53613ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p embed-certs-782205 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (626s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p embed-certs-782205 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.3
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p embed-certs-782205 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.3: (10m25.48906518s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p embed-certs-782205 -n embed-certs-782205
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (626.00s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.03s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-m92bg" [f4d1352c-8e0b-4fee-b049-0326ad445ec0] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.028068566s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (5.03s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-m92bg" [f4d1352c-8e0b-4fee-b049-0326ad445ec0] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.012476164s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-040698 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.36s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p old-k8s-version-040698 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20210326-1e038dc5
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.36s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (3.46s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p old-k8s-version-040698 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-040698 -n old-k8s-version-040698
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-040698 -n old-k8s-version-040698: exit status 2 (377.706932ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-040698 -n old-k8s-version-040698
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-040698 -n old-k8s-version-040698: exit status 2 (382.473867ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p old-k8s-version-040698 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p old-k8s-version-040698 -n old-k8s-version-040698
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p old-k8s-version-040698 -n old-k8s-version-040698
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (3.46s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (82.27s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-857763 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.3
E0718 00:29:40.375121 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:29:40.380363 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:29:40.391265 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:29:40.412334 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:29:40.453327 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:29:40.533598 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:29:40.694260 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:29:41.014445 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:29:41.655427 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:29:42.937283 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:29:45.498292 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:29:50.618486 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:29:52.890338 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0718 00:30:00.859208 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:30:11.073767 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
E0718 00:30:21.340361 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:30:28.028591 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-857763 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.3: (1m22.26559356s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (82.27s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (9.51s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-857763 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [779ebfa4-0afe-4dac-a87f-e95157afbf58] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [779ebfa4-0afe-4dac-a87f-e95157afbf58] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 9.030390217s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-857763 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (9.51s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.25s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-857763 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p default-k8s-diff-port-857763 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.121739682s)
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-857763 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (1.25s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (12.2s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p default-k8s-diff-port-857763 --alsologtostderr -v=3
E0718 00:31:02.300824 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p default-k8s-diff-port-857763 --alsologtostderr -v=3: (12.200543873s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (12.20s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-857763 -n default-k8s-diff-port-857763
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-857763 -n default-k8s-diff-port-857763: exit status 7 (76.795315ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p default-k8s-diff-port-857763 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (355.48s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p default-k8s-diff-port-857763 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.3
E0718 00:32:17.922619 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
E0718 00:32:24.221056 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:32:39.511429 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:32:39.516846 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:32:39.527089 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:32:39.547323 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:32:39.587642 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:32:39.667945 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:32:39.828338 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:32:40.148863 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:32:40.789808 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:32:42.070769 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:32:44.631438 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:32:49.752302 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:32:59.992656 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:33:20.473081 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:34:01.433879 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:34:40.374416 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:34:52.890388 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0718 00:35:08.061841 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:35:23.354489 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:35:28.028109 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
E0718 00:37:00.967160 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p default-k8s-diff-port-857763 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.3: (5m54.936494535s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p default-k8s-diff-port-857763 -n default-k8s-diff-port-857763
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (355.48s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (13.03s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-mz22l" [4f6a2a92-8fe3-4a35-aec0-aec1bf410ff1] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-mz22l" [4f6a2a92-8fe3-4a35-aec0-aec1bf410ff1] Running
E0718 00:37:17.921950 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 13.024551316s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (13.03s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-mz22l" [4f6a2a92-8fe3-4a35-aec0-aec1bf410ff1] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.007780212s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-857763 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.34s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p default-k8s-diff-port-857763 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.34s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (3.47s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p default-k8s-diff-port-857763 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-857763 -n default-k8s-diff-port-857763
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-857763 -n default-k8s-diff-port-857763: exit status 2 (357.223797ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-857763 -n default-k8s-diff-port-857763
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-857763 -n default-k8s-diff-port-857763: exit status 2 (371.53522ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p default-k8s-diff-port-857763 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p default-k8s-diff-port-857763 -n default-k8s-diff-port-857763
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p default-k8s-diff-port-857763 -n default-k8s-diff-port-857763
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (3.47s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (60.11s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-762878 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.3
E0718 00:37:39.511224 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
E0718 00:38:07.195451 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/old-k8s-version-040698/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-762878 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.3: (1m0.106263241s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (60.11s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (5.04s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-n9qct" [8133b6d7-2a4e-40d3-ad18-5c20a3babc9a] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.032100726s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (5.04s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.54s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-762878 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-arm64 addons enable metrics-server -p newest-cni-762878 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.54074521s)
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.54s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-5c5cfc8747-n9qct" [8133b6d7-2a4e-40d3-ad18-5c20a3babc9a] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.010556137s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-782205 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (1.27s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-arm64 stop -p newest-cni-762878 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-arm64 stop -p newest-cni-762878 --alsologtostderr -v=3: (1.273071432s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (1.27s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-762878 -n newest-cni-762878
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-762878 -n newest-cni-762878: exit status 7 (77.363745ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-arm64 addons enable dashboard -p newest-cni-762878 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (45.87s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-arm64 start -p newest-cni-762878 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.3
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-arm64 start -p newest-cni-762878 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=containerd --kubernetes-version=v1.27.3: (45.361531561s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p newest-cni-762878 -n newest-cni-762878
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (45.87s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.33s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p embed-certs-782205 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.33s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (4.07s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p embed-certs-782205 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-782205 -n embed-certs-782205
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-782205 -n embed-certs-782205: exit status 2 (414.337976ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-782205 -n embed-certs-782205
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-782205 -n embed-certs-782205: exit status 2 (469.217707ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p embed-certs-782205 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p embed-certs-782205 -n embed-certs-782205
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p embed-certs-782205 -n embed-certs-782205
--- PASS: TestStartStop/group/embed-certs/serial/Pause (4.07s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (92.49s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p auto-221906 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p auto-221906 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=containerd: (1m32.484311431s)
--- PASS: TestNetworkPlugins/group/auto/Start (92.49s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.43s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-arm64 ssh -p newest-cni-762878 "sudo crictl images -o json"
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.43s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (4.94s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 pause -p newest-cni-762878 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 pause -p newest-cni-762878 --alsologtostderr -v=1: (1.027021385s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-762878 -n newest-cni-762878
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-762878 -n newest-cni-762878: exit status 2 (417.136208ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-762878 -n newest-cni-762878
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-762878 -n newest-cni-762878: exit status 2 (445.993974ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 unpause -p newest-cni-762878 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 unpause -p newest-cni-762878 --alsologtostderr -v=1: (1.1438077s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-762878 -n newest-cni-762878
start_stop_delete_test.go:311: (dbg) Done: out/minikube-linux-arm64 status --format={{.APIServer}} -p newest-cni-762878 -n newest-cni-762878: (1.061175694s)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Kubelet}} -p newest-cni-762878 -n newest-cni-762878
--- PASS: TestStartStop/group/newest-cni/serial/Pause (4.94s)
E0718 00:45:31.350376 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/auto-221906/client.crt: no such file or directory
E0718 00:45:41.590551 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/auto-221906/client.crt: no such file or directory
E0718 00:45:51.252546 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/default-k8s-diff-port-857763/client.crt: no such file or directory
E0718 00:46:02.071095 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/auto-221906/client.crt: no such file or directory
E0718 00:46:03.422434 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:46:12.344760 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kindnet-221906/client.crt: no such file or directory
E0718 00:46:12.349985 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kindnet-221906/client.crt: no such file or directory
E0718 00:46:12.360157 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kindnet-221906/client.crt: no such file or directory
E0718 00:46:12.380403 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kindnet-221906/client.crt: no such file or directory
E0718 00:46:12.420635 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kindnet-221906/client.crt: no such file or directory
E0718 00:46:12.501601 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kindnet-221906/client.crt: no such file or directory
E0718 00:46:12.661909 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kindnet-221906/client.crt: no such file or directory
E0718 00:46:12.982660 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kindnet-221906/client.crt: no such file or directory
E0718 00:46:13.623558 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kindnet-221906/client.crt: no such file or directory
E0718 00:46:14.904200 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kindnet-221906/client.crt: no such file or directory
E0718 00:46:17.464350 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kindnet-221906/client.crt: no such file or directory
E0718 00:46:18.933699 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/default-k8s-diff-port-857763/client.crt: no such file or directory
E0718 00:46:22.584636 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kindnet-221906/client.crt: no such file or directory
E0718 00:46:32.825732 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kindnet-221906/client.crt: no such file or directory
E0718 00:46:43.032273 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/auto-221906/client.crt: no such file or directory
E0718 00:46:51.074545 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (99.83s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p kindnet-221906 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=containerd
E0718 00:39:35.934393 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
E0718 00:39:40.375220 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
E0718 00:39:52.890139 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p kindnet-221906 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=containerd: (1m39.82564086s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (99.83s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p auto-221906 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (9.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-221906 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-4wqt9" [04269bd8-fb98-4e83-96c0-7f4eb06e163c] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-4wqt9" [04269bd8-fb98-4e83-96c0-7f4eb06e163c] Running
E0718 00:40:28.028340 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/addons-225437/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 9.009135078s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (9.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-221906 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-221906 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-221906 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (76.63s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p calico-221906 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=containerd
E0718 00:40:53.809876 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/default-k8s-diff-port-857763/client.crt: no such file or directory
E0718 00:40:56.370350 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/default-k8s-diff-port-857763/client.crt: no such file or directory
E0718 00:41:01.490701 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/default-k8s-diff-port-857763/client.crt: no such file or directory
E0718 00:41:11.731577 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/default-k8s-diff-port-857763/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p calico-221906 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=containerd: (1m16.633965385s)
--- PASS: TestNetworkPlugins/group/calico/Start (76.63s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (5.03s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-7hv7j" [a95c4506-49cf-44c2-83b6-348c283f4ce1] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 5.026543526s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (5.03s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.49s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p kindnet-221906 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.49s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (11.6s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-221906 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-vqwtk" [8022431d-427a-4dd3-9889-f0fe4dc0da13] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-vqwtk" [8022431d-427a-4dd3-9889-f0fe4dc0da13] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 11.018877511s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (11.60s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-221906 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-221906 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-221906 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (70.88s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p custom-flannel-221906 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p custom-flannel-221906 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=containerd: (1m10.883185701s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (70.88s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (5.05s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-t6bkx" [fd9bcfd9-a7be-40ec-abb6-95bdb502b02e] Running
E0718 00:42:13.172460 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/default-k8s-diff-port-857763/client.crt: no such file or directory
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 5.043584395s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (5.05s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p calico-221906 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (10.43s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-221906 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-g5c58" [4ad29d4d-889c-431a-9e97-43030dbff5ff] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0718 00:42:17.922079 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/functional-128534/client.crt: no such file or directory
helpers_test.go:344: "netcat-7458db8b8-g5c58" [4ad29d4d-889c-431a-9e97-43030dbff5ff] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 10.011831772s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (10.43s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-221906 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.41s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-221906 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.41s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-221906 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (102.07s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p enable-default-cni-221906 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p enable-default-cni-221906 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=containerd: (1m42.066367364s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (102.07s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p custom-flannel-221906 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (9.37s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-221906 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-66lmp" [949f2620-f65b-4ab2-adda-1eb721f82707] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-66lmp" [949f2620-f65b-4ab2-adda-1eb721f82707] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 9.006780007s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (9.37s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-221906 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-221906 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-221906 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (62.78s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p flannel-221906 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=containerd
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p flannel-221906 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=containerd: (1m2.783549225s)
--- PASS: TestNetworkPlugins/group/flannel/Start (62.78s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.37s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p enable-default-cni-221906 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.37s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (10.61s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-221906 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-qzg82" [25ff54b1-4004-4a78-a025-24166804bd99] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0718 00:44:40.374588 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/no-preload-650223/client.crt: no such file or directory
helpers_test.go:344: "netcat-7458db8b8-qzg82" [25ff54b1-4004-4a78-a025-24166804bd99] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 10.008521858s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (10.61s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-221906 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-221906 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-221906 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.19s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (5.03s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-vckd6" [cfeabcb1-a099-4a2c-98e5-61374820b837] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 5.026268627s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (5.03s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p flannel-221906 "pgrep -a kubelet"
E0718 00:44:52.890327 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/ingress-addon-legacy-804572/client.crt: no such file or directory
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (10.53s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-221906 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-rpzvn" [a1a2587f-ca81-4648-be2f-de883e7bbacd] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-rpzvn" [a1a2587f-ca81-4648-be2f-de883e7bbacd] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 10.012966221s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (10.53s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.35s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-221906 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-221906 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-221906 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (102.51s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-arm64 start -p bridge-221906 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=containerd
E0718 00:45:21.109297 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/auto-221906/client.crt: no such file or directory
E0718 00:45:21.114548 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/auto-221906/client.crt: no such file or directory
E0718 00:45:21.124801 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/auto-221906/client.crt: no such file or directory
E0718 00:45:21.145285 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/auto-221906/client.crt: no such file or directory
E0718 00:45:21.185552 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/auto-221906/client.crt: no such file or directory
E0718 00:45:21.266171 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/auto-221906/client.crt: no such file or directory
E0718 00:45:21.427116 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/auto-221906/client.crt: no such file or directory
E0718 00:45:21.748097 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/auto-221906/client.crt: no such file or directory
E0718 00:45:22.388523 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/auto-221906/client.crt: no such file or directory
E0718 00:45:23.668747 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/auto-221906/client.crt: no such file or directory
E0718 00:45:26.229914 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/auto-221906/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-arm64 start -p bridge-221906 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=containerd: (1m42.505155326s)
--- PASS: TestNetworkPlugins/group/bridge/Start (102.51s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-arm64 ssh -p bridge-221906 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (8.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-221906 replace --force -f testdata/netcat-deployment.yaml
E0718 00:46:53.306686 1779350 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/kindnet-221906/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-7458db8b8-bx6sv" [e6244ba6-d471-4583-8fb6-30379cd62ee4] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-7458db8b8-bx6sv" [e6244ba6-d471-4583-8fb6-30379cd62ee4] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 8.008313058s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (8.36s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-221906 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.21s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-221906 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.19s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-221906 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.19s)

                                                
                                    

Test skip (28/304)

x
+
TestDownloadOnly/v1.16.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.16.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/binaries
aaa_download_only_test.go:136: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.16.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/kubectl
aaa_download_only_test.go:152: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.16.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/cached-images
aaa_download_only_test.go:117: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.27.3/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/binaries
aaa_download_only_test.go:136: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.27.3/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.27.3/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.27.3/kubectl
aaa_download_only_test.go:152: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.27.3/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0.56s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:222: (dbg) Run:  out/minikube-linux-arm64 start --download-only -p download-docker-159418 --alsologtostderr --driver=docker  --container-runtime=containerd
aaa_download_only_test.go:234: Skip for arm64 platform. See https://github.com/kubernetes/minikube/issues/10144
helpers_test.go:175: Cleaning up "download-docker-159418" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p download-docker-159418
--- SKIP: TestDownloadOnlyKic (0.56s)

                                                
                                    
x
+
TestOffline (0s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:35: skipping TestOffline - only docker runtime supported on arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestOffline (0.00s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (0s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:420: skip Helm test on arm64
--- SKIP: TestAddons/parallel/HelmTiller (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:474: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerFlags (0s)

                                                
                                                
=== RUN   TestDockerFlags
docker_test.go:41: skipping: only runs with docker container runtime, currently testing containerd
--- SKIP: TestDockerFlags (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:45: Skip if arm64. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1783: arm64 is not supported by mysql. Skip the test. See https://github.com/kubernetes/minikube/issues/10144
--- SKIP: TestFunctional/parallel/MySQL (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DockerEnv
functional_test.go:459: only validate docker env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing containerd
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild (0s)

                                                
                                                
=== RUN   TestImageBuild
image_test.go:33: 
--- SKIP: TestImageBuild (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestSkaffold (0s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing containerd container runtime
--- SKIP: TestSkaffold (0.00s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.16s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-750207" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p disable-driver-mounts-750207
--- SKIP: TestStartStop/group/disable-driver-mounts (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet (5.03s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet
net_test.go:93: Skipping the test as containerd container runtimes requires CNI
panic.go:522: 
----------------------- debugLogs start: kubenet-221906 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-221906

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: kubenet-221906

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-221906

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: kubenet-221906

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: kubenet-221906

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: kubenet-221906

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: kubenet-221906

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: kubenet-221906

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: kubenet-221906

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: kubenet-221906

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: kubenet-221906

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "kubenet-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "kubenet-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "kubenet-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "kubenet-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "kubenet-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "kubenet-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "kubenet-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "kubenet-221906" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "kubenet-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "kubenet-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "kubenet-221906" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/16899-1773963/.minikube/ca.crt
extensions:
- extension:
last-update: Tue, 18 Jul 2023 00:14:03 UTC
provider: minikube.sigs.k8s.io
version: v1.31.0
name: cluster_info
server: https://192.168.94.2:8443
name: pause-661264
contexts:
- context:
cluster: pause-661264
extensions:
- extension:
last-update: Tue, 18 Jul 2023 00:14:03 UTC
provider: minikube.sigs.k8s.io
version: v1.31.0
name: context_info
namespace: default
user: pause-661264
name: pause-661264
current-context: pause-661264
kind: Config
preferences: {}
users:
- name: pause-661264
user:
client-certificate: /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/pause-661264/client.crt
client-key: /home/jenkins/minikube-integration/16899-1773963/.minikube/profiles/pause-661264/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: kubenet-221906

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "kubenet-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-221906"

                                                
                                                
----------------------- debugLogs end: kubenet-221906 [took: 4.762487689s] --------------------------------
helpers_test.go:175: Cleaning up "kubenet-221906" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p kubenet-221906
--- SKIP: TestNetworkPlugins/group/kubenet (5.03s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (6.05s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:522: 
----------------------- debugLogs start: cilium-221906 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-221906

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-221906

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-221906

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-221906

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-221906

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-221906

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-221906

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-221906

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-221906

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-221906

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-221906

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-221906" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-221906

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-221906

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-221906

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-221906

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-221906" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-221906" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-221906

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-221906" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-221906"

                                                
                                                
----------------------- debugLogs end: cilium-221906 [took: 5.837933198s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-221906" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-arm64 delete -p cilium-221906
--- SKIP: TestNetworkPlugins/group/cilium (6.05s)

                                                
                                    
Copied to clipboard