Test Report: Docker_Linux_crio 20370

                    
                      48d14f3cb3aa737abe9969df0d43dc6a5030a05d:2025-09-18:41491
                    
                

Test fail (16/323)

x
+
TestAddons/parallel/Ingress (158.29s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:209: (dbg) Run:  kubectl --context addons-294579 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:234: (dbg) Run:  kubectl --context addons-294579 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:247: (dbg) Run:  kubectl --context addons-294579 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:252: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:352: "nginx" [eb87b968-eb82-4c61-88dc-3a8779d74803] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:352: "nginx" [eb87b968-eb82-4c61-88dc-3a8779d74803] Running
addons_test.go:252: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 10.002889833s
I0918 16:41:27.838924   11368 kapi.go:150] Service nginx in namespace default found.
addons_test.go:264: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:264: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-294579 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'": exit status 1 (2m15.822364455s)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 28

                                                
                                                
** /stderr **
addons_test.go:280: failed to get expected response from http://127.0.0.1/ within minikube: exit status 1
addons_test.go:288: (dbg) Run:  kubectl --context addons-294579 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:293: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 ip
addons_test.go:299: (dbg) Run:  nslookup hello-john.test 192.168.49.2
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======>  post-mortem[TestAddons/parallel/Ingress]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======>  post-mortem[TestAddons/parallel/Ingress]: docker inspect <======
helpers_test.go:239: (dbg) Run:  docker inspect addons-294579
helpers_test.go:243: (dbg) docker inspect addons-294579:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "8f686450d58a7761826b453524169c417f987f0a7e2c9a0b3707659bbaa7a910",
	        "Created": "2025-09-18T16:38:45.73656045Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 13333,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2025-09-18T16:38:45.77593695Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:c6b5532e987b5b4f5fc9cb0336e378ed49c0542bad8cbfc564b71e977a6269de",
	        "ResolvConfPath": "/var/lib/docker/containers/8f686450d58a7761826b453524169c417f987f0a7e2c9a0b3707659bbaa7a910/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/8f686450d58a7761826b453524169c417f987f0a7e2c9a0b3707659bbaa7a910/hostname",
	        "HostsPath": "/var/lib/docker/containers/8f686450d58a7761826b453524169c417f987f0a7e2c9a0b3707659bbaa7a910/hosts",
	        "LogPath": "/var/lib/docker/containers/8f686450d58a7761826b453524169c417f987f0a7e2c9a0b3707659bbaa7a910/8f686450d58a7761826b453524169c417f987f0a7e2c9a0b3707659bbaa7a910-json.log",
	        "Name": "/addons-294579",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "addons-294579:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "addons-294579",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "private",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4294967296,
	            "NanoCpus": 0,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8589934592,
	            "MemorySwappiness": null,
	            "OomKillDisable": null,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "ID": "8f686450d58a7761826b453524169c417f987f0a7e2c9a0b3707659bbaa7a910",
	                "LowerDir": "/var/lib/docker/overlay2/febfc16fcbf3bc2f62a7e606b094300708059b32ff92d5c68ad4cb0af5cf8087-init/diff:/var/lib/docker/overlay2/1fd2bbb67ab9e5bb8d4549665a1a228eadda56df39fee53908cd735ea16a4e10/diff",
	                "MergedDir": "/var/lib/docker/overlay2/febfc16fcbf3bc2f62a7e606b094300708059b32ff92d5c68ad4cb0af5cf8087/merged",
	                "UpperDir": "/var/lib/docker/overlay2/febfc16fcbf3bc2f62a7e606b094300708059b32ff92d5c68ad4cb0af5cf8087/diff",
	                "WorkDir": "/var/lib/docker/overlay2/febfc16fcbf3bc2f62a7e606b094300708059b32ff92d5c68ad4cb0af5cf8087/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "addons-294579",
	                "Source": "/var/lib/docker/volumes/addons-294579/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-294579",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-294579",
	                "name.minikube.sigs.k8s.io": "addons-294579",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "7de3529707ff92abc8943b38605697c85b4f320bbccc69b1dd0ae31647a59fac",
	            "SandboxKey": "/var/run/docker/netns/7de3529707ff",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32768"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32769"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32772"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32770"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32771"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-294579": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "e2:12:f5:d1:b3:97",
	                    "DriverOpts": null,
	                    "GwPriority": 0,
	                    "NetworkID": "e7860af1a8a99bc58dfe88f521cf328f27edd8a1f997da2ca4115ac343d30830",
	                    "EndpointID": "a4988cd4ce9d1da174b5a919d5429fad041f941e4aef089197bc3fbc1bb135de",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "addons-294579",
	                        "8f686450d58a"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p addons-294579 -n addons-294579
helpers_test.go:252: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======>  post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p addons-294579 logs -n 25: (1.244368989s)
helpers_test.go:260: TestAddons/parallel/Ingress logs: 
-- stdout --
	
	==> Audit <==
	┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬────────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
	│ COMMAND │                                                                                                                                                                                                                                   ARGS                                                                                                                                                                                                                                   │        PROFILE         │  USER   │ VERSION │     START TIME      │      END TIME       │
	├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼────────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
	│ delete  │ -p download-docker-967460                                                                                                                                                                                                                                                                                                                                                                                                                                                │ download-docker-967460 │ jenkins │ v1.37.0 │ 18 Sep 25 16:38 UTC │ 18 Sep 25 16:38 UTC │
	│ start   │ --download-only -p binary-mirror-108304 --alsologtostderr --binary-mirror http://127.0.0.1:33603 --driver=docker  --container-runtime=crio                                                                                                                                                                                                                                                                                                                               │ binary-mirror-108304   │ jenkins │ v1.37.0 │ 18 Sep 25 16:38 UTC │                     │
	│ delete  │ -p binary-mirror-108304                                                                                                                                                                                                                                                                                                                                                                                                                                                  │ binary-mirror-108304   │ jenkins │ v1.37.0 │ 18 Sep 25 16:38 UTC │ 18 Sep 25 16:38 UTC │
	│ addons  │ disable dashboard -p addons-294579                                                                                                                                                                                                                                                                                                                                                                                                                                       │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:38 UTC │                     │
	│ addons  │ enable dashboard -p addons-294579                                                                                                                                                                                                                                                                                                                                                                                                                                        │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:38 UTC │                     │
	│ start   │ -p addons-294579 --wait=true --memory=4096 --alsologtostderr --addons=registry --addons=registry-creds --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:38 UTC │ 18 Sep 25 16:40 UTC │
	│ addons  │ addons-294579 addons disable volcano --alsologtostderr -v=1                                                                                                                                                                                                                                                                                                                                                                                                              │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:40 UTC │ 18 Sep 25 16:40 UTC │
	│ addons  │ addons-294579 addons disable gcp-auth --alsologtostderr -v=1                                                                                                                                                                                                                                                                                                                                                                                                             │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:40 UTC │ 18 Sep 25 16:41 UTC │
	│ addons  │ enable headlamp -p addons-294579 --alsologtostderr -v=1                                                                                                                                                                                                                                                                                                                                                                                                                  │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:41 UTC │ 18 Sep 25 16:41 UTC │
	│ addons  │ addons-294579 addons disable amd-gpu-device-plugin --alsologtostderr -v=1                                                                                                                                                                                                                                                                                                                                                                                                │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:41 UTC │ 18 Sep 25 16:41 UTC │
	│ addons  │ addons-294579 addons disable nvidia-device-plugin --alsologtostderr -v=1                                                                                                                                                                                                                                                                                                                                                                                                 │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:41 UTC │ 18 Sep 25 16:41 UTC │
	│ addons  │ addons-294579 addons disable metrics-server --alsologtostderr -v=1                                                                                                                                                                                                                                                                                                                                                                                                       │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:41 UTC │ 18 Sep 25 16:41 UTC │
	│ addons  │ addons-294579 addons disable headlamp --alsologtostderr -v=1                                                                                                                                                                                                                                                                                                                                                                                                             │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:41 UTC │ 18 Sep 25 16:41 UTC │
	│ ip      │ addons-294579 ip                                                                                                                                                                                                                                                                                                                                                                                                                                                         │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:41 UTC │ 18 Sep 25 16:41 UTC │
	│ addons  │ addons-294579 addons disable registry --alsologtostderr -v=1                                                                                                                                                                                                                                                                                                                                                                                                             │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:41 UTC │ 18 Sep 25 16:41 UTC │
	│ addons  │ configure registry-creds -f ./testdata/addons_testconfig.json -p addons-294579                                                                                                                                                                                                                                                                                                                                                                                           │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:41 UTC │ 18 Sep 25 16:41 UTC │
	│ addons  │ addons-294579 addons disable registry-creds --alsologtostderr -v=1                                                                                                                                                                                                                                                                                                                                                                                                       │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:41 UTC │ 18 Sep 25 16:41 UTC │
	│ addons  │ addons-294579 addons disable cloud-spanner --alsologtostderr -v=1                                                                                                                                                                                                                                                                                                                                                                                                        │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:41 UTC │ 18 Sep 25 16:41 UTC │
	│ ssh     │ addons-294579 ssh cat /opt/local-path-provisioner/pvc-af5ddb96-f8f1-4029-9edb-8cb4d84b099c_default_test-pvc/file1                                                                                                                                                                                                                                                                                                                                                        │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:41 UTC │ 18 Sep 25 16:41 UTC │
	│ ssh     │ addons-294579 ssh curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'                                                                                                                                                                                                                                                                                                                                                                                                 │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:41 UTC │                     │
	│ addons  │ addons-294579 addons disable storage-provisioner-rancher --alsologtostderr -v=1                                                                                                                                                                                                                                                                                                                                                                                          │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:41 UTC │ 18 Sep 25 16:41 UTC │
	│ addons  │ addons-294579 addons disable yakd --alsologtostderr -v=1                                                                                                                                                                                                                                                                                                                                                                                                                 │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:41 UTC │ 18 Sep 25 16:41 UTC │
	│ addons  │ addons-294579 addons disable volumesnapshots --alsologtostderr -v=1                                                                                                                                                                                                                                                                                                                                                                                                      │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:41 UTC │ 18 Sep 25 16:41 UTC │
	│ addons  │ addons-294579 addons disable csi-hostpath-driver --alsologtostderr -v=1                                                                                                                                                                                                                                                                                                                                                                                                  │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:41 UTC │ 18 Sep 25 16:42 UTC │
	│ ip      │ addons-294579 ip                                                                                                                                                                                                                                                                                                                                                                                                                                                         │ addons-294579          │ jenkins │ v1.37.0 │ 18 Sep 25 16:43 UTC │ 18 Sep 25 16:43 UTC │
	└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴────────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
	
	
	==> Last Start <==
	Log file created at: 2025/09/18 16:38:20
	Running on machine: ubuntu-20-agent-4
	Binary: Built with gc go1.24.6 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0918 16:38:20.943219   12679 out.go:360] Setting OutFile to fd 1 ...
	I0918 16:38:20.943440   12679 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:38:20.943448   12679 out.go:374] Setting ErrFile to fd 2...
	I0918 16:38:20.943452   12679 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:38:20.943656   12679 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 16:38:20.944153   12679 out.go:368] Setting JSON to false
	I0918 16:38:20.944966   12679 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":1252,"bootTime":1758212249,"procs":174,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 16:38:20.945047   12679 start.go:140] virtualization: kvm guest
	I0918 16:38:20.946938   12679 out.go:179] * [addons-294579] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 16:38:20.948449   12679 notify.go:220] Checking for updates...
	I0918 16:38:20.948489   12679 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 16:38:20.949985   12679 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 16:38:20.951380   12679 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 16:38:20.952963   12679 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 16:38:20.954372   12679 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 16:38:20.955811   12679 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 16:38:20.957336   12679 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 16:38:20.980014   12679 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 16:38:20.980192   12679 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:38:21.041022   12679 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:26 OomKillDisable:false NGoroutines:50 SystemTime:2025-09-18 16:38:21.028935439 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:38:21.041126   12679 docker.go:318] overlay module found
	I0918 16:38:21.043147   12679 out.go:179] * Using the docker driver based on user configuration
	I0918 16:38:21.044928   12679 start.go:304] selected driver: docker
	I0918 16:38:21.044948   12679 start.go:924] validating driver "docker" against <nil>
	I0918 16:38:21.044961   12679 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 16:38:21.045533   12679 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:38:21.103057   12679 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:26 OomKillDisable:false NGoroutines:50 SystemTime:2025-09-18 16:38:21.093633971 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:38:21.103270   12679 start_flags.go:327] no existing cluster config was found, will generate one from the flags 
	I0918 16:38:21.103551   12679 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 16:38:21.105596   12679 out.go:179] * Using Docker driver with root privileges
	I0918 16:38:21.107111   12679 cni.go:84] Creating CNI manager for ""
	I0918 16:38:21.107184   12679 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0918 16:38:21.107197   12679 start_flags.go:336] Found "CNI" CNI - setting NetworkPlugin=cni
	I0918 16:38:21.107266   12679 start.go:348] cluster config:
	{Name:addons-294579 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:addons-294579 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: Network
Plugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

                                                
                                                
	I0918 16:38:21.108791   12679 out.go:179] * Starting "addons-294579" primary control-plane node in "addons-294579" cluster
	I0918 16:38:21.109995   12679 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 16:38:21.111257   12679 out.go:179] * Pulling base image v0.0.48 ...
	I0918 16:38:21.112670   12679 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:38:21.112714   12679 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
	I0918 16:38:21.112721   12679 cache.go:58] Caching tarball of preloaded images
	I0918 16:38:21.112804   12679 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 16:38:21.112815   12679 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 16:38:21.112813   12679 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 16:38:21.113147   12679 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/config.json ...
	I0918 16:38:21.113178   12679 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/config.json: {Name:mk4fb29de35b3481443d4851121922cfcc8e85d9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:38:21.129976   12679 cache.go:152] Downloading gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 to local cache
	I0918 16:38:21.130113   12679 image.go:65] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local cache directory
	I0918 16:38:21.130136   12679 image.go:68] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local cache directory, skipping pull
	I0918 16:38:21.130147   12679 image.go:137] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in cache, skipping pull
	I0918 16:38:21.130161   12679 cache.go:155] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 as a tarball
	I0918 16:38:21.130170   12679 cache.go:165] Loading gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 from local cache
	I0918 16:38:33.916186   12679 cache.go:167] successfully loaded and using gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 from cached tarball
	I0918 16:38:33.916222   12679 cache.go:232] Successfully downloaded all kic artifacts
	I0918 16:38:33.916250   12679 start.go:360] acquireMachinesLock for addons-294579: {Name:mk4998e163a9540e9892a31fbc9bab18b281c117 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 16:38:33.916341   12679 start.go:364] duration metric: took 73.391µs to acquireMachinesLock for "addons-294579"
	I0918 16:38:33.916372   12679 start.go:93] Provisioning new machine with config: &{Name:addons-294579 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:addons-294579 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[
] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: S
ocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:38:33.916436   12679 start.go:125] createHost starting for "" (driver="docker")
	I0918 16:38:33.918368   12679 out.go:252] * Creating docker container (CPUs=2, Memory=4096MB) ...
	I0918 16:38:33.918612   12679 start.go:159] libmachine.API.Create for "addons-294579" (driver="docker")
	I0918 16:38:33.918651   12679 client.go:168] LocalClient.Create starting
	I0918 16:38:33.918819   12679 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 16:38:34.334280   12679 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 16:38:34.468458   12679 cli_runner.go:164] Run: docker network inspect addons-294579 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0918 16:38:34.485971   12679 cli_runner.go:211] docker network inspect addons-294579 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0918 16:38:34.486035   12679 network_create.go:284] running [docker network inspect addons-294579] to gather additional debugging logs...
	I0918 16:38:34.486051   12679 cli_runner.go:164] Run: docker network inspect addons-294579
	W0918 16:38:34.502442   12679 cli_runner.go:211] docker network inspect addons-294579 returned with exit code 1
	I0918 16:38:34.502469   12679 network_create.go:287] error running [docker network inspect addons-294579]: docker network inspect addons-294579: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-294579 not found
	I0918 16:38:34.502511   12679 network_create.go:289] output of [docker network inspect addons-294579]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-294579 not found
	
	** /stderr **
	I0918 16:38:34.502601   12679 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:38:34.519853   12679 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001b93ef0}
	I0918 16:38:34.519896   12679 network_create.go:124] attempt to create docker network addons-294579 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0918 16:38:34.519954   12679 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-294579 addons-294579
	I0918 16:38:34.842748   12679 network_create.go:108] docker network addons-294579 192.168.49.0/24 created
	I0918 16:38:34.842778   12679 kic.go:121] calculated static IP "192.168.49.2" for the "addons-294579" container
	I0918 16:38:34.842866   12679 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 16:38:34.860128   12679 cli_runner.go:164] Run: docker volume create addons-294579 --label name.minikube.sigs.k8s.io=addons-294579 --label created_by.minikube.sigs.k8s.io=true
	I0918 16:38:34.906647   12679 oci.go:103] Successfully created a docker volume addons-294579
	I0918 16:38:34.906729   12679 cli_runner.go:164] Run: docker run --rm --name addons-294579-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-294579 --entrypoint /usr/bin/test -v addons-294579:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 16:38:41.334082   12679 cli_runner.go:217] Completed: docker run --rm --name addons-294579-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-294579 --entrypoint /usr/bin/test -v addons-294579:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib: (6.427306055s)
	I0918 16:38:41.334111   12679 oci.go:107] Successfully prepared a docker volume addons-294579
	I0918 16:38:41.334151   12679 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:38:41.334176   12679 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 16:38:41.334241   12679 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v addons-294579:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 16:38:45.662240   12679 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v addons-294579:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.327960941s)
	I0918 16:38:45.662267   12679 kic.go:203] duration metric: took 4.32808948s to extract preloaded images to volume ...
	W0918 16:38:45.662363   12679 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 16:38:45.662408   12679 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 16:38:45.662444   12679 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 16:38:45.720627   12679 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-294579 --name addons-294579 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-294579 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-294579 --network addons-294579 --ip 192.168.49.2 --volume addons-294579:/var --security-opt apparmor=unconfined --memory=4096mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 16:38:46.023909   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Running}}
	I0918 16:38:46.043077   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:38:46.061552   12679 cli_runner.go:164] Run: docker exec addons-294579 stat /var/lib/dpkg/alternatives/iptables
	I0918 16:38:46.114276   12679 oci.go:144] the created container "addons-294579" has a running status.
	I0918 16:38:46.114305   12679 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa...
	I0918 16:38:46.544441   12679 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 16:38:46.571475   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:38:46.591787   12679 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0918 16:38:46.591809   12679 kic_runner.go:114] Args: [docker exec --privileged addons-294579 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0918 16:38:46.637351   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:38:46.655874   12679 machine.go:93] provisionDockerMachine start ...
	I0918 16:38:46.655954   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:38:46.674811   12679 main.go:141] libmachine: Using SSH client type: native
	I0918 16:38:46.675136   12679 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32768 <nil> <nil>}
	I0918 16:38:46.675164   12679 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 16:38:46.810466   12679 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-294579
	
	I0918 16:38:46.810494   12679 ubuntu.go:182] provisioning hostname "addons-294579"
	I0918 16:38:46.810578   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:38:46.829308   12679 main.go:141] libmachine: Using SSH client type: native
	I0918 16:38:46.829573   12679 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32768 <nil> <nil>}
	I0918 16:38:46.829593   12679 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-294579 && echo "addons-294579" | sudo tee /etc/hostname
	I0918 16:38:46.979384   12679 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-294579
	
	I0918 16:38:46.979471   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:38:46.997300   12679 main.go:141] libmachine: Using SSH client type: native
	I0918 16:38:46.997496   12679 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32768 <nil> <nil>}
	I0918 16:38:46.997532   12679 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-294579' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-294579/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-294579' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 16:38:47.133004   12679 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 16:38:47.133031   12679 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 16:38:47.133049   12679 ubuntu.go:190] setting up certificates
	I0918 16:38:47.133060   12679 provision.go:84] configureAuth start
	I0918 16:38:47.133114   12679 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-294579
	I0918 16:38:47.150840   12679 provision.go:143] copyHostCerts
	I0918 16:38:47.150905   12679 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 16:38:47.151012   12679 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 16:38:47.151071   12679 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 16:38:47.151132   12679 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.addons-294579 san=[127.0.0.1 192.168.49.2 addons-294579 localhost minikube]
	I0918 16:38:47.179615   12679 provision.go:177] copyRemoteCerts
	I0918 16:38:47.179671   12679 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 16:38:47.179704   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:38:47.197452   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:38:47.293693   12679 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 16:38:47.320064   12679 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 16:38:47.344537   12679 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 16:38:47.368952   12679 provision.go:87] duration metric: took 235.879743ms to configureAuth
	I0918 16:38:47.368977   12679 ubuntu.go:206] setting minikube options for container-runtime
	I0918 16:38:47.369136   12679 config.go:182] Loaded profile config "addons-294579": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:38:47.369226   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:38:47.386459   12679 main.go:141] libmachine: Using SSH client type: native
	I0918 16:38:47.386726   12679 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32768 <nil> <nil>}
	I0918 16:38:47.386747   12679 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 16:38:47.627463   12679 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 16:38:47.627486   12679 machine.go:96] duration metric: took 971.590944ms to provisionDockerMachine
	I0918 16:38:47.627512   12679 client.go:171] duration metric: took 13.708836649s to LocalClient.Create
	I0918 16:38:47.627534   12679 start.go:167] duration metric: took 13.708922477s to libmachine.API.Create "addons-294579"
	I0918 16:38:47.627547   12679 start.go:293] postStartSetup for "addons-294579" (driver="docker")
	I0918 16:38:47.627560   12679 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 16:38:47.627636   12679 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 16:38:47.627682   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:38:47.644994   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:38:47.744579   12679 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 16:38:47.747992   12679 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 16:38:47.748077   12679 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 16:38:47.748097   12679 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 16:38:47.748107   12679 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 16:38:47.748128   12679 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 16:38:47.748199   12679 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 16:38:47.748233   12679 start.go:296] duration metric: took 120.678788ms for postStartSetup
	I0918 16:38:47.748630   12679 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-294579
	I0918 16:38:47.765696   12679 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/config.json ...
	I0918 16:38:47.765978   12679 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:38:47.766025   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:38:47.783807   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:38:47.875634   12679 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 16:38:47.880068   12679 start.go:128] duration metric: took 13.963617857s to createHost
	I0918 16:38:47.880090   12679 start.go:83] releasing machines lock for "addons-294579", held for 13.963737653s
	I0918 16:38:47.880170   12679 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-294579
	I0918 16:38:47.896832   12679 ssh_runner.go:195] Run: cat /version.json
	I0918 16:38:47.896884   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:38:47.896911   12679 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 16:38:47.896963   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:38:47.914656   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:38:47.915583   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:38:48.090835   12679 ssh_runner.go:195] Run: systemctl --version
	I0918 16:38:48.095428   12679 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 16:38:48.236300   12679 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 16:38:48.241517   12679 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:38:48.265589   12679 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 16:38:48.265675   12679 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:38:48.296974   12679 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0918 16:38:48.296996   12679 start.go:495] detecting cgroup driver to use...
	I0918 16:38:48.297038   12679 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 16:38:48.297088   12679 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 16:38:48.312745   12679 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 16:38:48.324779   12679 docker.go:218] disabling cri-docker service (if available) ...
	I0918 16:38:48.324849   12679 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 16:38:48.339019   12679 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 16:38:48.353289   12679 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 16:38:48.418195   12679 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 16:38:48.489158   12679 docker.go:234] disabling docker service ...
	I0918 16:38:48.489218   12679 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 16:38:48.506937   12679 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 16:38:48.519087   12679 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 16:38:48.589515   12679 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 16:38:48.699717   12679 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 16:38:48.711617   12679 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 16:38:48.728537   12679 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 16:38:48.728585   12679 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:38:48.741548   12679 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 16:38:48.741610   12679 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:38:48.751794   12679 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:38:48.761757   12679 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:38:48.772445   12679 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 16:38:48.782443   12679 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:38:48.793325   12679 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:38:48.810262   12679 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:38:48.821037   12679 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 16:38:48.830622   12679 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
	stdout:
	
	stderr:
	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
	I0918 16:38:48.830684   12679 ssh_runner.go:195] Run: sudo modprobe br_netfilter
	I0918 16:38:48.843559   12679 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 16:38:48.852925   12679 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:38:48.954453   12679 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 16:38:49.051862   12679 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 16:38:49.051926   12679 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 16:38:49.055732   12679 start.go:563] Will wait 60s for crictl version
	I0918 16:38:49.055786   12679 ssh_runner.go:195] Run: which crictl
	I0918 16:38:49.059207   12679 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 16:38:49.094588   12679 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 16:38:49.094709   12679 ssh_runner.go:195] Run: crio --version
	I0918 16:38:49.131665   12679 ssh_runner.go:195] Run: crio --version
	I0918 16:38:49.168677   12679 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 16:38:49.170214   12679 cli_runner.go:164] Run: docker network inspect addons-294579 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:38:49.187304   12679 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 16:38:49.191190   12679 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:38:49.202612   12679 kubeadm.go:875] updating cluster {Name:addons-294579 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:addons-294579 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] D
NSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVM
netPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0918 16:38:49.202719   12679 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:38:49.202763   12679 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 16:38:49.270476   12679 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 16:38:49.270516   12679 crio.go:433] Images already preloaded, skipping extraction
	I0918 16:38:49.270576   12679 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 16:38:49.306008   12679 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 16:38:49.306028   12679 cache_images.go:85] Images are preloaded, skipping loading
	I0918 16:38:49.306036   12679 kubeadm.go:926] updating node { 192.168.49.2 8443 v1.34.0 crio true true} ...
	I0918 16:38:49.306113   12679 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=addons-294579 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:addons-294579 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 16:38:49.306179   12679 ssh_runner.go:195] Run: crio config
	I0918 16:38:49.350006   12679 cni.go:84] Creating CNI manager for ""
	I0918 16:38:49.350030   12679 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0918 16:38:49.350042   12679 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0918 16:38:49.350060   12679 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.34.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-294579 NodeName:addons-294579 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernet
es/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0918 16:38:49.350185   12679 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "addons-294579"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.49.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	kubernetesVersion: v1.34.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: systemd
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0918 16:38:49.350244   12679 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 16:38:49.359847   12679 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 16:38:49.359914   12679 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0918 16:38:49.369350   12679 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0918 16:38:49.388353   12679 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 16:38:49.410845   12679 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2209 bytes)
	I0918 16:38:49.430312   12679 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0918 16:38:49.434192   12679 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:38:49.446220   12679 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:38:49.510395   12679 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:38:49.529973   12679 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579 for IP: 192.168.49.2
	I0918 16:38:49.529997   12679 certs.go:194] generating shared ca certs ...
	I0918 16:38:49.530018   12679 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:38:49.530152   12679 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 16:38:49.688877   12679 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt ...
	I0918 16:38:49.688906   12679 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt: {Name:mk34ce32a474804b6f884e768c6db0da87d316d8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:38:49.689119   12679 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key ...
	I0918 16:38:49.689140   12679 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key: {Name:mk9fd67c48fd5f89e6e1445a20dee7fa190595d9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:38:49.689246   12679 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 16:38:50.175205   12679 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt ...
	I0918 16:38:50.175237   12679 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt: {Name:mk5dc8ea2ac54a208ba91318c896f6bb0ebc98ab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:38:50.175433   12679 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key ...
	I0918 16:38:50.175453   12679 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key: {Name:mk533d03e39a1c85c5aeb94a0c4dd87de1d15c00 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:38:50.175582   12679 certs.go:256] generating profile certs ...
	I0918 16:38:50.175666   12679 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.key
	I0918 16:38:50.175686   12679 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt with IP's: []
	I0918 16:38:50.632603   12679 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt ...
	I0918 16:38:50.632632   12679 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: {Name:mkc1336dcdbb00eb371984bbc92be828843a73ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:38:50.632810   12679 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.key ...
	I0918 16:38:50.632828   12679 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.key: {Name:mk48c24d5ea12ed7f5f865fcb3aadd8995158b65 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:38:50.632928   12679 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/apiserver.key.e21332bb
	I0918 16:38:50.632954   12679 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/apiserver.crt.e21332bb with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
	I0918 16:38:50.880341   12679 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/apiserver.crt.e21332bb ...
	I0918 16:38:50.880372   12679 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/apiserver.crt.e21332bb: {Name:mk8d0ae7d0536dd4d1f480cfd3f0360f59f58065 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:38:50.880578   12679 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/apiserver.key.e21332bb ...
	I0918 16:38:50.880596   12679 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/apiserver.key.e21332bb: {Name:mkaac5be34d012fe3527fb506782e2318bd51b2f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:38:50.880694   12679 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/apiserver.crt.e21332bb -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/apiserver.crt
	I0918 16:38:50.880792   12679 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/apiserver.key.e21332bb -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/apiserver.key
	I0918 16:38:50.880860   12679 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/proxy-client.key
	I0918 16:38:50.880885   12679 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/proxy-client.crt with IP's: []
	I0918 16:38:50.960745   12679 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/proxy-client.crt ...
	I0918 16:38:50.960773   12679 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/proxy-client.crt: {Name:mka22d8bf2313053cc00dfd7e6b326ac6d648c7e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:38:50.960972   12679 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/proxy-client.key ...
	I0918 16:38:50.960990   12679 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/proxy-client.key: {Name:mk2a18ca38c56df48acf9f8a5f30917c4ba202a9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:38:50.961213   12679 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 16:38:50.961265   12679 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 16:38:50.961303   12679 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 16:38:50.961332   12679 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 16:38:50.961909   12679 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 16:38:50.987677   12679 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 16:38:51.012284   12679 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 16:38:51.037717   12679 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 16:38:51.062527   12679 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
	I0918 16:38:51.087975   12679 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 16:38:51.113401   12679 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 16:38:51.139554   12679 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0918 16:38:51.166586   12679 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 16:38:51.195937   12679 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0918 16:38:51.213953   12679 ssh_runner.go:195] Run: openssl version
	I0918 16:38:51.219609   12679 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 16:38:51.233020   12679 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:38:51.236647   12679 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:38:51.236704   12679 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:38:51.243652   12679 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 16:38:51.253810   12679 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 16:38:51.257711   12679 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0918 16:38:51.257773   12679 kubeadm.go:392] StartCluster: {Name:addons-294579 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:addons-294579 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSD
omain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnet
Path: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:38:51.257852   12679 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0918 16:38:51.257904   12679 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0918 16:38:51.292977   12679 cri.go:89] found id: ""
	I0918 16:38:51.293062   12679 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0918 16:38:51.302671   12679 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0918 16:38:51.312700   12679 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
	I0918 16:38:51.312754   12679 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0918 16:38:51.322810   12679 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0918 16:38:51.322885   12679 kubeadm.go:157] found existing configuration files:
	
	I0918 16:38:51.322960   12679 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0918 16:38:51.333079   12679 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0918 16:38:51.333133   12679 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0918 16:38:51.342654   12679 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0918 16:38:51.351898   12679 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0918 16:38:51.351948   12679 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0918 16:38:51.361009   12679 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0918 16:38:51.370390   12679 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0918 16:38:51.370456   12679 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0918 16:38:51.379408   12679 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0918 16:38:51.388992   12679 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0918 16:38:51.389050   12679 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0918 16:38:51.398480   12679 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0918 16:38:51.436128   12679 kubeadm.go:310] [init] Using Kubernetes version: v1.34.0
	I0918 16:38:51.436210   12679 kubeadm.go:310] [preflight] Running pre-flight checks
	I0918 16:38:51.454116   12679 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
	I0918 16:38:51.454246   12679 kubeadm.go:310] KERNEL_VERSION: 6.8.0-1037-gcp
	I0918 16:38:51.454310   12679 kubeadm.go:310] OS: Linux
	I0918 16:38:51.454369   12679 kubeadm.go:310] CGROUPS_CPU: enabled
	I0918 16:38:51.454453   12679 kubeadm.go:310] CGROUPS_CPUSET: enabled
	I0918 16:38:51.454549   12679 kubeadm.go:310] CGROUPS_DEVICES: enabled
	I0918 16:38:51.454632   12679 kubeadm.go:310] CGROUPS_FREEZER: enabled
	I0918 16:38:51.454697   12679 kubeadm.go:310] CGROUPS_MEMORY: enabled
	I0918 16:38:51.454770   12679 kubeadm.go:310] CGROUPS_PIDS: enabled
	I0918 16:38:51.454849   12679 kubeadm.go:310] CGROUPS_HUGETLB: enabled
	I0918 16:38:51.454920   12679 kubeadm.go:310] CGROUPS_IO: enabled
	I0918 16:38:51.505548   12679 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0918 16:38:51.505678   12679 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0918 16:38:51.505831   12679 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
	I0918 16:38:51.511748   12679 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0918 16:38:51.515321   12679 out.go:252]   - Generating certificates and keys ...
	I0918 16:38:51.515436   12679 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0918 16:38:51.515549   12679 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0918 16:38:51.570273   12679 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0918 16:38:51.672821   12679 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
	I0918 16:38:51.791059   12679 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
	I0918 16:38:52.760656   12679 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
	I0918 16:38:52.981818   12679 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
	I0918 16:38:52.981961   12679 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-294579 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0918 16:38:53.167805   12679 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
	I0918 16:38:53.167947   12679 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-294579 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0918 16:38:53.439667   12679 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0918 16:38:53.582833   12679 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
	I0918 16:38:53.712443   12679 kubeadm.go:310] [certs] Generating "sa" key and public key
	I0918 16:38:53.712586   12679 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0918 16:38:54.085244   12679 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0918 16:38:54.248103   12679 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
	I0918 16:38:54.404319   12679 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0918 16:38:54.611748   12679 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0918 16:38:54.810181   12679 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0918 16:38:54.810645   12679 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0918 16:38:54.815442   12679 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0918 16:38:54.818866   12679 out.go:252]   - Booting up control plane ...
	I0918 16:38:54.818973   12679 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0918 16:38:54.819040   12679 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0918 16:38:54.819117   12679 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0918 16:38:54.841316   12679 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0918 16:38:54.841480   12679 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
	I0918 16:38:54.847750   12679 kubeadm.go:310] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
	I0918 16:38:54.847946   12679 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0918 16:38:54.848000   12679 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0918 16:38:54.926175   12679 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
	I0918 16:38:54.926340   12679 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
	I0918 16:38:55.427675   12679 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 501.588868ms
	I0918 16:38:55.430413   12679 kubeadm.go:310] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
	I0918 16:38:55.430556   12679 kubeadm.go:310] [control-plane-check] Checking kube-apiserver at https://192.168.49.2:8443/livez
	I0918 16:38:55.430649   12679 kubeadm.go:310] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
	I0918 16:38:55.430730   12679 kubeadm.go:310] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
	I0918 16:38:57.595794   12679 kubeadm.go:310] [control-plane-check] kube-scheduler is healthy after 2.165202821s
	I0918 16:38:57.644814   12679 kubeadm.go:310] [control-plane-check] kube-controller-manager is healthy after 2.214225342s
	I0918 16:38:59.431945   12679 kubeadm.go:310] [control-plane-check] kube-apiserver is healthy after 4.001339768s
	I0918 16:38:59.443479   12679 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0918 16:38:59.454010   12679 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0918 16:38:59.462577   12679 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0918 16:38:59.462838   12679 kubeadm.go:310] [mark-control-plane] Marking the node addons-294579 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0918 16:38:59.471065   12679 kubeadm.go:310] [bootstrap-token] Using token: cm9ip6.kn8mt5vzy1a9ku96
	I0918 16:38:59.472602   12679 out.go:252]   - Configuring RBAC rules ...
	I0918 16:38:59.472768   12679 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0918 16:38:59.476212   12679 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0918 16:38:59.481428   12679 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0918 16:38:59.483742   12679 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0918 16:38:59.486179   12679 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0918 16:38:59.490865   12679 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0918 16:38:59.838338   12679 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0918 16:39:00.252990   12679 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0918 16:39:00.837781   12679 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0918 16:39:00.838537   12679 kubeadm.go:310] 
	I0918 16:39:00.838652   12679 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0918 16:39:00.838672   12679 kubeadm.go:310] 
	I0918 16:39:00.838767   12679 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0918 16:39:00.838778   12679 kubeadm.go:310] 
	I0918 16:39:00.838812   12679 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0918 16:39:00.838918   12679 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0918 16:39:00.838999   12679 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0918 16:39:00.839012   12679 kubeadm.go:310] 
	I0918 16:39:00.839113   12679 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0918 16:39:00.839128   12679 kubeadm.go:310] 
	I0918 16:39:00.839199   12679 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0918 16:39:00.839207   12679 kubeadm.go:310] 
	I0918 16:39:00.839284   12679 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0918 16:39:00.839388   12679 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0918 16:39:00.839482   12679 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0918 16:39:00.839516   12679 kubeadm.go:310] 
	I0918 16:39:00.839640   12679 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0918 16:39:00.839755   12679 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0918 16:39:00.839778   12679 kubeadm.go:310] 
	I0918 16:39:00.839901   12679 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token cm9ip6.kn8mt5vzy1a9ku96 \
	I0918 16:39:00.840001   12679 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 \
	I0918 16:39:00.840028   12679 kubeadm.go:310] 	--control-plane 
	I0918 16:39:00.840035   12679 kubeadm.go:310] 
	I0918 16:39:00.840125   12679 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0918 16:39:00.840135   12679 kubeadm.go:310] 
	I0918 16:39:00.840247   12679 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token cm9ip6.kn8mt5vzy1a9ku96 \
	I0918 16:39:00.840370   12679 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 
	I0918 16:39:00.842232   12679 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1037-gcp\n", err: exit status 1
	I0918 16:39:00.842329   12679 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0918 16:39:00.842352   12679 cni.go:84] Creating CNI manager for ""
	I0918 16:39:00.842361   12679 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0918 16:39:00.845016   12679 out.go:179] * Configuring CNI (Container Networking Interface) ...
	I0918 16:39:00.846485   12679 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0918 16:39:00.850672   12679 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.0/kubectl ...
	I0918 16:39:00.850687   12679 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
	I0918 16:39:00.869203   12679 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0918 16:39:01.087138   12679 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0918 16:39:01.087216   12679 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:39:01.087263   12679 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-294579 minikube.k8s.io/updated_at=2025_09_18T16_39_01_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596 minikube.k8s.io/name=addons-294579 minikube.k8s.io/primary=true
	I0918 16:39:01.097218   12679 ops.go:34] apiserver oom_adj: -16
	I0918 16:39:01.167821   12679 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:39:01.668278   12679 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:39:02.167858   12679 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:39:02.668729   12679 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:39:03.168383   12679 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:39:03.668091   12679 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:39:04.168849   12679 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:39:04.667948   12679 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:39:05.168602   12679 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:39:05.229290   12679 kubeadm.go:1105] duration metric: took 4.142137066s to wait for elevateKubeSystemPrivileges
	I0918 16:39:05.229337   12679 kubeadm.go:394] duration metric: took 13.971568296s to StartCluster
	I0918 16:39:05.229362   12679 settings.go:142] acquiring lock: {Name:mk72fea03aefe901db9522a467405d86665fedd0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:39:05.229467   12679 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 16:39:05.229898   12679 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:39:05.230086   12679 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0918 16:39:05.230107   12679 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:39:05.230182   12679 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:true auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:true storage-provisioner:true storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
	I0918 16:39:05.230302   12679 addons.go:69] Setting yakd=true in profile "addons-294579"
	I0918 16:39:05.230316   12679 addons.go:69] Setting inspektor-gadget=true in profile "addons-294579"
	I0918 16:39:05.230330   12679 addons.go:238] Setting addon yakd=true in "addons-294579"
	I0918 16:39:05.230338   12679 addons.go:238] Setting addon inspektor-gadget=true in "addons-294579"
	I0918 16:39:05.230374   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.230386   12679 addons.go:69] Setting storage-provisioner=true in profile "addons-294579"
	I0918 16:39:05.230369   12679 addons.go:69] Setting default-storageclass=true in profile "addons-294579"
	I0918 16:39:05.230411   12679 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-294579"
	I0918 16:39:05.230425   12679 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-294579"
	I0918 16:39:05.230429   12679 config.go:182] Loaded profile config "addons-294579": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:39:05.230443   12679 addons.go:69] Setting amd-gpu-device-plugin=true in profile "addons-294579"
	I0918 16:39:05.230455   12679 addons.go:238] Setting addon amd-gpu-device-plugin=true in "addons-294579"
	I0918 16:39:05.230464   12679 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-294579"
	I0918 16:39:05.230434   12679 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-294579"
	I0918 16:39:05.230484   12679 addons.go:69] Setting metrics-server=true in profile "addons-294579"
	I0918 16:39:05.230496   12679 addons.go:238] Setting addon metrics-server=true in "addons-294579"
	I0918 16:39:05.230484   12679 addons.go:69] Setting registry-creds=true in profile "addons-294579"
	I0918 16:39:05.230533   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.230534   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.230546   12679 addons.go:238] Setting addon registry-creds=true in "addons-294579"
	I0918 16:39:05.230402   12679 addons.go:238] Setting addon storage-provisioner=true in "addons-294579"
	I0918 16:39:05.230858   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.230891   12679 addons.go:69] Setting registry=true in profile "addons-294579"
	I0918 16:39:05.230917   12679 addons.go:238] Setting addon registry=true in "addons-294579"
	I0918 16:39:05.230949   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.230479   12679 addons.go:238] Setting addon nvidia-device-plugin=true in "addons-294579"
	I0918 16:39:05.231248   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.231448   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.231657   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.231669   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.231817   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.232042   12679 addons.go:69] Setting volcano=true in profile "addons-294579"
	I0918 16:39:05.232222   12679 addons.go:238] Setting addon volcano=true in "addons-294579"
	I0918 16:39:05.232311   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.233046   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.233665   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.233711   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.234627   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.232262   12679 addons.go:69] Setting volumesnapshots=true in profile "addons-294579"
	I0918 16:39:05.234734   12679 addons.go:238] Setting addon volumesnapshots=true in "addons-294579"
	I0918 16:39:05.234811   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.231205   12679 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-294579"
	I0918 16:39:05.235151   12679 addons.go:238] Setting addon csi-hostpath-driver=true in "addons-294579"
	I0918 16:39:05.235300   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.235410   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.230375   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.236428   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.236517   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.237567   12679 out.go:179] * Verifying Kubernetes components...
	I0918 16:39:05.237682   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.232433   12679 addons.go:69] Setting gcp-auth=true in profile "addons-294579"
	I0918 16:39:05.237847   12679 mustload.go:65] Loading cluster: addons-294579
	I0918 16:39:05.232445   12679 addons.go:69] Setting ingress=true in profile "addons-294579"
	I0918 16:39:05.237917   12679 addons.go:238] Setting addon ingress=true in "addons-294579"
	I0918 16:39:05.237956   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.232464   12679 addons.go:69] Setting ingress-dns=true in profile "addons-294579"
	I0918 16:39:05.238085   12679 addons.go:238] Setting addon ingress-dns=true in "addons-294579"
	I0918 16:39:05.238110   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.232888   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.239291   12679 config.go:182] Loaded profile config "addons-294579": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:39:05.239492   12679 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:39:05.239612   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.240074   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.240256   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.240336   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.231184   12679 addons.go:69] Setting cloud-spanner=true in profile "addons-294579"
	I0918 16:39:05.244624   12679 addons.go:238] Setting addon cloud-spanner=true in "addons-294579"
	I0918 16:39:05.244675   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.245448   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.295172   12679 out.go:179]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.8.0
	I0918 16:39:05.296615   12679 out.go:179]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.17.3
	I0918 16:39:05.296791   12679 addons.go:435] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0918 16:39:05.296804   12679 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0918 16:39:05.296874   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:05.296964   12679 out.go:179]   - Using image docker.io/upmcenterprises/registry-creds:1.10
	I0918 16:39:05.298716   12679 addons.go:435] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0918 16:39:05.298734   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
	I0918 16:39:05.298789   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:05.299878   12679 out.go:179]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I0918 16:39:05.303662   12679 addons.go:435] installing /etc/kubernetes/addons/registry-creds-rc.yaml
	I0918 16:39:05.303681   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-creds-rc.yaml (3306 bytes)
	I0918 16:39:05.303743   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:05.303988   12679 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I0918 16:39:05.304003   12679 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I0918 16:39:05.304061   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:05.310772   12679 out.go:179]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.44.1
	I0918 16:39:05.311242   12679 addons.go:238] Setting addon default-storageclass=true in "addons-294579"
	I0918 16:39:05.311285   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.312273   12679 addons.go:435] installing /etc/kubernetes/addons/ig-crd.yaml
	I0918 16:39:05.312293   12679 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (14 bytes)
	I0918 16:39:05.312366   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:05.314623   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.318515   12679 out.go:179]   - Using image registry.k8s.io/ingress-nginx/controller:v1.13.2
	I0918 16:39:05.320013   12679 out.go:179]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.6.2
	I0918 16:39:05.321494   12679 out.go:179]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.6.2
	I0918 16:39:05.326700   12679 addons.go:435] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I0918 16:39:05.326721   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
	I0918 16:39:05.326784   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:05.330405   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.334592   12679 out.go:179]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	W0918 16:39:05.336737   12679 out.go:285] ! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]
	I0918 16:39:05.339254   12679 out.go:179]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I0918 16:39:05.339390   12679 out.go:179]   - Using image docker.io/marcnuri/yakd:0.0.5
	I0918 16:39:05.340393   12679 addons.go:435] installing /etc/kubernetes/addons/yakd-ns.yaml
	I0918 16:39:05.340413   12679 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
	I0918 16:39:05.340474   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:05.344864   12679 out.go:179]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.9
	I0918 16:39:05.345035   12679 out.go:179]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I0918 16:39:05.346409   12679 out.go:179]   - Using image docker.io/registry:3.0.0
	I0918 16:39:05.350172   12679 out.go:179]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I0918 16:39:05.350320   12679 addons.go:435] installing /etc/kubernetes/addons/registry-rc.yaml
	I0918 16:39:05.350332   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
	I0918 16:39:05.350394   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:05.352866   12679 out.go:179]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I0918 16:39:05.352910   12679 out.go:179]   - Using image docker.io/kicbase/minikube-ingress-dns:0.0.4
	I0918 16:39:05.358749   12679 out.go:179]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I0918 16:39:05.359199   12679 addons.go:435] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0918 16:39:05.359219   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2889 bytes)
	I0918 16:39:05.359279   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:05.361593   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:05.363107   12679 out.go:179]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0918 16:39:05.363679   12679 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
	I0918 16:39:05.363700   12679 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0918 16:39:05.363750   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:05.364320   12679 out.go:179]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I0918 16:39:05.364629   12679 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 16:39:05.364650   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0918 16:39:05.364712   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:05.365467   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:05.368329   12679 out.go:179]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I0918 16:39:05.368392   12679 out.go:179]   - Using image docker.io/rocm/k8s-device-plugin:1.25.2.8
	I0918 16:39:05.370085   12679 addons.go:435] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I0918 16:39:05.370105   12679 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I0918 16:39:05.370156   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:05.370458   12679 addons.go:435] installing /etc/kubernetes/addons/amd-gpu-device-plugin.yaml
	I0918 16:39:05.370472   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/amd-gpu-device-plugin.yaml (1868 bytes)
	I0918 16:39:05.370535   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:05.370869   12679 addons.go:238] Setting addon storage-provisioner-rancher=true in "addons-294579"
	I0918 16:39:05.370650   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:05.372119   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:05.372659   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:05.376090   12679 out.go:179]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.41
	I0918 16:39:05.377402   12679 addons.go:435] installing /etc/kubernetes/addons/deployment.yaml
	I0918 16:39:05.377426   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
	I0918 16:39:05.377478   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:05.394826   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:05.396619   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:05.404587   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:05.405746   12679 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0918 16:39:05.406061   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:05.413162   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:05.415363   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:05.417897   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:05.430294   12679 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:39:05.436463   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:05.437754   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:05.441670   12679 out.go:179]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22
	I0918 16:39:05.442590   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:05.444755   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:05.444985   12679 out.go:179]   - Using image docker.io/busybox:stable
	I0918 16:39:05.446319   12679 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0918 16:39:05.446343   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
	I0918 16:39:05.446399   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:05.479374   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:05.541859   12679 addons.go:435] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I0918 16:39:05.541905   12679 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I0918 16:39:05.550062   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/registry-creds-rc.yaml
	I0918 16:39:05.550868   12679 addons.go:435] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0918 16:39:05.550889   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I0918 16:39:05.566875   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0918 16:39:05.566991   12679 addons.go:435] installing /etc/kubernetes/addons/yakd-sa.yaml
	I0918 16:39:05.567008   12679 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
	I0918 16:39:05.579440   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I0918 16:39:05.580351   12679 addons.go:435] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I0918 16:39:05.580382   12679 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I0918 16:39:05.589517   12679 addons.go:435] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I0918 16:39:05.589541   12679 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I0918 16:39:05.597055   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0918 16:39:05.598632   12679 addons.go:435] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0918 16:39:05.598654   12679 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0918 16:39:05.611199   12679 addons.go:435] installing /etc/kubernetes/addons/ig-deployment.yaml
	I0918 16:39:05.611229   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-deployment.yaml (15034 bytes)
	I0918 16:39:05.624372   12679 addons.go:435] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I0918 16:39:05.624402   12679 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I0918 16:39:05.629263   12679 addons.go:435] installing /etc/kubernetes/addons/registry-svc.yaml
	I0918 16:39:05.629290   12679 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I0918 16:39:05.629826   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0918 16:39:05.631463   12679 addons.go:435] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I0918 16:39:05.631491   12679 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I0918 16:39:05.631618   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 16:39:05.638906   12679 addons.go:435] installing /etc/kubernetes/addons/yakd-crb.yaml
	I0918 16:39:05.638929   12679 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
	I0918 16:39:05.639486   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/amd-gpu-device-plugin.yaml
	I0918 16:39:05.650335   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I0918 16:39:05.655174   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0918 16:39:05.678016   12679 addons.go:435] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0918 16:39:05.678050   12679 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0918 16:39:05.684408   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
	I0918 16:39:05.704006   12679 addons.go:435] installing /etc/kubernetes/addons/registry-proxy.yaml
	I0918 16:39:05.704029   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I0918 16:39:05.705552   12679 addons.go:435] installing /etc/kubernetes/addons/yakd-svc.yaml
	I0918 16:39:05.705577   12679 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
	I0918 16:39:05.718974   12679 addons.go:435] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I0918 16:39:05.719003   12679 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I0918 16:39:05.723627   12679 addons.go:435] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I0918 16:39:05.723648   12679 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I0918 16:39:05.773182   12679 addons.go:435] installing /etc/kubernetes/addons/yakd-dp.yaml
	I0918 16:39:05.773202   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
	I0918 16:39:05.780888   12679 node_ready.go:35] waiting up to 6m0s for node "addons-294579" to be "Ready" ...
	I0918 16:39:05.781333   12679 start.go:976] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0918 16:39:05.781407   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I0918 16:39:05.781372   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0918 16:39:05.796389   12679 addons.go:435] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0918 16:39:05.796410   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I0918 16:39:05.803915   12679 addons.go:435] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I0918 16:39:05.803941   12679 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I0918 16:39:05.852776   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
	I0918 16:39:05.881776   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0918 16:39:05.901896   12679 addons.go:435] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I0918 16:39:05.901995   12679 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I0918 16:39:05.998068   12679 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I0918 16:39:05.998090   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I0918 16:39:06.048739   12679 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I0918 16:39:06.048778   12679 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I0918 16:39:06.112103   12679 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I0918 16:39:06.112126   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I0918 16:39:06.183113   12679 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I0918 16:39:06.183135   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I0918 16:39:06.274587   12679 addons.go:435] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0918 16:39:06.274681   12679 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I0918 16:39:06.291180   12679 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-294579" context rescaled to 1 replicas
	I0918 16:39:06.309383   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0918 16:39:06.771853   12679 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (1.192370258s)
	I0918 16:39:06.771892   12679 addons.go:479] Verifying addon ingress=true in "addons-294579"
	I0918 16:39:06.771910   12679 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.174815095s)
	I0918 16:39:06.772021   12679 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.140390159s)
	I0918 16:39:06.771966   12679 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (1.142111849s)
	I0918 16:39:06.772087   12679 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/amd-gpu-device-plugin.yaml: (1.132522681s)
	I0918 16:39:06.772125   12679 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (1.121757336s)
	I0918 16:39:06.772229   12679 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (1.117027557s)
	I0918 16:39:06.772322   12679 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: (1.087886492s)
	W0918 16:39:06.772353   12679 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget created
	serviceaccount/gadget created
	configmap/gadget created
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role created
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding created
	role.rbac.authorization.k8s.io/gadget-role created
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding created
	daemonset.apps/gadget created
	
	stderr:
	Warning: spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/gadget]: deprecated since v1.30; use the "appArmorProfile" field instead
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:06.772384   12679 retry.go:31] will retry after 289.196507ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget created
	serviceaccount/gadget created
	configmap/gadget created
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role created
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding created
	role.rbac.authorization.k8s.io/gadget-role created
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding created
	daemonset.apps/gadget created
	
	stderr:
	Warning: spec.template.metadata.annotations[container.apparmor.security.beta.kubernetes.io/gadget]: deprecated since v1.30; use the "appArmorProfile" field instead
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:06.772395   12679 addons.go:479] Verifying addon metrics-server=true in "addons-294579"
	I0918 16:39:06.772427   12679 addons.go:479] Verifying addon registry=true in "addons-294579"
	I0918 16:39:06.774923   12679 out.go:179] * Verifying registry addon...
	I0918 16:39:06.775014   12679 out.go:179] * Verifying ingress addon...
	I0918 16:39:06.775039   12679 out.go:179] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
	
		minikube -p addons-294579 service yakd-dashboard -n yakd-dashboard
	
	I0918 16:39:06.778901   12679 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I0918 16:39:06.778912   12679 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	W0918 16:39:06.780181   12679 out.go:285] ! Enabling 'storage-provisioner-rancher' returned an error: running callbacks: [Error making local-path the default storage class: Error while marking storage class local-path as default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
	I0918 16:39:06.782643   12679 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=registry
	I0918 16:39:06.782664   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:06.782982   12679 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I0918 16:39:06.782994   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:07.062192   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
	I0918 16:39:07.290930   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:07.291074   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:07.305916   12679 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.423973104s)
	W0918 16:39:07.305968   12679 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	Warning: unrecognized format "int64"
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0918 16:39:07.305993   12679 retry.go:31] will retry after 272.333179ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	Warning: unrecognized format "int64"
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0918 16:39:07.306209   12679 addons.go:479] Verifying addon csi-hostpath-driver=true in "addons-294579"
	I0918 16:39:07.308222   12679 out.go:179] * Verifying csi-hostpath-driver addon...
	I0918 16:39:07.310543   12679 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I0918 16:39:07.315851   12679 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0918 16:39:07.315885   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:07.578604   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	W0918 16:39:07.689797   12679 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:07.689832   12679 retry.go:31] will retry after 504.967392ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:07.782649   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:07.782765   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0918 16:39:07.784163   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:07.814313   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:08.195270   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
	I0918 16:39:08.282624   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:08.282798   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:08.313870   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:08.782674   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:08.782841   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:08.814566   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:09.282530   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:09.282799   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:09.313470   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:09.782178   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:09.782235   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:09.813613   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:10.084149   12679 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.505504512s)
	I0918 16:39:10.084237   12679 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: (1.888933672s)
	W0918 16:39:10.084283   12679 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:10.084311   12679 retry.go:31] will retry after 285.334007ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:10.282090   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:10.282391   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0918 16:39:10.283454   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:10.314021   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:10.370478   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
	I0918 16:39:10.782809   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:10.783227   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:10.813227   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	W0918 16:39:10.906791   12679 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:10.906824   12679 retry.go:31] will retry after 781.666048ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:11.282558   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:11.282831   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:11.313861   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:11.688639   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
	I0918 16:39:11.782953   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:11.783063   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:11.813714   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	W0918 16:39:12.234163   12679 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:12.234189   12679 retry.go:31] will retry after 1.82508003s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:12.282093   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:12.282274   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0918 16:39:12.283604   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:12.313168   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:12.782555   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:12.782735   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:12.813538   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:12.937241   12679 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I0918 16:39:12.937304   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:12.958694   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:13.067898   12679 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I0918 16:39:13.087484   12679 addons.go:238] Setting addon gcp-auth=true in "addons-294579"
	I0918 16:39:13.087552   12679 host.go:66] Checking if "addons-294579" exists ...
	I0918 16:39:13.087900   12679 cli_runner.go:164] Run: docker container inspect addons-294579 --format={{.State.Status}}
	I0918 16:39:13.106603   12679 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I0918 16:39:13.106645   12679 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-294579
	I0918 16:39:13.125578   12679 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/addons-294579/id_rsa Username:docker}
	I0918 16:39:13.220588   12679 out.go:179]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.6.2
	I0918 16:39:13.222019   12679 out.go:179]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.3
	I0918 16:39:13.223341   12679 addons.go:435] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I0918 16:39:13.223360   12679 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I0918 16:39:13.242706   12679 addons.go:435] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I0918 16:39:13.242750   12679 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I0918 16:39:13.261688   12679 addons.go:435] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0918 16:39:13.261710   12679 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
	I0918 16:39:13.280084   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0918 16:39:13.282467   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:13.282541   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:13.313676   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:13.585637   12679 addons.go:479] Verifying addon gcp-auth=true in "addons-294579"
	I0918 16:39:13.587648   12679 out.go:179] * Verifying gcp-auth addon...
	I0918 16:39:13.589666   12679 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I0918 16:39:13.592040   12679 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0918 16:39:13.592057   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:13.781808   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:13.781924   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:13.813526   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:14.059709   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
	I0918 16:39:14.095636   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:14.282059   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:14.282276   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:14.314423   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:14.593100   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	W0918 16:39:14.596231   12679 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:14.596263   12679 retry.go:31] will retry after 1.108008122s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:14.782136   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:14.782147   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	W0918 16:39:14.783928   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:14.813551   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:15.093099   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:15.281939   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:15.281942   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:15.313291   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:15.592840   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:15.705015   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
	I0918 16:39:15.782081   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:15.782288   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:15.813213   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:16.093200   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	W0918 16:39:16.240831   12679 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:16.240863   12679 retry.go:31] will retry after 2.884310446s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:16.282873   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:16.283092   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:16.313722   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:16.592360   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:16.781873   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:16.782037   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:16.814032   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:17.093245   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:17.281817   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:17.282020   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0918 16:39:17.283489   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:17.314326   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:17.593151   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:17.781624   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:17.781848   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:17.814077   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:18.093192   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:18.282016   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:18.282264   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:18.314230   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:18.592657   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:18.782137   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:18.782279   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:18.813416   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:19.093115   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:19.126262   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
	I0918 16:39:19.282759   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:19.282862   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0918 16:39:19.284169   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:19.313722   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:19.593128   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	W0918 16:39:19.659444   12679 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:19.659485   12679 retry.go:31] will retry after 6.123375003s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:19.782088   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:19.782183   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:19.813397   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:20.093645   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:20.282196   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:20.282246   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:20.313305   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:20.592981   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:20.782126   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:20.782318   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:20.814061   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:21.093134   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:21.281762   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:21.281794   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:21.314647   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:21.592366   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:21.782137   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:21.782212   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0918 16:39:21.783623   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:21.813352   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:22.093713   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:22.282611   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:22.282778   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:22.313643   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:22.592766   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:22.782911   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:22.783148   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:22.813661   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:23.092088   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:23.281909   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:23.282012   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:23.313491   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:23.593181   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:23.781824   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:23.782010   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:23.813180   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:24.093215   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:24.281942   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:24.282119   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0918 16:39:24.283551   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:24.314063   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:24.592743   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:24.782580   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:24.782593   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:24.813429   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:25.093355   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:25.282082   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:25.282270   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:25.313301   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:25.593257   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:25.781945   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:25.782161   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:25.783813   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
	I0918 16:39:25.813725   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:26.093836   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:26.281308   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:26.281534   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:26.313789   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	W0918 16:39:26.325863   12679 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:26.325891   12679 retry.go:31] will retry after 8.480370135s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:26.595858   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:26.781600   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:26.781789   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0918 16:39:26.783325   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:26.813982   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:27.093022   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:27.281649   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:27.281811   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:27.314167   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:27.592966   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:27.781690   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:27.781936   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:27.813877   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:28.093243   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:28.281726   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:28.281926   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:28.314149   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:28.593102   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:28.781984   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:28.782021   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0918 16:39:28.783531   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:28.814234   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:29.093319   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:29.282461   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:29.282551   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:29.313133   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:29.592958   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:29.781416   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:29.781570   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:29.814152   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:30.093465   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:30.282158   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:30.282401   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:30.313757   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:30.592371   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:30.782615   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:30.782666   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0918 16:39:30.784051   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:30.813787   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:31.092921   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:31.282661   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:31.282884   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:31.313990   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:31.592855   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:31.781768   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:31.782001   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:31.814557   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:32.093314   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:32.282044   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:32.282068   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:32.313300   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:32.592861   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:32.781619   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:32.781662   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:32.813982   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:33.092738   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:33.282573   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:33.282691   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0918 16:39:33.282991   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:33.313795   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:33.592703   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:33.782598   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:33.782643   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:33.813762   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:34.092364   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:34.282135   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:34.282719   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:34.314046   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:34.592767   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:34.782768   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:34.782860   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:34.806542   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
	I0918 16:39:34.813751   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:35.092718   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:35.281926   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:35.282061   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0918 16:39:35.283746   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:35.314415   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	W0918 16:39:35.345925   12679 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:35.345958   12679 retry.go:31] will retry after 13.381500898s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:35.592930   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:35.781759   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:35.781882   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:35.813114   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:36.093078   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:36.281884   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:36.282068   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:36.313261   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:36.593025   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:36.781706   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:36.781853   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:36.814127   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:37.093460   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:37.282449   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:37.282540   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0918 16:39:37.284232   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:37.313766   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:37.592523   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:37.782073   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:37.782134   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:37.813020   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:38.092859   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:38.282403   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:38.282611   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:38.313423   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:38.593521   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:38.782259   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:38.782320   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:38.813772   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:39.092340   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:39.282146   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:39.282336   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:39.313200   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:39.593001   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:39.781559   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:39.781782   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0918 16:39:39.783320   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:39.813854   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:40.092365   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:40.282009   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:40.282146   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:40.313418   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:40.593290   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:40.782525   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:40.782657   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:40.813978   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:41.092988   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:41.281603   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:41.281877   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:41.313792   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:41.592547   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:41.782441   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:41.782523   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	W0918 16:39:41.783976   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:41.813602   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:42.092252   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:42.281782   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:42.282004   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:42.314252   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:42.593340   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:42.782404   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:42.782626   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:42.813754   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:43.093321   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:43.282112   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:43.282184   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:43.313231   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:43.592807   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:43.782465   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:43.782668   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:43.813562   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:44.092392   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:44.281987   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:44.282160   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0918 16:39:44.283575   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:44.313137   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:44.592751   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:44.782636   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:44.782846   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:44.813784   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:45.092671   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:45.282085   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:45.282116   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:45.313518   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:45.592439   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:45.782696   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:45.782739   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:45.813878   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:46.092664   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:46.282345   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:46.282513   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:46.313443   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:46.593078   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:46.781571   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:46.781774   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	W0918 16:39:46.783338   12679 node_ready.go:57] node "addons-294579" has "Ready":"False" status (will retry)
	I0918 16:39:46.814255   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:47.092830   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:47.282558   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:47.282636   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:47.313611   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:47.592428   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:47.782079   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:47.782236   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:47.813579   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:48.093234   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:48.281830   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:48.282036   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:48.314032   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:48.592635   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:48.727765   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
	I0918 16:39:48.782200   12679 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I0918 16:39:48.782222   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:48.782349   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:48.782969   12679 node_ready.go:49] node "addons-294579" is "Ready"
	I0918 16:39:48.782992   12679 node_ready.go:38] duration metric: took 43.002071153s for node "addons-294579" to be "Ready" ...
	I0918 16:39:48.783006   12679 api_server.go:52] waiting for apiserver process to appear ...
	I0918 16:39:48.783049   12679 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 16:39:48.819970   12679 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0918 16:39:48.820005   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:49.093493   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:49.283547   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:49.283684   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:49.384431   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	W0918 16:39:49.396967   12679 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:49.397000   12679 retry.go:31] will retry after 19.418333546s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:39:49.397080   12679 api_server.go:72] duration metric: took 44.166944986s to wait for apiserver process to appear ...
	I0918 16:39:49.397102   12679 api_server.go:88] waiting for apiserver healthz status ...
	I0918 16:39:49.397117   12679 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0918 16:39:49.402471   12679 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0918 16:39:49.403391   12679 api_server.go:141] control plane version: v1.34.0
	I0918 16:39:49.403409   12679 api_server.go:131] duration metric: took 6.302ms to wait for apiserver health ...
	I0918 16:39:49.403417   12679 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 16:39:49.406563   12679 system_pods.go:59] 20 kube-system pods found
	I0918 16:39:49.406593   12679 system_pods.go:61] "amd-gpu-device-plugin-zl2hz" [82885ec9-ef4a-448f-8993-c59a1da8720e] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
	I0918 16:39:49.406600   12679 system_pods.go:61] "coredns-66bc5c9577-f6kjd" [0d930e37-c687-4048-b869-56796c1238d8] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 16:39:49.406608   12679 system_pods.go:61] "csi-hostpath-attacher-0" [23d081e3-c247-4985-b14c-184de1ced508] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0918 16:39:49.406613   12679 system_pods.go:61] "csi-hostpath-resizer-0" [ce0a6fc1-0743-4772-800f-f90626324f3f] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0918 16:39:49.406623   12679 system_pods.go:61] "csi-hostpathplugin-knfhb" [a9aeccf6-daf5-427e-847d-156e6332b043] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0918 16:39:49.406627   12679 system_pods.go:61] "etcd-addons-294579" [a728f7a0-58b0-44ba-aada-36b84af390ba] Running
	I0918 16:39:49.406630   12679 system_pods.go:61] "kindnet-7swk5" [a225fb86-4203-40f5-b42f-31cd59c2ccfd] Running
	I0918 16:39:49.406634   12679 system_pods.go:61] "kube-apiserver-addons-294579" [c7696c06-d293-4960-a4dc-d2867cc9fb3e] Running
	I0918 16:39:49.406643   12679 system_pods.go:61] "kube-controller-manager-addons-294579" [1d6c899e-bd1e-4ec4-aca0-c23a3ba2c090] Running
	I0918 16:39:49.406651   12679 system_pods.go:61] "kube-ingress-dns-minikube" [c28f422b-e8e4-4753-a6f3-adc52fa2b569] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0918 16:39:49.406654   12679 system_pods.go:61] "kube-proxy-p2c4p" [32ab80c6-ecb6-4232-a8d7-5b603be592b2] Running
	I0918 16:39:49.406658   12679 system_pods.go:61] "kube-scheduler-addons-294579" [9fea194f-dbeb-40a5-b07b-56e6e9ae51cf] Running
	I0918 16:39:49.406663   12679 system_pods.go:61] "metrics-server-85b7d694d7-v5wc5" [8478dbc1-e162-487c-840a-8aaf78d27e7f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0918 16:39:49.406671   12679 system_pods.go:61] "nvidia-device-plugin-daemonset-v5mmk" [ed85f4e8-a497-4873-bd68-46c7aeac578a] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
	I0918 16:39:49.406679   12679 system_pods.go:61] "registry-66898fdd98-smmbw" [09f9a63e-d06a-4049-a31e-60537f65d737] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0918 16:39:49.406688   12679 system_pods.go:61] "registry-creds-764b6fb674-rrbb5" [30f0bcbf-4fb9-4268-9ed4-197e73de8723] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
	I0918 16:39:49.406693   12679 system_pods.go:61] "registry-proxy-ksqpq" [04fa5c90-d967-43b0-80a3-6906c0905306] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0918 16:39:49.406701   12679 system_pods.go:61] "snapshot-controller-7d9fbc56b8-kvtht" [4ae9e795-1ada-48fb-870c-7c31a9dea070] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0918 16:39:49.406710   12679 system_pods.go:61] "snapshot-controller-7d9fbc56b8-ttvhz" [41a7f275-bf8b-4430-972f-ec7abe94b02b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0918 16:39:49.406716   12679 system_pods.go:61] "storage-provisioner" [7e7a4937-699e-44fb-b11d-488e3d9dad71] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
	I0918 16:39:49.406723   12679 system_pods.go:74] duration metric: took 3.302182ms to wait for pod list to return data ...
	I0918 16:39:49.406734   12679 default_sa.go:34] waiting for default service account to be created ...
	I0918 16:39:49.408796   12679 default_sa.go:45] found service account: "default"
	I0918 16:39:49.408811   12679 default_sa.go:55] duration metric: took 2.072668ms for default service account to be created ...
	I0918 16:39:49.408819   12679 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 16:39:49.411851   12679 system_pods.go:86] 20 kube-system pods found
	I0918 16:39:49.411876   12679 system_pods.go:89] "amd-gpu-device-plugin-zl2hz" [82885ec9-ef4a-448f-8993-c59a1da8720e] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
	I0918 16:39:49.411884   12679 system_pods.go:89] "coredns-66bc5c9577-f6kjd" [0d930e37-c687-4048-b869-56796c1238d8] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 16:39:49.411894   12679 system_pods.go:89] "csi-hostpath-attacher-0" [23d081e3-c247-4985-b14c-184de1ced508] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0918 16:39:49.411906   12679 system_pods.go:89] "csi-hostpath-resizer-0" [ce0a6fc1-0743-4772-800f-f90626324f3f] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0918 16:39:49.411918   12679 system_pods.go:89] "csi-hostpathplugin-knfhb" [a9aeccf6-daf5-427e-847d-156e6332b043] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0918 16:39:49.411924   12679 system_pods.go:89] "etcd-addons-294579" [a728f7a0-58b0-44ba-aada-36b84af390ba] Running
	I0918 16:39:49.411934   12679 system_pods.go:89] "kindnet-7swk5" [a225fb86-4203-40f5-b42f-31cd59c2ccfd] Running
	I0918 16:39:49.411938   12679 system_pods.go:89] "kube-apiserver-addons-294579" [c7696c06-d293-4960-a4dc-d2867cc9fb3e] Running
	I0918 16:39:49.411941   12679 system_pods.go:89] "kube-controller-manager-addons-294579" [1d6c899e-bd1e-4ec4-aca0-c23a3ba2c090] Running
	I0918 16:39:49.411946   12679 system_pods.go:89] "kube-ingress-dns-minikube" [c28f422b-e8e4-4753-a6f3-adc52fa2b569] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0918 16:39:49.411952   12679 system_pods.go:89] "kube-proxy-p2c4p" [32ab80c6-ecb6-4232-a8d7-5b603be592b2] Running
	I0918 16:39:49.411956   12679 system_pods.go:89] "kube-scheduler-addons-294579" [9fea194f-dbeb-40a5-b07b-56e6e9ae51cf] Running
	I0918 16:39:49.411961   12679 system_pods.go:89] "metrics-server-85b7d694d7-v5wc5" [8478dbc1-e162-487c-840a-8aaf78d27e7f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0918 16:39:49.411969   12679 system_pods.go:89] "nvidia-device-plugin-daemonset-v5mmk" [ed85f4e8-a497-4873-bd68-46c7aeac578a] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
	I0918 16:39:49.411977   12679 system_pods.go:89] "registry-66898fdd98-smmbw" [09f9a63e-d06a-4049-a31e-60537f65d737] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0918 16:39:49.411990   12679 system_pods.go:89] "registry-creds-764b6fb674-rrbb5" [30f0bcbf-4fb9-4268-9ed4-197e73de8723] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
	I0918 16:39:49.412010   12679 system_pods.go:89] "registry-proxy-ksqpq" [04fa5c90-d967-43b0-80a3-6906c0905306] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0918 16:39:49.412018   12679 system_pods.go:89] "snapshot-controller-7d9fbc56b8-kvtht" [4ae9e795-1ada-48fb-870c-7c31a9dea070] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0918 16:39:49.412027   12679 system_pods.go:89] "snapshot-controller-7d9fbc56b8-ttvhz" [41a7f275-bf8b-4430-972f-ec7abe94b02b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0918 16:39:49.412032   12679 system_pods.go:89] "storage-provisioner" [7e7a4937-699e-44fb-b11d-488e3d9dad71] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
	I0918 16:39:49.412048   12679 retry.go:31] will retry after 267.120562ms: missing components: kube-dns
	I0918 16:39:49.593126   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:49.683908   12679 system_pods.go:86] 20 kube-system pods found
	I0918 16:39:49.683939   12679 system_pods.go:89] "amd-gpu-device-plugin-zl2hz" [82885ec9-ef4a-448f-8993-c59a1da8720e] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
	I0918 16:39:49.683948   12679 system_pods.go:89] "coredns-66bc5c9577-f6kjd" [0d930e37-c687-4048-b869-56796c1238d8] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 16:39:49.683955   12679 system_pods.go:89] "csi-hostpath-attacher-0" [23d081e3-c247-4985-b14c-184de1ced508] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0918 16:39:49.683960   12679 system_pods.go:89] "csi-hostpath-resizer-0" [ce0a6fc1-0743-4772-800f-f90626324f3f] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0918 16:39:49.683968   12679 system_pods.go:89] "csi-hostpathplugin-knfhb" [a9aeccf6-daf5-427e-847d-156e6332b043] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0918 16:39:49.683972   12679 system_pods.go:89] "etcd-addons-294579" [a728f7a0-58b0-44ba-aada-36b84af390ba] Running
	I0918 16:39:49.683977   12679 system_pods.go:89] "kindnet-7swk5" [a225fb86-4203-40f5-b42f-31cd59c2ccfd] Running
	I0918 16:39:49.683983   12679 system_pods.go:89] "kube-apiserver-addons-294579" [c7696c06-d293-4960-a4dc-d2867cc9fb3e] Running
	I0918 16:39:49.683986   12679 system_pods.go:89] "kube-controller-manager-addons-294579" [1d6c899e-bd1e-4ec4-aca0-c23a3ba2c090] Running
	I0918 16:39:49.683992   12679 system_pods.go:89] "kube-ingress-dns-minikube" [c28f422b-e8e4-4753-a6f3-adc52fa2b569] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0918 16:39:49.683998   12679 system_pods.go:89] "kube-proxy-p2c4p" [32ab80c6-ecb6-4232-a8d7-5b603be592b2] Running
	I0918 16:39:49.684002   12679 system_pods.go:89] "kube-scheduler-addons-294579" [9fea194f-dbeb-40a5-b07b-56e6e9ae51cf] Running
	I0918 16:39:49.684006   12679 system_pods.go:89] "metrics-server-85b7d694d7-v5wc5" [8478dbc1-e162-487c-840a-8aaf78d27e7f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0918 16:39:49.684011   12679 system_pods.go:89] "nvidia-device-plugin-daemonset-v5mmk" [ed85f4e8-a497-4873-bd68-46c7aeac578a] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
	I0918 16:39:49.684017   12679 system_pods.go:89] "registry-66898fdd98-smmbw" [09f9a63e-d06a-4049-a31e-60537f65d737] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0918 16:39:49.684022   12679 system_pods.go:89] "registry-creds-764b6fb674-rrbb5" [30f0bcbf-4fb9-4268-9ed4-197e73de8723] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
	I0918 16:39:49.684027   12679 system_pods.go:89] "registry-proxy-ksqpq" [04fa5c90-d967-43b0-80a3-6906c0905306] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0918 16:39:49.684032   12679 system_pods.go:89] "snapshot-controller-7d9fbc56b8-kvtht" [4ae9e795-1ada-48fb-870c-7c31a9dea070] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0918 16:39:49.684039   12679 system_pods.go:89] "snapshot-controller-7d9fbc56b8-ttvhz" [41a7f275-bf8b-4430-972f-ec7abe94b02b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0918 16:39:49.684044   12679 system_pods.go:89] "storage-provisioner" [7e7a4937-699e-44fb-b11d-488e3d9dad71] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
	I0918 16:39:49.684059   12679 retry.go:31] will retry after 253.82517ms: missing components: kube-dns
	I0918 16:39:49.782184   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:49.782237   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:49.813958   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:49.943228   12679 system_pods.go:86] 20 kube-system pods found
	I0918 16:39:49.943278   12679 system_pods.go:89] "amd-gpu-device-plugin-zl2hz" [82885ec9-ef4a-448f-8993-c59a1da8720e] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
	I0918 16:39:49.943302   12679 system_pods.go:89] "coredns-66bc5c9577-f6kjd" [0d930e37-c687-4048-b869-56796c1238d8] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 16:39:49.943318   12679 system_pods.go:89] "csi-hostpath-attacher-0" [23d081e3-c247-4985-b14c-184de1ced508] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0918 16:39:49.943338   12679 system_pods.go:89] "csi-hostpath-resizer-0" [ce0a6fc1-0743-4772-800f-f90626324f3f] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0918 16:39:49.943348   12679 system_pods.go:89] "csi-hostpathplugin-knfhb" [a9aeccf6-daf5-427e-847d-156e6332b043] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0918 16:39:49.943359   12679 system_pods.go:89] "etcd-addons-294579" [a728f7a0-58b0-44ba-aada-36b84af390ba] Running
	I0918 16:39:49.943365   12679 system_pods.go:89] "kindnet-7swk5" [a225fb86-4203-40f5-b42f-31cd59c2ccfd] Running
	I0918 16:39:49.943371   12679 system_pods.go:89] "kube-apiserver-addons-294579" [c7696c06-d293-4960-a4dc-d2867cc9fb3e] Running
	I0918 16:39:49.943377   12679 system_pods.go:89] "kube-controller-manager-addons-294579" [1d6c899e-bd1e-4ec4-aca0-c23a3ba2c090] Running
	I0918 16:39:49.943391   12679 system_pods.go:89] "kube-ingress-dns-minikube" [c28f422b-e8e4-4753-a6f3-adc52fa2b569] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0918 16:39:49.943395   12679 system_pods.go:89] "kube-proxy-p2c4p" [32ab80c6-ecb6-4232-a8d7-5b603be592b2] Running
	I0918 16:39:49.943402   12679 system_pods.go:89] "kube-scheduler-addons-294579" [9fea194f-dbeb-40a5-b07b-56e6e9ae51cf] Running
	I0918 16:39:49.943415   12679 system_pods.go:89] "metrics-server-85b7d694d7-v5wc5" [8478dbc1-e162-487c-840a-8aaf78d27e7f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0918 16:39:49.943428   12679 system_pods.go:89] "nvidia-device-plugin-daemonset-v5mmk" [ed85f4e8-a497-4873-bd68-46c7aeac578a] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
	I0918 16:39:49.943439   12679 system_pods.go:89] "registry-66898fdd98-smmbw" [09f9a63e-d06a-4049-a31e-60537f65d737] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0918 16:39:49.943452   12679 system_pods.go:89] "registry-creds-764b6fb674-rrbb5" [30f0bcbf-4fb9-4268-9ed4-197e73de8723] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
	I0918 16:39:49.943460   12679 system_pods.go:89] "registry-proxy-ksqpq" [04fa5c90-d967-43b0-80a3-6906c0905306] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0918 16:39:49.943475   12679 system_pods.go:89] "snapshot-controller-7d9fbc56b8-kvtht" [4ae9e795-1ada-48fb-870c-7c31a9dea070] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0918 16:39:49.943484   12679 system_pods.go:89] "snapshot-controller-7d9fbc56b8-ttvhz" [41a7f275-bf8b-4430-972f-ec7abe94b02b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0918 16:39:49.943493   12679 system_pods.go:89] "storage-provisioner" [7e7a4937-699e-44fb-b11d-488e3d9dad71] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])
	I0918 16:39:49.943533   12679 retry.go:31] will retry after 389.983398ms: missing components: kube-dns
	I0918 16:39:50.092340   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:50.282352   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:50.282403   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:50.314294   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:50.385315   12679 system_pods.go:86] 20 kube-system pods found
	I0918 16:39:50.385365   12679 system_pods.go:89] "amd-gpu-device-plugin-zl2hz" [82885ec9-ef4a-448f-8993-c59a1da8720e] Pending / Ready:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin]) / ContainersReady:ContainersNotReady (containers with unready status: [amd-gpu-device-plugin])
	I0918 16:39:50.385374   12679 system_pods.go:89] "coredns-66bc5c9577-f6kjd" [0d930e37-c687-4048-b869-56796c1238d8] Running
	I0918 16:39:50.385385   12679 system_pods.go:89] "csi-hostpath-attacher-0" [23d081e3-c247-4985-b14c-184de1ced508] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0918 16:39:50.385395   12679 system_pods.go:89] "csi-hostpath-resizer-0" [ce0a6fc1-0743-4772-800f-f90626324f3f] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0918 16:39:50.385403   12679 system_pods.go:89] "csi-hostpathplugin-knfhb" [a9aeccf6-daf5-427e-847d-156e6332b043] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0918 16:39:50.385414   12679 system_pods.go:89] "etcd-addons-294579" [a728f7a0-58b0-44ba-aada-36b84af390ba] Running
	I0918 16:39:50.385419   12679 system_pods.go:89] "kindnet-7swk5" [a225fb86-4203-40f5-b42f-31cd59c2ccfd] Running
	I0918 16:39:50.385424   12679 system_pods.go:89] "kube-apiserver-addons-294579" [c7696c06-d293-4960-a4dc-d2867cc9fb3e] Running
	I0918 16:39:50.385435   12679 system_pods.go:89] "kube-controller-manager-addons-294579" [1d6c899e-bd1e-4ec4-aca0-c23a3ba2c090] Running
	I0918 16:39:50.385446   12679 system_pods.go:89] "kube-ingress-dns-minikube" [c28f422b-e8e4-4753-a6f3-adc52fa2b569] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
	I0918 16:39:50.385452   12679 system_pods.go:89] "kube-proxy-p2c4p" [32ab80c6-ecb6-4232-a8d7-5b603be592b2] Running
	I0918 16:39:50.385458   12679 system_pods.go:89] "kube-scheduler-addons-294579" [9fea194f-dbeb-40a5-b07b-56e6e9ae51cf] Running
	I0918 16:39:50.385469   12679 system_pods.go:89] "metrics-server-85b7d694d7-v5wc5" [8478dbc1-e162-487c-840a-8aaf78d27e7f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0918 16:39:50.385482   12679 system_pods.go:89] "nvidia-device-plugin-daemonset-v5mmk" [ed85f4e8-a497-4873-bd68-46c7aeac578a] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
	I0918 16:39:50.385493   12679 system_pods.go:89] "registry-66898fdd98-smmbw" [09f9a63e-d06a-4049-a31e-60537f65d737] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0918 16:39:50.385516   12679 system_pods.go:89] "registry-creds-764b6fb674-rrbb5" [30f0bcbf-4fb9-4268-9ed4-197e73de8723] Pending / Ready:ContainersNotReady (containers with unready status: [registry-creds]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-creds])
	I0918 16:39:50.385525   12679 system_pods.go:89] "registry-proxy-ksqpq" [04fa5c90-d967-43b0-80a3-6906c0905306] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0918 16:39:50.385537   12679 system_pods.go:89] "snapshot-controller-7d9fbc56b8-kvtht" [4ae9e795-1ada-48fb-870c-7c31a9dea070] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0918 16:39:50.385550   12679 system_pods.go:89] "snapshot-controller-7d9fbc56b8-ttvhz" [41a7f275-bf8b-4430-972f-ec7abe94b02b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
	I0918 16:39:50.385558   12679 system_pods.go:89] "storage-provisioner" [7e7a4937-699e-44fb-b11d-488e3d9dad71] Running
	I0918 16:39:50.385568   12679 system_pods.go:126] duration metric: took 976.744364ms to wait for k8s-apps to be running ...
	I0918 16:39:50.385579   12679 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 16:39:50.385633   12679 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 16:39:50.400136   12679 system_svc.go:56] duration metric: took 14.547674ms WaitForService to wait for kubelet
	I0918 16:39:50.400169   12679 kubeadm.go:578] duration metric: took 45.17003757s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 16:39:50.400190   12679 node_conditions.go:102] verifying NodePressure condition ...
	I0918 16:39:50.403154   12679 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:39:50.403185   12679 node_conditions.go:123] node cpu capacity is 8
	I0918 16:39:50.403203   12679 node_conditions.go:105] duration metric: took 3.007398ms to run NodePressure ...
	I0918 16:39:50.403220   12679 start.go:241] waiting for startup goroutines ...
	I0918 16:39:50.593652   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:50.783220   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:50.783241   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:50.814267   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:51.093384   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:51.282384   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:51.282413   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:51.314223   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:51.593565   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:51.782704   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:51.782729   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:51.814531   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:52.093554   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:52.282322   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:52.282429   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:52.314607   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:52.592694   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:52.782724   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:52.782772   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:52.813573   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:53.093239   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:53.282283   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:53.282430   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:53.314632   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:53.593707   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:53.782397   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:53.782493   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:53.814185   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:54.093110   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:54.282257   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:54.282341   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:54.313824   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:54.592569   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:54.782611   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:54.782657   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:54.814703   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:55.093612   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:55.283641   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:55.283805   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:55.314307   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:55.593426   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:55.783106   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:55.783157   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:55.814258   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:56.093187   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:56.282173   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:56.282197   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:56.314272   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:56.593556   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:56.782435   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:56.782449   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:56.813861   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:57.092348   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:57.282459   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:57.282701   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:57.314465   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:57.593684   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:57.783250   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:57.783254   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:57.813892   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:58.092759   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:58.283026   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:58.283071   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:58.313956   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:58.592424   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:58.782615   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:58.782761   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:58.813593   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:59.093548   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:59.282970   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:59.283041   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:59.313905   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:39:59.593304   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:39:59.782437   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:39:59.782530   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:39:59.814161   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:00.092727   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:00.282565   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:00.282748   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:00.314292   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:00.592716   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:00.784136   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:00.784185   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:00.814557   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:01.092735   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:01.283066   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:01.283521   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:01.315789   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:01.592723   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:01.782996   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:01.783031   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:01.814182   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:02.093111   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:02.282017   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:02.282217   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:02.315331   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:02.593333   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:02.782232   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:02.782270   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:02.814158   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:03.092972   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:03.281774   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:03.281784   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:03.313232   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:03.593166   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:03.781885   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:03.781895   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:03.813773   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:04.092222   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:04.282047   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:04.282056   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:04.314103   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:04.593367   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:04.782322   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:04.782338   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:04.814103   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:05.093493   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:05.282305   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:05.282530   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:05.314008   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:05.593199   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:05.782033   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:05.782772   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:05.814959   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:06.093150   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:06.283927   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:06.284253   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:06.384735   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:06.593966   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:06.782052   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:06.782133   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:06.814036   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:07.092954   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:07.281682   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:07.281744   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:07.313496   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:07.593571   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:07.782454   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:07.782467   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:07.814866   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:08.093937   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:08.282198   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:08.282211   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:08.314218   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:08.592907   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:08.781661   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:08.781786   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:08.813614   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:08.815536   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
	I0918 16:40:09.093429   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:09.282320   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:09.282396   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:09.314437   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	W0918 16:40:09.447409   12679 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:40:09.447442   12679 retry.go:31] will retry after 26.55286645s: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 16:40:09.593555   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:09.782240   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:09.782384   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:09.814132   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:10.093221   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:10.339605   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:10.339919   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:10.367869   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:10.695006   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:10.796214   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:10.796419   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:10.813891   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:11.092834   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:11.283368   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:11.283553   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:11.313647   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:11.592642   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:11.782659   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:11.782700   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:11.814729   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:12.093637   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:12.283133   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:12.283515   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:12.314242   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:12.593571   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:12.782212   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:12.782252   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:12.814076   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:13.092831   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:13.282659   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:13.282695   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:13.313877   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:13.592874   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:13.781757   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:13.781828   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:13.813336   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:14.093025   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:14.281895   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:14.281911   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:14.313761   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:14.592978   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:14.781667   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:14.781712   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:14.814669   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:15.093112   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:15.281951   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:15.282001   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:15.313877   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:15.592807   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:15.782833   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:15.783069   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:15.814184   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:16.093389   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:16.331890   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:16.332120   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:16.332381   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:16.593599   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:16.786358   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:16.786569   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:16.816568   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:17.095415   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:17.287252   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:17.287739   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:17.314347   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:17.592990   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:17.781781   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:17.781863   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:17.814519   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:18.093456   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:18.282312   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:18.282449   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:18.314589   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:18.593402   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:18.782125   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:18.782169   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:18.816381   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:19.092763   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:19.285652   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:19.285777   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:19.313678   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:19.593717   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:19.782595   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:19.782626   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:19.814088   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:20.093272   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:20.282103   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:20.282293   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:20.314564   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:20.605950   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:20.782864   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:20.782906   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:20.813472   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:21.093303   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:21.282472   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:21.282602   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:21.330317   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:21.671110   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:21.782158   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:21.782158   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:21.814537   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:22.093372   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:22.282123   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:22.282188   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:22.314098   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:22.593105   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:22.782156   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:22.782203   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:22.814375   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:23.093355   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:23.282646   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:23.282764   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:23.383275   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:23.592993   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:23.781859   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:23.781898   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:23.813751   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:24.092546   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:24.282537   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:24.282578   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:24.315189   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:24.593168   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:24.782808   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:24.782913   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:24.813409   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:25.093472   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:25.282382   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:25.282422   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:25.314151   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:25.648184   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:25.782908   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:25.783059   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:25.814441   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:26.093818   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:26.281745   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:26.281898   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0918 16:40:26.316912   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:26.594521   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:26.782614   12679 kapi.go:107] duration metric: took 1m20.003707918s to wait for kubernetes.io/minikube-addons=registry ...
	I0918 16:40:26.782696   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:26.814735   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:27.094576   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:27.283009   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:27.314613   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:27.593709   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:27.783362   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:27.814304   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:28.093400   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:28.282755   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:28.314451   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:28.593136   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:28.782433   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:28.814387   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:29.092948   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:29.283645   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:29.314714   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:29.594065   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:29.782271   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:29.814095   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:30.092890   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:30.282737   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:30.313685   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:30.593416   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:30.782517   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:30.814785   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:31.093563   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:31.283354   12679 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0918 16:40:31.316350   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:31.593925   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:31.783567   12679 kapi.go:107] duration metric: took 1m25.004652799s to wait for app.kubernetes.io/name=ingress-nginx ...
	I0918 16:40:31.814313   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:32.093245   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:32.314303   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:32.592831   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:32.813770   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:33.092946   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:33.314009   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:33.593031   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:33.814938   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:34.092354   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:34.314222   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:34.593159   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:34.814434   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:35.093028   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:35.314713   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:35.593344   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:35.816020   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:36.001410   12679 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml
	I0918 16:40:36.092724   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:36.314891   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:36.593357   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	W0918 16:40:36.625728   12679 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	W0918 16:40:36.625846   12679 out.go:285] ! Enabling 'inspektor-gadget' returned an error: running callbacks: [sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: Process exited with status 1
	stdout:
	namespace/gadget unchanged
	serviceaccount/gadget unchanged
	configmap/gadget unchanged
	clusterrole.rbac.authorization.k8s.io/gadget-cluster-role unchanged
	clusterrolebinding.rbac.authorization.k8s.io/gadget-cluster-role-binding unchanged
	role.rbac.authorization.k8s.io/gadget-role unchanged
	rolebinding.rbac.authorization.k8s.io/gadget-role-binding unchanged
	daemonset.apps/gadget configured
	
	stderr:
	error: error validating "/etc/kubernetes/addons/ig-crd.yaml": error validating data: [apiVersion not set, kind not set]; if you choose to ignore these errors, turn validation off with --validate=false
	]
	I0918 16:40:36.814752   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:37.093029   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0918 16:40:37.315022   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:37.593644   12679 kapi.go:107] duration metric: took 1m24.003976096s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I0918 16:40:37.595576   12679 out.go:179] * Your GCP credentials will now be mounted into every pod created in the addons-294579 cluster.
	I0918 16:40:37.596852   12679 out.go:179] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I0918 16:40:37.598009   12679 out.go:179] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I0918 16:40:37.814550   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:38.314284   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:38.814905   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:39.314647   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:39.814659   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:40.314662   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:40.814757   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:41.314316   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:41.814102   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:42.313955   12679 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0918 16:40:42.815038   12679 kapi.go:107] duration metric: took 1m35.504495063s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I0918 16:40:42.817364   12679 out.go:179] * Enabled addons: registry-creds, nvidia-device-plugin, storage-provisioner, ingress-dns, amd-gpu-device-plugin, cloud-spanner, metrics-server, yakd, default-storageclass, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver
	I0918 16:40:42.819100   12679 addons.go:514] duration metric: took 1m37.58890001s for enable addons: enabled=[registry-creds nvidia-device-plugin storage-provisioner ingress-dns amd-gpu-device-plugin cloud-spanner metrics-server yakd default-storageclass volumesnapshots registry ingress gcp-auth csi-hostpath-driver]
	I0918 16:40:42.819167   12679 start.go:246] waiting for cluster config update ...
	I0918 16:40:42.819184   12679 start.go:255] writing updated cluster config ...
	I0918 16:40:42.819459   12679 ssh_runner.go:195] Run: rm -f paused
	I0918 16:40:42.823591   12679 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
	I0918 16:40:42.826614   12679 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-f6kjd" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:40:42.830781   12679 pod_ready.go:94] pod "coredns-66bc5c9577-f6kjd" is "Ready"
	I0918 16:40:42.830804   12679 pod_ready.go:86] duration metric: took 4.166652ms for pod "coredns-66bc5c9577-f6kjd" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:40:42.832742   12679 pod_ready.go:83] waiting for pod "etcd-addons-294579" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:40:42.836385   12679 pod_ready.go:94] pod "etcd-addons-294579" is "Ready"
	I0918 16:40:42.836415   12679 pod_ready.go:86] duration metric: took 3.646992ms for pod "etcd-addons-294579" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:40:42.838194   12679 pod_ready.go:83] waiting for pod "kube-apiserver-addons-294579" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:40:42.841671   12679 pod_ready.go:94] pod "kube-apiserver-addons-294579" is "Ready"
	I0918 16:40:42.841695   12679 pod_ready.go:86] duration metric: took 3.482286ms for pod "kube-apiserver-addons-294579" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:40:42.843973   12679 pod_ready.go:83] waiting for pod "kube-controller-manager-addons-294579" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:40:43.227754   12679 pod_ready.go:94] pod "kube-controller-manager-addons-294579" is "Ready"
	I0918 16:40:43.227781   12679 pod_ready.go:86] duration metric: took 383.788019ms for pod "kube-controller-manager-addons-294579" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:40:43.428147   12679 pod_ready.go:83] waiting for pod "kube-proxy-p2c4p" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:40:43.827706   12679 pod_ready.go:94] pod "kube-proxy-p2c4p" is "Ready"
	I0918 16:40:43.827737   12679 pod_ready.go:86] duration metric: took 399.560765ms for pod "kube-proxy-p2c4p" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:40:44.028127   12679 pod_ready.go:83] waiting for pod "kube-scheduler-addons-294579" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:40:44.426928   12679 pod_ready.go:94] pod "kube-scheduler-addons-294579" is "Ready"
	I0918 16:40:44.426954   12679 pod_ready.go:86] duration metric: took 398.802897ms for pod "kube-scheduler-addons-294579" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:40:44.426964   12679 pod_ready.go:40] duration metric: took 1.60334323s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
	I0918 16:40:44.471216   12679 start.go:623] kubectl: 1.34.1, cluster: 1.34.0 (minor skew: 0)
	I0918 16:40:44.473713   12679 out.go:179] * Done! kubectl is now configured to use "addons-294579" cluster and "default" namespace by default
	
	
	==> CRI-O <==
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.090693033Z" level=info msg="Running pod sandbox: default/hello-world-app-5d498dc89-897bg/POD" id=1bd23154-e94b-46c8-a38a-603e16c6f6f1 name=/runtime.v1.RuntimeService/RunPodSandbox
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.090754448Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.115992835Z" level=info msg="Got pod network &{Name:hello-world-app-5d498dc89-897bg Namespace:default ID:e77e74c402bc47e0305e28973e3d64bc82741b5cf7ffc5b69a24d3060cfc6336 UID:a70b236a-93b9-4b9a-bfb8-eedf410e780e NetNS:/var/run/netns/555caadd-0cc6-4b54-b9f1-901d854131c8 Networks:[] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.116042643Z" level=info msg="Adding pod default_hello-world-app-5d498dc89-897bg to CNI network \"kindnet\" (type=ptp)"
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.126464489Z" level=info msg="Got pod network &{Name:hello-world-app-5d498dc89-897bg Namespace:default ID:e77e74c402bc47e0305e28973e3d64bc82741b5cf7ffc5b69a24d3060cfc6336 UID:a70b236a-93b9-4b9a-bfb8-eedf410e780e NetNS:/var/run/netns/555caadd-0cc6-4b54-b9f1-901d854131c8 Networks:[] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.126605578Z" level=info msg="Checking pod default_hello-world-app-5d498dc89-897bg for CNI network kindnet (type=ptp)"
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.127345406Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.128138746Z" level=info msg="Ran pod sandbox e77e74c402bc47e0305e28973e3d64bc82741b5cf7ffc5b69a24d3060cfc6336 with infra container: default/hello-world-app-5d498dc89-897bg/POD" id=1bd23154-e94b-46c8-a38a-603e16c6f6f1 name=/runtime.v1.RuntimeService/RunPodSandbox
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.129345126Z" level=info msg="Checking image status: docker.io/kicbase/echo-server:1.0" id=b845a57c-f806-474e-b8ea-b97bac1f72a2 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.129633983Z" level=info msg="Image docker.io/kicbase/echo-server:1.0 not found" id=b845a57c-f806-474e-b8ea-b97bac1f72a2 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.130729614Z" level=info msg="Pulling image: docker.io/kicbase/echo-server:1.0" id=cbc04e78-01c3-4db7-b855-557b44635bc9 name=/runtime.v1.ImageService/PullImage
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.138816323Z" level=info msg="Trying to access \"docker.io/kicbase/echo-server:1.0\""
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.274846169Z" level=info msg="Trying to access \"docker.io/kicbase/echo-server:1.0\""
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.752081350Z" level=info msg="Pulled image: docker.io/kicbase/echo-server@sha256:127ac38a2bb9537b7f252addff209ea6801edcac8a92c8b1104dacd66a583ed6" id=cbc04e78-01c3-4db7-b855-557b44635bc9 name=/runtime.v1.ImageService/PullImage
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.752722619Z" level=info msg="Checking image status: docker.io/kicbase/echo-server:1.0" id=9da171eb-1b30-4b7c-9f41-4b1bff87140f name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.753378913Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:9056ab77afb8e18e04303f11000a9d31b3f16b74c59475b899ae1b342d328d30,RepoTags:[docker.io/kicbase/echo-server:1.0],RepoDigests:[docker.io/kicbase/echo-server@sha256:127ac38a2bb9537b7f252addff209ea6801edcac8a92c8b1104dacd66a583ed6 docker.io/kicbase/echo-server@sha256:a82eba7887a40ecae558433f34225b2611dc77f982ce05b1ddb9b282b780fc86],Size_:4944818,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=9da171eb-1b30-4b7c-9f41-4b1bff87140f name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.754744493Z" level=info msg="Checking image status: docker.io/kicbase/echo-server:1.0" id=96839d51-e171-467c-b5ee-378612d612f0 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.755416409Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:9056ab77afb8e18e04303f11000a9d31b3f16b74c59475b899ae1b342d328d30,RepoTags:[docker.io/kicbase/echo-server:1.0],RepoDigests:[docker.io/kicbase/echo-server@sha256:127ac38a2bb9537b7f252addff209ea6801edcac8a92c8b1104dacd66a583ed6 docker.io/kicbase/echo-server@sha256:a82eba7887a40ecae558433f34225b2611dc77f982ce05b1ddb9b282b780fc86],Size_:4944818,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=96839d51-e171-467c-b5ee-378612d612f0 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.758872130Z" level=info msg="Creating container: default/hello-world-app-5d498dc89-897bg/hello-world-app" id=c3240072-a28e-4305-804d-e1acb3e1279e name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.758977487Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.775330040Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/61118c60844551fe3e9aa26274ad7c0e21365ff403be50a67f6d4b8cd0168236/merged/etc/passwd: no such file or directory"
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.775390229Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/61118c60844551fe3e9aa26274ad7c0e21365ff403be50a67f6d4b8cd0168236/merged/etc/group: no such file or directory"
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.840940678Z" level=info msg="Created container 66610cd20e317416969aa745c9ba1692206178038786c9b0d800874dab0312e7: default/hello-world-app-5d498dc89-897bg/hello-world-app" id=c3240072-a28e-4305-804d-e1acb3e1279e name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.841620545Z" level=info msg="Starting container: 66610cd20e317416969aa745c9ba1692206178038786c9b0d800874dab0312e7" id=36033363-bd52-4c7e-ac30-7e42de0f72ae name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 16:43:44 addons-294579 crio[937]: time="2025-09-18 16:43:44.848332365Z" level=info msg="Started container" PID=12098 containerID=66610cd20e317416969aa745c9ba1692206178038786c9b0d800874dab0312e7 description=default/hello-world-app-5d498dc89-897bg/hello-world-app id=36033363-bd52-4c7e-ac30-7e42de0f72ae name=/runtime.v1.RuntimeService/StartContainer sandboxID=e77e74c402bc47e0305e28973e3d64bc82741b5cf7ffc5b69a24d3060cfc6336
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                                                        CREATED                  STATE               NAME                      ATTEMPT             POD ID              POD
	66610cd20e317       docker.io/kicbase/echo-server@sha256:127ac38a2bb9537b7f252addff209ea6801edcac8a92c8b1104dacd66a583ed6                        Less than a second ago   Running             hello-world-app           0                   e77e74c402bc4       hello-world-app-5d498dc89-897bg
	cd16df714a1d1       docker.io/library/nginx@sha256:42a516af16b852e33b7682d5ef8acbd5d13fe08fecadc7ed98605ba5e3b26ab8                              2 minutes ago            Running             nginx                     0                   001eb223d50b4       nginx
	2ffe10c0ded7f       gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e                          2 minutes ago            Running             busybox                   0                   d1b055736ed54       busybox
	6e64164c40af2       ghcr.io/inspektor-gadget/inspektor-gadget@sha256:66fdf18cc8a577423b2a36b96a5be40fe690fdb986bfe7875f54edfa9c7d19a5            3 minutes ago            Running             gadget                    0                   83e92db66b2be       gadget-pztwm
	58ec6779e7447       registry.k8s.io/ingress-nginx/controller@sha256:1f7eaeb01933e719c8a9f4acd8181e555e582330c7d50f24484fb64d2ba9b2ef             3 minutes ago            Running             controller                0                   54e63b118a485       ingress-nginx-controller-9cc49f96f-q5ldk
	20dffe1af2482       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:050a34002d5bb4966849c880c56c91f5320372564245733b33d4b3461b4dbd24   3 minutes ago            Exited              patch                     0                   259fe25532920       ingress-nginx-admission-patch-2rfsk
	5967219d2806a       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:050a34002d5bb4966849c880c56c91f5320372564245733b33d4b3461b4dbd24   3 minutes ago            Exited              create                    0                   2757a8b59761e       ingress-nginx-admission-create-flq8n
	cd5c9df515189       docker.io/kicbase/minikube-ingress-dns@sha256:a0cc6cd76812357245a51bb05fabcd346a616c880e40ca4e0c8c8253912eaae7               3 minutes ago            Running             minikube-ingress-dns      0                   ceec660c719bc       kube-ingress-dns-minikube
	4acc58d10ed13       docker.io/rancher/local-path-provisioner@sha256:73f712e7af12b06720c35ce75217f904f00e4bd96de79f8db1cf160112e667ef             3 minutes ago            Running             local-path-provisioner    0                   ddfb4369fc612       local-path-provisioner-648f6765c9-24cxf
	82a49d0273b50       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                                             3 minutes ago            Running             storage-provisioner       0                   402bcd44a617a       storage-provisioner
	b6aa395cdbf1b       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                                             3 minutes ago            Running             coredns                   0                   8c5c57233ac1d       coredns-66bc5c9577-f6kjd
	b6d2521896796       409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c                                                             4 minutes ago            Running             kindnet-cni               0                   305a55643bd31       kindnet-7swk5
	6c099ea35b363       df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce                                                             4 minutes ago            Running             kube-proxy                0                   2dbf10fce4704       kube-proxy-p2c4p
	e19dadcebac9a       46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc                                                             4 minutes ago            Running             kube-scheduler            0                   0aeb1180136a4       kube-scheduler-addons-294579
	79fd768db03a7       a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634                                                             4 minutes ago            Running             kube-controller-manager   0                   872484e4d1243       kube-controller-manager-addons-294579
	6f923f832bbf9       90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90                                                             4 minutes ago            Running             kube-apiserver            0                   2ce375f2a88c2       kube-apiserver-addons-294579
	7245b00c96353       5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115                                                             4 minutes ago            Running             etcd                      0                   8abc26f284ccb       etcd-addons-294579
	
	
	==> coredns [b6aa395cdbf1b8aa9ab2639571fb8425887201ddf49c8091e3c5863032f4a99c] <==
	[INFO] 10.244.0.19:36091 - 25882 "A IN registry.kube-system.svc.cluster.local.us-east4-a.c.k8s-minikube.internal. udp 91 false 512" NXDOMAIN qr,aa,rd,ra 198 0.000152766s
	[INFO] 10.244.0.19:50108 - 2796 "AAAA IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 80 false 512" NXDOMAIN qr,aa,rd,ra 185 0.000085136s
	[INFO] 10.244.0.19:50108 - 2526 "A IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 80 false 512" NXDOMAIN qr,aa,rd,ra 185 0.000129314s
	[INFO] 10.244.0.19:34026 - 39184 "A IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,aa,rd,ra 177 0.000093506s
	[INFO] 10.244.0.19:34026 - 39458 "AAAA IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,aa,rd,ra 177 0.000142711s
	[INFO] 10.244.0.19:54707 - 15612 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000125365s
	[INFO] 10.244.0.19:54707 - 15172 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000160052s
	[INFO] 10.244.0.22:43949 - 2437 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000193779s
	[INFO] 10.244.0.22:41157 - 31255 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000280937s
	[INFO] 10.244.0.22:42353 - 54552 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000167925s
	[INFO] 10.244.0.22:47590 - 10596 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000213905s
	[INFO] 10.244.0.22:43017 - 6277 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000151487s
	[INFO] 10.244.0.22:59219 - 36910 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000191192s
	[INFO] 10.244.0.22:60365 - 53563 "A IN storage.googleapis.com.local. udp 57 false 1232" NXDOMAIN qr,rd,ra 46 0.004886785s
	[INFO] 10.244.0.22:57222 - 55398 "AAAA IN storage.googleapis.com.local. udp 57 false 1232" NXDOMAIN qr,rd,ra 46 0.005191279s
	[INFO] 10.244.0.22:53802 - 49284 "A IN storage.googleapis.com.us-east4-a.c.k8s-minikube.internal. udp 86 false 1232" NXDOMAIN qr,rd,ra 182 0.007570984s
	[INFO] 10.244.0.22:43482 - 64509 "AAAA IN storage.googleapis.com.us-east4-a.c.k8s-minikube.internal. udp 86 false 1232" NXDOMAIN qr,rd,ra 182 0.008715491s
	[INFO] 10.244.0.22:60047 - 33508 "AAAA IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 169 0.005980686s
	[INFO] 10.244.0.22:48187 - 9538 "A IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 169 0.012201038s
	[INFO] 10.244.0.22:44599 - 14963 "A IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 161 0.006361156s
	[INFO] 10.244.0.22:51595 - 59363 "AAAA IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 161 0.006451988s
	[INFO] 10.244.0.22:36743 - 1648 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 420 0.001279953s
	[INFO] 10.244.0.22:50988 - 59130 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.002389995s
	[INFO] 10.244.0.25:35983 - 2 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000215094s
	[INFO] 10.244.0.25:60683 - 3 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000126915s
	
	
	==> describe nodes <==
	Name:               addons-294579
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=addons-294579
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=addons-294579
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2025_09_18T16_39_01_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-294579
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:38:57 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-294579
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 16:43:35 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 16:41:32 +0000   Thu, 18 Sep 2025 16:38:56 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 16:41:32 +0000   Thu, 18 Sep 2025 16:38:56 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 16:41:32 +0000   Thu, 18 Sep 2025 16:38:56 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 16:41:32 +0000   Thu, 18 Sep 2025 16:39:48 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-294579
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 282d636f5fd144389e160a7e9fdf1e7b
	  System UUID:                330e8ca5-7218-4d2f-b74a-4c529b8abdd6
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (15 in total)
	  Namespace                   Name                                        CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                        ------------  ----------  ---------------  -------------  ---
	  default                     busybox                                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m
	  default                     hello-world-app-5d498dc89-897bg             0 (0%)        0 (0%)      0 (0%)           0 (0%)         2s
	  default                     nginx                                       0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m28s
	  gadget                      gadget-pztwm                                0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m39s
	  ingress-nginx               ingress-nginx-controller-9cc49f96f-q5ldk    100m (1%)     0 (0%)      90Mi (0%)        0 (0%)         4m39s
	  kube-system                 coredns-66bc5c9577-f6kjd                    100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     4m40s
	  kube-system                 etcd-addons-294579                          100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         4m47s
	  kube-system                 kindnet-7swk5                               100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      4m40s
	  kube-system                 kube-apiserver-addons-294579                250m (3%)     0 (0%)      0 (0%)           0 (0%)         4m45s
	  kube-system                 kube-controller-manager-addons-294579       200m (2%)     0 (0%)      0 (0%)           0 (0%)         4m45s
	  kube-system                 kube-ingress-dns-minikube                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m39s
	  kube-system                 kube-proxy-p2c4p                            0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m40s
	  kube-system                 kube-scheduler-addons-294579                100m (1%)     0 (0%)      0 (0%)           0 (0%)         4m45s
	  kube-system                 storage-provisioner                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m39s
	  local-path-storage          local-path-provisioner-648f6765c9-24cxf     0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m39s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (11%)  100m (1%)
	  memory             310Mi (0%)  220Mi (0%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age    From             Message
	  ----    ------                   ----   ----             -------
	  Normal  Starting                 4m37s  kube-proxy       
	  Normal  Starting                 4m45s  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  4m45s  kubelet          Node addons-294579 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    4m45s  kubelet          Node addons-294579 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     4m45s  kubelet          Node addons-294579 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           4m41s  node-controller  Node addons-294579 event: Registered Node addons-294579 in Controller
	  Normal  NodeReady                3m57s  kubelet          Node addons-294579 status is now: NodeReady
	
	
	==> dmesg <==
	[  +0.089038] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
	[  +0.028015] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
	[  +7.570818] kauditd_printk_skb: 47 callbacks suppressed
	[Sep18 16:41] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.013586] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023854] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023944] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023869] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023927] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000033] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +2.047789] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +4.031621] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000030] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +8.127251] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[Sep18 16:42] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[ +32.253146] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	
	
	==> etcd [7245b00c9635395b6cfce80cd08b8f0247899cdb4824461dfd5a18e5ee58a47c] <==
	{"level":"warn","ts":"2025-09-18T16:38:57.080894Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:37784","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:38:57.087247Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:37812","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:38:57.099006Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:37828","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:38:57.105357Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:37836","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:38:57.111638Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:37852","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:38:57.159395Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:37880","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:39:07.838490Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:49612","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:39:34.667751Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36934","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:39:34.674590Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36966","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:39:34.685688Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:36982","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:39:34.692248Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:37004","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:40:10.692675Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"158.358451ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/jobs\" limit:1 ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2025-09-18T16:40:10.692772Z","caller":"traceutil/trace.go:172","msg":"trace[2065937017] range","detail":"{range_begin:/registry/jobs; range_end:; response_count:0; response_revision:1042; }","duration":"158.471915ms","start":"2025-09-18T16:40:10.534287Z","end":"2025-09-18T16:40:10.692758Z","steps":["trace[2065937017] 'agreement among raft nodes before linearized reading'  (duration: 51.834754ms)","trace[2065937017] 'range keys from in-memory index tree'  (duration: 106.493341ms)"],"step_count":2}
	{"level":"warn","ts":"2025-09-18T16:40:10.693281Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"106.650967ms","expected-duration":"100ms","prefix":"","request":"header:<ID:8128040055185414987 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/jobs/ingress-nginx/ingress-nginx-admission-patch\" mod_revision:1039 > success:<request_put:<key:\"/registry/jobs/ingress-nginx/ingress-nginx-admission-patch\" value_size:4426 >> failure:<request_range:<key:\"/registry/jobs/ingress-nginx/ingress-nginx-admission-patch\" > >>","response":"size:16"}
	{"level":"info","ts":"2025-09-18T16:40:10.693351Z","caller":"traceutil/trace.go:172","msg":"trace[426396472] linearizableReadLoop","detail":"{readStateIndex:1077; appliedIndex:1076; }","duration":"101.938847ms","start":"2025-09-18T16:40:10.591402Z","end":"2025-09-18T16:40:10.693341Z","steps":["trace[426396472] 'read index received'  (duration: 25.902µs)","trace[426396472] 'applied index is now lower than readState.Index'  (duration: 101.912314ms)"],"step_count":2}
	{"level":"info","ts":"2025-09-18T16:40:10.693387Z","caller":"traceutil/trace.go:172","msg":"trace[1189714309] transaction","detail":"{read_only:false; response_revision:1043; number_of_response:1; }","duration":"235.471621ms","start":"2025-09-18T16:40:10.457903Z","end":"2025-09-18T16:40:10.693374Z","steps":["trace[1189714309] 'process raft request'  (duration: 128.210295ms)","trace[1189714309] 'compare'  (duration: 106.552645ms)"],"step_count":2}
	{"level":"warn","ts":"2025-09-18T16:40:10.693448Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"102.045068ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2025-09-18T16:40:10.693474Z","caller":"traceutil/trace.go:172","msg":"trace[1575896402] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:1043; }","duration":"102.073192ms","start":"2025-09-18T16:40:10.591394Z","end":"2025-09-18T16:40:10.693468Z","steps":["trace[1575896402] 'agreement among raft nodes before linearized reading'  (duration: 102.023445ms)"],"step_count":1}
	{"level":"info","ts":"2025-09-18T16:40:16.461102Z","caller":"traceutil/trace.go:172","msg":"trace[1126839000] transaction","detail":"{read_only:false; response_revision:1094; number_of_response:1; }","duration":"125.711252ms","start":"2025-09-18T16:40:16.335366Z","end":"2025-09-18T16:40:16.461077Z","steps":["trace[1126839000] 'process raft request'  (duration: 61.40074ms)","trace[1126839000] 'compare'  (duration: 64.111502ms)"],"step_count":2}
	{"level":"info","ts":"2025-09-18T16:40:16.461183Z","caller":"traceutil/trace.go:172","msg":"trace[151789618] transaction","detail":"{read_only:false; response_revision:1096; number_of_response:1; }","duration":"124.682935ms","start":"2025-09-18T16:40:16.336487Z","end":"2025-09-18T16:40:16.461170Z","steps":["trace[151789618] 'process raft request'  (duration: 124.634685ms)"],"step_count":1}
	{"level":"info","ts":"2025-09-18T16:40:16.461379Z","caller":"traceutil/trace.go:172","msg":"trace[271645123] transaction","detail":"{read_only:false; response_revision:1095; number_of_response:1; }","duration":"124.887827ms","start":"2025-09-18T16:40:16.336481Z","end":"2025-09-18T16:40:16.461369Z","steps":["trace[271645123] 'process raft request'  (duration: 124.535627ms)"],"step_count":1}
	{"level":"info","ts":"2025-09-18T16:41:07.619952Z","caller":"traceutil/trace.go:172","msg":"trace[183075471] linearizableReadLoop","detail":"{readStateIndex:1411; appliedIndex:1411; }","duration":"131.464646ms","start":"2025-09-18T16:41:07.488457Z","end":"2025-09-18T16:41:07.619922Z","steps":["trace[183075471] 'read index received'  (duration: 131.45449ms)","trace[183075471] 'applied index is now lower than readState.Index'  (duration: 8.617µs)"],"step_count":2}
	{"level":"warn","ts":"2025-09-18T16:41:07.620081Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"131.604046ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods\" limit:1 ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2025-09-18T16:41:07.620101Z","caller":"traceutil/trace.go:172","msg":"trace[733124816] range","detail":"{range_begin:/registry/pods; range_end:; response_count:0; response_revision:1364; }","duration":"131.641987ms","start":"2025-09-18T16:41:07.488453Z","end":"2025-09-18T16:41:07.620095Z","steps":["trace[733124816] 'agreement among raft nodes before linearized reading'  (duration: 131.573501ms)"],"step_count":1}
	{"level":"info","ts":"2025-09-18T16:41:07.620086Z","caller":"traceutil/trace.go:172","msg":"trace[1885166116] transaction","detail":"{read_only:false; response_revision:1365; number_of_response:1; }","duration":"167.287818ms","start":"2025-09-18T16:41:07.452784Z","end":"2025-09-18T16:41:07.620072Z","steps":["trace[1885166116] 'process raft request'  (duration: 167.172001ms)"],"step_count":1}
	
	
	==> kernel <==
	 16:43:45 up 26 min,  0 users,  load average: 0.47, 0.56, 0.30
	Linux addons-294579 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [b6d25218967967d438a0ea58bd37988675379159cd23e1c8dfe9a1a86d0e5f84] <==
	I0918 16:41:38.243484       1 main.go:301] handling current node
	I0918 16:41:48.242129       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:41:48.242179       1 main.go:301] handling current node
	I0918 16:41:58.241846       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:41:58.241882       1 main.go:301] handling current node
	I0918 16:42:08.251120       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:42:08.251155       1 main.go:301] handling current node
	I0918 16:42:18.243155       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:42:18.243190       1 main.go:301] handling current node
	I0918 16:42:28.241831       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:42:28.241872       1 main.go:301] handling current node
	I0918 16:42:38.250991       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:42:38.251032       1 main.go:301] handling current node
	I0918 16:42:48.242817       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:42:48.242869       1 main.go:301] handling current node
	I0918 16:42:58.241918       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:42:58.241950       1 main.go:301] handling current node
	I0918 16:43:08.250073       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:43:08.250105       1 main.go:301] handling current node
	I0918 16:43:18.244440       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:43:18.244468       1 main.go:301] handling current node
	I0918 16:43:28.251599       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:43:28.251642       1 main.go:301] handling current node
	I0918 16:43:38.250818       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:43:38.250857       1 main.go:301] handling current node
	
	
	==> kube-apiserver [6f923f832bbf9bf6b7d379d7c697fc36460d4217beb758e4103063cdb27e59bd] <==
	E0918 16:40:54.206135       1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8443->192.168.49.1:58584: use of closed network connection
	E0918 16:40:54.381705       1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8443->192.168.49.1:58600: use of closed network connection
	I0918 16:41:03.442610       1 alloc.go:328] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.102.189.208"}
	I0918 16:41:10.515921       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:41:17.493938       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).
	I0918 16:41:17.589825       1 controller.go:667] quota admission added evaluator for: ingresses.networking.k8s.io
	I0918 16:41:17.828790       1 alloc.go:328] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.111.52.124"}
	I0918 16:41:26.630166       1 controller.go:667] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
	I0918 16:41:37.990840       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:41:55.474833       1 handler.go:285] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0918 16:41:55.474882       1 handler.go:285] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0918 16:41:55.489937       1 handler.go:285] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0918 16:41:55.489983       1 handler.go:285] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0918 16:41:55.492983       1 handler.go:285] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0918 16:41:55.493021       1 handler.go:285] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0918 16:41:55.503092       1 handler.go:285] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0918 16:41:55.503152       1 handler.go:285] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0918 16:41:55.538709       1 handler.go:285] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0918 16:41:55.538817       1 handler.go:285] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	W0918 16:41:56.492998       1 cacher.go:182] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
	W0918 16:41:56.538959       1 cacher.go:182] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
	W0918 16:41:56.555001       1 cacher.go:182] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
	I0918 16:42:26.967957       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:43:03.724661       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:43:43.872410       1 alloc.go:328] "allocated clusterIPs" service="default/hello-world-app" clusterIPs={"IPv4":"10.99.140.132"}
	
	
	==> kube-controller-manager [79fd768db03a751dee530bd1f71d352ff32ac34643d3d0b1396d4b5cfb9eec71] <==
	I0918 16:42:04.786591       1 shared_informer.go:356] "Caches are synced" controller="resource quota"
	I0918 16:42:04.811061       1 shared_informer.go:349] "Waiting for caches to sync" controller="garbage collector"
	I0918 16:42:04.811104       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	E0918 16:42:05.345583       1 reflector.go:422] "The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking" err="the server could not find the requested resource"
	E0918 16:42:05.346431       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError" reflector="k8s.io/client-go/metadata/metadatainformer/informer.go:138" type="*v1.PartialObjectMetadata"
	E0918 16:42:06.219579       1 reflector.go:422] "The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking" err="the server could not find the requested resource"
	E0918 16:42:06.220483       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError" reflector="k8s.io/client-go/metadata/metadatainformer/informer.go:138" type="*v1.PartialObjectMetadata"
	E0918 16:42:13.467990       1 reflector.go:422] "The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking" err="the server could not find the requested resource"
	E0918 16:42:13.468963       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError" reflector="k8s.io/client-go/metadata/metadatainformer/informer.go:138" type="*v1.PartialObjectMetadata"
	E0918 16:42:14.312137       1 reflector.go:422] "The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking" err="the server could not find the requested resource"
	E0918 16:42:14.313214       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError" reflector="k8s.io/client-go/metadata/metadatainformer/informer.go:138" type="*v1.PartialObjectMetadata"
	E0918 16:42:16.473306       1 reflector.go:422] "The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking" err="the server could not find the requested resource"
	E0918 16:42:16.474362       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError" reflector="k8s.io/client-go/metadata/metadatainformer/informer.go:138" type="*v1.PartialObjectMetadata"
	E0918 16:42:33.616251       1 reflector.go:422] "The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking" err="the server could not find the requested resource"
	E0918 16:42:33.617305       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError" reflector="k8s.io/client-go/metadata/metadatainformer/informer.go:138" type="*v1.PartialObjectMetadata"
	E0918 16:42:36.767069       1 reflector.go:422] "The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking" err="the server could not find the requested resource"
	E0918 16:42:36.768088       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError" reflector="k8s.io/client-go/metadata/metadatainformer/informer.go:138" type="*v1.PartialObjectMetadata"
	E0918 16:42:37.835641       1 reflector.go:422] "The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking" err="the server could not find the requested resource"
	E0918 16:42:37.836544       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError" reflector="k8s.io/client-go/metadata/metadatainformer/informer.go:138" type="*v1.PartialObjectMetadata"
	E0918 16:43:08.368383       1 reflector.go:422] "The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking" err="the server could not find the requested resource"
	E0918 16:43:08.369339       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError" reflector="k8s.io/client-go/metadata/metadatainformer/informer.go:138" type="*v1.PartialObjectMetadata"
	E0918 16:43:20.873347       1 reflector.go:422] "The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking" err="the server could not find the requested resource"
	E0918 16:43:20.874360       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError" reflector="k8s.io/client-go/metadata/metadatainformer/informer.go:138" type="*v1.PartialObjectMetadata"
	E0918 16:43:23.799569       1 reflector.go:422] "The watchlist request ended with an error, falling back to the standard LIST/WATCH semantics because making progress is better than deadlocking" err="the server could not find the requested resource"
	E0918 16:43:23.800530       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError" reflector="k8s.io/client-go/metadata/metadatainformer/informer.go:138" type="*v1.PartialObjectMetadata"
	
	
	==> kube-proxy [6c099ea35b3639775580395c38a15b50a9c309fc0f8cb610f42ab0a9c13757a2] <==
	I0918 16:39:07.901674       1 server_linux.go:53] "Using iptables proxy"
	I0918 16:39:07.965197       1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
	I0918 16:39:08.065363       1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
	I0918 16:39:08.065396       1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.49.2"]
	E0918 16:39:08.065468       1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
	I0918 16:39:08.084809       1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0918 16:39:08.084863       1 server_linux.go:132] "Using iptables Proxier"
	I0918 16:39:08.091048       1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
	I0918 16:39:08.098031       1 server.go:527] "Version info" version="v1.34.0"
	I0918 16:39:08.098057       1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 16:39:08.099440       1 config.go:403] "Starting serviceCIDR config controller"
	I0918 16:39:08.099463       1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
	I0918 16:39:08.099445       1 config.go:200] "Starting service config controller"
	I0918 16:39:08.099471       1 config.go:106] "Starting endpoint slice config controller"
	I0918 16:39:08.099485       1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
	I0918 16:39:08.099517       1 config.go:309] "Starting node config controller"
	I0918 16:39:08.099487       1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
	I0918 16:39:08.099524       1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
	I0918 16:39:08.199666       1 shared_informer.go:356] "Caches are synced" controller="node config"
	I0918 16:39:08.199681       1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
	I0918 16:39:08.199697       1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
	I0918 16:39:08.199705       1 shared_informer.go:356] "Caches are synced" controller="service config"
	
	
	==> kube-scheduler [e19dadcebac9ae266c223846fdb7a70b81012c8aef9017d31aea2b39f1147d19] <==
	E0918 16:38:57.594914       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
	E0918 16:38:57.594595       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
	E0918 16:38:57.594680       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
	E0918 16:38:57.594763       1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
	E0918 16:38:57.594813       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
	E0918 16:38:57.594827       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
	E0918 16:38:57.594542       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
	E0918 16:38:57.595200       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
	E0918 16:38:57.595192       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
	E0918 16:38:57.595476       1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
	E0918 16:38:58.400989       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
	E0918 16:38:58.421351       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
	E0918 16:38:58.433467       1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: deviceclasses.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"deviceclasses\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
	E0918 16:38:58.433469       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
	E0918 16:38:58.446954       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
	E0918 16:38:58.528463       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
	E0918 16:38:58.590934       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
	E0918 16:38:58.604930       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
	E0918 16:38:58.647010       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
	E0918 16:38:58.659159       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
	E0918 16:38:58.674299       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
	E0918 16:38:58.678578       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
	E0918 16:38:58.717917       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
	E0918 16:38:58.970791       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
	I0918 16:39:01.290489       1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	
	
	==> kubelet <==
	Sep 18 16:42:00 addons-294579 kubelet[1565]: I0918 16:42:00.118536    1565 scope.go:117] "RemoveContainer" containerID="7fc6961169114d17144bf11b4e3510aa9766b98bc52e42e7de1ed95b52c73a3d"
	Sep 18 16:42:00 addons-294579 kubelet[1565]: I0918 16:42:00.138017    1565 scope.go:117] "RemoveContainer" containerID="d35ed799571689dd08a88d597fa95c42ea7c76280beb67e9c0b83e116f3bd53d"
	Sep 18 16:42:10 addons-294579 kubelet[1565]: E0918 16:42:10.092169    1565 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758213730091899953  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:42:10 addons-294579 kubelet[1565]: E0918 16:42:10.092204    1565 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758213730091899953  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:42:20 addons-294579 kubelet[1565]: E0918 16:42:20.094750    1565 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758213740094541697  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:42:20 addons-294579 kubelet[1565]: E0918 16:42:20.094779    1565 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758213740094541697  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:42:30 addons-294579 kubelet[1565]: E0918 16:42:30.097395    1565 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758213750097179338  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:42:30 addons-294579 kubelet[1565]: E0918 16:42:30.097429    1565 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758213750097179338  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:42:40 addons-294579 kubelet[1565]: E0918 16:42:40.100091    1565 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758213760099865375  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:42:40 addons-294579 kubelet[1565]: E0918 16:42:40.100125    1565 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758213760099865375  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:42:50 addons-294579 kubelet[1565]: E0918 16:42:50.102194    1565 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758213770101898893  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:42:50 addons-294579 kubelet[1565]: E0918 16:42:50.102225    1565 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758213770101898893  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:43:00 addons-294579 kubelet[1565]: E0918 16:43:00.105233    1565 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758213780104942098  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:43:00 addons-294579 kubelet[1565]: E0918 16:43:00.105266    1565 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758213780104942098  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:43:04 addons-294579 kubelet[1565]: I0918 16:43:04.052110    1565 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="default/busybox" secret="" err="secret \"gcp-auth\" not found"
	Sep 18 16:43:10 addons-294579 kubelet[1565]: E0918 16:43:10.108224    1565 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758213790107956639  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:43:10 addons-294579 kubelet[1565]: E0918 16:43:10.108255    1565 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758213790107956639  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:43:20 addons-294579 kubelet[1565]: E0918 16:43:20.110776    1565 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758213800110492640  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:43:20 addons-294579 kubelet[1565]: E0918 16:43:20.110814    1565 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758213800110492640  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:43:30 addons-294579 kubelet[1565]: E0918 16:43:30.112997    1565 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758213810112723638  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:43:30 addons-294579 kubelet[1565]: E0918 16:43:30.113066    1565 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758213810112723638  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:43:40 addons-294579 kubelet[1565]: E0918 16:43:40.115309    1565 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758213820114992832  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:43:40 addons-294579 kubelet[1565]: E0918 16:43:40.115343    1565 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758213820114992832  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:608711}  inodes_used:{value:230}}"
	Sep 18 16:43:43 addons-294579 kubelet[1565]: I0918 16:43:43.973938    1565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t85n\" (UniqueName: \"kubernetes.io/projected/a70b236a-93b9-4b9a-bfb8-eedf410e780e-kube-api-access-5t85n\") pod \"hello-world-app-5d498dc89-897bg\" (UID: \"a70b236a-93b9-4b9a-bfb8-eedf410e780e\") " pod="default/hello-world-app-5d498dc89-897bg"
	Sep 18 16:43:44 addons-294579 kubelet[1565]: I0918 16:43:44.911460    1565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="default/hello-world-app-5d498dc89-897bg" podStartSLOduration=1.287171417 podStartE2EDuration="1.911441053s" podCreationTimestamp="2025-09-18 16:43:43 +0000 UTC" firstStartedPulling="2025-09-18 16:43:44.129878012 +0000 UTC m=+284.160413213" lastFinishedPulling="2025-09-18 16:43:44.754147646 +0000 UTC m=+284.784682849" observedRunningTime="2025-09-18 16:43:44.911251325 +0000 UTC m=+284.941786562" watchObservedRunningTime="2025-09-18 16:43:44.911441053 +0000 UTC m=+284.941976266"
	
	
	==> storage-provisioner [82a49d0273b50d7d3d4fcb23b521044e23878621613a4712a075ddecf0f541bc] <==
	W0918 16:43:20.306749       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:22.309575       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:22.313599       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:24.316022       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:24.319883       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:26.322355       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:26.326094       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:28.328870       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:28.332809       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:30.336031       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:30.339640       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:32.341828       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:32.346464       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:34.349319       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:34.353136       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:36.356072       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:36.361136       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:38.364289       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:38.368002       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:40.371146       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:40.374815       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:42.378176       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:42.381955       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:44.385188       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:43:44.389310       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	

                                                
                                                
-- /stdout --
helpers_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-294579 -n addons-294579
helpers_test.go:269: (dbg) Run:  kubectl --context addons-294579 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:280: non-running pods: ingress-nginx-admission-create-flq8n ingress-nginx-admission-patch-2rfsk
helpers_test.go:282: ======> post-mortem[TestAddons/parallel/Ingress]: describe non-running pods <======
helpers_test.go:285: (dbg) Run:  kubectl --context addons-294579 describe pod ingress-nginx-admission-create-flq8n ingress-nginx-admission-patch-2rfsk
helpers_test.go:285: (dbg) Non-zero exit: kubectl --context addons-294579 describe pod ingress-nginx-admission-create-flq8n ingress-nginx-admission-patch-2rfsk: exit status 1 (67.903583ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "ingress-nginx-admission-create-flq8n" not found
	Error from server (NotFound): pods "ingress-nginx-admission-patch-2rfsk" not found

                                                
                                                
** /stderr **
helpers_test.go:287: kubectl --context addons-294579 describe pod ingress-nginx-admission-create-flq8n ingress-nginx-admission-patch-2rfsk: exit status 1
addons_test.go:1053: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:1053: (dbg) Done: out/minikube-linux-amd64 -p addons-294579 addons disable ingress-dns --alsologtostderr -v=1: (1.492804936s)
addons_test.go:1053: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 addons disable ingress --alsologtostderr -v=1
addons_test.go:1053: (dbg) Done: out/minikube-linux-amd64 -p addons-294579 addons disable ingress --alsologtostderr -v=1: (7.672717718s)
--- FAIL: TestAddons/parallel/Ingress (158.29s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (603.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1636: (dbg) Run:  kubectl --context functional-366930 create deployment hello-node-connect --image kicbase/echo-server
functional_test.go:1640: (dbg) Run:  kubectl --context functional-366930 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1645: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:352: "hello-node-connect-7d85dfc575-6v2ng" [520d37ee-ebe6-4a8b-a52a-40975d6b8bc4] Pending / Ready:ContainersNotReady (containers with unready status: [echo-server]) / ContainersReady:ContainersNotReady (containers with unready status: [echo-server])
helpers_test.go:337: TestFunctional/parallel/ServiceCmdConnect: WARNING: pod list for "default" "app=hello-node-connect" returned: client rate limiter Wait returned an error: context deadline exceeded
functional_test.go:1645: ***** TestFunctional/parallel/ServiceCmdConnect: pod "app=hello-node-connect" failed to start within 10m0s: context deadline exceeded ****
functional_test.go:1645: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p functional-366930 -n functional-366930
functional_test.go:1645: TestFunctional/parallel/ServiceCmdConnect: showing logs for failed pods as of 2025-09-18 16:56:51.674328083 +0000 UTC m=+1123.753423331
functional_test.go:1645: (dbg) Run:  kubectl --context functional-366930 describe po hello-node-connect-7d85dfc575-6v2ng -n default
functional_test.go:1645: (dbg) kubectl --context functional-366930 describe po hello-node-connect-7d85dfc575-6v2ng -n default:
Name:             hello-node-connect-7d85dfc575-6v2ng
Namespace:        default
Priority:         0
Service Account:  default
Node:             functional-366930/192.168.49.2
Start Time:       Thu, 18 Sep 2025 16:46:51 +0000
Labels:           app=hello-node-connect
pod-template-hash=7d85dfc575
Annotations:      <none>
Status:           Pending
IP:               10.244.0.10
IPs:
IP:           10.244.0.10
Controlled By:  ReplicaSet/hello-node-connect-7d85dfc575
Containers:
echo-server:
Container ID:   
Image:          kicbase/echo-server
Image ID:       
Port:           <none>
Host Port:      <none>
State:          Waiting
Reason:       ImagePullBackOff
Ready:          False
Restart Count:  0
Environment:    <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-fs7td (ro)
Conditions:
Type                        Status
PodReadyToStartContainers   True 
Initialized                 True 
Ready                       False 
ContainersReady             False 
PodScheduled                True 
Volumes:
kube-api-access-fs7td:
Type:                    Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds:  3607
ConfigMapName:           kube-root-ca.crt
Optional:                false
DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type     Reason     Age                     From               Message
----     ------     ----                    ----               -------
Normal   Scheduled  10m                     default-scheduler  Successfully assigned default/hello-node-connect-7d85dfc575-6v2ng to functional-366930
Normal   Pulling    7m12s (x5 over 10m)     kubelet            Pulling image "kicbase/echo-server"
Warning  Failed     7m12s (x5 over 10m)     kubelet            Failed to pull image "kicbase/echo-server": short-name "kicbase/echo-server:latest" did not resolve to an alias and no unqualified-search registries are defined in "/etc/containers/registries.conf"
Warning  Failed     7m12s (x5 over 10m)     kubelet            Error: ErrImagePull
Normal   BackOff    4m54s (x21 over 9m59s)  kubelet            Back-off pulling image "kicbase/echo-server"
Warning  Failed     4m54s (x21 over 9m59s)  kubelet            Error: ImagePullBackOff
functional_test.go:1645: (dbg) Run:  kubectl --context functional-366930 logs hello-node-connect-7d85dfc575-6v2ng -n default
functional_test.go:1645: (dbg) Non-zero exit: kubectl --context functional-366930 logs hello-node-connect-7d85dfc575-6v2ng -n default: exit status 1 (61.371691ms)

                                                
                                                
** stderr ** 
	Error from server (BadRequest): container "echo-server" in pod "hello-node-connect-7d85dfc575-6v2ng" is waiting to start: trying and failing to pull image

                                                
                                                
** /stderr **
functional_test.go:1645: kubectl --context functional-366930 logs hello-node-connect-7d85dfc575-6v2ng -n default: exit status 1
functional_test.go:1646: failed waiting for hello-node pod: app=hello-node-connect within 10m0s: context deadline exceeded
functional_test.go:1608: service test failed - dumping debug information
functional_test.go:1609: -----------------------service failure post-mortem--------------------------------
functional_test.go:1612: (dbg) Run:  kubectl --context functional-366930 describe po hello-node-connect
functional_test.go:1616: hello-node pod describe:
Name:             hello-node-connect-7d85dfc575-6v2ng
Namespace:        default
Priority:         0
Service Account:  default
Node:             functional-366930/192.168.49.2
Start Time:       Thu, 18 Sep 2025 16:46:51 +0000
Labels:           app=hello-node-connect
pod-template-hash=7d85dfc575
Annotations:      <none>
Status:           Pending
IP:               10.244.0.10
IPs:
IP:           10.244.0.10
Controlled By:  ReplicaSet/hello-node-connect-7d85dfc575
Containers:
echo-server:
Container ID:   
Image:          kicbase/echo-server
Image ID:       
Port:           <none>
Host Port:      <none>
State:          Waiting
Reason:       ImagePullBackOff
Ready:          False
Restart Count:  0
Environment:    <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-fs7td (ro)
Conditions:
Type                        Status
PodReadyToStartContainers   True 
Initialized                 True 
Ready                       False 
ContainersReady             False 
PodScheduled                True 
Volumes:
kube-api-access-fs7td:
Type:                    Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds:  3607
ConfigMapName:           kube-root-ca.crt
Optional:                false
DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type     Reason     Age                     From               Message
----     ------     ----                    ----               -------
Normal   Scheduled  10m                     default-scheduler  Successfully assigned default/hello-node-connect-7d85dfc575-6v2ng to functional-366930
Normal   Pulling    7m12s (x5 over 10m)     kubelet            Pulling image "kicbase/echo-server"
Warning  Failed     7m12s (x5 over 10m)     kubelet            Failed to pull image "kicbase/echo-server": short-name "kicbase/echo-server:latest" did not resolve to an alias and no unqualified-search registries are defined in "/etc/containers/registries.conf"
Warning  Failed     7m12s (x5 over 10m)     kubelet            Error: ErrImagePull
Normal   BackOff    4m54s (x21 over 9m59s)  kubelet            Back-off pulling image "kicbase/echo-server"
Warning  Failed     4m54s (x21 over 9m59s)  kubelet            Error: ImagePullBackOff

                                                
                                                
functional_test.go:1618: (dbg) Run:  kubectl --context functional-366930 logs -l app=hello-node-connect
functional_test.go:1618: (dbg) Non-zero exit: kubectl --context functional-366930 logs -l app=hello-node-connect: exit status 1 (63.558414ms)

                                                
                                                
** stderr ** 
	Error from server (BadRequest): container "echo-server" in pod "hello-node-connect-7d85dfc575-6v2ng" is waiting to start: trying and failing to pull image

                                                
                                                
** /stderr **
functional_test.go:1620: "kubectl --context functional-366930 logs -l app=hello-node-connect" failed: exit status 1
functional_test.go:1622: hello-node logs:
functional_test.go:1624: (dbg) Run:  kubectl --context functional-366930 describe svc hello-node-connect
functional_test.go:1628: hello-node svc describe:
Name:                     hello-node-connect
Namespace:                default
Labels:                   app=hello-node-connect
Annotations:              <none>
Selector:                 app=hello-node-connect
Type:                     NodePort
IP Family Policy:         SingleStack
IP Families:              IPv4
IP:                       10.105.86.97
IPs:                      10.105.86.97
Port:                     <unset>  8080/TCP
TargetPort:               8080/TCP
NodePort:                 <unset>  30564/TCP
Endpoints:                
Session Affinity:         None
External Traffic Policy:  Cluster
Internal Traffic Policy:  Cluster
Events:                   <none>
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======>  post-mortem[TestFunctional/parallel/ServiceCmdConnect]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======>  post-mortem[TestFunctional/parallel/ServiceCmdConnect]: docker inspect <======
helpers_test.go:239: (dbg) Run:  docker inspect functional-366930
helpers_test.go:243: (dbg) docker inspect functional-366930:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "20f60d27f24144358bccf3742514bfb6aa9d6224d9dac83421b8c2f50a40d870",
	        "Created": "2025-09-18T16:44:56.508144919Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 37551,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2025-09-18T16:44:56.545713226Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:c6b5532e987b5b4f5fc9cb0336e378ed49c0542bad8cbfc564b71e977a6269de",
	        "ResolvConfPath": "/var/lib/docker/containers/20f60d27f24144358bccf3742514bfb6aa9d6224d9dac83421b8c2f50a40d870/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/20f60d27f24144358bccf3742514bfb6aa9d6224d9dac83421b8c2f50a40d870/hostname",
	        "HostsPath": "/var/lib/docker/containers/20f60d27f24144358bccf3742514bfb6aa9d6224d9dac83421b8c2f50a40d870/hosts",
	        "LogPath": "/var/lib/docker/containers/20f60d27f24144358bccf3742514bfb6aa9d6224d9dac83421b8c2f50a40d870/20f60d27f24144358bccf3742514bfb6aa9d6224d9dac83421b8c2f50a40d870-json.log",
	        "Name": "/functional-366930",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "functional-366930:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "functional-366930",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8441/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "private",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4294967296,
	            "NanoCpus": 0,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8589934592,
	            "MemorySwappiness": null,
	            "OomKillDisable": null,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "ID": "20f60d27f24144358bccf3742514bfb6aa9d6224d9dac83421b8c2f50a40d870",
	                "LowerDir": "/var/lib/docker/overlay2/87fcaaf59950a6c152fc79744e5e07916722eb5ea369794a67babcbc2facc925-init/diff:/var/lib/docker/overlay2/1fd2bbb67ab9e5bb8d4549665a1a228eadda56df39fee53908cd735ea16a4e10/diff",
	                "MergedDir": "/var/lib/docker/overlay2/87fcaaf59950a6c152fc79744e5e07916722eb5ea369794a67babcbc2facc925/merged",
	                "UpperDir": "/var/lib/docker/overlay2/87fcaaf59950a6c152fc79744e5e07916722eb5ea369794a67babcbc2facc925/diff",
	                "WorkDir": "/var/lib/docker/overlay2/87fcaaf59950a6c152fc79744e5e07916722eb5ea369794a67babcbc2facc925/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "functional-366930",
	                "Source": "/var/lib/docker/volumes/functional-366930/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "functional-366930",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8441/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "functional-366930",
	                "name.minikube.sigs.k8s.io": "functional-366930",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "8fd0baa558592c715346f63844cce93549c6940e8a8f6f161fcc52a4111d264c",
	            "SandboxKey": "/var/run/docker/netns/8fd0baa55859",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32778"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32779"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32782"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32780"
	                    }
	                ],
	                "8441/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32781"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "functional-366930": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "e2:44:05:0b:b9:4b",
	                    "DriverOpts": null,
	                    "GwPriority": 0,
	                    "NetworkID": "337580234e74cc0e80cefdb2f1043d1f05020d798d47ce74a536bce50ad6bf65",
	                    "EndpointID": "be310cef848958d6713bb2e258ac3f7bbd61687f9c51318488cf9bda5c02592e",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "functional-366930",
	                        "20f60d27f241"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p functional-366930 -n functional-366930
helpers_test.go:252: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======>  post-mortem[TestFunctional/parallel/ServiceCmdConnect]: minikube logs <======
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p functional-366930 logs -n 25: (1.501359089s)
helpers_test.go:260: TestFunctional/parallel/ServiceCmdConnect logs: 
-- stdout --
	
	==> Audit <==
	┌────────────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬───────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
	│    COMMAND     │                                                           ARGS                                                            │      PROFILE      │  USER   │ VERSION │     START TIME      │      END TIME       │
	├────────────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼───────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
	│ image          │ functional-366930 image load /home/jenkins/workspace/Docker_Linux_crio_integration/echo-server-save.tar --alsologtostderr │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:46 UTC │ 18 Sep 25 16:46 UTC │
	│ image          │ functional-366930 image ls                                                                                                │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:46 UTC │ 18 Sep 25 16:46 UTC │
	│ image          │ functional-366930 image save --daemon kicbase/echo-server:functional-366930 --alsologtostderr                             │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:46 UTC │ 18 Sep 25 16:46 UTC │
	│ ssh            │ functional-366930 ssh sudo cat /etc/ssl/certs/11368.pem                                                                   │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:46 UTC │ 18 Sep 25 16:46 UTC │
	│ ssh            │ functional-366930 ssh sudo cat /usr/share/ca-certificates/11368.pem                                                       │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:46 UTC │ 18 Sep 25 16:46 UTC │
	│ ssh            │ functional-366930 ssh sudo cat /etc/ssl/certs/51391683.0                                                                  │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:46 UTC │ 18 Sep 25 16:46 UTC │
	│ ssh            │ functional-366930 ssh sudo cat /etc/ssl/certs/113682.pem                                                                  │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:46 UTC │ 18 Sep 25 16:46 UTC │
	│ ssh            │ functional-366930 ssh sudo cat /usr/share/ca-certificates/113682.pem                                                      │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:46 UTC │ 18 Sep 25 16:46 UTC │
	│ ssh            │ functional-366930 ssh sudo cat /etc/ssl/certs/3ec20f2e.0                                                                  │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:46 UTC │ 18 Sep 25 16:46 UTC │
	│ ssh            │ functional-366930 ssh sudo cat /etc/test/nested/copy/11368/hosts                                                          │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:46 UTC │ 18 Sep 25 16:46 UTC │
	│ image          │ functional-366930 image ls --format short --alsologtostderr                                                               │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:47 UTC │ 18 Sep 25 16:47 UTC │
	│ image          │ functional-366930 image ls --format yaml --alsologtostderr                                                                │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:47 UTC │ 18 Sep 25 16:47 UTC │
	│ ssh            │ functional-366930 ssh pgrep buildkitd                                                                                     │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:47 UTC │                     │
	│ image          │ functional-366930 image build -t localhost/my-image:functional-366930 testdata/build --alsologtostderr                    │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:47 UTC │ 18 Sep 25 16:47 UTC │
	│ image          │ functional-366930 image ls                                                                                                │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:47 UTC │ 18 Sep 25 16:47 UTC │
	│ image          │ functional-366930 image ls --format json --alsologtostderr                                                                │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:47 UTC │ 18 Sep 25 16:47 UTC │
	│ image          │ functional-366930 image ls --format table --alsologtostderr                                                               │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:47 UTC │ 18 Sep 25 16:47 UTC │
	│ update-context │ functional-366930 update-context --alsologtostderr -v=2                                                                   │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:47 UTC │ 18 Sep 25 16:47 UTC │
	│ update-context │ functional-366930 update-context --alsologtostderr -v=2                                                                   │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:47 UTC │ 18 Sep 25 16:47 UTC │
	│ update-context │ functional-366930 update-context --alsologtostderr -v=2                                                                   │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:47 UTC │ 18 Sep 25 16:47 UTC │
	│ service        │ functional-366930 service list                                                                                            │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:56 UTC │ 18 Sep 25 16:56 UTC │
	│ service        │ functional-366930 service list -o json                                                                                    │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:56 UTC │ 18 Sep 25 16:56 UTC │
	│ service        │ functional-366930 service --namespace=default --https --url hello-node                                                    │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:56 UTC │                     │
	│ service        │ functional-366930 service hello-node --url --format={{.IP}}                                                               │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:56 UTC │                     │
	│ service        │ functional-366930 service hello-node --url                                                                                │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:56 UTC │                     │
	└────────────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴───────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
	
	
	==> Last Start <==
	Log file created at: 2025/09/18 16:46:34
	Running on machine: ubuntu-20-agent-4
	Binary: Built with gc go1.24.6 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0918 16:46:34.050890   48374 out.go:360] Setting OutFile to fd 1 ...
	I0918 16:46:34.051199   48374 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:46:34.051216   48374 out.go:374] Setting ErrFile to fd 2...
	I0918 16:46:34.051222   48374 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:46:34.051576   48374 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 16:46:34.052194   48374 out.go:368] Setting JSON to false
	I0918 16:46:34.053331   48374 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":1745,"bootTime":1758212249,"procs":216,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 16:46:34.053439   48374 start.go:140] virtualization: kvm guest
	I0918 16:46:34.055597   48374 out.go:179] * [functional-366930] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 16:46:34.057159   48374 notify.go:220] Checking for updates...
	I0918 16:46:34.057168   48374 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 16:46:34.058464   48374 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 16:46:34.060280   48374 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 16:46:34.065243   48374 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 16:46:34.066769   48374 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 16:46:34.069912   48374 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 16:46:34.028779   48349 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:46:34.029373   48349 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 16:46:34.055400   48349 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 16:46:34.055594   48349 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:46:34.118215   48349 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:37 OomKillDisable:false NGoroutines:56 SystemTime:2025-09-18 16:46:34.106642739 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:46:34.118381   48349 docker.go:318] overlay module found
	I0918 16:46:34.123697   48349 out.go:179] * Utilisation du pilote docker basé sur le profil existant
	I0918 16:46:34.125633   48349 start.go:304] selected driver: docker
	I0918 16:46:34.125653   48349 start.go:924] validating driver "docker" against &{Name:functional-366930 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:functional-366930 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p Mou
ntUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:46:34.125852   48349 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 16:46:34.127830   48349 out.go:203] 
	W0918 16:46:34.129523   48349 out.go:285] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0918 16:46:34.131075   48349 out.go:203] 
	I0918 16:46:34.071823   48374 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:46:34.072382   48374 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 16:46:34.099212   48374 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 16:46:34.099323   48374 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:46:34.159693   48374 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:37 OomKillDisable:false NGoroutines:56 SystemTime:2025-09-18 16:46:34.149477648 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:46:34.159808   48374 docker.go:318] overlay module found
	I0918 16:46:34.161691   48374 out.go:179] * Using the docker driver based on existing profile
	I0918 16:46:34.162912   48374 start.go:304] selected driver: docker
	I0918 16:46:34.162926   48374 start.go:924] validating driver "docker" against &{Name:functional-366930 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:functional-366930 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p Mou
ntUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:46:34.163002   48374 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 16:46:34.163083   48374 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:46:34.223157   48374 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:37 OomKillDisable:false NGoroutines:56 SystemTime:2025-09-18 16:46:34.213336415 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:46:34.223846   48374 cni.go:84] Creating CNI manager for ""
	I0918 16:46:34.223914   48374 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0918 16:46:34.223958   48374 start.go:348] cluster config:
	{Name:functional-366930 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:functional-366930 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket:
NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Disab
leCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:46:34.226746   48374 out.go:179] * dry-run validation complete!
	
	
	==> CRI-O <==
	Sep 18 16:47:04 functional-366930 crio[4214]: time="2025-09-18 16:47:04.950183843Z" level=info msg="Stopping pod sandbox: 488f7f05ef4a8ab9bca1e5ebbff1431e892662b8dc0ff30874f94050216f80ff" id=d5c9c01a-4820-4df3-876f-911d55495244 name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 18 16:47:04 functional-366930 crio[4214]: time="2025-09-18 16:47:04.950229805Z" level=info msg="Stopped pod sandbox (already stopped): 488f7f05ef4a8ab9bca1e5ebbff1431e892662b8dc0ff30874f94050216f80ff" id=d5c9c01a-4820-4df3-876f-911d55495244 name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 18 16:47:04 functional-366930 crio[4214]: time="2025-09-18 16:47:04.950623958Z" level=info msg="Removing pod sandbox: 488f7f05ef4a8ab9bca1e5ebbff1431e892662b8dc0ff30874f94050216f80ff" id=a83ae91f-6015-4bde-b1c0-528bf17ffe21 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Sep 18 16:47:04 functional-366930 crio[4214]: time="2025-09-18 16:47:04.956580493Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
	Sep 18 16:47:04 functional-366930 crio[4214]: time="2025-09-18 16:47:04.956629528Z" level=info msg="Removed pod sandbox: 488f7f05ef4a8ab9bca1e5ebbff1431e892662b8dc0ff30874f94050216f80ff" id=a83ae91f-6015-4bde-b1c0-528bf17ffe21 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Sep 18 16:47:04 functional-366930 crio[4214]: time="2025-09-18 16:47:04.957121954Z" level=info msg="Stopping pod sandbox: 361fba322a64b3a41c191f72f300224bea45cb592f3a03a8cbc7db778a468566" id=c300d568-2f18-4e8e-ac09-095d43dafe81 name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 18 16:47:04 functional-366930 crio[4214]: time="2025-09-18 16:47:04.957160281Z" level=info msg="Stopped pod sandbox (already stopped): 361fba322a64b3a41c191f72f300224bea45cb592f3a03a8cbc7db778a468566" id=c300d568-2f18-4e8e-ac09-095d43dafe81 name=/runtime.v1.RuntimeService/StopPodSandbox
	Sep 18 16:47:04 functional-366930 crio[4214]: time="2025-09-18 16:47:04.957554854Z" level=info msg="Removing pod sandbox: 361fba322a64b3a41c191f72f300224bea45cb592f3a03a8cbc7db778a468566" id=2198bbfc-e0cf-48d6-94bc-e71f6b68ccb9 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Sep 18 16:47:04 functional-366930 crio[4214]: time="2025-09-18 16:47:04.964219727Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
	Sep 18 16:47:04 functional-366930 crio[4214]: time="2025-09-18 16:47:04.964265762Z" level=info msg="Removed pod sandbox: 361fba322a64b3a41c191f72f300224bea45cb592f3a03a8cbc7db778a468566" id=2198bbfc-e0cf-48d6-94bc-e71f6b68ccb9 name=/runtime.v1.RuntimeService/RemovePodSandbox
	Sep 18 16:47:05 functional-366930 crio[4214]: time="2025-09-18 16:47:05.919619146Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=b04b22bc-ea9a-4871-a72b-98948327c7ba name=/runtime.v1.ImageService/PullImage
	Sep 18 16:47:18 functional-366930 crio[4214]: time="2025-09-18 16:47:18.919190455Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=25f41759-14c2-426d-8f7d-ca0f2394d17f name=/runtime.v1.ImageService/PullImage
	Sep 18 16:47:29 functional-366930 crio[4214]: time="2025-09-18 16:47:29.919168334Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=92b979ef-e462-4ff3-bb15-e3412c4fb8c2 name=/runtime.v1.ImageService/PullImage
	Sep 18 16:47:46 functional-366930 crio[4214]: time="2025-09-18 16:47:46.574198068Z" level=info msg="Cleaning up stale resource k8s_kube-apiserver_kube-apiserver-functional-366930_kube-system_a0ae7f9bdcbe99bbecca4848e1bd19a4_1"
	Sep 18 16:47:46 functional-366930 crio[4214]: time="2025-09-18 16:47:46.574272818Z" level=info msg="createCtr: removing container ID 5bf28fd4f246b2b501e97c9ff3025d1f1257719641e8e33134ab56391b92d08d from runtime" id=a2707c08-95b5-4acc-a089-f37f66f36142 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:47:46 functional-366930 crio[4214]: time="2025-09-18 16:47:46.579328013Z" level=info msg="createCtr: removing container ID 5bf28fd4f246b2b501e97c9ff3025d1f1257719641e8e33134ab56391b92d08d from runtime" id=a2707c08-95b5-4acc-a089-f37f66f36142 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:47:46 functional-366930 crio[4214]: time="2025-09-18 16:47:46.579378002Z" level=info msg="createCtr: removing container ID 5bf28fd4f246b2b501e97c9ff3025d1f1257719641e8e33134ab56391b92d08d from runtime" id=a2707c08-95b5-4acc-a089-f37f66f36142 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:47:46 functional-366930 crio[4214]: time="2025-09-18 16:47:46.579392140Z" level=info msg="createCtr: removing container ID 5bf28fd4f246b2b501e97c9ff3025d1f1257719641e8e33134ab56391b92d08d from runtime" id=a2707c08-95b5-4acc-a089-f37f66f36142 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:47:46 functional-366930 crio[4214]: time="2025-09-18 16:47:46.579478633Z" level=info msg="createCtr: removing container ID 5bf28fd4f246b2b501e97c9ff3025d1f1257719641e8e33134ab56391b92d08d from runtime" id=a2707c08-95b5-4acc-a089-f37f66f36142 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:48:09 functional-366930 crio[4214]: time="2025-09-18 16:48:09.919138116Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=3aabeb54-55b3-4b18-b68f-1c1cbdfa633c name=/runtime.v1.ImageService/PullImage
	Sep 18 16:48:18 functional-366930 crio[4214]: time="2025-09-18 16:48:18.919302967Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=19d7e576-fd2f-4df3-90ad-364431a8492b name=/runtime.v1.ImageService/PullImage
	Sep 18 16:49:39 functional-366930 crio[4214]: time="2025-09-18 16:49:39.919156796Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=9d9df294-9a1c-4b33-9091-9dbf72310280 name=/runtime.v1.ImageService/PullImage
	Sep 18 16:49:42 functional-366930 crio[4214]: time="2025-09-18 16:49:42.919138278Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=32df3424-7a37-4444-8616-e16961713301 name=/runtime.v1.ImageService/PullImage
	Sep 18 16:52:23 functional-366930 crio[4214]: time="2025-09-18 16:52:23.919165805Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=127b561a-b74c-44bc-b311-7a79e593d294 name=/runtime.v1.ImageService/PullImage
	Sep 18 16:52:29 functional-366930 crio[4214]: time="2025-09-18 16:52:29.919208761Z" level=info msg="Pulling image: kicbase/echo-server:latest" id=835f0d7d-dc34-4860-bd20-2cc96591e071 name=/runtime.v1.ImageService/PullImage
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                                            CREATED             STATE               NAME                        ATTEMPT             POD ID              POD
	9ecb0d8d600e0       docker.io/library/mysql@sha256:4bc6bc963e6d8443453676cae56536f4b8156d78bae03c0145cbe47c2aad73bb                  9 minutes ago       Running             mysql                       0                   f4e49042a4b46       mysql-5bb876957f-drvbw
	7861a4f0268ba       docker.io/library/nginx@sha256:27637a97e3d1d0518adc2a877b60db3779970f19474b6e586ddcbc2d5500e285                  10 minutes ago      Running             myfrontend                  0                   dd0aa68dc0910       sp-pod
	11930619c7f78       docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93         10 minutes ago      Running             kubernetes-dashboard        0                   dcad53fb32784       kubernetes-dashboard-855c9754f9-cn4dx
	c768961cb1d58       docker.io/kubernetesui/metrics-scraper@sha256:43227e8286fd379ee0415a5e2156a9439c4056807e3caa38e1dd413b0644807a   10 minutes ago      Running             dashboard-metrics-scraper   0                   ca38992f86117       dashboard-metrics-scraper-77bf4d6c4c-v2tvl
	2ccf8d74058c5       gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e              10 minutes ago      Exited              mount-munger                0                   2fbb55f47792a       busybox-mount
	56257cb42138d       docker.io/library/nginx@sha256:42a516af16b852e33b7682d5ef8acbd5d13fe08fecadc7ed98605ba5e3b26ab8                  10 minutes ago      Running             nginx                       0                   4656440d45459       nginx-svc
	731d1b03ebea1       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                                 10 minutes ago      Running             storage-provisioner         2                   2f9c225fd0217       storage-provisioner
	f04373ce2156e       90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90                                                 10 minutes ago      Running             kube-apiserver              0                   ae6b49b52b96b       kube-apiserver-functional-366930
	fa8e55d1616ed       a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634                                                 10 minutes ago      Running             kube-controller-manager     1                   60a8d33cb7863       kube-controller-manager-functional-366930
	2413df063f2a6       5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115                                                 10 minutes ago      Running             etcd                        1                   23dc5aed50e62       etcd-functional-366930
	fac3a6dd2f632       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                                 10 minutes ago      Running             coredns                     1                   fb64b1f68003c       coredns-66bc5c9577-lwjcn
	3ac9013ca5762       46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc                                                 10 minutes ago      Running             kube-scheduler              1                   e001771430cfc       kube-scheduler-functional-366930
	ae443e130c3de       df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce                                                 10 minutes ago      Running             kube-proxy                  1                   644f736f51e29       kube-proxy-cff9k
	7dc5299a82fad       409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c                                                 10 minutes ago      Running             kindnet-cni                 1                   f4ca3d02e92a9       kindnet-ffpxq
	856a766c1f7ae       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                                 10 minutes ago      Exited              storage-provisioner         1                   2f9c225fd0217       storage-provisioner
	ad064b718e677       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                                 11 minutes ago      Exited              coredns                     0                   fb64b1f68003c       coredns-66bc5c9577-lwjcn
	a7d5f11fad155       df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce                                                 11 minutes ago      Exited              kube-proxy                  0                   644f736f51e29       kube-proxy-cff9k
	28fe95395e86a       409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c                                                 11 minutes ago      Exited              kindnet-cni                 0                   f4ca3d02e92a9       kindnet-ffpxq
	f6e76ee0aaa6f       46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc                                                 11 minutes ago      Exited              kube-scheduler              0                   e001771430cfc       kube-scheduler-functional-366930
	4cb1a01504173       5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115                                                 11 minutes ago      Exited              etcd                        0                   23dc5aed50e62       etcd-functional-366930
	9cded950aeb6d       a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634                                                 11 minutes ago      Exited              kube-controller-manager     0                   60a8d33cb7863       kube-controller-manager-functional-366930
	
	
	==> coredns [ad064b718e677a1fe7f1b33ed0c39a47980d0d0877fc148fde4bb422336e029f] <==
	maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
	.:53
	[INFO] plugin/reload: Running configuration SHA512 = 9e2996f8cb67ac53e0259ab1f8d615d07d1beb0bd07e6a1e39769c3bf486a905bb991cc47f8d2f14d0d3a90a87dfc625a0b4c524fed169d8158c40657c0694b1
	CoreDNS-1.12.1
	linux/amd64, go1.24.1, 707c7c1
	[INFO] 127.0.0.1:55687 - 51493 "HINFO IN 1165728289899223367.6014184709361099124. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.036417272s
	[INFO] SIGTERM: Shutting down servers then terminating
	[INFO] plugin/health: Going into lameduck mode for 5s
	
	
	==> coredns [fac3a6dd2f63260e5a8c6cf9bd59bdc79758585a49775b0aec65356df3615068] <==
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
	[ERROR] plugin/kubernetes: Unhandled Error
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
	[ERROR] plugin/kubernetes: Unhandled Error
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
	[ERROR] plugin/kubernetes: Unhandled Error
	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
	.:53
	[INFO] plugin/reload: Running configuration SHA512 = 9e2996f8cb67ac53e0259ab1f8d615d07d1beb0bd07e6a1e39769c3bf486a905bb991cc47f8d2f14d0d3a90a87dfc625a0b4c524fed169d8158c40657c0694b1
	CoreDNS-1.12.1
	linux/amd64, go1.24.1, 707c7c1
	[INFO] 127.0.0.1:58701 - 1933 "HINFO IN 2131185552024442904.8245432209842822466. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.018418327s
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
	[ERROR] plugin/kubernetes: Unhandled Error
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
	[ERROR] plugin/kubernetes: Unhandled Error
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: connect: connection refused
	[ERROR] plugin/kubernetes: Unhandled Error
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	
	
	==> describe nodes <==
	Name:               functional-366930
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=functional-366930
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=functional-366930
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2025_09_18T16_45_12_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:45:09 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  functional-366930
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 16:56:49 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 16:56:19 +0000   Thu, 18 Sep 2025 16:45:07 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 16:56:19 +0000   Thu, 18 Sep 2025 16:45:07 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 16:56:19 +0000   Thu, 18 Sep 2025 16:45:07 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 16:56:19 +0000   Thu, 18 Sep 2025 16:45:28 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    functional-366930
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 bbb0fdf1c2634f53833da2281dc6cacf
	  System UUID:                97da99ff-315e-4043-a81e-285144faac96
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (15 in total)
	  Namespace                   Name                                          CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                          ------------  ----------  ---------------  -------------  ---
	  default                     hello-node-75c85bcc94-hvvxm                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         10m
	  default                     hello-node-connect-7d85dfc575-6v2ng           0 (0%)        0 (0%)      0 (0%)           0 (0%)         10m
	  default                     mysql-5bb876957f-drvbw                        600m (7%)     700m (8%)   512Mi (1%)       700Mi (2%)     9m57s
	  default                     nginx-svc                                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         10m
	  default                     sp-pod                                        0 (0%)        0 (0%)      0 (0%)           0 (0%)         10m
	  kube-system                 coredns-66bc5c9577-lwjcn                      100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     11m
	  kube-system                 etcd-functional-366930                        100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         11m
	  kube-system                 kindnet-ffpxq                                 100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      11m
	  kube-system                 kube-apiserver-functional-366930              250m (3%)     0 (0%)      0 (0%)           0 (0%)         10m
	  kube-system                 kube-controller-manager-functional-366930     200m (2%)     0 (0%)      0 (0%)           0 (0%)         11m
	  kube-system                 kube-proxy-cff9k                              0 (0%)        0 (0%)      0 (0%)           0 (0%)         11m
	  kube-system                 kube-scheduler-functional-366930              100m (1%)     0 (0%)      0 (0%)           0 (0%)         11m
	  kube-system                 storage-provisioner                           0 (0%)        0 (0%)      0 (0%)           0 (0%)         11m
	  kubernetes-dashboard        dashboard-metrics-scraper-77bf4d6c4c-v2tvl    0 (0%)        0 (0%)      0 (0%)           0 (0%)         10m
	  kubernetes-dashboard        kubernetes-dashboard-855c9754f9-cn4dx         0 (0%)        0 (0%)      0 (0%)           0 (0%)         10m
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests     Limits
	  --------           --------     ------
	  cpu                1450m (18%)  800m (10%)
	  memory             732Mi (2%)   920Mi (2%)
	  ephemeral-storage  0 (0%)       0 (0%)
	  hugepages-1Gi      0 (0%)       0 (0%)
	  hugepages-2Mi      0 (0%)       0 (0%)
	Events:
	  Type    Reason                   Age                From             Message
	  ----    ------                   ----               ----             -------
	  Normal  Starting                 11m                kube-proxy       
	  Normal  Starting                 10m                kube-proxy       
	  Normal  NodeHasSufficientMemory  11m (x8 over 11m)  kubelet          Node functional-366930 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    11m (x8 over 11m)  kubelet          Node functional-366930 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     11m (x8 over 11m)  kubelet          Node functional-366930 status is now: NodeHasSufficientPID
	  Normal  NodeHasSufficientPID     11m                kubelet          Node functional-366930 status is now: NodeHasSufficientPID
	  Normal  NodeHasSufficientMemory  11m                kubelet          Node functional-366930 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    11m                kubelet          Node functional-366930 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 11m                kubelet          Starting kubelet.
	  Normal  RegisteredNode           11m                node-controller  Node functional-366930 event: Registered Node functional-366930 in Controller
	  Normal  NodeReady                11m                kubelet          Node functional-366930 status is now: NodeReady
	  Normal  Starting                 10m                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  10m (x8 over 10m)  kubelet          Node functional-366930 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    10m (x8 over 10m)  kubelet          Node functional-366930 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     10m (x8 over 10m)  kubelet          Node functional-366930 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           10m                node-controller  Node functional-366930 event: Registered Node functional-366930 in Controller
	
	
	==> dmesg <==
	[  +0.089038] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
	[  +0.028015] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
	[  +7.570818] kauditd_printk_skb: 47 callbacks suppressed
	[Sep18 16:41] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.013586] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023854] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023944] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023869] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023927] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000033] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +2.047789] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +4.031621] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000030] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +8.127251] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[Sep18 16:42] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[ +32.253146] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	
	
	==> etcd [2413df063f2a666911c7569cf0a24d9340ed8539e2e9f4adb0121adb0ddc633f] <==
	{"level":"warn","ts":"2025-09-18T16:46:06.394917Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53020","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.402302Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53044","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.408986Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53070","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.418482Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53086","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.429952Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53098","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.443483Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53124","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.450649Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53134","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.459767Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53150","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.464134Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53168","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.470236Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53192","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.476281Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53222","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.482588Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53232","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.489993Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53240","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.496262Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53278","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.502384Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53286","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.508814Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53310","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.515459Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53322","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.521557Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53338","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.536798Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53366","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.546368Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53386","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.552657Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53412","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:46:06.606396Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:53416","server-name":"","error":"EOF"}
	{"level":"info","ts":"2025-09-18T16:56:06.098215Z","caller":"mvcc/index.go:194","msg":"compact tree index","revision":1140}
	{"level":"info","ts":"2025-09-18T16:56:06.119110Z","caller":"mvcc/kvstore_compaction.go:70","msg":"finished scheduled compaction","compact-revision":1140,"took":"20.529998ms","hash":441233721,"current-db-size-bytes":3420160,"current-db-size":"3.4 MB","current-db-size-in-use-bytes":1523712,"current-db-size-in-use":"1.5 MB"}
	{"level":"info","ts":"2025-09-18T16:56:06.119158Z","caller":"mvcc/hash.go:157","msg":"storing new hash","hash":441233721,"revision":1140,"compact-revision":-1}
	
	
	==> etcd [4cb1a015041738e2068b4c01ff13d7628e0ef838117c8124a5f76bc3e2817f86] <==
	{"level":"warn","ts":"2025-09-18T16:45:08.542060Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:60558","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:45:08.548478Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:60588","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:45:08.554707Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:60616","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:45:08.567220Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:60630","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:45:08.573665Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:60644","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:45:08.581330Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:60654","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T16:45:08.628609Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:60690","server-name":"","error":"EOF"}
	{"level":"info","ts":"2025-09-18T16:46:03.516885Z","caller":"osutil/interrupt_unix.go:65","msg":"received signal; shutting down","signal":"terminated"}
	{"level":"info","ts":"2025-09-18T16:46:03.516972Z","caller":"embed/etcd.go:426","msg":"closing etcd server","name":"functional-366930","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"]}
	{"level":"error","ts":"2025-09-18T16:46:03.517089Z","caller":"embed/etcd.go:912","msg":"setting up serving from embedded etcd failed.","error":"http: Server closed","stacktrace":"go.etcd.io/etcd/server/v3/embed.(*Etcd).errHandler\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:912\ngo.etcd.io/etcd/server/v3/embed.(*serveCtx).startHandler.func1\n\tgo.etcd.io/etcd/server/v3/embed/serve.go:90"}
	{"level":"error","ts":"2025-09-18T16:46:03.518597Z","caller":"embed/etcd.go:912","msg":"setting up serving from embedded etcd failed.","error":"http: Server closed","stacktrace":"go.etcd.io/etcd/server/v3/embed.(*Etcd).errHandler\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:912\ngo.etcd.io/etcd/server/v3/embed.(*serveCtx).startHandler.func1\n\tgo.etcd.io/etcd/server/v3/embed/serve.go:90"}
	{"level":"error","ts":"2025-09-18T16:46:03.518643Z","caller":"embed/etcd.go:912","msg":"setting up serving from embedded etcd failed.","error":"accept tcp 127.0.0.1:2381: use of closed network connection","stacktrace":"go.etcd.io/etcd/server/v3/embed.(*Etcd).errHandler\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:912\ngo.etcd.io/etcd/server/v3/embed.(*Etcd).startHandler.func1\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:906"}
	{"level":"info","ts":"2025-09-18T16:46:03.518661Z","caller":"etcdserver/server.go:1281","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"aec36adc501070cc","current-leader-member-id":"aec36adc501070cc"}
	{"level":"info","ts":"2025-09-18T16:46:03.518743Z","caller":"etcdserver/server.go:2342","msg":"server has stopped; stopping storage version's monitor"}
	{"level":"info","ts":"2025-09-18T16:46:03.518760Z","caller":"etcdserver/server.go:2319","msg":"server has stopped; stopping cluster version's monitor"}
	{"level":"warn","ts":"2025-09-18T16:46:03.518744Z","caller":"embed/serve.go:245","msg":"stopping secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}
	{"level":"warn","ts":"2025-09-18T16:46:03.518780Z","caller":"embed/serve.go:247","msg":"stopped secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}
	{"level":"error","ts":"2025-09-18T16:46:03.518797Z","caller":"embed/etcd.go:912","msg":"setting up serving from embedded etcd failed.","error":"accept tcp 127.0.0.1:2379: use of closed network connection","stacktrace":"go.etcd.io/etcd/server/v3/embed.(*Etcd).errHandler\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:912\ngo.etcd.io/etcd/server/v3/embed.(*Etcd).startHandler.func1\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:906"}
	{"level":"warn","ts":"2025-09-18T16:46:03.518754Z","caller":"embed/serve.go:245","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.49.2:2379: use of closed network connection"}
	{"level":"warn","ts":"2025-09-18T16:46:03.518814Z","caller":"embed/serve.go:247","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.49.2:2379: use of closed network connection"}
	{"level":"error","ts":"2025-09-18T16:46:03.518825Z","caller":"embed/etcd.go:912","msg":"setting up serving from embedded etcd failed.","error":"accept tcp 192.168.49.2:2379: use of closed network connection","stacktrace":"go.etcd.io/etcd/server/v3/embed.(*Etcd).errHandler\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:912\ngo.etcd.io/etcd/server/v3/embed.(*Etcd).startHandler.func1\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:906"}
	{"level":"info","ts":"2025-09-18T16:46:03.520599Z","caller":"embed/etcd.go:621","msg":"stopping serving peer traffic","address":"192.168.49.2:2380"}
	{"level":"error","ts":"2025-09-18T16:46:03.520661Z","caller":"embed/etcd.go:912","msg":"setting up serving from embedded etcd failed.","error":"accept tcp 192.168.49.2:2380: use of closed network connection","stacktrace":"go.etcd.io/etcd/server/v3/embed.(*Etcd).errHandler\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:912\ngo.etcd.io/etcd/server/v3/embed.(*Etcd).startHandler.func1\n\tgo.etcd.io/etcd/server/v3/embed/etcd.go:906"}
	{"level":"info","ts":"2025-09-18T16:46:03.520688Z","caller":"embed/etcd.go:626","msg":"stopped serving peer traffic","address":"192.168.49.2:2380"}
	{"level":"info","ts":"2025-09-18T16:46:03.520696Z","caller":"embed/etcd.go:428","msg":"closed etcd server","name":"functional-366930","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"]}
	
	
	==> kernel <==
	 16:56:53 up 39 min,  0 users,  load average: 0.17, 0.21, 0.26
	Linux functional-366930 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [28fe95395e86aa8acd170df35762916760610bbb3c8b064a73b8c0b39ac315cc] <==
	I0918 16:45:17.476074       1 main.go:109] connected to apiserver: https://10.96.0.1:443
	I0918 16:45:17.567953       1 main.go:139] hostIP = 192.168.49.2
	podIP = 192.168.49.2
	I0918 16:45:17.568106       1 main.go:148] setting mtu 1500 for CNI 
	I0918 16:45:17.568125       1 main.go:178] kindnetd IP family: "ipv4"
	I0918 16:45:17.568140       1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
	time="2025-09-18T16:45:17Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
	I0918 16:45:17.676307       1 controller.go:377] "Starting controller" name="kube-network-policies"
	I0918 16:45:17.768761       1 controller.go:381] "Waiting for informer caches to sync"
	I0918 16:45:17.768817       1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
	I0918 16:45:17.769016       1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
	I0918 16:45:18.069224       1 shared_informer.go:357] "Caches are synced" controller="kube-network-policies"
	I0918 16:45:18.069255       1 metrics.go:72] Registering metrics
	I0918 16:45:18.069345       1 controller.go:711] "Syncing nftables rules"
	I0918 16:45:27.676724       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:45:27.676811       1 main.go:301] handling current node
	I0918 16:45:37.683609       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:45:37.683649       1 main.go:301] handling current node
	I0918 16:45:47.679628       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:45:47.679663       1 main.go:301] handling current node
	
	
	==> kindnet [7dc5299a82fadab1444133000d57290bd4e278f3a7efa08e039e6ac416f72145] <==
	I0918 16:54:44.224627       1 main.go:301] handling current node
	I0918 16:54:54.227422       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:54:54.227458       1 main.go:301] handling current node
	I0918 16:55:04.232642       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:55:04.232675       1 main.go:301] handling current node
	I0918 16:55:14.224258       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:55:14.224292       1 main.go:301] handling current node
	I0918 16:55:24.225849       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:55:24.225881       1 main.go:301] handling current node
	I0918 16:55:34.232145       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:55:34.232185       1 main.go:301] handling current node
	I0918 16:55:44.224237       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:55:44.224286       1 main.go:301] handling current node
	I0918 16:55:54.227646       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:55:54.227685       1 main.go:301] handling current node
	I0918 16:56:04.233422       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:56:04.233458       1 main.go:301] handling current node
	I0918 16:56:14.224218       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:56:14.224249       1 main.go:301] handling current node
	I0918 16:56:24.226727       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:56:24.226758       1 main.go:301] handling current node
	I0918 16:56:34.232065       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:56:34.232115       1 main.go:301] handling current node
	I0918 16:56:44.224967       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:56:44.225007       1 main.go:301] handling current node
	
	
	==> kube-apiserver [f04373ce2156ef4f9fb5e0e6a790cdb09e8b333802ba3cc12627b55be95e356a] <==
	I0918 16:46:44.528252       1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.107.230.209"}
	I0918 16:46:51.363126       1 alloc.go:328] "allocated clusterIPs" service="default/hello-node-connect" clusterIPs={"IPv4":"10.105.86.97"}
	E0918 16:46:51.617320       1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8441->192.168.49.1:53450: use of closed network connection
	I0918 16:46:56.124345       1 alloc.go:328] "allocated clusterIPs" service="default/mysql" clusterIPs={"IPv4":"10.96.57.106"}
	E0918 16:46:59.356214       1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8441->192.168.49.1:58120: use of closed network connection
	E0918 16:47:10.279401       1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8441->192.168.49.1:49002: use of closed network connection
	E0918 16:47:10.976596       1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8441->192.168.49.1:49016: use of closed network connection
	E0918 16:47:12.236002       1 conn.go:339] Error on socket receive: read tcp 192.168.49.2:8441->192.168.49.1:49042: use of closed network connection
	I0918 16:47:19.357078       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:47:28.680288       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:48:35.770597       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:48:45.484566       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:49:48.248724       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:50:01.152926       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:51:14.158380       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:51:15.222621       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:52:35.659663       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:52:37.118219       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:53:45.118589       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:53:46.560520       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:55:01.732185       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:55:07.668898       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:56:06.994053       1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
	I0918 16:56:09.431936       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:56:10.496496       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	
	
	==> kube-controller-manager [9cded950aeb6d3d8e9ff357695a3317dd2bb9adc58c3850580ccfd690a9d6850] <==
	I0918 16:45:16.017103       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrapproving"
	I0918 16:45:16.017125       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	I0918 16:45:16.017140       1 garbagecollector.go:154] "Garbage collector: all resource monitors have synced" logger="garbage-collector-controller"
	I0918 16:45:16.017148       1 garbagecollector.go:157] "Proceeding to collect garbage" logger="garbage-collector-controller"
	I0918 16:45:16.017862       1 shared_informer.go:356] "Caches are synced" controller="attach detach"
	I0918 16:45:16.017892       1 shared_informer.go:356] "Caches are synced" controller="service-cidr-controller"
	I0918 16:45:16.017900       1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
	I0918 16:45:16.018461       1 shared_informer.go:356] "Caches are synced" controller="expand"
	I0918 16:45:16.018509       1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice_mirroring"
	I0918 16:45:16.018742       1 shared_informer.go:356] "Caches are synced" controller="taint"
	I0918 16:45:16.019011       1 node_lifecycle_controller.go:1221] "Initializing eviction metric for zone" logger="node-lifecycle-controller" zone=""
	I0918 16:45:16.019250       1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="functional-366930"
	I0918 16:45:16.019358       1 node_lifecycle_controller.go:1025] "Controller detected that all Nodes are not-Ready. Entering master disruption mode" logger="node-lifecycle-controller"
	I0918 16:45:16.019855       1 shared_informer.go:356] "Caches are synced" controller="endpoint"
	I0918 16:45:16.020168       1 shared_informer.go:356] "Caches are synced" controller="crt configmap"
	I0918 16:45:16.020276       1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
	I0918 16:45:16.020329       1 shared_informer.go:356] "Caches are synced" controller="stateful set"
	I0918 16:45:16.020391       1 shared_informer.go:356] "Caches are synced" controller="ReplicaSet"
	I0918 16:45:16.021720       1 shared_informer.go:356] "Caches are synced" controller="job"
	I0918 16:45:16.023152       1 shared_informer.go:356] "Caches are synced" controller="namespace"
	I0918 16:45:16.026704       1 shared_informer.go:356] "Caches are synced" controller="GC"
	I0918 16:45:16.029892       1 shared_informer.go:356] "Caches are synced" controller="resource quota"
	I0918 16:45:16.038198       1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
	I0918 16:45:16.042455       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	I0918 16:45:31.021838       1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
	
	
	==> kube-controller-manager [fa8e55d1616ed55816589dc57ad2793c9af7047b71de2f0a7a5c29685a27cfba] <==
	I0918 16:46:10.377862       1 shared_informer.go:356] "Caches are synced" controller="ReplicaSet"
	I0918 16:46:10.378883       1 shared_informer.go:356] "Caches are synced" controller="TTL"
	I0918 16:46:10.378903       1 shared_informer.go:356] "Caches are synced" controller="stateful set"
	I0918 16:46:10.378920       1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice"
	I0918 16:46:10.379017       1 shared_informer.go:356] "Caches are synced" controller="endpoint"
	I0918 16:46:10.383993       1 shared_informer.go:356] "Caches are synced" controller="resource quota"
	I0918 16:46:10.390868       1 shared_informer.go:356] "Caches are synced" controller="resource quota"
	I0918 16:46:10.392011       1 shared_informer.go:356] "Caches are synced" controller="node"
	I0918 16:46:10.392111       1 range_allocator.go:177] "Sending events to api server" logger="node-ipam-controller"
	I0918 16:46:10.392162       1 range_allocator.go:183] "Starting range CIDR allocator" logger="node-ipam-controller"
	I0918 16:46:10.392173       1 shared_informer.go:349] "Waiting for caches to sync" controller="cidrallocator"
	I0918 16:46:10.392182       1 shared_informer.go:356] "Caches are synced" controller="cidrallocator"
	I0918 16:46:10.395316       1 shared_informer.go:356] "Caches are synced" controller="taint"
	I0918 16:46:10.395388       1 node_lifecycle_controller.go:1221] "Initializing eviction metric for zone" logger="node-lifecycle-controller" zone=""
	I0918 16:46:10.395446       1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="functional-366930"
	I0918 16:46:10.395489       1 node_lifecycle_controller.go:1067] "Controller detected that zone is now in new state" logger="node-lifecycle-controller" zone="" newState="Normal"
	I0918 16:46:10.396767       1 shared_informer.go:356] "Caches are synced" controller="deployment"
	I0918 16:46:10.399103       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	I0918 16:46:10.400131       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrapproving"
	I0918 16:46:10.405080       1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
	I0918 16:46:10.405093       1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
	E0918 16:46:44.407036       1 replica_set.go:587] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-77bf4d6c4c\" failed with pods \"dashboard-metrics-scraper-77bf4d6c4c-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"
	E0918 16:46:44.414618       1 replica_set.go:587] "Unhandled Error" err="sync \"kubernetes-dashboard/kubernetes-dashboard-855c9754f9\" failed with pods \"kubernetes-dashboard-855c9754f9-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"
	E0918 16:46:44.420621       1 replica_set.go:587] "Unhandled Error" err="sync \"kubernetes-dashboard/dashboard-metrics-scraper-77bf4d6c4c\" failed with pods \"dashboard-metrics-scraper-77bf4d6c4c-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"
	E0918 16:46:44.422162       1 replica_set.go:587] "Unhandled Error" err="sync \"kubernetes-dashboard/kubernetes-dashboard-855c9754f9\" failed with pods \"kubernetes-dashboard-855c9754f9-\" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount \"kubernetes-dashboard\" not found" logger="UnhandledError"
	
	
	==> kube-proxy [a7d5f11fad1559733148b834372725174627ce1e2d77b37a26b7ec6f9c52b414] <==
	I0918 16:45:17.360121       1 server_linux.go:53] "Using iptables proxy"
	I0918 16:45:17.421196       1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
	I0918 16:45:17.521998       1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
	I0918 16:45:17.522032       1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.49.2"]
	E0918 16:45:17.522185       1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
	I0918 16:45:17.540228       1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0918 16:45:17.540296       1 server_linux.go:132] "Using iptables Proxier"
	I0918 16:45:17.545438       1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
	I0918 16:45:17.545768       1 server.go:527] "Version info" version="v1.34.0"
	I0918 16:45:17.545799       1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 16:45:17.547199       1 config.go:200] "Starting service config controller"
	I0918 16:45:17.547226       1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
	I0918 16:45:17.547278       1 config.go:403] "Starting serviceCIDR config controller"
	I0918 16:45:17.547296       1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
	I0918 16:45:17.547290       1 config.go:106] "Starting endpoint slice config controller"
	I0918 16:45:17.547321       1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
	I0918 16:45:17.547341       1 config.go:309] "Starting node config controller"
	I0918 16:45:17.547346       1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
	I0918 16:45:17.547353       1 shared_informer.go:356] "Caches are synced" controller="node config"
	I0918 16:45:17.647432       1 shared_informer.go:356] "Caches are synced" controller="service config"
	I0918 16:45:17.647469       1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
	I0918 16:45:17.647495       1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
	
	
	==> kube-proxy [ae443e130c3de9e1b0a32d11e9c89d24727c328a69d1799f53d80744e2e60bd1] <==
	I0918 16:45:53.963377       1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
	E0918 16:45:53.964320       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: Get \"https://control-plane.minikube.internal:8441/api/v1/nodes?fieldSelector=metadata.name%3Dfunctional-366930&limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
	E0918 16:45:54.898761       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: Get \"https://control-plane.minikube.internal:8441/api/v1/nodes?fieldSelector=metadata.name%3Dfunctional-366930&limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
	E0918 16:45:57.915239       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: Get \"https://control-plane.minikube.internal:8441/api/v1/nodes?fieldSelector=metadata.name%3Dfunctional-366930&limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
	E0918 16:46:03.809130       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: Get \"https://control-plane.minikube.internal:8441/api/v1/nodes?fieldSelector=metadata.name%3Dfunctional-366930&limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
	I0918 16:46:14.963902       1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
	I0918 16:46:14.963939       1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.49.2"]
	E0918 16:46:14.964022       1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
	I0918 16:46:14.984007       1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0918 16:46:14.984066       1 server_linux.go:132] "Using iptables Proxier"
	I0918 16:46:14.989677       1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
	I0918 16:46:14.990150       1 server.go:527] "Version info" version="v1.34.0"
	I0918 16:46:14.990184       1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 16:46:14.991416       1 config.go:200] "Starting service config controller"
	I0918 16:46:14.991446       1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
	I0918 16:46:14.991533       1 config.go:403] "Starting serviceCIDR config controller"
	I0918 16:46:14.991598       1 config.go:309] "Starting node config controller"
	I0918 16:46:14.991947       1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
	I0918 16:46:14.991982       1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
	I0918 16:46:14.991996       1 shared_informer.go:356] "Caches are synced" controller="node config"
	I0918 16:46:14.992030       1 config.go:106] "Starting endpoint slice config controller"
	I0918 16:46:14.992044       1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
	I0918 16:46:15.091672       1 shared_informer.go:356] "Caches are synced" controller="service config"
	I0918 16:46:15.092551       1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
	I0918 16:46:15.092633       1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
	
	
	==> kube-scheduler [3ac9013ca5762d5700a73fecc13a4c4bfcb4a1b85c88601eb10e8b3f009ba9a1] <==
	E0918 16:45:58.864786       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: Get \"https://192.168.49.2:8441/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
	E0918 16:45:58.924708       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: Get \"https://192.168.49.2:8441/api/v1/namespaces?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
	E0918 16:45:58.972644       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: Get \"https://192.168.49.2:8441/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%3Dextension-apiserver-authentication&limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
	E0918 16:45:58.994350       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: Get \"https://192.168.49.2:8441/api/v1/nodes?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
	E0918 16:45:59.217122       1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: Get \"https://192.168.49.2:8441/apis/resource.k8s.io/v1/deviceclasses?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
	E0918 16:46:00.760612       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: Get \"https://192.168.49.2:8441/apis/apps/v1/statefulsets?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
	E0918 16:46:02.284489       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: Get \"https://192.168.49.2:8441/apis/resource.k8s.io/v1/resourceclaims?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
	E0918 16:46:02.438685       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: Get \"https://192.168.49.2:8441/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
	E0918 16:46:02.533630       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: Get \"https://192.168.49.2:8441/apis/resource.k8s.io/v1/resourceslices?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
	E0918 16:46:02.653309       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: Get \"https://192.168.49.2:8441/apis/apps/v1/replicasets?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
	E0918 16:46:03.129203       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: Get \"https://192.168.49.2:8441/api/v1/pods?fieldSelector=status.phase%21%3DSucceeded%2Cstatus.phase%21%3DFailed&limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
	E0918 16:46:03.163793       1 reflector.go:205] "Failed to watch" err="failed to list *v1.DeviceClass: Get \"https://192.168.49.2:8441/apis/resource.k8s.io/v1/deviceclasses?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.DeviceClass"
	E0918 16:46:03.715746       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: Get \"https://192.168.49.2:8441/api/v1/services?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
	E0918 16:46:03.746452       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: Get \"https://192.168.49.2:8441/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
	E0918 16:46:03.800266       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: Get \"https://192.168.49.2:8441/api/v1/nodes?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
	E0918 16:46:04.041823       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: Get \"https://192.168.49.2:8441/apis/storage.k8s.io/v1/csistoragecapacities?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
	E0918 16:46:04.076487       1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: Get \"https://192.168.49.2:8441/apis/storage.k8s.io/v1/volumeattachments?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
	E0918 16:46:04.214143       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: Get \"https://192.168.49.2:8441/api/v1/persistentvolumeclaims?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
	E0918 16:46:04.289659       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: Get \"https://192.168.49.2:8441/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%3Dextension-apiserver-authentication&limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
	E0918 16:46:04.371669       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: Get \"https://192.168.49.2:8441/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
	E0918 16:46:04.517889       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: Get \"https://192.168.49.2:8441/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
	E0918 16:46:04.734174       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: Get \"https://192.168.49.2:8441/api/v1/replicationcontrollers?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
	E0918 16:46:04.801453       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: Get \"https://192.168.49.2:8441/api/v1/persistentvolumes?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
	E0918 16:46:04.847966       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Namespace: Get \"https://192.168.49.2:8441/api/v1/namespaces?limit=500&resourceVersion=0\": dial tcp 192.168.49.2:8441: connect: connection refused" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Namespace"
	I0918 16:46:15.892099       1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	
	
	==> kube-scheduler [f6e76ee0aaa6fd048202146f3cee1d4fb6d41241df044ba39ff08b3fe5df15ba] <==
	E0918 16:45:09.030426       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
	E0918 16:45:09.030464       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
	E0918 16:45:09.030496       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
	E0918 16:45:09.030529       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
	E0918 16:45:09.030567       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
	E0918 16:45:09.030611       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
	E0918 16:45:09.030621       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
	E0918 16:45:09.848192       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
	E0918 16:45:09.865488       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
	E0918 16:45:09.956305       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
	E0918 16:45:09.998559       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSINode"
	E0918 16:45:10.062196       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
	E0918 16:45:10.066161       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicaSet"
	E0918 16:45:10.113277       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PodDisruptionBudget"
	E0918 16:45:10.141622       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
	E0918 16:45:10.188999       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
	E0918 16:45:10.189252       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolumeClaim"
	E0918 16:45:10.195197       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
	E0918 16:45:10.225103       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
	I0918 16:45:10.528029       1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0918 16:45:53.231922       1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController"
	I0918 16:45:53.231993       1 secure_serving.go:259] Stopped listening on 127.0.0.1:10259
	I0918 16:45:53.232025       1 server.go:263] "[graceful-termination] secure server has stopped listening"
	I0918 16:45:53.232067       1 server.go:265] "[graceful-termination] secure server is exiting"
	E0918 16:45:53.232181       1 run.go:72] "command failed" err="finished without leader elect"
	
	
	==> kubelet <==
	Sep 18 16:55:42 functional-366930 kubelet[5254]: E0918 16:55:42.919563    5254 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short-name \\\"kicbase/echo-server:latest\\\" did not resolve to an alias and no unqualified-search registries are defined in \\\"/etc/containers/registries.conf\\\"\"" pod="default/hello-node-connect-7d85dfc575-6v2ng" podUID="520d37ee-ebe6-4a8b-a52a-40975d6b8bc4"
	Sep 18 16:55:45 functional-366930 kubelet[5254]: E0918 16:55:45.019131    5254 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214545018945526  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:303433}  inodes_used:{value:134}}"
	Sep 18 16:55:45 functional-366930 kubelet[5254]: E0918 16:55:45.019170    5254 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214545018945526  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:303433}  inodes_used:{value:134}}"
	Sep 18 16:55:55 functional-366930 kubelet[5254]: E0918 16:55:55.020708    5254 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214555020480291  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:303433}  inodes_used:{value:134}}"
	Sep 18 16:55:55 functional-366930 kubelet[5254]: E0918 16:55:55.020754    5254 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214555020480291  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:303433}  inodes_used:{value:134}}"
	Sep 18 16:55:55 functional-366930 kubelet[5254]: E0918 16:55:55.919047    5254 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short-name \\\"kicbase/echo-server:latest\\\" did not resolve to an alias and no unqualified-search registries are defined in \\\"/etc/containers/registries.conf\\\"\"" pod="default/hello-node-connect-7d85dfc575-6v2ng" podUID="520d37ee-ebe6-4a8b-a52a-40975d6b8bc4"
	Sep 18 16:55:56 functional-366930 kubelet[5254]: E0918 16:55:56.919058    5254 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short-name \\\"kicbase/echo-server:latest\\\" did not resolve to an alias and no unqualified-search registries are defined in \\\"/etc/containers/registries.conf\\\"\"" pod="default/hello-node-75c85bcc94-hvvxm" podUID="1c31e133-422a-4918-a536-9c4e595d41c1"
	Sep 18 16:56:05 functional-366930 kubelet[5254]: E0918 16:56:05.022272    5254 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214565022033831  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:303433}  inodes_used:{value:134}}"
	Sep 18 16:56:05 functional-366930 kubelet[5254]: E0918 16:56:05.022309    5254 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214565022033831  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:303433}  inodes_used:{value:134}}"
	Sep 18 16:56:07 functional-366930 kubelet[5254]: E0918 16:56:07.919083    5254 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short-name \\\"kicbase/echo-server:latest\\\" did not resolve to an alias and no unqualified-search registries are defined in \\\"/etc/containers/registries.conf\\\"\"" pod="default/hello-node-75c85bcc94-hvvxm" podUID="1c31e133-422a-4918-a536-9c4e595d41c1"
	Sep 18 16:56:07 functional-366930 kubelet[5254]: E0918 16:56:07.919083    5254 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short-name \\\"kicbase/echo-server:latest\\\" did not resolve to an alias and no unqualified-search registries are defined in \\\"/etc/containers/registries.conf\\\"\"" pod="default/hello-node-connect-7d85dfc575-6v2ng" podUID="520d37ee-ebe6-4a8b-a52a-40975d6b8bc4"
	Sep 18 16:56:15 functional-366930 kubelet[5254]: E0918 16:56:15.023861    5254 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214575023668268  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:303433}  inodes_used:{value:134}}"
	Sep 18 16:56:15 functional-366930 kubelet[5254]: E0918 16:56:15.023899    5254 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214575023668268  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:303433}  inodes_used:{value:134}}"
	Sep 18 16:56:19 functional-366930 kubelet[5254]: E0918 16:56:19.919035    5254 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short-name \\\"kicbase/echo-server:latest\\\" did not resolve to an alias and no unqualified-search registries are defined in \\\"/etc/containers/registries.conf\\\"\"" pod="default/hello-node-connect-7d85dfc575-6v2ng" podUID="520d37ee-ebe6-4a8b-a52a-40975d6b8bc4"
	Sep 18 16:56:21 functional-366930 kubelet[5254]: E0918 16:56:21.919313    5254 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short-name \\\"kicbase/echo-server:latest\\\" did not resolve to an alias and no unqualified-search registries are defined in \\\"/etc/containers/registries.conf\\\"\"" pod="default/hello-node-75c85bcc94-hvvxm" podUID="1c31e133-422a-4918-a536-9c4e595d41c1"
	Sep 18 16:56:25 functional-366930 kubelet[5254]: E0918 16:56:25.025480    5254 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214585025276963  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:303433}  inodes_used:{value:134}}"
	Sep 18 16:56:25 functional-366930 kubelet[5254]: E0918 16:56:25.025528    5254 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214585025276963  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:303433}  inodes_used:{value:134}}"
	Sep 18 16:56:34 functional-366930 kubelet[5254]: E0918 16:56:34.919946    5254 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short-name \\\"kicbase/echo-server:latest\\\" did not resolve to an alias and no unqualified-search registries are defined in \\\"/etc/containers/registries.conf\\\"\"" pod="default/hello-node-connect-7d85dfc575-6v2ng" podUID="520d37ee-ebe6-4a8b-a52a-40975d6b8bc4"
	Sep 18 16:56:35 functional-366930 kubelet[5254]: E0918 16:56:35.026935    5254 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214595026756974  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:303433}  inodes_used:{value:134}}"
	Sep 18 16:56:35 functional-366930 kubelet[5254]: E0918 16:56:35.026970    5254 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214595026756974  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:303433}  inodes_used:{value:134}}"
	Sep 18 16:56:35 functional-366930 kubelet[5254]: E0918 16:56:35.919313    5254 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short-name \\\"kicbase/echo-server:latest\\\" did not resolve to an alias and no unqualified-search registries are defined in \\\"/etc/containers/registries.conf\\\"\"" pod="default/hello-node-75c85bcc94-hvvxm" podUID="1c31e133-422a-4918-a536-9c4e595d41c1"
	Sep 18 16:56:45 functional-366930 kubelet[5254]: E0918 16:56:45.028313    5254 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214605028124258  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:303433}  inodes_used:{value:134}}"
	Sep 18 16:56:45 functional-366930 kubelet[5254]: E0918 16:56:45.028348    5254 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214605028124258  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:303433}  inodes_used:{value:134}}"
	Sep 18 16:56:45 functional-366930 kubelet[5254]: E0918 16:56:45.919020    5254 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short-name \\\"kicbase/echo-server:latest\\\" did not resolve to an alias and no unqualified-search registries are defined in \\\"/etc/containers/registries.conf\\\"\"" pod="default/hello-node-connect-7d85dfc575-6v2ng" podUID="520d37ee-ebe6-4a8b-a52a-40975d6b8bc4"
	Sep 18 16:56:49 functional-366930 kubelet[5254]: E0918 16:56:49.919105    5254 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"echo-server\" with ImagePullBackOff: \"Back-off pulling image \\\"kicbase/echo-server\\\": ErrImagePull: short-name \\\"kicbase/echo-server:latest\\\" did not resolve to an alias and no unqualified-search registries are defined in \\\"/etc/containers/registries.conf\\\"\"" pod="default/hello-node-75c85bcc94-hvvxm" podUID="1c31e133-422a-4918-a536-9c4e595d41c1"
	
	
	==> kubernetes-dashboard [11930619c7f783e702319b27bcfec5700c4be9eb26adfd91ef7340e3c655cedf] <==
	2025/09/18 16:46:49 Starting overwatch
	2025/09/18 16:46:49 Using namespace: kubernetes-dashboard
	2025/09/18 16:46:49 Using in-cluster config to connect to apiserver
	2025/09/18 16:46:49 Using secret token for csrf signing
	2025/09/18 16:46:49 Initializing csrf token from kubernetes-dashboard-csrf secret
	2025/09/18 16:46:49 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf
	2025/09/18 16:46:49 Successful initial request to the apiserver, version: v1.34.0
	2025/09/18 16:46:49 Generating JWE encryption key
	2025/09/18 16:46:49 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting
	2025/09/18 16:46:49 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard
	2025/09/18 16:46:49 Initializing JWE encryption key from synchronized object
	2025/09/18 16:46:49 Creating in-cluster Sidecar client
	2025/09/18 16:46:49 Successful request to sidecar
	2025/09/18 16:46:49 Serving insecurely on HTTP port: 9090
	
	
	==> storage-provisioner [731d1b03ebea191345fbc0f77aecb2243e293a808437c934eafb31f488233253] <==
	W0918 16:56:28.131716       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:30.134955       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:30.139961       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:32.143511       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:32.147746       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:34.151135       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:34.157629       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:36.161220       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:36.167333       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:38.169959       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:38.174137       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:40.177017       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:40.181630       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:42.184660       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:42.188763       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:44.192174       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:44.197816       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:46.201475       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:46.206644       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:48.209739       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:48.214571       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:50.218049       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:50.221854       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:52.224820       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	W0918 16:56:52.229276       1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice
	
	
	==> storage-provisioner [856a766c1f7ae0be18f81881219605459be1962479b21c3f2875f9248bb5439f] <==
	I0918 16:45:53.857117       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	F0918 16:45:53.861039       1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: connect: connection refused
	

                                                
                                                
-- /stdout --
helpers_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p functional-366930 -n functional-366930
helpers_test.go:269: (dbg) Run:  kubectl --context functional-366930 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:280: non-running pods: busybox-mount hello-node-75c85bcc94-hvvxm hello-node-connect-7d85dfc575-6v2ng
helpers_test.go:282: ======> post-mortem[TestFunctional/parallel/ServiceCmdConnect]: describe non-running pods <======
helpers_test.go:285: (dbg) Run:  kubectl --context functional-366930 describe pod busybox-mount hello-node-75c85bcc94-hvvxm hello-node-connect-7d85dfc575-6v2ng
helpers_test.go:290: (dbg) kubectl --context functional-366930 describe pod busybox-mount hello-node-75c85bcc94-hvvxm hello-node-connect-7d85dfc575-6v2ng:

                                                
                                                
-- stdout --
	Name:             busybox-mount
	Namespace:        default
	Priority:         0
	Service Account:  default
	Node:             functional-366930/192.168.49.2
	Start Time:       Thu, 18 Sep 2025 16:46:35 +0000
	Labels:           integration-test=busybox-mount
	Annotations:      <none>
	Status:           Succeeded
	IP:               10.244.0.6
	IPs:
	  IP:  10.244.0.6
	Containers:
	  mount-munger:
	    Container ID:  cri-o://2ccf8d74058c5faa704f4a18d684955e325a4d60c360f090eb79f2a995dfca4e
	    Image:         gcr.io/k8s-minikube/busybox:1.28.4-glibc
	    Image ID:      gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
	    Port:          <none>
	    Host Port:     <none>
	    Command:
	      /bin/sh
	      -c
	      --
	    Args:
	      cat /mount-9p/created-by-test; echo test > /mount-9p/created-by-pod; rm /mount-9p/created-by-test-removed-by-pod; echo test > /mount-9p/created-by-pod-removed-by-test date >> /mount-9p/pod-dates
	    State:          Terminated
	      Reason:       Completed
	      Exit Code:    0
	      Started:      Thu, 18 Sep 2025 16:46:39 +0000
	      Finished:     Thu, 18 Sep 2025 16:46:39 +0000
	    Ready:          False
	    Restart Count:  0
	    Environment:    <none>
	    Mounts:
	      /mount-9p from test-volume (rw)
	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-wtgr6 (ro)
	Conditions:
	  Type                        Status
	  PodReadyToStartContainers   False 
	  Initialized                 True 
	  Ready                       False 
	  ContainersReady             False 
	  PodScheduled                True 
	Volumes:
	  test-volume:
	    Type:          HostPath (bare host directory volume)
	    Path:          /mount-9p
	    HostPathType:  
	  kube-api-access-wtgr6:
	    Type:                    Projected (a volume that contains injected data from multiple sources)
	    TokenExpirationSeconds:  3607
	    ConfigMapName:           kube-root-ca.crt
	    Optional:                false
	    DownwardAPI:             true
	QoS Class:                   BestEffort
	Node-Selectors:              <none>
	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
	Events:
	  Type    Reason     Age   From               Message
	  ----    ------     ----  ----               -------
	  Normal  Scheduled  10m   default-scheduler  Successfully assigned default/busybox-mount to functional-366930
	  Normal  Pulling    10m   kubelet            Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
	  Normal  Pulled     10m   kubelet            Successfully pulled image "gcr.io/k8s-minikube/busybox:1.28.4-glibc" in 2.115s (3.551s including waiting). Image size: 4631262 bytes.
	  Normal  Created    10m   kubelet            Created container: mount-munger
	  Normal  Started    10m   kubelet            Started container mount-munger
	
	
	Name:             hello-node-75c85bcc94-hvvxm
	Namespace:        default
	Priority:         0
	Service Account:  default
	Node:             functional-366930/192.168.49.2
	Start Time:       Thu, 18 Sep 2025 16:46:32 +0000
	Labels:           app=hello-node
	                  pod-template-hash=75c85bcc94
	Annotations:      <none>
	Status:           Pending
	IP:               10.244.0.4
	IPs:
	  IP:           10.244.0.4
	Controlled By:  ReplicaSet/hello-node-75c85bcc94
	Containers:
	  echo-server:
	    Container ID:   
	    Image:          kicbase/echo-server
	    Image ID:       
	    Port:           <none>
	    Host Port:      <none>
	    State:          Waiting
	      Reason:       ImagePullBackOff
	    Ready:          False
	    Restart Count:  0
	    Environment:    <none>
	    Mounts:
	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-frhvh (ro)
	Conditions:
	  Type                        Status
	  PodReadyToStartContainers   True 
	  Initialized                 True 
	  Ready                       False 
	  ContainersReady             False 
	  PodScheduled                True 
	Volumes:
	  kube-api-access-frhvh:
	    Type:                    Projected (a volume that contains injected data from multiple sources)
	    TokenExpirationSeconds:  3607
	    ConfigMapName:           kube-root-ca.crt
	    Optional:                false
	    DownwardAPI:             true
	QoS Class:                   BestEffort
	Node-Selectors:              <none>
	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
	Events:
	  Type     Reason     Age                  From               Message
	  ----     ------     ----                 ----               -------
	  Normal   Scheduled  10m                  default-scheduler  Successfully assigned default/hello-node-75c85bcc94-hvvxm to functional-366930
	  Normal   Pulling    7m12s (x5 over 10m)  kubelet            Pulling image "kicbase/echo-server"
	  Warning  Failed     7m12s (x5 over 10m)  kubelet            Failed to pull image "kicbase/echo-server": short-name "kicbase/echo-server:latest" did not resolve to an alias and no unqualified-search registries are defined in "/etc/containers/registries.conf"
	  Warning  Failed     7m12s (x5 over 10m)  kubelet            Error: ErrImagePull
	  Normal   BackOff    19s (x42 over 10m)   kubelet            Back-off pulling image "kicbase/echo-server"
	  Warning  Failed     19s (x42 over 10m)   kubelet            Error: ImagePullBackOff
	
	
	Name:             hello-node-connect-7d85dfc575-6v2ng
	Namespace:        default
	Priority:         0
	Service Account:  default
	Node:             functional-366930/192.168.49.2
	Start Time:       Thu, 18 Sep 2025 16:46:51 +0000
	Labels:           app=hello-node-connect
	                  pod-template-hash=7d85dfc575
	Annotations:      <none>
	Status:           Pending
	IP:               10.244.0.10
	IPs:
	  IP:           10.244.0.10
	Controlled By:  ReplicaSet/hello-node-connect-7d85dfc575
	Containers:
	  echo-server:
	    Container ID:   
	    Image:          kicbase/echo-server
	    Image ID:       
	    Port:           <none>
	    Host Port:      <none>
	    State:          Waiting
	      Reason:       ImagePullBackOff
	    Ready:          False
	    Restart Count:  0
	    Environment:    <none>
	    Mounts:
	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-fs7td (ro)
	Conditions:
	  Type                        Status
	  PodReadyToStartContainers   True 
	  Initialized                 True 
	  Ready                       False 
	  ContainersReady             False 
	  PodScheduled                True 
	Volumes:
	  kube-api-access-fs7td:
	    Type:                    Projected (a volume that contains injected data from multiple sources)
	    TokenExpirationSeconds:  3607
	    ConfigMapName:           kube-root-ca.crt
	    Optional:                false
	    DownwardAPI:             true
	QoS Class:                   BestEffort
	Node-Selectors:              <none>
	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
	Events:
	  Type     Reason     Age                   From               Message
	  ----     ------     ----                  ----               -------
	  Normal   Scheduled  10m                   default-scheduler  Successfully assigned default/hello-node-connect-7d85dfc575-6v2ng to functional-366930
	  Normal   Pulling    7m15s (x5 over 10m)   kubelet            Pulling image "kicbase/echo-server"
	  Warning  Failed     7m15s (x5 over 10m)   kubelet            Failed to pull image "kicbase/echo-server": short-name "kicbase/echo-server:latest" did not resolve to an alias and no unqualified-search registries are defined in "/etc/containers/registries.conf"
	  Warning  Failed     7m15s (x5 over 10m)   kubelet            Error: ErrImagePull
	  Normal   BackOff    4m57s (x21 over 10m)  kubelet            Back-off pulling image "kicbase/echo-server"
	  Warning  Failed     4m57s (x21 over 10m)  kubelet            Error: ImagePullBackOff

                                                
                                                
-- /stdout --
helpers_test.go:293: <<< TestFunctional/parallel/ServiceCmdConnect FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestFunctional/parallel/ServiceCmdConnect (603.06s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (600.64s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1451: (dbg) Run:  kubectl --context functional-366930 create deployment hello-node --image kicbase/echo-server
functional_test.go:1455: (dbg) Run:  kubectl --context functional-366930 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1460: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:352: "hello-node-75c85bcc94-hvvxm" [1c31e133-422a-4918-a536-9c4e595d41c1] Pending / Ready:ContainersNotReady (containers with unready status: [echo-server]) / ContainersReady:ContainersNotReady (containers with unready status: [echo-server])
helpers_test.go:337: TestFunctional/parallel/ServiceCmd/DeployApp: WARNING: pod list for "default" "app=hello-node" returned: client rate limiter Wait returned an error: context deadline exceeded
functional_test.go:1460: ***** TestFunctional/parallel/ServiceCmd/DeployApp: pod "app=hello-node" failed to start within 10m0s: context deadline exceeded ****
functional_test.go:1460: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p functional-366930 -n functional-366930
functional_test.go:1460: TestFunctional/parallel/ServiceCmd/DeployApp: showing logs for failed pods as of 2025-09-18 16:56:32.539337797 +0000 UTC m=+1104.618433051
functional_test.go:1460: (dbg) Run:  kubectl --context functional-366930 describe po hello-node-75c85bcc94-hvvxm -n default
functional_test.go:1460: (dbg) kubectl --context functional-366930 describe po hello-node-75c85bcc94-hvvxm -n default:
Name:             hello-node-75c85bcc94-hvvxm
Namespace:        default
Priority:         0
Service Account:  default
Node:             functional-366930/192.168.49.2
Start Time:       Thu, 18 Sep 2025 16:46:32 +0000
Labels:           app=hello-node
pod-template-hash=75c85bcc94
Annotations:      <none>
Status:           Pending
IP:               10.244.0.4
IPs:
IP:           10.244.0.4
Controlled By:  ReplicaSet/hello-node-75c85bcc94
Containers:
echo-server:
Container ID:   
Image:          kicbase/echo-server
Image ID:       
Port:           <none>
Host Port:      <none>
State:          Waiting
Reason:       ImagePullBackOff
Ready:          False
Restart Count:  0
Environment:    <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-frhvh (ro)
Conditions:
Type                        Status
PodReadyToStartContainers   True 
Initialized                 True 
Ready                       False 
ContainersReady             False 
PodScheduled                True 
Volumes:
kube-api-access-frhvh:
Type:                    Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds:  3607
ConfigMapName:           kube-root-ca.crt
Optional:                false
DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type     Reason     Age                     From               Message
----     ------     ----                    ----               -------
Normal   Scheduled  10m                     default-scheduler  Successfully assigned default/hello-node-75c85bcc94-hvvxm to functional-366930
Normal   Pulling    6m50s (x5 over 10m)     kubelet            Pulling image "kicbase/echo-server"
Warning  Failed     6m50s (x5 over 10m)     kubelet            Failed to pull image "kicbase/echo-server": short-name "kicbase/echo-server:latest" did not resolve to an alias and no unqualified-search registries are defined in "/etc/containers/registries.conf"
Warning  Failed     6m50s (x5 over 10m)     kubelet            Error: ErrImagePull
Warning  Failed     4m56s (x20 over 9m59s)  kubelet            Error: ImagePullBackOff
Normal   BackOff    4m43s (x21 over 9m59s)  kubelet            Back-off pulling image "kicbase/echo-server"
functional_test.go:1460: (dbg) Run:  kubectl --context functional-366930 logs hello-node-75c85bcc94-hvvxm -n default
functional_test.go:1460: (dbg) Non-zero exit: kubectl --context functional-366930 logs hello-node-75c85bcc94-hvvxm -n default: exit status 1 (70.317316ms)

                                                
                                                
** stderr ** 
	Error from server (BadRequest): container "echo-server" in pod "hello-node-75c85bcc94-hvvxm" is waiting to start: trying and failing to pull image

                                                
                                                
** /stderr **
functional_test.go:1460: kubectl --context functional-366930 logs hello-node-75c85bcc94-hvvxm -n default: exit status 1
functional_test.go:1461: failed waiting for hello-node pod: app=hello-node within 10m0s: context deadline exceeded
--- FAIL: TestFunctional/parallel/ServiceCmd/DeployApp (600.64s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.53s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1519: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 service --namespace=default --https --url hello-node
functional_test.go:1519: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-366930 service --namespace=default --https --url hello-node: exit status 115 (533.65032ms)

                                                
                                                
-- stdout --
	https://192.168.49.2:30790
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service hello-node found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_3af0dd3f106bd0c134df3d834cbdbb288a06d35d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:1521: failed to get service url. args "out/minikube-linux-amd64 -p functional-366930 service --namespace=default --https --url hello-node" : exit status 115
--- FAIL: TestFunctional/parallel/ServiceCmd/HTTPS (0.53s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.53s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1550: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 service hello-node --url --format={{.IP}}
functional_test.go:1550: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-366930 service hello-node --url --format={{.IP}}: exit status 115 (530.723516ms)

                                                
                                                
-- stdout --
	192.168.49.2
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service hello-node found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_7cc4328ee572bf2be3730700e5bda4ff5ee9066f_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:1552: failed to get service url with custom format. args "out/minikube-linux-amd64 -p functional-366930 service hello-node --url --format={{.IP}}": exit status 115
--- FAIL: TestFunctional/parallel/ServiceCmd/Format (0.53s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.53s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1569: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 service hello-node --url
functional_test.go:1569: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-366930 service hello-node --url: exit status 115 (530.067847ms)

                                                
                                                
-- stdout --
	http://192.168.49.2:30790
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service hello-node found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_7cc4328ee572bf2be3730700e5bda4ff5ee9066f_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:1571: failed to get service url. args: "out/minikube-linux-amd64 -p functional-366930 service hello-node --url": exit status 115
functional_test.go:1575: found endpoint for hello-node: http://192.168.49.2:30790
--- FAIL: TestFunctional/parallel/ServiceCmd/URL (0.53s)

                                                
                                    
x
+
TestMultiControlPlane/serial/AddWorkerNode (30.64s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/AddWorkerNode
ha_test.go:228: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 node add --alsologtostderr -v 5
ha_test.go:228: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 node add --alsologtostderr -v 5: exit status 80 (28.645718228s)

                                                
                                                
-- stdout --
	* Adding node m04 to cluster ha-078118 as [worker]
	* Starting "ha-078118-m04" worker node in "ha-078118" cluster
	* Pulling base image v0.0.48 ...
	* Stopping node "ha-078118-m04"  ...
	* Deleting "ha-078118-m04" in docker ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 16:59:20.814557   70738 out.go:360] Setting OutFile to fd 1 ...
	I0918 16:59:20.814883   70738 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:59:20.814895   70738 out.go:374] Setting ErrFile to fd 2...
	I0918 16:59:20.814901   70738 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:59:20.815176   70738 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 16:59:20.815646   70738 mustload.go:65] Loading cluster: ha-078118
	I0918 16:59:20.816105   70738 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:59:20.816598   70738 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:59:20.835019   70738 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:59:20.835340   70738 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:59:20.890476   70738 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:65 OomKillDisable:false NGoroutines:75 SystemTime:2025-09-18 16:59:20.879851716 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:59:20.890801   70738 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 16:59:20.908362   70738 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 16:59:20.908789   70738 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 16:59:20.928064   70738 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 16:59:20.928294   70738 api_server.go:166] Checking apiserver status ...
	I0918 16:59:20.928337   70738 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 16:59:20.928378   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:59:20.946193   70738 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:59:21.046701   70738 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup
	W0918 16:59:21.057088   70738 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 16:59:21.057146   70738 ssh_runner.go:195] Run: ls
	I0918 16:59:21.060719   70738 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0918 16:59:21.065117   70738 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0918 16:59:21.067161   70738 out.go:179] * Adding node m04 to cluster ha-078118 as [worker]
	I0918 16:59:21.068989   70738 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:59:21.069135   70738 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:59:21.070996   70738 out.go:179] * Starting "ha-078118-m04" worker node in "ha-078118" cluster
	I0918 16:59:21.072626   70738 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 16:59:21.074256   70738 out.go:179] * Pulling base image v0.0.48 ...
	I0918 16:59:21.075606   70738 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:59:21.075651   70738 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
	I0918 16:59:21.075660   70738 cache.go:58] Caching tarball of preloaded images
	I0918 16:59:21.075730   70738 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 16:59:21.075747   70738 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 16:59:21.075755   70738 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 16:59:21.075846   70738 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:59:21.096901   70738 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 16:59:21.096925   70738 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 16:59:21.096940   70738 cache.go:232] Successfully downloaded all kic artifacts
	I0918 16:59:21.096969   70738 start.go:360] acquireMachinesLock for ha-078118-m04: {Name:mkdcee71069a15ce1d36f6cf5f43097fe7468c48 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 16:59:21.097082   70738 start.go:364] duration metric: took 89.35µs to acquireMachinesLock for "ha-078118-m04"
	I0918 16:59:21.097110   70738 start.go:93] Provisioning new machine with config: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:fal
se inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLo
g:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime: ControlPlane:false Worker:true}
	I0918 16:59:21.097221   70738 start.go:125] createHost starting for "m04" (driver="docker")
	I0918 16:59:21.099312   70738 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
	I0918 16:59:21.099454   70738 start.go:159] libmachine.API.Create for "ha-078118" (driver="docker")
	I0918 16:59:21.099491   70738 client.go:168] LocalClient.Create starting
	I0918 16:59:21.099625   70738 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 16:59:21.099673   70738 main.go:141] libmachine: Decoding PEM data...
	I0918 16:59:21.099693   70738 main.go:141] libmachine: Parsing certificate...
	I0918 16:59:21.099783   70738 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 16:59:21.099807   70738 main.go:141] libmachine: Decoding PEM data...
	I0918 16:59:21.099830   70738 main.go:141] libmachine: Parsing certificate...
	I0918 16:59:21.100115   70738 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:59:21.117474   70738 network_create.go:77] Found existing network {name:ha-078118 subnet:0xc000831230 gateway:[0 0 0 0 0 0 0 0 0 0 255 255 192 168 49 1] mtu:1500}
	I0918 16:59:21.117539   70738 kic.go:121] calculated static IP "192.168.49.5" for the "ha-078118-m04" container
	I0918 16:59:21.117601   70738 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 16:59:21.135395   70738 cli_runner.go:164] Run: docker volume create ha-078118-m04 --label name.minikube.sigs.k8s.io=ha-078118-m04 --label created_by.minikube.sigs.k8s.io=true
	I0918 16:59:21.154681   70738 oci.go:103] Successfully created a docker volume ha-078118-m04
	I0918 16:59:21.154745   70738 cli_runner.go:164] Run: docker run --rm --name ha-078118-m04-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m04 --entrypoint /usr/bin/test -v ha-078118-m04:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 16:59:21.526901   70738 oci.go:107] Successfully prepared a docker volume ha-078118-m04
	I0918 16:59:21.526942   70738 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:59:21.526960   70738 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 16:59:21.527016   70738 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m04:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 16:59:25.828188   70738 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m04:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.301114242s)
	I0918 16:59:25.828216   70738 kic.go:203] duration metric: took 4.301252864s to extract preloaded images to volume ...
	W0918 16:59:25.828315   70738 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 16:59:25.828349   70738 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 16:59:25.828387   70738 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 16:59:25.887305   70738 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ha-078118-m04 --name ha-078118-m04 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m04 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ha-078118-m04 --network ha-078118 --ip 192.168.49.5 --volume ha-078118-m04:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 16:59:26.174472   70738 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Running}}
	I0918 16:59:26.195572   70738 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 16:59:26.216088   70738 cli_runner.go:164] Run: docker exec ha-078118-m04 stat /var/lib/dpkg/alternatives/iptables
	I0918 16:59:26.268598   70738 oci.go:144] the created container "ha-078118-m04" has a running status.
	I0918 16:59:26.268627   70738 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa...
	I0918 16:59:26.423636   70738 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0918 16:59:26.423676   70738 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 16:59:26.648617   70738 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 16:59:26.668281   70738 cli_runner.go:164] Run: docker inspect ha-078118-m04
	I0918 16:59:26.686384   70738 errors.go:84] Postmortem inspect ("docker inspect ha-078118-m04"): -- stdout --
	[
	    {
	        "Id": "d4e12ab3cd2961c3ed116ea01030c23d220c29cbba8236b3bbd076ab03afc387",
	        "Created": "2025-09-18T16:59:25.904545565Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "exited",
	            "Running": false,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 0,
	            "ExitCode": 255,
	            "Error": "",
	            "StartedAt": "2025-09-18T16:59:25.942868288Z",
	            "FinishedAt": "2025-09-18T16:59:26.325546923Z"
	        },
	        "Image": "sha256:c6b5532e987b5b4f5fc9cb0336e378ed49c0542bad8cbfc564b71e977a6269de",
	        "ResolvConfPath": "/var/lib/docker/containers/d4e12ab3cd2961c3ed116ea01030c23d220c29cbba8236b3bbd076ab03afc387/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/d4e12ab3cd2961c3ed116ea01030c23d220c29cbba8236b3bbd076ab03afc387/hostname",
	        "HostsPath": "/var/lib/docker/containers/d4e12ab3cd2961c3ed116ea01030c23d220c29cbba8236b3bbd076ab03afc387/hosts",
	        "LogPath": "/var/lib/docker/containers/d4e12ab3cd2961c3ed116ea01030c23d220c29cbba8236b3bbd076ab03afc387/d4e12ab3cd2961c3ed116ea01030c23d220c29cbba8236b3bbd076ab03afc387-json.log",
	        "Name": "/ha-078118-m04",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ha-078118-m04:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "ha-078118",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "private",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 3221225472,
	            "NanoCpus": 0,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 6442450944,
	            "MemorySwappiness": null,
	            "OomKillDisable": null,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "ID": "d4e12ab3cd2961c3ed116ea01030c23d220c29cbba8236b3bbd076ab03afc387",
	                "LowerDir": "/var/lib/docker/overlay2/de2adaa3ae4cc58fa5d53299caff8740e3fa3fa5cb32f3403590eeb915359bd3-init/diff:/var/lib/docker/overlay2/1fd2bbb67ab9e5bb8d4549665a1a228eadda56df39fee53908cd735ea16a4e10/diff",
	                "MergedDir": "/var/lib/docker/overlay2/de2adaa3ae4cc58fa5d53299caff8740e3fa3fa5cb32f3403590eeb915359bd3/merged",
	                "UpperDir": "/var/lib/docker/overlay2/de2adaa3ae4cc58fa5d53299caff8740e3fa3fa5cb32f3403590eeb915359bd3/diff",
	                "WorkDir": "/var/lib/docker/overlay2/de2adaa3ae4cc58fa5d53299caff8740e3fa3fa5cb32f3403590eeb915359bd3/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "ha-078118-m04",
	                "Source": "/var/lib/docker/volumes/ha-078118-m04/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "ha-078118-m04",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ha-078118-m04",
	                "name.minikube.sigs.k8s.io": "ha-078118-m04",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "",
	            "SandboxKey": "",
	            "Ports": {},
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ha-078118": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.5"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "",
	                    "DriverOpts": null,
	                    "GwPriority": 0,
	                    "NetworkID": "0aa191750de6e44eaf49073a9e05a52994c63ccafcb0870d32aaf105d93cb724",
	                    "EndpointID": "",
	                    "Gateway": "",
	                    "IPAddress": "",
	                    "IPPrefixLen": 0,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "ha-078118-m04",
	                        "d4e12ab3cd29"
	                    ]
	                }
	            }
	        }
	    }
	]
	
	-- /stdout --
	I0918 16:59:26.686484   70738 cli_runner.go:164] Run: docker logs --timestamps --details ha-078118-m04
	I0918 16:59:26.708740   70738 errors.go:91] Postmortem logs ("docker logs --timestamps --details ha-078118-m04"): -- stdout --
	2025-09-18T16:59:26.166931650Z  + userns=
	2025-09-18T16:59:26.166963305Z  + grep -Eqv '0[[:space:]]+0[[:space:]]+4294967295' /proc/self/uid_map
	2025-09-18T16:59:26.169657520Z  + validate_userns
	2025-09-18T16:59:26.170254728Z  + [[ -z '' ]]
	2025-09-18T16:59:26.170263134Z  + return
	2025-09-18T16:59:26.170265104Z  + configure_containerd
	2025-09-18T16:59:26.170266860Z  + local snapshotter=
	2025-09-18T16:59:26.170273653Z  + [[ -n '' ]]
	2025-09-18T16:59:26.170275769Z  + [[ -z '' ]]
	2025-09-18T16:59:26.170277440Z  ++ stat -f -c %T /kind
	2025-09-18T16:59:26.171303011Z  + container_filesystem=overlayfs
	2025-09-18T16:59:26.171321870Z  + [[ overlayfs == \z\f\s ]]
	2025-09-18T16:59:26.171325260Z  + [[ -n '' ]]
	2025-09-18T16:59:26.171379032Z  + configure_proxy
	2025-09-18T16:59:26.171385583Z  + mkdir -p /etc/systemd/system.conf.d/
	2025-09-18T16:59:26.179706071Z  + [[ ! -z '' ]]
	2025-09-18T16:59:26.179733165Z  + cat
	2025-09-18T16:59:26.180935442Z  + fix_mount
	2025-09-18T16:59:26.180957936Z  + echo 'INFO: ensuring we can execute mount/umount even with userns-remap'
	2025-09-18T16:59:26.180962708Z  INFO: ensuring we can execute mount/umount even with userns-remap
	2025-09-18T16:59:26.181426183Z  ++ which mount
	2025-09-18T16:59:26.183002461Z  ++ which umount
	2025-09-18T16:59:26.184198766Z  + chown root:root /usr/bin/mount /usr/bin/umount
	2025-09-18T16:59:26.191327777Z  ++ which mount
	2025-09-18T16:59:26.192868871Z  ++ which umount
	2025-09-18T16:59:26.193814005Z  + chmod -s /usr/bin/mount /usr/bin/umount
	2025-09-18T16:59:26.195564400Z  +++ which mount
	2025-09-18T16:59:26.197310493Z  ++ stat -f -c %T /usr/bin/mount
	2025-09-18T16:59:26.197793655Z  + [[ overlayfs == \a\u\f\s ]]
	2025-09-18T16:59:26.197808191Z  + echo 'INFO: remounting /sys read-only'
	2025-09-18T16:59:26.197810604Z  INFO: remounting /sys read-only
	2025-09-18T16:59:26.197812588Z  + mount -o remount,ro /sys
	2025-09-18T16:59:26.199613460Z  + echo 'INFO: making mounts shared'
	2025-09-18T16:59:26.199633391Z  INFO: making mounts shared
	2025-09-18T16:59:26.199637406Z  + mount --make-rshared /
	2025-09-18T16:59:26.200945915Z  + retryable_fix_cgroup
	2025-09-18T16:59:26.201255850Z  ++ seq 0 10
	2025-09-18T16:59:26.202074833Z  + for i in $(seq 0 10)
	2025-09-18T16:59:26.202090893Z  + fix_cgroup
	2025-09-18T16:59:26.202170703Z  + [[ -f /sys/fs/cgroup/cgroup.controllers ]]
	2025-09-18T16:59:26.202182414Z  + echo 'INFO: detected cgroup v2'
	2025-09-18T16:59:26.202185676Z  INFO: detected cgroup v2
	2025-09-18T16:59:26.202204927Z  + return
	2025-09-18T16:59:26.202232804Z  + return
	2025-09-18T16:59:26.202254679Z  + fix_machine_id
	2025-09-18T16:59:26.202258475Z  + echo 'INFO: clearing and regenerating /etc/machine-id'
	2025-09-18T16:59:26.202269464Z  INFO: clearing and regenerating /etc/machine-id
	2025-09-18T16:59:26.202272385Z  + rm -f /etc/machine-id
	2025-09-18T16:59:26.203372556Z  + systemd-machine-id-setup
	2025-09-18T16:59:26.207046050Z  Initializing machine ID from random generator.
	2025-09-18T16:59:26.209451111Z  + fix_product_name
	2025-09-18T16:59:26.209464466Z  + [[ -f /sys/class/dmi/id/product_name ]]
	2025-09-18T16:59:26.209466813Z  + echo 'INFO: faking /sys/class/dmi/id/product_name to be "kind"'
	2025-09-18T16:59:26.209468754Z  INFO: faking /sys/class/dmi/id/product_name to be "kind"
	2025-09-18T16:59:26.209470534Z  + echo kind
	2025-09-18T16:59:26.210770018Z  + mount -o ro,bind /kind/product_name /sys/class/dmi/id/product_name
	2025-09-18T16:59:26.212525297Z  + fix_product_uuid
	2025-09-18T16:59:26.212542838Z  + [[ ! -f /kind/product_uuid ]]
	2025-09-18T16:59:26.212546554Z  + cat /proc/sys/kernel/random/uuid
	2025-09-18T16:59:26.213733944Z  + [[ -f /sys/class/dmi/id/product_uuid ]]
	2025-09-18T16:59:26.213750019Z  + echo 'INFO: faking /sys/class/dmi/id/product_uuid to be random'
	2025-09-18T16:59:26.213753877Z  INFO: faking /sys/class/dmi/id/product_uuid to be random
	2025-09-18T16:59:26.213756916Z  + mount -o ro,bind /kind/product_uuid /sys/class/dmi/id/product_uuid
	2025-09-18T16:59:26.215431700Z  + [[ -f /sys/devices/virtual/dmi/id/product_uuid ]]
	2025-09-18T16:59:26.215447039Z  + echo 'INFO: faking /sys/devices/virtual/dmi/id/product_uuid as well'
	2025-09-18T16:59:26.215450890Z  INFO: faking /sys/devices/virtual/dmi/id/product_uuid as well
	2025-09-18T16:59:26.215453931Z  + mount -o ro,bind /kind/product_uuid /sys/devices/virtual/dmi/id/product_uuid
	2025-09-18T16:59:26.216936789Z  + select_iptables
	2025-09-18T16:59:26.216949943Z  + local mode num_legacy_lines num_nft_lines
	2025-09-18T16:59:26.217831478Z  ++ grep -c '^-'
	2025-09-18T16:59:26.220392530Z  ++ true
	2025-09-18T16:59:26.220646111Z  + num_legacy_lines=0
	2025-09-18T16:59:26.221827009Z  ++ grep -c '^-'
	2025-09-18T16:59:26.227509235Z  + num_nft_lines=6
	2025-09-18T16:59:26.227526878Z  + '[' 0 -ge 6 ']'
	2025-09-18T16:59:26.227530282Z  + mode=nft
	2025-09-18T16:59:26.227532943Z  + echo 'INFO: setting iptables to detected mode: nft'
	2025-09-18T16:59:26.227608516Z  INFO: setting iptables to detected mode: nft
	2025-09-18T16:59:26.227684513Z  + update-alternatives --set iptables /usr/sbin/iptables-nft
	2025-09-18T16:59:26.227704022Z  + echo 'retryable update-alternatives: --set iptables /usr/sbin/iptables-nft'
	2025-09-18T16:59:26.227707402Z  + local 'args=--set iptables /usr/sbin/iptables-nft'
	2025-09-18T16:59:26.228176228Z  ++ seq 0 15
	2025-09-18T16:59:26.228967888Z  + for i in $(seq 0 15)
	2025-09-18T16:59:26.228985113Z  + /usr/bin/update-alternatives --set iptables /usr/sbin/iptables-nft
	2025-09-18T16:59:26.232008421Z  + return
	2025-09-18T16:59:26.232025710Z  + update-alternatives --set ip6tables /usr/sbin/ip6tables-nft
	2025-09-18T16:59:26.232061253Z  + echo 'retryable update-alternatives: --set ip6tables /usr/sbin/ip6tables-nft'
	2025-09-18T16:59:26.232065731Z  + local 'args=--set ip6tables /usr/sbin/ip6tables-nft'
	2025-09-18T16:59:26.232487434Z  ++ seq 0 15
	2025-09-18T16:59:26.233370468Z  + for i in $(seq 0 15)
	2025-09-18T16:59:26.233385869Z  + /usr/bin/update-alternatives --set ip6tables /usr/sbin/ip6tables-nft
	2025-09-18T16:59:26.236167940Z  + return
	2025-09-18T16:59:26.236185493Z  + enable_network_magic
	2025-09-18T16:59:26.236251724Z  + local docker_embedded_dns_ip=127.0.0.11
	2025-09-18T16:59:26.236258326Z  + local docker_host_ip
	2025-09-18T16:59:26.237425622Z  ++ cut '-d ' -f1
	2025-09-18T16:59:26.237558049Z  ++ head -n1 /dev/fd/63
	2025-09-18T16:59:26.237750801Z  +++ timeout 5 getent ahostsv4 host.docker.internal
	2025-09-18T16:59:26.282478726Z  + docker_host_ip=
	2025-09-18T16:59:26.282524642Z  + [[ -z '' ]]
	2025-09-18T16:59:26.283175781Z  ++ ip -4 route show default
	2025-09-18T16:59:26.283233852Z  ++ cut '-d ' -f3
	2025-09-18T16:59:26.285230951Z  + docker_host_ip=192.168.49.1
	2025-09-18T16:59:26.285585975Z  + iptables-save
	2025-09-18T16:59:26.285912675Z  + iptables-restore
	2025-09-18T16:59:26.288074524Z  + sed -e 's/-d 127.0.0.11/-d 192.168.49.1/g' -e 's/-A OUTPUT \(.*\) -j DOCKER_OUTPUT/\0\n-A PREROUTING \1 -j DOCKER_OUTPUT/' -e 's/--to-source :53/--to-source 192.168.49.1:53/g' -e 's/p -j DNAT --to-destination 127.0.0.11/p --dport 53 -j DNAT --to-destination 127.0.0.11/g'
	2025-09-18T16:59:26.299160627Z  + cp /etc/resolv.conf /etc/resolv.conf.original
	2025-09-18T16:59:26.301256282Z  ++ sed -e s/127.0.0.11/192.168.49.1/g /etc/resolv.conf.original
	2025-09-18T16:59:26.302490393Z  + replaced='# Generated by Docker Engine.
	2025-09-18T16:59:26.302516733Z  # This file can be edited; Docker Engine will not make further changes once it
	2025-09-18T16:59:26.302521350Z  # has been modified.
	2025-09-18T16:59:26.302524394Z  
	2025-09-18T16:59:26.302527442Z  nameserver 192.168.49.1
	2025-09-18T16:59:26.302530772Z  search local us-east4-a.c.k8s-minikube.internal c.k8s-minikube.internal google.internal
	2025-09-18T16:59:26.302534050Z  options edns0 trust-ad ndots:0
	2025-09-18T16:59:26.302548397Z  
	2025-09-18T16:59:26.302551087Z  # Based on host file: '\''/etc/resolv.conf'\'' (internal resolver)
	2025-09-18T16:59:26.302554128Z  # ExtServers: [host(127.0.0.53)]
	2025-09-18T16:59:26.302556895Z  # Overrides: []
	2025-09-18T16:59:26.302559632Z  # Option ndots from: internal'
	2025-09-18T16:59:26.302562438Z  + [[ '' == '' ]]
	2025-09-18T16:59:26.302565160Z  + echo '# Generated by Docker Engine.
	2025-09-18T16:59:26.302568082Z  # This file can be edited; Docker Engine will not make further changes once it
	2025-09-18T16:59:26.302570335Z  # has been modified.
	2025-09-18T16:59:26.302571928Z  
	2025-09-18T16:59:26.302573435Z  nameserver 192.168.49.1
	2025-09-18T16:59:26.302575015Z  search local us-east4-a.c.k8s-minikube.internal c.k8s-minikube.internal google.internal
	2025-09-18T16:59:26.302576652Z  options edns0 trust-ad ndots:0
	2025-09-18T16:59:26.302578232Z  
	2025-09-18T16:59:26.302579705Z  # Based on host file: '\''/etc/resolv.conf'\'' (internal resolver)
	2025-09-18T16:59:26.302581982Z  # ExtServers: [host(127.0.0.53)]
	2025-09-18T16:59:26.302584688Z  # Overrides: []
	2025-09-18T16:59:26.302587424Z  # Option ndots from: internal'
	2025-09-18T16:59:26.302682060Z  + files_to_update=('/etc/kubernetes/manifests/etcd.yaml' '/etc/kubernetes/manifests/kube-apiserver.yaml' '/etc/kubernetes/manifests/kube-controller-manager.yaml' '/etc/kubernetes/manifests/kube-scheduler.yaml' '/etc/kubernetes/controller-manager.conf' '/etc/kubernetes/scheduler.conf' '/kind/kubeadm.conf' '/var/lib/kubelet/kubeadm-flags.env')
	2025-09-18T16:59:26.302695407Z  + local files_to_update
	2025-09-18T16:59:26.302698645Z  + local should_fix_certificate=false
	2025-09-18T16:59:26.303967669Z  ++ cut '-d ' -f1
	2025-09-18T16:59:26.303982146Z  ++ head -n1 /dev/fd/63
	2025-09-18T16:59:26.304566413Z  ++++ hostname
	2025-09-18T16:59:26.305406820Z  +++ timeout 5 getent ahostsv4 ha-078118-m04
	2025-09-18T16:59:26.308353368Z  + curr_ipv4=192.168.49.5
	2025-09-18T16:59:26.308375498Z  + echo 'INFO: Detected IPv4 address: 192.168.49.5'
	2025-09-18T16:59:26.308379265Z  INFO: Detected IPv4 address: 192.168.49.5
	2025-09-18T16:59:26.308381880Z  + '[' -f /kind/old-ipv4 ']'
	2025-09-18T16:59:26.308421606Z  + [[ -n 192.168.49.5 ]]
	2025-09-18T16:59:26.308436452Z  + echo -n 192.168.49.5
	2025-09-18T16:59:26.309726838Z  ++ cut '-d ' -f1
	2025-09-18T16:59:26.309825049Z  ++ head -n1 /dev/fd/63
	2025-09-18T16:59:26.310348550Z  ++++ hostname
	2025-09-18T16:59:26.311175669Z  +++ timeout 5 getent ahostsv6 ha-078118-m04
	2025-09-18T16:59:26.314130919Z  + curr_ipv6=
	2025-09-18T16:59:26.314147584Z  + echo 'INFO: Detected IPv6 address: '
	2025-09-18T16:59:26.314161103Z  INFO: Detected IPv6 address: 
	2025-09-18T16:59:26.314162972Z  + '[' -f /kind/old-ipv6 ']'
	2025-09-18T16:59:26.314164622Z  + [[ -n '' ]]
	2025-09-18T16:59:26.314166269Z  + false
	2025-09-18T16:59:26.314671716Z  ++ uname -a
	2025-09-18T16:59:26.315561142Z  + echo 'entrypoint completed: Linux ha-078118-m04 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux'
	2025-09-18T16:59:26.315576645Z  entrypoint completed: Linux ha-078118-m04 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
	2025-09-18T16:59:26.315579312Z  + exec /sbin/init
	2025-09-18T16:59:26.321830250Z  systemd 249.11-0ubuntu3.16 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
	2025-09-18T16:59:26.321850624Z  Detected virtualization docker.
	2025-09-18T16:59:26.321855409Z  Detected architecture x86-64.
	2025-09-18T16:59:26.321939103Z  
	2025-09-18T16:59:26.321952833Z  Welcome to Ubuntu 22.04.5 LTS!
	2025-09-18T16:59:26.321956694Z  
	2025-09-18T16:59:26.322382911Z  Failed to create control group inotify object: Too many open files
	2025-09-18T16:59:26.322392648Z  Failed to allocate manager object: Too many open files
	2025-09-18T16:59:26.322396170Z  [!!!!!!] Failed to allocate manager object.
	2025-09-18T16:59:26.322399134Z  Exiting PID 1...
	
	-- /stdout --
	I0918 16:59:26.708838   70738 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:59:26.771900   70738 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:65 OomKillDisable:false NGoroutines:76 SystemTime:2025-09-18 16:59:26.759832295 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:59:26.771974   70738 errors.go:98] postmortem docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:65 OomKillDisable:false NGoroutines:76 SystemTime:2025-09-18 16:59:26.759832295 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux A
rchitecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:fals
e Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:59:26.772054   70738 network_create.go:284] running [docker network inspect ha-078118-m04] to gather additional debugging logs...
	I0918 16:59:26.772069   70738 cli_runner.go:164] Run: docker network inspect ha-078118-m04
	W0918 16:59:26.790097   70738 cli_runner.go:211] docker network inspect ha-078118-m04 returned with exit code 1
	I0918 16:59:26.790123   70738 network_create.go:287] error running [docker network inspect ha-078118-m04]: docker network inspect ha-078118-m04: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network ha-078118-m04 not found
	I0918 16:59:26.790145   70738 network_create.go:289] output of [docker network inspect ha-078118-m04]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network ha-078118-m04 not found
	
	** /stderr **
	I0918 16:59:26.790202   70738 client.go:171] duration metric: took 5.690672153s to LocalClient.Create
	I0918 16:59:28.790681   70738 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:59:28.790724   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:28.810545   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	I0918 16:59:28.810662   70738 retry.go:31] will retry after 340.989607ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:29.152259   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:29.170181   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	I0918 16:59:29.170312   70738 retry.go:31] will retry after 305.983457ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:29.476693   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:29.495729   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	I0918 16:59:29.495823   70738 retry.go:31] will retry after 423.621721ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:29.920495   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:29.939182   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	I0918 16:59:29.939307   70738 retry.go:31] will retry after 844.283571ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:30.784374   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:30.804566   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	W0918 16:59:30.804691   70738 start.go:268] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	W0918 16:59:30.804708   70738 start.go:235] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:30.804784   70738 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 16:59:30.804821   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:30.822811   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	I0918 16:59:30.822902   70738 retry.go:31] will retry after 166.557671ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:30.990369   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:31.010005   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	I0918 16:59:31.010171   70738 retry.go:31] will retry after 468.171595ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:31.478658   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:31.497278   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	I0918 16:59:31.497419   70738 retry.go:31] will retry after 581.798077ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:32.079789   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:32.097726   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	W0918 16:59:32.097850   70738 start.go:283] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	W0918 16:59:32.097868   70738 start.go:240] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:32.097876   70738 start.go:128] duration metric: took 11.0006489s to createHost
	I0918 16:59:32.097883   70738 start.go:83] releasing machines lock for "ha-078118-m04", held for 11.00079162s
	W0918 16:59:32.097896   70738 start.go:714] error starting host: creating host: create: creating: prepare kic ssh: container name "ha-078118-m04" state Stopped: log: 2025-09-18T16:59:26.322382911Z  Failed to create control group inotify object: Too many open files
	2025-09-18T16:59:26.322392648Z  Failed to allocate manager object: Too many open files
	2025-09-18T16:59:26.322396170Z  [!!!!!!] Failed to allocate manager object.
	2025-09-18T16:59:26.322399134Z  Exiting PID 1...: container exited unexpectedly
	I0918 16:59:32.098289   70738 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 16:59:32.118307   70738 stop.go:39] StopHost: ha-078118-m04
	W0918 16:59:32.118631   70738 register.go:133] "Stopping" was not found within the registered steps for "Initial Minikube Setup": [Initial Minikube Setup Selecting Driver Downloading Artifacts Starting Node Updating Driver Pulling Base Image Running on Localhost Local OS Release Creating Container Creating VM Running Remotely Preparing Kubernetes Generating certificates Booting control plane Configuring RBAC rules Configuring CNI Configuring Localhost Environment Verifying Kubernetes Enabling Addons Done]
	I0918 16:59:32.120645   70738 out.go:179] * Stopping node "ha-078118-m04"  ...
	I0918 16:59:32.122206   70738 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 16:59:32.139797   70738 stop.go:87] host is in state Stopped
	I0918 16:59:32.139832   70738 main.go:141] libmachine: Stopping "ha-078118-m04"...
	I0918 16:59:32.139912   70738 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 16:59:32.158124   70738 stop.go:66] stop err: Machine "ha-078118-m04" is already stopped.
	I0918 16:59:32.158162   70738 stop.go:69] host is already stopped
	W0918 16:59:33.158674   70738 register.go:133] "Stopping" was not found within the registered steps for "Initial Minikube Setup": [Initial Minikube Setup Selecting Driver Downloading Artifacts Starting Node Updating Driver Pulling Base Image Running on Localhost Local OS Release Creating Container Creating VM Running Remotely Preparing Kubernetes Generating certificates Booting control plane Configuring RBAC rules Configuring CNI Configuring Localhost Environment Verifying Kubernetes Enabling Addons Done]
	I0918 16:59:33.160757   70738 out.go:179] * Deleting "ha-078118-m04" in docker ...
	I0918 16:59:33.162036   70738 cli_runner.go:164] Run: docker container inspect -f {{.Id}} ha-078118-m04
	I0918 16:59:33.181046   70738 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 16:59:33.198932   70738 cli_runner.go:164] Run: docker exec --privileged -t ha-078118-m04 /bin/bash -c "sudo init 0"
	W0918 16:59:33.217819   70738 cli_runner.go:211] docker exec --privileged -t ha-078118-m04 /bin/bash -c "sudo init 0" returned with exit code 1
	I0918 16:59:33.217848   70738 oci.go:659] error shutdown ha-078118-m04: docker exec --privileged -t ha-078118-m04 /bin/bash -c "sudo init 0": exit status 1
	stdout:
	
	stderr:
	Error response from daemon: container d4e12ab3cd2961c3ed116ea01030c23d220c29cbba8236b3bbd076ab03afc387 is not running
	I0918 16:59:34.218693   70738 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 16:59:34.238730   70738 oci.go:667] container ha-078118-m04 status is Stopped
	I0918 16:59:34.238762   70738 oci.go:679] Successfully shutdown container ha-078118-m04
	I0918 16:59:34.238824   70738 cli_runner.go:164] Run: docker rm -f -v ha-078118-m04
	I0918 16:59:34.262664   70738 cli_runner.go:164] Run: docker container inspect -f {{.Id}} ha-078118-m04
	W0918 16:59:34.279775   70738 cli_runner.go:211] docker container inspect -f {{.Id}} ha-078118-m04 returned with exit code 1
	I0918 16:59:34.279870   70738 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:59:34.297241   70738 cli_runner.go:164] Run: docker network rm ha-078118
	W0918 16:59:34.315955   70738 cli_runner.go:211] docker network rm ha-078118 returned with exit code 1
	W0918 16:59:34.316083   70738 kic.go:390] failed to remove network (which might be okay) ha-078118: unable to delete a network that is attached to a running container
	W0918 16:59:34.316277   70738 out.go:285] ! StartHost failed, but will try again: creating host: create: creating: prepare kic ssh: container name "ha-078118-m04" state Stopped: log: 2025-09-18T16:59:26.322382911Z  Failed to create control group inotify object: Too many open files
	2025-09-18T16:59:26.322392648Z  Failed to allocate manager object: Too many open files
	2025-09-18T16:59:26.322396170Z  [!!!!!!] Failed to allocate manager object.
	2025-09-18T16:59:26.322399134Z  Exiting PID 1...: container exited unexpectedly
	! StartHost failed, but will try again: creating host: create: creating: prepare kic ssh: container name "ha-078118-m04" state Stopped: log: 2025-09-18T16:59:26.322382911Z  Failed to create control group inotify object: Too many open files
	2025-09-18T16:59:26.322392648Z  Failed to allocate manager object: Too many open files
	2025-09-18T16:59:26.322396170Z  [!!!!!!] Failed to allocate manager object.
	2025-09-18T16:59:26.322399134Z  Exiting PID 1...: container exited unexpectedly
	I0918 16:59:34.316294   70738 start.go:729] Will try again in 5 seconds ...
	I0918 16:59:39.318633   70738 start.go:360] acquireMachinesLock for ha-078118-m04: {Name:mkdcee71069a15ce1d36f6cf5f43097fe7468c48 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 16:59:39.318730   70738 start.go:364] duration metric: took 62.432µs to acquireMachinesLock for "ha-078118-m04"
	I0918 16:59:39.318766   70738 start.go:93] Provisioning new machine with config: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:fal
se inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLo
g:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime: ControlPlane:false Worker:true}
	I0918 16:59:39.318884   70738 start.go:125] createHost starting for "m04" (driver="docker")
	I0918 16:59:39.321031   70738 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
	I0918 16:59:39.321155   70738 start.go:159] libmachine.API.Create for "ha-078118" (driver="docker")
	I0918 16:59:39.321191   70738 client.go:168] LocalClient.Create starting
	I0918 16:59:39.321259   70738 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 16:59:39.321306   70738 main.go:141] libmachine: Decoding PEM data...
	I0918 16:59:39.321325   70738 main.go:141] libmachine: Parsing certificate...
	I0918 16:59:39.321401   70738 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 16:59:39.321429   70738 main.go:141] libmachine: Decoding PEM data...
	I0918 16:59:39.321443   70738 main.go:141] libmachine: Parsing certificate...
	I0918 16:59:39.321681   70738 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:59:39.339585   70738 network_create.go:77] Found existing network {name:ha-078118 subnet:0xc001974930 gateway:[0 0 0 0 0 0 0 0 0 0 255 255 192 168 49 1] mtu:1500}
	I0918 16:59:39.339629   70738 kic.go:121] calculated static IP "192.168.49.5" for the "ha-078118-m04" container
	I0918 16:59:39.339695   70738 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 16:59:39.358096   70738 cli_runner.go:164] Run: docker volume create ha-078118-m04 --label name.minikube.sigs.k8s.io=ha-078118-m04 --label created_by.minikube.sigs.k8s.io=true
	I0918 16:59:39.375125   70738 oci.go:103] Successfully created a docker volume ha-078118-m04
	I0918 16:59:39.375192   70738 cli_runner.go:164] Run: docker run --rm --name ha-078118-m04-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m04 --entrypoint /usr/bin/test -v ha-078118-m04:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 16:59:39.632989   70738 oci.go:107] Successfully prepared a docker volume ha-078118-m04
	I0918 16:59:39.633026   70738 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:59:39.633044   70738 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 16:59:39.633100   70738 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m04:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 16:59:44.033409   70738 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m04:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.400268895s)
	I0918 16:59:44.033445   70738 kic.go:203] duration metric: took 4.40039678s to extract preloaded images to volume ...
	W0918 16:59:44.033559   70738 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 16:59:44.033590   70738 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 16:59:44.033636   70738 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 16:59:44.089750   70738 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ha-078118-m04 --name ha-078118-m04 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m04 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ha-078118-m04 --network ha-078118 --ip 192.168.49.5 --volume ha-078118-m04:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 16:59:44.368327   70738 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Running}}
	I0918 16:59:44.387174   70738 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 16:59:44.406426   70738 cli_runner.go:164] Run: docker exec ha-078118-m04 stat /var/lib/dpkg/alternatives/iptables
	I0918 16:59:44.463420   70738 oci.go:144] the created container "ha-078118-m04" has a running status.
	I0918 16:59:44.463447   70738 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa...
	I0918 16:59:44.714768   70738 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0918 16:59:44.714808   70738 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 16:59:44.837763   70738 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 16:59:44.855930   70738 cli_runner.go:164] Run: docker inspect ha-078118-m04
	I0918 16:59:44.873810   70738 errors.go:84] Postmortem inspect ("docker inspect ha-078118-m04"): -- stdout --
	[
	    {
	        "Id": "17c2b85048723beda638aca46c8021f063b49bbec6b3ff6c8f3390ff1c716c68",
	        "Created": "2025-09-18T16:59:44.107678096Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "exited",
	            "Running": false,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 0,
	            "ExitCode": 255,
	            "Error": "",
	            "StartedAt": "2025-09-18T16:59:44.147769262Z",
	            "FinishedAt": "2025-09-18T16:59:44.507659687Z"
	        },
	        "Image": "sha256:c6b5532e987b5b4f5fc9cb0336e378ed49c0542bad8cbfc564b71e977a6269de",
	        "ResolvConfPath": "/var/lib/docker/containers/17c2b85048723beda638aca46c8021f063b49bbec6b3ff6c8f3390ff1c716c68/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/17c2b85048723beda638aca46c8021f063b49bbec6b3ff6c8f3390ff1c716c68/hostname",
	        "HostsPath": "/var/lib/docker/containers/17c2b85048723beda638aca46c8021f063b49bbec6b3ff6c8f3390ff1c716c68/hosts",
	        "LogPath": "/var/lib/docker/containers/17c2b85048723beda638aca46c8021f063b49bbec6b3ff6c8f3390ff1c716c68/17c2b85048723beda638aca46c8021f063b49bbec6b3ff6c8f3390ff1c716c68-json.log",
	        "Name": "/ha-078118-m04",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ha-078118-m04:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "ha-078118",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "private",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 3221225472,
	            "NanoCpus": 0,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 6442450944,
	            "MemorySwappiness": null,
	            "OomKillDisable": null,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "ID": "17c2b85048723beda638aca46c8021f063b49bbec6b3ff6c8f3390ff1c716c68",
	                "LowerDir": "/var/lib/docker/overlay2/f1adeaadcc57f77023a7b0155e28478e422837141ecde4b20c40ca881b623dc6-init/diff:/var/lib/docker/overlay2/1fd2bbb67ab9e5bb8d4549665a1a228eadda56df39fee53908cd735ea16a4e10/diff",
	                "MergedDir": "/var/lib/docker/overlay2/f1adeaadcc57f77023a7b0155e28478e422837141ecde4b20c40ca881b623dc6/merged",
	                "UpperDir": "/var/lib/docker/overlay2/f1adeaadcc57f77023a7b0155e28478e422837141ecde4b20c40ca881b623dc6/diff",
	                "WorkDir": "/var/lib/docker/overlay2/f1adeaadcc57f77023a7b0155e28478e422837141ecde4b20c40ca881b623dc6/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "ha-078118-m04",
	                "Source": "/var/lib/docker/volumes/ha-078118-m04/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "ha-078118-m04",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ha-078118-m04",
	                "name.minikube.sigs.k8s.io": "ha-078118-m04",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "",
	            "SandboxKey": "",
	            "Ports": {},
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ha-078118": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.5"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "",
	                    "DriverOpts": null,
	                    "GwPriority": 0,
	                    "NetworkID": "0aa191750de6e44eaf49073a9e05a52994c63ccafcb0870d32aaf105d93cb724",
	                    "EndpointID": "",
	                    "Gateway": "",
	                    "IPAddress": "",
	                    "IPPrefixLen": 0,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "ha-078118-m04",
	                        "17c2b8504872"
	                    ]
	                }
	            }
	        }
	    }
	]
	
	-- /stdout --
	I0918 16:59:44.873892   70738 cli_runner.go:164] Run: docker logs --timestamps --details ha-078118-m04
	I0918 16:59:44.893480   70738 errors.go:91] Postmortem logs ("docker logs --timestamps --details ha-078118-m04"): -- stdout --
	2025-09-18T16:59:44.361600926Z  + userns=
	2025-09-18T16:59:44.361635560Z  + grep -Eqv '0[[:space:]]+0[[:space:]]+4294967295' /proc/self/uid_map
	2025-09-18T16:59:44.364254887Z  + validate_userns
	2025-09-18T16:59:44.364274650Z  + [[ -z '' ]]
	2025-09-18T16:59:44.364278269Z  + return
	2025-09-18T16:59:44.364280933Z  + configure_containerd
	2025-09-18T16:59:44.364283448Z  + local snapshotter=
	2025-09-18T16:59:44.364286331Z  + [[ -n '' ]]
	2025-09-18T16:59:44.364289079Z  + [[ -z '' ]]
	2025-09-18T16:59:44.364692165Z  ++ stat -f -c %T /kind
	2025-09-18T16:59:44.366029931Z  + container_filesystem=overlayfs
	2025-09-18T16:59:44.366046285Z  + [[ overlayfs == \z\f\s ]]
	2025-09-18T16:59:44.366050235Z  + [[ -n '' ]]
	2025-09-18T16:59:44.366091013Z  + configure_proxy
	2025-09-18T16:59:44.366103127Z  + mkdir -p /etc/systemd/system.conf.d/
	2025-09-18T16:59:44.370244507Z  + [[ ! -z '' ]]
	2025-09-18T16:59:44.370261668Z  + cat
	2025-09-18T16:59:44.371650530Z  + fix_mount
	2025-09-18T16:59:44.371665134Z  + echo 'INFO: ensuring we can execute mount/umount even with userns-remap'
	2025-09-18T16:59:44.371667814Z  INFO: ensuring we can execute mount/umount even with userns-remap
	2025-09-18T16:59:44.372086180Z  ++ which mount
	2025-09-18T16:59:44.373488151Z  ++ which umount
	2025-09-18T16:59:44.374733999Z  + chown root:root /usr/bin/mount /usr/bin/umount
	2025-09-18T16:59:44.380951796Z  ++ which mount
	2025-09-18T16:59:44.382441039Z  ++ which umount
	2025-09-18T16:59:44.383444821Z  + chmod -s /usr/bin/mount /usr/bin/umount
	2025-09-18T16:59:44.385141977Z  +++ which mount
	2025-09-18T16:59:44.386120147Z  ++ stat -f -c %T /usr/bin/mount
	2025-09-18T16:59:44.387177490Z  + [[ overlayfs == \a\u\f\s ]]
	2025-09-18T16:59:44.387193718Z  + echo 'INFO: remounting /sys read-only'
	2025-09-18T16:59:44.387197342Z  INFO: remounting /sys read-only
	2025-09-18T16:59:44.387200201Z  + mount -o remount,ro /sys
	2025-09-18T16:59:44.389108779Z  + echo 'INFO: making mounts shared'
	2025-09-18T16:59:44.389125234Z  INFO: making mounts shared
	2025-09-18T16:59:44.389129162Z  + mount --make-rshared /
	2025-09-18T16:59:44.390780904Z  + retryable_fix_cgroup
	2025-09-18T16:59:44.391175670Z  ++ seq 0 10
	2025-09-18T16:59:44.392058001Z  + for i in $(seq 0 10)
	2025-09-18T16:59:44.392072789Z  + fix_cgroup
	2025-09-18T16:59:44.392076242Z  + [[ -f /sys/fs/cgroup/cgroup.controllers ]]
	2025-09-18T16:59:44.392079268Z  + echo 'INFO: detected cgroup v2'
	2025-09-18T16:59:44.392082358Z  INFO: detected cgroup v2
	2025-09-18T16:59:44.392097414Z  + return
	2025-09-18T16:59:44.392100503Z  + return
	2025-09-18T16:59:44.392106188Z  + fix_machine_id
	2025-09-18T16:59:44.392108926Z  + echo 'INFO: clearing and regenerating /etc/machine-id'
	2025-09-18T16:59:44.392111332Z  INFO: clearing and regenerating /etc/machine-id
	2025-09-18T16:59:44.392136492Z  + rm -f /etc/machine-id
	2025-09-18T16:59:44.393182186Z  + systemd-machine-id-setup
	2025-09-18T16:59:44.396527892Z  Initializing machine ID from random generator.
	2025-09-18T16:59:44.398789189Z  + fix_product_name
	2025-09-18T16:59:44.398806041Z  + [[ -f /sys/class/dmi/id/product_name ]]
	2025-09-18T16:59:44.398838629Z  + echo 'INFO: faking /sys/class/dmi/id/product_name to be "kind"'
	2025-09-18T16:59:44.398849407Z  INFO: faking /sys/class/dmi/id/product_name to be "kind"
	2025-09-18T16:59:44.398852509Z  + echo kind
	2025-09-18T16:59:44.399972935Z  + mount -o ro,bind /kind/product_name /sys/class/dmi/id/product_name
	2025-09-18T16:59:44.401541821Z  + fix_product_uuid
	2025-09-18T16:59:44.401556064Z  + [[ ! -f /kind/product_uuid ]]
	2025-09-18T16:59:44.401559701Z  + cat /proc/sys/kernel/random/uuid
	2025-09-18T16:59:44.402654692Z  + [[ -f /sys/class/dmi/id/product_uuid ]]
	2025-09-18T16:59:44.402668491Z  + echo 'INFO: faking /sys/class/dmi/id/product_uuid to be random'
	2025-09-18T16:59:44.402671950Z  INFO: faking /sys/class/dmi/id/product_uuid to be random
	2025-09-18T16:59:44.402675040Z  + mount -o ro,bind /kind/product_uuid /sys/class/dmi/id/product_uuid
	2025-09-18T16:59:44.404002420Z  + [[ -f /sys/devices/virtual/dmi/id/product_uuid ]]
	2025-09-18T16:59:44.404016892Z  + echo 'INFO: faking /sys/devices/virtual/dmi/id/product_uuid as well'
	2025-09-18T16:59:44.404020935Z  INFO: faking /sys/devices/virtual/dmi/id/product_uuid as well
	2025-09-18T16:59:44.404023845Z  + mount -o ro,bind /kind/product_uuid /sys/devices/virtual/dmi/id/product_uuid
	2025-09-18T16:59:44.405340740Z  + select_iptables
	2025-09-18T16:59:44.405354696Z  + local mode num_legacy_lines num_nft_lines
	2025-09-18T16:59:44.406227529Z  ++ grep -c '^-'
	2025-09-18T16:59:44.408825132Z  ++ true
	2025-09-18T16:59:44.409072724Z  + num_legacy_lines=0
	2025-09-18T16:59:44.409954575Z  ++ grep -c '^-'
	2025-09-18T16:59:44.415342137Z  + num_nft_lines=6
	2025-09-18T16:59:44.415366063Z  + '[' 0 -ge 6 ']'
	2025-09-18T16:59:44.415370341Z  + mode=nft
	2025-09-18T16:59:44.415373123Z  + echo 'INFO: setting iptables to detected mode: nft'
	2025-09-18T16:59:44.415376314Z  INFO: setting iptables to detected mode: nft
	2025-09-18T16:59:44.415379247Z  + update-alternatives --set iptables /usr/sbin/iptables-nft
	2025-09-18T16:59:44.415445034Z  + echo 'retryable update-alternatives: --set iptables /usr/sbin/iptables-nft'
	2025-09-18T16:59:44.415456559Z  + local 'args=--set iptables /usr/sbin/iptables-nft'
	2025-09-18T16:59:44.415886028Z  ++ seq 0 15
	2025-09-18T16:59:44.416824522Z  + for i in $(seq 0 15)
	2025-09-18T16:59:44.416838909Z  + /usr/bin/update-alternatives --set iptables /usr/sbin/iptables-nft
	2025-09-18T16:59:44.417924449Z  + return
	2025-09-18T16:59:44.417940406Z  + update-alternatives --set ip6tables /usr/sbin/ip6tables-nft
	2025-09-18T16:59:44.417998259Z  + echo 'retryable update-alternatives: --set ip6tables /usr/sbin/ip6tables-nft'
	2025-09-18T16:59:44.418008879Z  + local 'args=--set ip6tables /usr/sbin/ip6tables-nft'
	2025-09-18T16:59:44.418424011Z  ++ seq 0 15
	2025-09-18T16:59:44.419356653Z  + for i in $(seq 0 15)
	2025-09-18T16:59:44.419387470Z  + /usr/bin/update-alternatives --set ip6tables /usr/sbin/ip6tables-nft
	2025-09-18T16:59:44.420485204Z  + return
	2025-09-18T16:59:44.420513149Z  + enable_network_magic
	2025-09-18T16:59:44.420589104Z  + local docker_embedded_dns_ip=127.0.0.11
	2025-09-18T16:59:44.420598400Z  + local docker_host_ip
	2025-09-18T16:59:44.421762679Z  ++ cut '-d ' -f1
	2025-09-18T16:59:44.421840311Z  ++ head -n1 /dev/fd/63
	2025-09-18T16:59:44.421917455Z  +++ timeout 5 getent ahostsv4 host.docker.internal
	2025-09-18T16:59:44.467985297Z  + docker_host_ip=
	2025-09-18T16:59:44.468010228Z  + [[ -z '' ]]
	2025-09-18T16:59:44.468734469Z  ++ ip -4 route show default
	2025-09-18T16:59:44.468862101Z  ++ cut '-d ' -f3
	2025-09-18T16:59:44.471154545Z  + docker_host_ip=192.168.49.1
	2025-09-18T16:59:44.471568100Z  + iptables-save
	2025-09-18T16:59:44.472054795Z  + iptables-restore
	2025-09-18T16:59:44.474573861Z  + sed -e 's/-d 127.0.0.11/-d 192.168.49.1/g' -e 's/-A OUTPUT \(.*\) -j DOCKER_OUTPUT/\0\n-A PREROUTING \1 -j DOCKER_OUTPUT/' -e 's/--to-source :53/--to-source 192.168.49.1:53/g' -e 's/p -j DNAT --to-destination 127.0.0.11/p --dport 53 -j DNAT --to-destination 127.0.0.11/g'
	2025-09-18T16:59:44.483102331Z  + cp /etc/resolv.conf /etc/resolv.conf.original
	2025-09-18T16:59:44.485035349Z  ++ sed -e s/127.0.0.11/192.168.49.1/g /etc/resolv.conf.original
	2025-09-18T16:59:44.486260580Z  + replaced='# Generated by Docker Engine.
	2025-09-18T16:59:44.486272899Z  # This file can be edited; Docker Engine will not make further changes once it
	2025-09-18T16:59:44.486276279Z  # has been modified.
	2025-09-18T16:59:44.486279080Z  
	2025-09-18T16:59:44.486281779Z  nameserver 192.168.49.1
	2025-09-18T16:59:44.486284679Z  search local us-east4-a.c.k8s-minikube.internal c.k8s-minikube.internal google.internal
	2025-09-18T16:59:44.486287720Z  options edns0 trust-ad ndots:0
	2025-09-18T16:59:44.486300665Z  
	2025-09-18T16:59:44.486303494Z  # Based on host file: '\''/etc/resolv.conf'\'' (internal resolver)
	2025-09-18T16:59:44.486306505Z  # ExtServers: [host(127.0.0.53)]
	2025-09-18T16:59:44.486309280Z  # Overrides: []
	2025-09-18T16:59:44.486312009Z  # Option ndots from: internal'
	2025-09-18T16:59:44.486314722Z  + [[ '' == '' ]]
	2025-09-18T16:59:44.486317387Z  + echo '# Generated by Docker Engine.
	2025-09-18T16:59:44.486320142Z  # This file can be edited; Docker Engine will not make further changes once it
	2025-09-18T16:59:44.486323238Z  # has been modified.
	2025-09-18T16:59:44.486325976Z  
	2025-09-18T16:59:44.486328807Z  nameserver 192.168.49.1
	2025-09-18T16:59:44.486331592Z  search local us-east4-a.c.k8s-minikube.internal c.k8s-minikube.internal google.internal
	2025-09-18T16:59:44.486334576Z  options edns0 trust-ad ndots:0
	2025-09-18T16:59:44.486337253Z  
	2025-09-18T16:59:44.486339801Z  # Based on host file: '\''/etc/resolv.conf'\'' (internal resolver)
	2025-09-18T16:59:44.486342703Z  # ExtServers: [host(127.0.0.53)]
	2025-09-18T16:59:44.486345565Z  # Overrides: []
	2025-09-18T16:59:44.486352459Z  # Option ndots from: internal'
	2025-09-18T16:59:44.486455819Z  + files_to_update=('/etc/kubernetes/manifests/etcd.yaml' '/etc/kubernetes/manifests/kube-apiserver.yaml' '/etc/kubernetes/manifests/kube-controller-manager.yaml' '/etc/kubernetes/manifests/kube-scheduler.yaml' '/etc/kubernetes/controller-manager.conf' '/etc/kubernetes/scheduler.conf' '/kind/kubeadm.conf' '/var/lib/kubelet/kubeadm-flags.env')
	2025-09-18T16:59:44.486466318Z  + local files_to_update
	2025-09-18T16:59:44.486468516Z  + local should_fix_certificate=false
	2025-09-18T16:59:44.487598870Z  ++ cut '-d ' -f1
	2025-09-18T16:59:44.487656405Z  ++ head -n1 /dev/fd/63
	2025-09-18T16:59:44.488170935Z  ++++ hostname
	2025-09-18T16:59:44.488940395Z  +++ timeout 5 getent ahostsv4 ha-078118-m04
	2025-09-18T16:59:44.491431646Z  + curr_ipv4=192.168.49.5
	2025-09-18T16:59:44.491444026Z  + echo 'INFO: Detected IPv4 address: 192.168.49.5'
	2025-09-18T16:59:44.491447154Z  INFO: Detected IPv4 address: 192.168.49.5
	2025-09-18T16:59:44.491449888Z  + '[' -f /kind/old-ipv4 ']'
	2025-09-18T16:59:44.491452884Z  + [[ -n 192.168.49.5 ]]
	2025-09-18T16:59:44.491473898Z  + echo -n 192.168.49.5
	2025-09-18T16:59:44.492605730Z  ++ cut '-d ' -f1
	2025-09-18T16:59:44.492686222Z  ++ head -n1 /dev/fd/63
	2025-09-18T16:59:44.493197544Z  ++++ hostname
	2025-09-18T16:59:44.493917963Z  +++ timeout 5 getent ahostsv6 ha-078118-m04
	2025-09-18T16:59:44.496285054Z  + curr_ipv6=
	2025-09-18T16:59:44.496298075Z  + echo 'INFO: Detected IPv6 address: '
	2025-09-18T16:59:44.496311457Z  INFO: Detected IPv6 address: 
	2025-09-18T16:59:44.496314367Z  + '[' -f /kind/old-ipv6 ']'
	2025-09-18T16:59:44.496355440Z  + [[ -n '' ]]
	2025-09-18T16:59:44.496364890Z  + false
	2025-09-18T16:59:44.496839547Z  ++ uname -a
	2025-09-18T16:59:44.497680448Z  + echo 'entrypoint completed: Linux ha-078118-m04 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux'
	2025-09-18T16:59:44.497696910Z  entrypoint completed: Linux ha-078118-m04 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
	2025-09-18T16:59:44.497700629Z  + exec /sbin/init
	2025-09-18T16:59:44.504679312Z  systemd 249.11-0ubuntu3.16 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
	2025-09-18T16:59:44.504694631Z  Detected virtualization docker.
	2025-09-18T16:59:44.504697180Z  Detected architecture x86-64.
	2025-09-18T16:59:44.504777161Z  
	2025-09-18T16:59:44.504788901Z  Welcome to Ubuntu 22.04.5 LTS!
	2025-09-18T16:59:44.504792998Z  
	2025-09-18T16:59:44.505280896Z  Failed to create control group inotify object: Too many open files
	2025-09-18T16:59:44.505288900Z  Failed to allocate manager object: Too many open files
	2025-09-18T16:59:44.505292421Z  [!!!!!!] Failed to allocate manager object.
	2025-09-18T16:59:44.505295659Z  Exiting PID 1...
	
	-- /stdout --
	I0918 16:59:44.893592   70738 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:59:44.946868   70738 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:65 OomKillDisable:false NGoroutines:76 SystemTime:2025-09-18 16:59:44.936653665 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:59:44.946942   70738 errors.go:98] postmortem docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:65 OomKillDisable:false NGoroutines:76 SystemTime:2025-09-18 16:59:44.936653665 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux A
rchitecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:fals
e Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:59:44.947024   70738 network_create.go:284] running [docker network inspect ha-078118-m04] to gather additional debugging logs...
	I0918 16:59:44.947041   70738 cli_runner.go:164] Run: docker network inspect ha-078118-m04
	W0918 16:59:44.964602   70738 cli_runner.go:211] docker network inspect ha-078118-m04 returned with exit code 1
	I0918 16:59:44.964629   70738 network_create.go:287] error running [docker network inspect ha-078118-m04]: docker network inspect ha-078118-m04: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network ha-078118-m04 not found
	I0918 16:59:44.964641   70738 network_create.go:289] output of [docker network inspect ha-078118-m04]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network ha-078118-m04 not found
	
	** /stderr **
	I0918 16:59:44.964696   70738 client.go:171] duration metric: took 5.643496065s to LocalClient.Create
	I0918 16:59:46.965698   70738 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:59:46.965760   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:46.984276   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	I0918 16:59:46.984430   70738 retry.go:31] will retry after 290.680447ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:47.275709   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:47.294430   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	I0918 16:59:47.294587   70738 retry.go:31] will retry after 249.237196ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:47.544011   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:47.562237   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	I0918 16:59:47.562364   70738 retry.go:31] will retry after 545.737679ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:48.109154   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:48.128483   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	W0918 16:59:48.128618   70738 start.go:268] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	W0918 16:59:48.128642   70738 start.go:235] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:48.128693   70738 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 16:59:48.128734   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:48.148959   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	I0918 16:59:48.149091   70738 retry.go:31] will retry after 153.52631ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:48.303495   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:48.323309   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	I0918 16:59:48.323406   70738 retry.go:31] will retry after 211.629118ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:48.535746   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:48.553810   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	I0918 16:59:48.553929   70738 retry.go:31] will retry after 834.059499ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:49.388646   70738 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	W0918 16:59:49.407795   70738 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04 returned with exit code 1
	W0918 16:59:49.407892   70738 start.go:283] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	W0918 16:59:49.407913   70738 start.go:240] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 16:59:49.407921   70738 start.go:128] duration metric: took 10.089030286s to createHost
	I0918 16:59:49.407928   70738 start.go:83] releasing machines lock for "ha-078118-m04", held for 10.089184166s
	W0918 16:59:49.407989   70738 out.go:285] * Failed to start docker container. Running "minikube delete -p ha-078118" may fix it: creating host: create: creating: prepare kic ssh: container name "ha-078118-m04" state Stopped: log: 2025-09-18T16:59:44.505280896Z  Failed to create control group inotify object: Too many open files
	2025-09-18T16:59:44.505288900Z  Failed to allocate manager object: Too many open files
	2025-09-18T16:59:44.505292421Z  [!!!!!!] Failed to allocate manager object.
	2025-09-18T16:59:44.505295659Z  Exiting PID 1...: container exited unexpectedly
	* Failed to start docker container. Running "minikube delete -p ha-078118" may fix it: creating host: create: creating: prepare kic ssh: container name "ha-078118-m04" state Stopped: log: 2025-09-18T16:59:44.505280896Z  Failed to create control group inotify object: Too many open files
	2025-09-18T16:59:44.505288900Z  Failed to allocate manager object: Too many open files
	2025-09-18T16:59:44.505292421Z  [!!!!!!] Failed to allocate manager object.
	2025-09-18T16:59:44.505295659Z  Exiting PID 1...: container exited unexpectedly
	I0918 16:59:49.410365   70738 out.go:203] 
	W0918 16:59:49.411573   70738 out.go:285] X Exiting due to GUEST_PROVISION_EXIT_UNEXPECTED: Failed to start host: creating host: create: creating: prepare kic ssh: container name "ha-078118-m04" state Stopped: log: 2025-09-18T16:59:44.505280896Z  Failed to create control group inotify object: Too many open files
	2025-09-18T16:59:44.505288900Z  Failed to allocate manager object: Too many open files
	2025-09-18T16:59:44.505292421Z  [!!!!!!] Failed to allocate manager object.
	2025-09-18T16:59:44.505295659Z  Exiting PID 1...: container exited unexpectedly
	X Exiting due to GUEST_PROVISION_EXIT_UNEXPECTED: Failed to start host: creating host: create: creating: prepare kic ssh: container name "ha-078118-m04" state Stopped: log: 2025-09-18T16:59:44.505280896Z  Failed to create control group inotify object: Too many open files
	2025-09-18T16:59:44.505288900Z  Failed to allocate manager object: Too many open files
	2025-09-18T16:59:44.505292421Z  [!!!!!!] Failed to allocate manager object.
	2025-09-18T16:59:44.505295659Z  Exiting PID 1...: container exited unexpectedly
	I0918 16:59:49.413118   70738 out.go:203] 

                                                
                                                
** /stderr **
ha_test.go:230: failed to add worker node to current ha (multi-control plane) cluster. args "out/minikube-linux-amd64 -p ha-078118 node add --alsologtostderr -v 5" : exit status 80
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======>  post-mortem[TestMultiControlPlane/serial/AddWorkerNode]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======>  post-mortem[TestMultiControlPlane/serial/AddWorkerNode]: docker inspect <======
helpers_test.go:239: (dbg) Run:  docker inspect ha-078118
helpers_test.go:243: (dbg) docker inspect ha-078118:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7",
	        "Created": "2025-09-18T16:57:02.681891976Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 60804,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2025-09-18T16:57:02.720947584Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:c6b5532e987b5b4f5fc9cb0336e378ed49c0542bad8cbfc564b71e977a6269de",
	        "ResolvConfPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/hostname",
	        "HostsPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/hosts",
	        "LogPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7-json.log",
	        "Name": "/ha-078118",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ha-078118:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "ha-078118",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "private",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 3221225472,
	            "NanoCpus": 0,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 6442450944,
	            "MemorySwappiness": null,
	            "OomKillDisable": null,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "ID": "0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7",
	                "LowerDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91-init/diff:/var/lib/docker/overlay2/1fd2bbb67ab9e5bb8d4549665a1a228eadda56df39fee53908cd735ea16a4e10/diff",
	                "MergedDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/merged",
	                "UpperDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/diff",
	                "WorkDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "ha-078118",
	                "Source": "/var/lib/docker/volumes/ha-078118/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "ha-078118",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ha-078118",
	                "name.minikube.sigs.k8s.io": "ha-078118",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "46c241f4f759650d3d72325bd2e71329577f7cf9aeedeb6d33ceecff2db46b27",
	            "SandboxKey": "/var/run/docker/netns/46c241f4f759",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32783"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32784"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32787"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32785"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32786"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ha-078118": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "7a:b0:8a:ae:56:9b",
	                    "DriverOpts": null,
	                    "GwPriority": 0,
	                    "NetworkID": "0aa191750de6e44eaf49073a9e05a52994c63ccafcb0870d32aaf105d93cb724",
	                    "EndpointID": "4a33baf269d5fab1a605edfe7de39d655fdf3c152c658d8c6eca8c3ca23635ea",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "ha-078118",
	                        "0cb187fb2895"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-078118 -n ha-078118
helpers_test.go:252: <<< TestMultiControlPlane/serial/AddWorkerNode FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======>  post-mortem[TestMultiControlPlane/serial/AddWorkerNode]: minikube logs <======
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p ha-078118 logs -n 25: (1.149216988s)
helpers_test.go:260: TestMultiControlPlane/serial/AddWorkerNode logs: 
-- stdout --
	
	==> Audit <==
	┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬───────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
	│ COMMAND │                                                           ARGS                                                            │      PROFILE      │  USER   │ VERSION │     START TIME      │      END TIME       │
	├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼───────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
	│ service │ functional-366930 service hello-node --url --format={{.IP}}                                                               │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:56 UTC │                     │
	│ service │ functional-366930 service hello-node --url                                                                                │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:56 UTC │                     │
	│ delete  │ -p functional-366930                                                                                                      │ functional-366930 │ jenkins │ v1.37.0 │ 18 Sep 25 16:56 UTC │ 18 Sep 25 16:56 UTC │
	│ start   │ ha-078118 start --ha --memory 3072 --wait true --alsologtostderr -v 5 --driver=docker  --container-runtime=crio           │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:56 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- apply -f ./testdata/ha/ha-pod-dns-test.yaml                                                          │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- rollout status deployment/busybox                                                                    │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- get pods -o jsonpath='{.items[*].status.podIP}'                                                      │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- get pods -o jsonpath='{.items[*].metadata.name}'                                                     │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- exec busybox-7b57f96db7-95578 -- nslookup kubernetes.io                                              │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- exec busybox-7b57f96db7-bzrv2 -- nslookup kubernetes.io                                              │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- exec busybox-7b57f96db7-t7rzr -- nslookup kubernetes.io                                              │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- exec busybox-7b57f96db7-95578 -- nslookup kubernetes.default                                         │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- exec busybox-7b57f96db7-bzrv2 -- nslookup kubernetes.default                                         │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- exec busybox-7b57f96db7-t7rzr -- nslookup kubernetes.default                                         │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- exec busybox-7b57f96db7-95578 -- nslookup kubernetes.default.svc.cluster.local                       │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- exec busybox-7b57f96db7-bzrv2 -- nslookup kubernetes.default.svc.cluster.local                       │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- exec busybox-7b57f96db7-t7rzr -- nslookup kubernetes.default.svc.cluster.local                       │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- get pods -o jsonpath='{.items[*].metadata.name}'                                                     │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- exec busybox-7b57f96db7-95578 -- sh -c nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3 │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- exec busybox-7b57f96db7-95578 -- sh -c ping -c 1 192.168.49.1                                        │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- exec busybox-7b57f96db7-bzrv2 -- sh -c nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3 │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- exec busybox-7b57f96db7-bzrv2 -- sh -c ping -c 1 192.168.49.1                                        │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- exec busybox-7b57f96db7-t7rzr -- sh -c nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3 │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ kubectl │ ha-078118 kubectl -- exec busybox-7b57f96db7-t7rzr -- sh -c ping -c 1 192.168.49.1                                        │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │ 18 Sep 25 16:59 UTC │
	│ node    │ ha-078118 node add --alsologtostderr -v 5                                                                                 │ ha-078118         │ jenkins │ v1.37.0 │ 18 Sep 25 16:59 UTC │                     │
	└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴───────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
	
	
	==> Last Start <==
	Log file created at: 2025/09/18 16:56:57
	Running on machine: ubuntu-20-agent-4
	Binary: Built with gc go1.24.6 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0918 16:56:57.574799   60243 out.go:360] Setting OutFile to fd 1 ...
	I0918 16:56:57.575055   60243 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:56:57.575064   60243 out.go:374] Setting ErrFile to fd 2...
	I0918 16:56:57.575068   60243 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:56:57.575239   60243 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 16:56:57.575752   60243 out.go:368] Setting JSON to false
	I0918 16:56:57.576663   60243 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":2369,"bootTime":1758212249,"procs":182,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 16:56:57.576763   60243 start.go:140] virtualization: kvm guest
	I0918 16:56:57.579065   60243 out.go:179] * [ha-078118] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 16:56:57.580589   60243 notify.go:220] Checking for updates...
	I0918 16:56:57.580637   60243 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 16:56:57.582251   60243 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 16:56:57.583930   60243 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 16:56:57.585344   60243 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 16:56:57.586681   60243 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 16:56:57.588118   60243 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 16:56:57.589868   60243 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 16:56:57.616949   60243 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 16:56:57.617226   60243 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:56:57.672926   60243 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 16:56:57.662881749 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:56:57.673067   60243 docker.go:318] overlay module found
	I0918 16:56:57.674951   60243 out.go:179] * Using the docker driver based on user configuration
	I0918 16:56:57.676488   60243 start.go:304] selected driver: docker
	I0918 16:56:57.676533   60243 start.go:924] validating driver "docker" against <nil>
	I0918 16:56:57.676551   60243 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 16:56:57.677232   60243 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:56:57.735443   60243 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 16:56:57.725396122 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:56:57.735617   60243 start_flags.go:327] no existing cluster config was found, will generate one from the flags 
	I0918 16:56:57.735836   60243 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 16:56:57.737842   60243 out.go:179] * Using Docker driver with root privileges
	I0918 16:56:57.739170   60243 cni.go:84] Creating CNI manager for ""
	I0918 16:56:57.739238   60243 cni.go:136] multinode detected (0 nodes found), recommending kindnet
	I0918 16:56:57.739249   60243 start_flags.go:336] Found "CNI" CNI - setting NetworkPlugin=cni
	I0918 16:56:57.739334   60243 start.go:348] cluster config:
	{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:c
ni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:56:57.740825   60243 out.go:179] * Starting "ha-078118" primary control-plane node in "ha-078118" cluster
	I0918 16:56:57.742276   60243 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 16:56:57.743877   60243 out.go:179] * Pulling base image v0.0.48 ...
	I0918 16:56:57.745428   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:56:57.745480   60243 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
	I0918 16:56:57.745487   60243 cache.go:58] Caching tarball of preloaded images
	I0918 16:56:57.745560   60243 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 16:56:57.745653   60243 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 16:56:57.745669   60243 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 16:56:57.745990   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:56:57.746019   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json: {Name:mke5d1dac7b5b198fe436d519c900523bef38bac Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:56:57.768293   60243 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 16:56:57.768319   60243 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 16:56:57.768342   60243 cache.go:232] Successfully downloaded all kic artifacts
	I0918 16:56:57.768380   60243 start.go:360] acquireMachinesLock for ha-078118: {Name:mk24a1b2c9ed1c42e9ffd635727b36c75401a437 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 16:56:57.768479   60243 start.go:364] duration metric: took 78.905µs to acquireMachinesLock for "ha-078118"
	I0918 16:56:57.768533   60243 start.go:93] Provisioning new machine with config: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APISer
verIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMne
tPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:56:57.768610   60243 start.go:125] createHost starting for "" (driver="docker")
	I0918 16:56:57.770671   60243 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
	I0918 16:56:57.770887   60243 start.go:159] libmachine.API.Create for "ha-078118" (driver="docker")
	I0918 16:56:57.770915   60243 client.go:168] LocalClient.Create starting
	I0918 16:56:57.771017   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 16:56:57.771052   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:56:57.771063   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:56:57.771109   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 16:56:57.771128   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:56:57.771139   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:56:57.771472   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0918 16:56:57.788966   60243 cli_runner.go:211] docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0918 16:56:57.789055   60243 network_create.go:284] running [docker network inspect ha-078118] to gather additional debugging logs...
	I0918 16:56:57.789082   60243 cli_runner.go:164] Run: docker network inspect ha-078118
	W0918 16:56:57.806227   60243 cli_runner.go:211] docker network inspect ha-078118 returned with exit code 1
	I0918 16:56:57.806257   60243 network_create.go:287] error running [docker network inspect ha-078118]: docker network inspect ha-078118: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network ha-078118 not found
	I0918 16:56:57.806269   60243 network_create.go:289] output of [docker network inspect ha-078118]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network ha-078118 not found
	
	** /stderr **
	I0918 16:56:57.806367   60243 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:56:57.825048   60243 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000b6fd40}
	I0918 16:56:57.825108   60243 network_create.go:124] attempt to create docker network ha-078118 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0918 16:56:57.825168   60243 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=ha-078118 ha-078118
	I0918 16:56:57.883807   60243 network_create.go:108] docker network ha-078118 192.168.49.0/24 created
	I0918 16:56:57.883839   60243 kic.go:121] calculated static IP "192.168.49.2" for the "ha-078118" container
	I0918 16:56:57.883907   60243 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 16:56:57.901150   60243 cli_runner.go:164] Run: docker volume create ha-078118 --label name.minikube.sigs.k8s.io=ha-078118 --label created_by.minikube.sigs.k8s.io=true
	I0918 16:56:57.920292   60243 oci.go:103] Successfully created a docker volume ha-078118
	I0918 16:56:57.920371   60243 cli_runner.go:164] Run: docker run --rm --name ha-078118-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118 --entrypoint /usr/bin/test -v ha-078118:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 16:56:58.331429   60243 oci.go:107] Successfully prepared a docker volume ha-078118
	I0918 16:56:58.331493   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:56:58.331538   60243 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 16:56:58.331609   60243 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 16:57:02.609752   60243 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.278086372s)
	I0918 16:57:02.609786   60243 kic.go:203] duration metric: took 4.278244507s to extract preloaded images to volume ...
	W0918 16:57:02.609879   60243 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 16:57:02.609928   60243 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 16:57:02.609985   60243 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 16:57:02.664799   60243 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ha-078118 --name ha-078118 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ha-078118 --network ha-078118 --ip 192.168.49.2 --volume ha-078118:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 16:57:02.939918   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Running}}
	I0918 16:57:02.960880   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:02.979302   60243 cli_runner.go:164] Run: docker exec ha-078118 stat /var/lib/dpkg/alternatives/iptables
	I0918 16:57:03.031279   60243 oci.go:144] the created container "ha-078118" has a running status.
	I0918 16:57:03.031320   60243 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa...
	I0918 16:57:03.339176   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0918 16:57:03.339260   60243 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 16:57:03.367335   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:03.386757   60243 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0918 16:57:03.386779   60243 kic_runner.go:114] Args: [docker exec --privileged ha-078118 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0918 16:57:03.436474   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:03.454883   60243 machine.go:93] provisionDockerMachine start ...
	I0918 16:57:03.454973   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:03.473294   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:03.473657   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32783 <nil> <nil>}
	I0918 16:57:03.473681   60243 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 16:57:03.614090   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 16:57:03.614134   60243 ubuntu.go:182] provisioning hostname "ha-078118"
	I0918 16:57:03.614194   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:03.632632   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:03.632839   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32783 <nil> <nil>}
	I0918 16:57:03.632853   60243 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118 && echo "ha-078118" | sudo tee /etc/hostname
	I0918 16:57:03.782762   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 16:57:03.782829   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:03.801381   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:03.801652   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32783 <nil> <nil>}
	I0918 16:57:03.801672   60243 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 16:57:03.939426   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 16:57:03.939465   60243 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 16:57:03.939512   60243 ubuntu.go:190] setting up certificates
	I0918 16:57:03.939523   60243 provision.go:84] configureAuth start
	I0918 16:57:03.939572   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 16:57:03.957335   60243 provision.go:143] copyHostCerts
	I0918 16:57:03.957375   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:57:03.957408   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 16:57:03.957416   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:57:03.957515   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 16:57:03.957636   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:57:03.957667   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 16:57:03.957676   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:57:03.957723   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 16:57:03.957805   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:57:03.957831   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 16:57:03.957840   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:57:03.957878   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 16:57:03.957967   60243 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118 san=[127.0.0.1 192.168.49.2 ha-078118 localhost minikube]
	I0918 16:57:04.446406   60243 provision.go:177] copyRemoteCerts
	I0918 16:57:04.446467   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 16:57:04.446516   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:04.464707   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:04.562243   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 16:57:04.562316   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 16:57:04.588874   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 16:57:04.588947   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)
	I0918 16:57:04.614556   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 16:57:04.614618   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0918 16:57:04.639365   60243 provision.go:87] duration metric: took 699.826763ms to configureAuth
	I0918 16:57:04.639398   60243 ubuntu.go:206] setting minikube options for container-runtime
	I0918 16:57:04.639604   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:04.639701   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:04.656946   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:04.657177   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32783 <nil> <nil>}
	I0918 16:57:04.657195   60243 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 16:57:04.894695   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 16:57:04.894721   60243 machine.go:96] duration metric: took 1.439819388s to provisionDockerMachine
	I0918 16:57:04.894730   60243 client.go:171] duration metric: took 7.123809117s to LocalClient.Create
	I0918 16:57:04.894745   60243 start.go:167] duration metric: took 7.123860389s to libmachine.API.Create "ha-078118"
	I0918 16:57:04.894752   60243 start.go:293] postStartSetup for "ha-078118" (driver="docker")
	I0918 16:57:04.894761   60243 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 16:57:04.894810   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 16:57:04.894846   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:04.912730   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:05.012590   60243 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 16:57:05.016311   60243 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 16:57:05.016343   60243 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 16:57:05.016356   60243 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 16:57:05.016365   60243 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 16:57:05.016390   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 16:57:05.016463   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 16:57:05.016587   60243 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 16:57:05.016603   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 16:57:05.016747   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 16:57:05.026453   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:57:05.054679   60243 start.go:296] duration metric: took 159.911183ms for postStartSetup
	I0918 16:57:05.055125   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 16:57:05.073363   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:57:05.073657   60243 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:57:05.073698   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:05.091184   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:05.183583   60243 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 16:57:05.187892   60243 start.go:128] duration metric: took 7.419268686s to createHost
	I0918 16:57:05.187925   60243 start.go:83] releasing machines lock for "ha-078118", held for 7.419435528s
	I0918 16:57:05.187997   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 16:57:05.206007   60243 ssh_runner.go:195] Run: cat /version.json
	I0918 16:57:05.206061   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:05.206078   60243 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 16:57:05.206128   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:05.226344   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:05.226582   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:05.390376   60243 ssh_runner.go:195] Run: systemctl --version
	I0918 16:57:05.395210   60243 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 16:57:05.535393   60243 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 16:57:05.540215   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:57:05.563699   60243 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 16:57:05.563777   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:57:05.593610   60243 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0918 16:57:05.593635   60243 start.go:495] detecting cgroup driver to use...
	I0918 16:57:05.593682   60243 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 16:57:05.593755   60243 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 16:57:05.609690   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 16:57:05.621084   60243 docker.go:218] disabling cri-docker service (if available) ...
	I0918 16:57:05.621139   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 16:57:05.634236   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 16:57:05.649602   60243 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 16:57:05.717704   60243 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 16:57:05.791536   60243 docker.go:234] disabling docker service ...
	I0918 16:57:05.791597   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 16:57:05.809456   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 16:57:05.821093   60243 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 16:57:05.891934   60243 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 16:57:05.996308   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 16:57:06.008290   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 16:57:06.025752   60243 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 16:57:06.025802   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.039023   60243 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 16:57:06.039085   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.049537   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.059941   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.070049   60243 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 16:57:06.079646   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.089835   60243 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.106740   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.116937   60243 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 16:57:06.125702   60243 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 16:57:06.136246   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:06.241697   60243 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 16:57:06.338653   60243 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 16:57:06.338718   60243 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 16:57:06.342873   60243 start.go:563] Will wait 60s for crictl version
	I0918 16:57:06.342929   60243 ssh_runner.go:195] Run: which crictl
	I0918 16:57:06.346790   60243 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 16:57:06.382517   60243 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 16:57:06.382605   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:57:06.419798   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:57:06.456221   60243 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 16:57:06.457601   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:57:06.475395   60243 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 16:57:06.479436   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:57:06.491469   60243 kubeadm.go:875] updating cluster {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIP
s:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: Soc
ketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0918 16:57:06.491586   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:57:06.491632   60243 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 16:57:06.560467   60243 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 16:57:06.560490   60243 crio.go:433] Images already preloaded, skipping extraction
	I0918 16:57:06.560565   60243 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 16:57:06.596435   60243 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 16:57:06.596457   60243 cache_images.go:85] Images are preloaded, skipping loading
	I0918 16:57:06.596465   60243 kubeadm.go:926] updating node { 192.168.49.2 8443 v1.34.0 crio true true} ...
	I0918 16:57:06.596593   60243 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 16:57:06.596663   60243 ssh_runner.go:195] Run: crio config
	I0918 16:57:06.638379   60243 cni.go:84] Creating CNI manager for ""
	I0918 16:57:06.638415   60243 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0918 16:57:06.638485   60243 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0918 16:57:06.638551   60243 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.34.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-078118 NodeName:ha-078118 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manif
ests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0918 16:57:06.638713   60243 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "ha-078118"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.49.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	kubernetesVersion: v1.34.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: systemd
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0918 16:57:06.638746   60243 kube-vip.go:115] generating kube-vip config ...
	I0918 16:57:06.638798   60243 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 16:57:06.651869   60243 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 16:57:06.652012   60243 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/super-admin.conf"
	    name: kubeconfig
	status: {}
	I0918 16:57:06.652164   60243 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 16:57:06.661798   60243 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 16:57:06.661868   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
	I0918 16:57:06.671425   60243 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (359 bytes)
	I0918 16:57:06.690684   60243 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 16:57:06.712365   60243 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2205 bytes)
	I0918 16:57:06.730837   60243 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1364 bytes)
	I0918 16:57:06.751634   60243 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 16:57:06.755620   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:57:06.767580   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:06.834874   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:57:06.856024   60243 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.2
	I0918 16:57:06.856044   60243 certs.go:194] generating shared ca certs ...
	I0918 16:57:06.856058   60243 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:06.856204   60243 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 16:57:06.856251   60243 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 16:57:06.856269   60243 certs.go:256] generating profile certs ...
	I0918 16:57:06.856336   60243 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 16:57:06.856374   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt with IP's: []
	I0918 16:57:07.092454   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt ...
	I0918 16:57:07.092487   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt: {Name:mk19062e6a12c311074ac12acf7e6f0d17c6d89a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.092685   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key ...
	I0918 16:57:07.092704   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key: {Name:mk318c046cc338ba0b28b363817d97a3070d94ed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.092818   60243 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.37f1b339
	I0918 16:57:07.092834   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.37f1b339 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.254]
	I0918 16:57:07.337211   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.37f1b339 ...
	I0918 16:57:07.337241   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.37f1b339: {Name:mk0b5e39f9123a2c4e24d5df860b2ac053c5a5e0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.337432   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.37f1b339 ...
	I0918 16:57:07.337456   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.37f1b339: {Name:mkf9155cc06cff6c926a6f1637026b23fbaea042 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.337590   60243 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.37f1b339 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 16:57:07.337708   60243 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.37f1b339 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 16:57:07.337789   60243 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 16:57:07.337811   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt with IP's: []
	I0918 16:57:07.508219   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt ...
	I0918 16:57:07.508250   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt: {Name:mk9be1072d013045d70f28d234a2966ed6a259eb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.508439   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key ...
	I0918 16:57:07.508459   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key: {Name:mk0fa849d3f79114700ec4346366d93036905ac9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.508586   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 16:57:07.508611   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 16:57:07.508632   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 16:57:07.508659   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 16:57:07.508679   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 16:57:07.508694   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 16:57:07.508710   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 16:57:07.508729   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 16:57:07.508805   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 16:57:07.508852   60243 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 16:57:07.508866   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 16:57:07.508898   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 16:57:07.508928   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 16:57:07.508964   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 16:57:07.509027   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:57:07.509070   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 16:57:07.509093   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:07.509106   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 16:57:07.509647   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 16:57:07.536147   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 16:57:07.563252   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 16:57:07.590602   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 16:57:07.616431   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
	I0918 16:57:07.642036   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 16:57:07.668728   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 16:57:07.695297   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 16:57:07.720300   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 16:57:07.748223   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 16:57:07.774345   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 16:57:07.799523   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0918 16:57:07.818102   60243 ssh_runner.go:195] Run: openssl version
	I0918 16:57:07.823677   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 16:57:07.833790   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:07.837671   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:07.837733   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:07.844558   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 16:57:07.854483   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 16:57:07.864206   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 16:57:07.868068   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 16:57:07.868131   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 16:57:07.875355   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 16:57:07.885526   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 16:57:07.895494   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 16:57:07.899217   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 16:57:07.899266   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 16:57:07.906421   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 16:57:07.916547   60243 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 16:57:07.920046   60243 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0918 16:57:07.920125   60243 kubeadm.go:392] StartCluster: {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[
] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: Socket
VMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:57:07.920228   60243 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0918 16:57:07.920275   60243 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0918 16:57:07.956205   60243 cri.go:89] found id: ""
	I0918 16:57:07.956268   60243 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0918 16:57:07.965688   60243 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0918 16:57:07.975065   60243 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
	I0918 16:57:07.975155   60243 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0918 16:57:07.984553   60243 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0918 16:57:07.984571   60243 kubeadm.go:157] found existing configuration files:
	
	I0918 16:57:07.984632   60243 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0918 16:57:07.993826   60243 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0918 16:57:07.993878   60243 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0918 16:57:08.002980   60243 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0918 16:57:08.012468   60243 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0918 16:57:08.012566   60243 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0918 16:57:08.021925   60243 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0918 16:57:08.031367   60243 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0918 16:57:08.031459   60243 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0918 16:57:08.040660   60243 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0918 16:57:08.050415   60243 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0918 16:57:08.050490   60243 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0918 16:57:08.059624   60243 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0918 16:57:08.100277   60243 kubeadm.go:310] [init] Using Kubernetes version: v1.34.0
	I0918 16:57:08.100331   60243 kubeadm.go:310] [preflight] Running pre-flight checks
	I0918 16:57:08.116038   60243 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
	I0918 16:57:08.116128   60243 kubeadm.go:310] KERNEL_VERSION: 6.8.0-1037-gcp
	I0918 16:57:08.116186   60243 kubeadm.go:310] OS: Linux
	I0918 16:57:08.116266   60243 kubeadm.go:310] CGROUPS_CPU: enabled
	I0918 16:57:08.116315   60243 kubeadm.go:310] CGROUPS_CPUSET: enabled
	I0918 16:57:08.116373   60243 kubeadm.go:310] CGROUPS_DEVICES: enabled
	I0918 16:57:08.116443   60243 kubeadm.go:310] CGROUPS_FREEZER: enabled
	I0918 16:57:08.116522   60243 kubeadm.go:310] CGROUPS_MEMORY: enabled
	I0918 16:57:08.116571   60243 kubeadm.go:310] CGROUPS_PIDS: enabled
	I0918 16:57:08.116615   60243 kubeadm.go:310] CGROUPS_HUGETLB: enabled
	I0918 16:57:08.116655   60243 kubeadm.go:310] CGROUPS_IO: enabled
	I0918 16:57:08.171905   60243 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0918 16:57:08.172043   60243 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0918 16:57:08.172141   60243 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
	I0918 16:57:08.179444   60243 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0918 16:57:08.181874   60243 out.go:252]   - Generating certificates and keys ...
	I0918 16:57:08.181988   60243 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0918 16:57:08.182109   60243 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0918 16:57:08.384218   60243 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0918 16:57:08.699741   60243 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
	I0918 16:57:08.825486   60243 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
	I0918 16:57:09.371495   60243 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
	I0918 16:57:09.773350   60243 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
	I0918 16:57:09.773540   60243 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [ha-078118 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0918 16:57:09.808553   60243 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
	I0918 16:57:09.808791   60243 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [ha-078118 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0918 16:57:10.030134   60243 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0918 16:57:10.543694   60243 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
	I0918 16:57:10.609235   60243 kubeadm.go:310] [certs] Generating "sa" key and public key
	I0918 16:57:10.609444   60243 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0918 16:57:10.844107   60243 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0918 16:57:10.880658   60243 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
	I0918 16:57:11.137641   60243 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0918 16:57:11.532580   60243 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0918 16:57:12.251321   60243 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0918 16:57:12.251715   60243 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0918 16:57:12.253897   60243 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0918 16:57:12.256755   60243 out.go:252]   - Booting up control plane ...
	I0918 16:57:12.256866   60243 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0918 16:57:12.256981   60243 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0918 16:57:12.257446   60243 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0918 16:57:12.266598   60243 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0918 16:57:12.266737   60243 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
	I0918 16:57:12.272623   60243 kubeadm.go:310] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
	I0918 16:57:12.272803   60243 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0918 16:57:12.272863   60243 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0918 16:57:12.350329   60243 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
	I0918 16:57:12.350484   60243 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
	I0918 16:57:12.852220   60243 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 502.00859ms
	I0918 16:57:12.854990   60243 kubeadm.go:310] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
	I0918 16:57:12.855092   60243 kubeadm.go:310] [control-plane-check] Checking kube-apiserver at https://192.168.49.2:8443/livez
	I0918 16:57:12.855203   60243 kubeadm.go:310] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
	I0918 16:57:12.855323   60243 kubeadm.go:310] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
	I0918 16:57:14.965273   60243 kubeadm.go:310] [control-plane-check] kube-scheduler is healthy after 2.110264832s
	I0918 16:57:14.984462   60243 kubeadm.go:310] [control-plane-check] kube-controller-manager is healthy after 2.1294049s
	I0918 16:57:19.024541   60243 kubeadm.go:310] [control-plane-check] kube-apiserver is healthy after 6.169430817s
	I0918 16:57:19.036534   60243 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0918 16:57:19.048658   60243 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0918 16:57:19.058561   60243 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0918 16:57:19.058849   60243 kubeadm.go:310] [mark-control-plane] Marking the node ha-078118 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0918 16:57:19.067655   60243 kubeadm.go:310] [bootstrap-token] Using token: u1re3r.382xtbpelzb2vqn2
	I0918 16:57:19.069664   60243 out.go:252]   - Configuring RBAC rules ...
	I0918 16:57:19.069828   60243 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0918 16:57:19.073078   60243 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0918 16:57:19.080001   60243 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0918 16:57:19.082815   60243 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0918 16:57:19.085370   60243 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0918 16:57:19.088075   60243 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0918 16:57:19.430480   60243 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0918 16:57:19.851385   60243 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0918 16:57:20.430959   60243 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0918 16:57:20.432013   60243 kubeadm.go:310] 
	I0918 16:57:20.432090   60243 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0918 16:57:20.432099   60243 kubeadm.go:310] 
	I0918 16:57:20.432181   60243 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0918 16:57:20.432188   60243 kubeadm.go:310] 
	I0918 16:57:20.432210   60243 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0918 16:57:20.432276   60243 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0918 16:57:20.432337   60243 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0918 16:57:20.432348   60243 kubeadm.go:310] 
	I0918 16:57:20.432441   60243 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0918 16:57:20.432460   60243 kubeadm.go:310] 
	I0918 16:57:20.432557   60243 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0918 16:57:20.432567   60243 kubeadm.go:310] 
	I0918 16:57:20.432631   60243 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0918 16:57:20.432695   60243 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0918 16:57:20.432772   60243 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0918 16:57:20.432781   60243 kubeadm.go:310] 
	I0918 16:57:20.432883   60243 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0918 16:57:20.433004   60243 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0918 16:57:20.433043   60243 kubeadm.go:310] 
	I0918 16:57:20.433148   60243 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token u1re3r.382xtbpelzb2vqn2 \
	I0918 16:57:20.433277   60243 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 \
	I0918 16:57:20.433309   60243 kubeadm.go:310] 	--control-plane 
	I0918 16:57:20.433319   60243 kubeadm.go:310] 
	I0918 16:57:20.433422   60243 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0918 16:57:20.433430   60243 kubeadm.go:310] 
	I0918 16:57:20.433578   60243 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token u1re3r.382xtbpelzb2vqn2 \
	I0918 16:57:20.433727   60243 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 
	I0918 16:57:20.436674   60243 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1037-gcp\n", err: exit status 1
	I0918 16:57:20.436833   60243 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0918 16:57:20.436876   60243 cni.go:84] Creating CNI manager for ""
	I0918 16:57:20.436887   60243 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0918 16:57:20.439722   60243 out.go:179] * Configuring CNI (Container Networking Interface) ...
	I0918 16:57:20.441111   60243 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0918 16:57:20.445728   60243 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.0/kubectl ...
	I0918 16:57:20.445756   60243 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
	I0918 16:57:20.465315   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0918 16:57:20.690521   60243 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0918 16:57:20.690609   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:20.690640   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-078118 minikube.k8s.io/updated_at=2025_09_18T16_57_20_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596 minikube.k8s.io/name=ha-078118 minikube.k8s.io/primary=true
	I0918 16:57:20.700737   60243 ops.go:34] apiserver oom_adj: -16
	I0918 16:57:20.767604   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:21.268560   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:21.768089   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:22.268176   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:22.767676   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:22.839542   60243 kubeadm.go:1105] duration metric: took 2.149001453s to wait for elevateKubeSystemPrivileges
	I0918 16:57:22.839581   60243 kubeadm.go:394] duration metric: took 14.919472386s to StartCluster
	I0918 16:57:22.839607   60243 settings.go:142] acquiring lock: {Name:mk72fea03aefe901db9522a467405d86665fedd0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:22.839682   60243 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 16:57:22.840462   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:22.840735   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0918 16:57:22.840750   60243 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:57:22.840775   60243 start.go:241] waiting for startup goroutines ...
	I0918 16:57:22.840788   60243 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0918 16:57:22.840876   60243 addons.go:69] Setting storage-provisioner=true in profile "ha-078118"
	I0918 16:57:22.840891   60243 addons.go:69] Setting default-storageclass=true in profile "ha-078118"
	I0918 16:57:22.840905   60243 addons.go:238] Setting addon storage-provisioner=true in "ha-078118"
	I0918 16:57:22.840939   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:57:22.840991   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:22.840941   60243 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-078118"
	I0918 16:57:22.841392   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:22.841558   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:22.865202   60243 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0918 16:57:22.865763   60243 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
	I0918 16:57:22.865795   60243 cert_rotation.go:141] "Starting client certificate rotation controller" logger="tls-transport-cache"
	I0918 16:57:22.865809   60243 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I0918 16:57:22.865816   60243 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
	I0918 16:57:22.865822   60243 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I0918 16:57:22.865828   60243 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
	I0918 16:57:22.866253   60243 addons.go:238] Setting addon default-storageclass=true in "ha-078118"
	I0918 16:57:22.866295   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:57:22.866582   60243 out.go:179]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0918 16:57:22.866825   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:22.868241   60243 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 16:57:22.868262   60243 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0918 16:57:22.868342   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:22.887359   60243 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
	I0918 16:57:22.887382   60243 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0918 16:57:22.887455   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:22.887753   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:22.910642   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:22.923544   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0918 16:57:23.006833   60243 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 16:57:23.025178   60243 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0918 16:57:23.102314   60243 start.go:976] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0918 16:57:23.320187   60243 out.go:179] * Enabled addons: storage-provisioner, default-storageclass
	I0918 16:57:23.321629   60243 addons.go:514] duration metric: took 480.833788ms for enable addons: enabled=[storage-provisioner default-storageclass]
	I0918 16:57:23.321670   60243 start.go:246] waiting for cluster config update ...
	I0918 16:57:23.321686   60243 start.go:255] writing updated cluster config ...
	I0918 16:57:23.323424   60243 out.go:203] 
	I0918 16:57:23.325109   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:23.325199   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:57:23.327022   60243 out.go:179] * Starting "ha-078118-m02" control-plane node in "ha-078118" cluster
	I0918 16:57:23.328400   60243 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 16:57:23.329828   60243 out.go:179] * Pulling base image v0.0.48 ...
	I0918 16:57:23.331236   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:57:23.331263   60243 cache.go:58] Caching tarball of preloaded images
	I0918 16:57:23.331263   60243 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 16:57:23.331360   60243 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 16:57:23.331373   60243 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 16:57:23.331452   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:57:23.352040   60243 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 16:57:23.352060   60243 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 16:57:23.352072   60243 cache.go:232] Successfully downloaded all kic artifacts
	I0918 16:57:23.352116   60243 start.go:360] acquireMachinesLock for ha-078118-m02: {Name:mk65f6a883861f2032241e1132c63effea2ab61f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 16:57:23.352223   60243 start.go:364] duration metric: took 88.663µs to acquireMachinesLock for "ha-078118-m02"
	I0918 16:57:23.352254   60243 start.go:93] Provisioning new machine with config: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:57:23.352328   60243 start.go:125] createHost starting for "m02" (driver="docker")
	I0918 16:57:23.354398   60243 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
	I0918 16:57:23.354538   60243 start.go:159] libmachine.API.Create for "ha-078118" (driver="docker")
	I0918 16:57:23.354572   60243 client.go:168] LocalClient.Create starting
	I0918 16:57:23.354639   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 16:57:23.354680   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:57:23.354700   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:57:23.354772   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 16:57:23.354801   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:57:23.354818   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:57:23.355707   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:57:23.373229   60243 network_create.go:77] Found existing network {name:ha-078118 subnet:0xc002073950 gateway:[0 0 0 0 0 0 0 0 0 0 255 255 192 168 49 1] mtu:1500}
	I0918 16:57:23.373281   60243 kic.go:121] calculated static IP "192.168.49.3" for the "ha-078118-m02" container
	I0918 16:57:23.373335   60243 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 16:57:23.392406   60243 cli_runner.go:164] Run: docker volume create ha-078118-m02 --label name.minikube.sigs.k8s.io=ha-078118-m02 --label created_by.minikube.sigs.k8s.io=true
	I0918 16:57:23.414767   60243 oci.go:103] Successfully created a docker volume ha-078118-m02
	I0918 16:57:23.414860   60243 cli_runner.go:164] Run: docker run --rm --name ha-078118-m02-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m02 --entrypoint /usr/bin/test -v ha-078118-m02:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 16:57:23.852088   60243 oci.go:107] Successfully prepared a docker volume ha-078118-m02
	I0918 16:57:23.852142   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:57:23.852165   60243 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 16:57:23.852243   60243 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m02:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 16:57:28.049263   60243 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m02:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.19696985s)
	I0918 16:57:28.049296   60243 kic.go:203] duration metric: took 4.197127441s to extract preloaded images to volume ...
	W0918 16:57:28.049399   60243 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 16:57:28.049426   60243 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 16:57:28.049461   60243 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 16:57:28.104457   60243 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ha-078118-m02 --name ha-078118-m02 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m02 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ha-078118-m02 --network ha-078118 --ip 192.168.49.3 --volume ha-078118-m02:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 16:57:28.377133   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Running}}
	I0918 16:57:28.396963   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 16:57:28.416714   60243 cli_runner.go:164] Run: docker exec ha-078118-m02 stat /var/lib/dpkg/alternatives/iptables
	I0918 16:57:28.473951   60243 oci.go:144] the created container "ha-078118-m02" has a running status.
	I0918 16:57:28.473985   60243 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa...
	I0918 16:57:29.190216   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0918 16:57:29.190259   60243 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 16:57:29.215556   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 16:57:29.233891   60243 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0918 16:57:29.233912   60243 kic_runner.go:114] Args: [docker exec --privileged ha-078118-m02 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0918 16:57:29.288122   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 16:57:29.305873   60243 machine.go:93] provisionDockerMachine start ...
	I0918 16:57:29.305960   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:29.324234   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:29.324468   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32788 <nil> <nil>}
	I0918 16:57:29.324480   60243 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 16:57:29.460587   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 16:57:29.460616   60243 ubuntu.go:182] provisioning hostname "ha-078118-m02"
	I0918 16:57:29.460684   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:29.479097   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:29.479306   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32788 <nil> <nil>}
	I0918 16:57:29.479323   60243 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m02 && echo "ha-078118-m02" | sudo tee /etc/hostname
	I0918 16:57:29.628691   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 16:57:29.628814   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:29.647616   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:29.647872   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32788 <nil> <nil>}
	I0918 16:57:29.647893   60243 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m02' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m02/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m02' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 16:57:29.784402   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 16:57:29.784431   60243 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 16:57:29.784448   60243 ubuntu.go:190] setting up certificates
	I0918 16:57:29.784457   60243 provision.go:84] configureAuth start
	I0918 16:57:29.784531   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 16:57:29.803424   60243 provision.go:143] copyHostCerts
	I0918 16:57:29.803462   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:57:29.803520   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 16:57:29.803535   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:57:29.803621   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 16:57:29.803783   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:57:29.803815   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 16:57:29.803822   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:57:29.803868   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 16:57:29.803949   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:57:29.803975   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 16:57:29.803981   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:57:29.804020   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 16:57:29.804097   60243 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m02 san=[127.0.0.1 192.168.49.3 ha-078118-m02 localhost minikube]
	I0918 16:57:29.933774   60243 provision.go:177] copyRemoteCerts
	I0918 16:57:29.933834   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 16:57:29.933864   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:29.952199   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.053380   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 16:57:30.053448   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 16:57:30.079586   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 16:57:30.079652   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 16:57:30.106162   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 16:57:30.106215   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0918 16:57:30.131599   60243 provision.go:87] duration metric: took 347.131672ms to configureAuth
	I0918 16:57:30.131623   60243 ubuntu.go:206] setting minikube options for container-runtime
	I0918 16:57:30.131803   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:30.131903   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.151255   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:30.151466   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32788 <nil> <nil>}
	I0918 16:57:30.151481   60243 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 16:57:30.393377   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 16:57:30.393406   60243 machine.go:96] duration metric: took 1.08751272s to provisionDockerMachine
	I0918 16:57:30.393419   60243 client.go:171] duration metric: took 7.038837191s to LocalClient.Create
	I0918 16:57:30.393445   60243 start.go:167] duration metric: took 7.038908487s to libmachine.API.Create "ha-078118"
	I0918 16:57:30.393465   60243 start.go:293] postStartSetup for "ha-078118-m02" (driver="docker")
	I0918 16:57:30.393489   60243 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 16:57:30.393583   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 16:57:30.393629   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.412821   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.513018   60243 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 16:57:30.516819   60243 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 16:57:30.516868   60243 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 16:57:30.516888   60243 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 16:57:30.516896   60243 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 16:57:30.516914   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 16:57:30.516990   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 16:57:30.517127   60243 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 16:57:30.517140   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 16:57:30.517261   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 16:57:30.528368   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:57:30.556419   60243 start.go:296] duration metric: took 162.941822ms for postStartSetup
	I0918 16:57:30.556822   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 16:57:30.575320   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:57:30.575623   60243 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:57:30.575666   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.593574   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.686828   60243 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 16:57:30.691487   60243 start.go:128] duration metric: took 7.339144526s to createHost
	I0918 16:57:30.691534   60243 start.go:83] releasing machines lock for "ha-078118-m02", held for 7.33929551s
	I0918 16:57:30.691607   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 16:57:30.712513   60243 out.go:179] * Found network options:
	I0918 16:57:30.713751   60243 out.go:179]   - NO_PROXY=192.168.49.2
	W0918 16:57:30.714978   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 16:57:30.715016   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 16:57:30.715086   60243 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 16:57:30.715123   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.715166   60243 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 16:57:30.715216   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.734742   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.735055   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.962897   60243 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 16:57:30.967520   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:57:30.990153   60243 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 16:57:30.990237   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:57:31.019088   60243 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0918 16:57:31.019116   60243 start.go:495] detecting cgroup driver to use...
	I0918 16:57:31.019152   60243 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 16:57:31.019210   60243 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 16:57:31.034083   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 16:57:31.047475   60243 docker.go:218] disabling cri-docker service (if available) ...
	I0918 16:57:31.047603   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 16:57:31.061869   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 16:57:31.076170   60243 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 16:57:31.145517   60243 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 16:57:31.219386   60243 docker.go:234] disabling docker service ...
	I0918 16:57:31.219457   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 16:57:31.237791   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 16:57:31.250673   60243 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 16:57:31.317780   60243 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 16:57:31.430074   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 16:57:31.441929   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 16:57:31.459420   60243 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 16:57:31.459485   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.472552   60243 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 16:57:31.472626   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.483632   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.494315   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.505031   60243 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 16:57:31.515002   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.526242   60243 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.543262   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.554050   60243 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 16:57:31.563178   60243 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 16:57:31.572111   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:31.678605   60243 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 16:57:31.775150   60243 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 16:57:31.775210   60243 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 16:57:31.778938   60243 start.go:563] Will wait 60s for crictl version
	I0918 16:57:31.778989   60243 ssh_runner.go:195] Run: which crictl
	I0918 16:57:31.782593   60243 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 16:57:31.816289   60243 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 16:57:31.816365   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:57:31.851649   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:57:31.888680   60243 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 16:57:31.890365   60243 out.go:179]   - env NO_PROXY=192.168.49.2
	I0918 16:57:31.891835   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:57:31.909279   60243 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 16:57:31.913221   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:57:31.925293   60243 mustload.go:65] Loading cluster: ha-078118
	I0918 16:57:31.925540   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:31.925802   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:31.943863   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:57:31.944113   60243 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.3
	I0918 16:57:31.944124   60243 certs.go:194] generating shared ca certs ...
	I0918 16:57:31.944136   60243 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:31.944251   60243 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 16:57:31.944295   60243 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 16:57:31.944304   60243 certs.go:256] generating profile certs ...
	I0918 16:57:31.944380   60243 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 16:57:31.944412   60243 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd
	I0918 16:57:31.944425   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.77376cdd with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.3 192.168.49.254]
	I0918 16:57:32.168102   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.77376cdd ...
	I0918 16:57:32.168133   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.77376cdd: {Name:mk632021bef8af557693dc3ec289ba5200d429d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:32.168315   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd ...
	I0918 16:57:32.168329   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd: {Name:mk6495f27d17861f263fd496e8789375ecd02b96 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:32.168403   60243 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.77376cdd -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 16:57:32.168560   60243 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 16:57:32.168697   60243 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 16:57:32.168717   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 16:57:32.168729   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 16:57:32.168744   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 16:57:32.168757   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 16:57:32.168772   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 16:57:32.168785   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 16:57:32.168797   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 16:57:32.168806   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 16:57:32.168853   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 16:57:32.168877   60243 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 16:57:32.168887   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 16:57:32.168911   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 16:57:32.168937   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 16:57:32.168963   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 16:57:32.169007   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:57:32.169032   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 16:57:32.169052   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 16:57:32.169066   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:32.169122   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:32.187428   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:32.275908   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
	I0918 16:57:32.280174   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
	I0918 16:57:32.293804   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
	I0918 16:57:32.297921   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
	I0918 16:57:32.312674   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
	I0918 16:57:32.317137   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
	I0918 16:57:32.332012   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
	I0918 16:57:32.335910   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)
	I0918 16:57:32.349818   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
	I0918 16:57:32.353706   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
	I0918 16:57:32.367328   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
	I0918 16:57:32.371320   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
	I0918 16:57:32.384442   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 16:57:32.410849   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 16:57:32.436643   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 16:57:32.463000   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 16:57:32.489057   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)
	I0918 16:57:32.515291   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0918 16:57:32.541234   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 16:57:32.566259   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 16:57:32.591152   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 16:57:32.619176   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 16:57:32.645865   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 16:57:32.672086   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
	I0918 16:57:32.691464   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
	I0918 16:57:32.711184   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
	I0918 16:57:32.730444   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)
	I0918 16:57:32.749620   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
	I0918 16:57:32.768643   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
	I0918 16:57:32.788328   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
	I0918 16:57:32.807884   60243 ssh_runner.go:195] Run: openssl version
	I0918 16:57:32.813660   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 16:57:32.823960   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 16:57:32.828123   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 16:57:32.828191   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 16:57:32.835458   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 16:57:32.846026   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 16:57:32.856631   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 16:57:32.860308   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 16:57:32.860358   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 16:57:32.866856   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 16:57:32.876690   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 16:57:32.886762   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:32.890660   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:32.890731   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:32.897540   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 16:57:32.907932   60243 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 16:57:32.911973   60243 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0918 16:57:32.912038   60243 kubeadm.go:926] updating node {m02 192.168.49.3 8443 v1.34.0 crio true true} ...
	I0918 16:57:32.912131   60243 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.3
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 16:57:32.912158   60243 kube-vip.go:115] generating kube-vip config ...
	I0918 16:57:32.912205   60243 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 16:57:32.924930   60243 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 16:57:32.924991   60243 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 16:57:32.925053   60243 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 16:57:32.934340   60243 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 16:57:32.934404   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
	I0918 16:57:32.944100   60243 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0918 16:57:32.964172   60243 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 16:57:32.986017   60243 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 16:57:33.007415   60243 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 16:57:33.011436   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:57:33.023696   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:33.094414   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:57:33.122168   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:57:33.122460   60243 start.go:317] joinCluster: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]
DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mount
Type:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:57:33.122601   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm token create --print-join-command --ttl=0"
	I0918 16:57:33.122663   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:33.143661   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:33.287975   60243 start.go:343] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:57:33.288021   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token zhmybn.ylv6f2k1dop39m4s --discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-078118-m02 --control-plane --apiserver-advertise-address=192.168.49.3 --apiserver-bind-port=8443"
	I0918 16:57:50.957307   60243 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token zhmybn.ylv6f2k1dop39m4s --discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-078118-m02 --control-plane --apiserver-advertise-address=192.168.49.3 --apiserver-bind-port=8443": (17.669258722s)
	I0918 16:57:50.957347   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"
	I0918 16:57:51.183198   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-078118-m02 minikube.k8s.io/updated_at=2025_09_18T16_57_51_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596 minikube.k8s.io/name=ha-078118 minikube.k8s.io/primary=false
	I0918 16:57:51.257842   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-078118-m02 node-role.kubernetes.io/control-plane:NoSchedule-
	I0918 16:57:51.333794   60243 start.go:319] duration metric: took 18.211330608s to joinCluster
	I0918 16:57:51.333873   60243 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:57:51.334134   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:51.335826   60243 out.go:179] * Verifying Kubernetes components...
	I0918 16:57:51.337317   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:51.433888   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:57:51.448166   60243 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	W0918 16:57:51.448229   60243 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.49.254:8443 with https://192.168.49.2:8443
	I0918 16:57:51.448458   60243 node_ready.go:35] waiting up to 6m0s for node "ha-078118-m02" to be "Ready" ...
	W0918 16:57:53.452514   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:57:55.954646   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:57:58.452847   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:00.951914   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:02.952603   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:04.952691   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:06.953510   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:09.452614   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:11.951583   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:13.952555   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:16.452462   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:18.951818   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:20.952078   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:22.952626   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:25.452581   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:27.952333   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:30.452627   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:32.452894   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	I0918 16:58:34.452216   60243 node_ready.go:49] node "ha-078118-m02" is "Ready"
	I0918 16:58:34.452242   60243 node_ready.go:38] duration metric: took 43.00375648s for node "ha-078118-m02" to be "Ready" ...
	I0918 16:58:34.452256   60243 api_server.go:52] waiting for apiserver process to appear ...
	I0918 16:58:34.452305   60243 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 16:58:34.464123   60243 api_server.go:72] duration metric: took 43.130215918s to wait for apiserver process to appear ...
	I0918 16:58:34.464146   60243 api_server.go:88] waiting for apiserver healthz status ...
	I0918 16:58:34.464162   60243 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0918 16:58:34.469944   60243 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0918 16:58:34.470928   60243 api_server.go:141] control plane version: v1.34.0
	I0918 16:58:34.470956   60243 api_server.go:131] duration metric: took 6.803903ms to wait for apiserver health ...
	I0918 16:58:34.470975   60243 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 16:58:34.475258   60243 system_pods.go:59] 17 kube-system pods found
	I0918 16:58:34.475292   60243 system_pods.go:61] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 16:58:34.475298   60243 system_pods.go:61] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 16:58:34.475301   60243 system_pods.go:61] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 16:58:34.475306   60243 system_pods.go:61] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 16:58:34.475310   60243 system_pods.go:61] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 16:58:34.475313   60243 system_pods.go:61] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 16:58:34.475318   60243 system_pods.go:61] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 16:58:34.475322   60243 system_pods.go:61] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 16:58:34.475325   60243 system_pods.go:61] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 16:58:34.475328   60243 system_pods.go:61] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 16:58:34.475332   60243 system_pods.go:61] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 16:58:34.475334   60243 system_pods.go:61] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 16:58:34.475337   60243 system_pods.go:61] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 16:58:34.475340   60243 system_pods.go:61] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 16:58:34.475343   60243 system_pods.go:61] "kube-vip-ha-078118" [9d6c9fdb-435c-43e0-b477-6ad4ac75fecf] Running
	I0918 16:58:34.475346   60243 system_pods.go:61] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 16:58:34.475349   60243 system_pods.go:61] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 16:58:34.475354   60243 system_pods.go:74] duration metric: took 4.373062ms to wait for pod list to return data ...
	I0918 16:58:34.475363   60243 default_sa.go:34] waiting for default service account to be created ...
	I0918 16:58:34.478310   60243 default_sa.go:45] found service account: "default"
	I0918 16:58:34.478331   60243 default_sa.go:55] duration metric: took 2.963019ms for default service account to be created ...
	I0918 16:58:34.478340   60243 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 16:58:34.481978   60243 system_pods.go:86] 17 kube-system pods found
	I0918 16:58:34.482005   60243 system_pods.go:89] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 16:58:34.482013   60243 system_pods.go:89] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 16:58:34.482019   60243 system_pods.go:89] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 16:58:34.482024   60243 system_pods.go:89] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 16:58:34.482029   60243 system_pods.go:89] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 16:58:34.482034   60243 system_pods.go:89] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 16:58:34.482041   60243 system_pods.go:89] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 16:58:34.482047   60243 system_pods.go:89] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 16:58:34.482055   60243 system_pods.go:89] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 16:58:34.482062   60243 system_pods.go:89] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 16:58:34.482071   60243 system_pods.go:89] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 16:58:34.482077   60243 system_pods.go:89] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 16:58:34.482086   60243 system_pods.go:89] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 16:58:34.482098   60243 system_pods.go:89] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 16:58:34.482106   60243 system_pods.go:89] "kube-vip-ha-078118" [9d6c9fdb-435c-43e0-b477-6ad4ac75fecf] Running
	I0918 16:58:34.482112   60243 system_pods.go:89] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 16:58:34.482120   60243 system_pods.go:89] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 16:58:34.482128   60243 system_pods.go:126] duration metric: took 3.781721ms to wait for k8s-apps to be running ...
	I0918 16:58:34.482140   60243 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 16:58:34.482192   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 16:58:34.503029   60243 system_svc.go:56] duration metric: took 20.8799ms WaitForService to wait for kubelet
	I0918 16:58:34.503062   60243 kubeadm.go:578] duration metric: took 43.169159629s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 16:58:34.503098   60243 node_conditions.go:102] verifying NodePressure condition ...
	I0918 16:58:34.506955   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:58:34.506981   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:58:34.506999   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:58:34.507002   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:58:34.507009   60243 node_conditions.go:105] duration metric: took 3.904235ms to run NodePressure ...
	I0918 16:58:34.507023   60243 start.go:241] waiting for startup goroutines ...
	I0918 16:58:34.507059   60243 start.go:255] writing updated cluster config ...
	I0918 16:58:34.509378   60243 out.go:203] 
	I0918 16:58:34.511211   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:58:34.511316   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:58:34.513091   60243 out.go:179] * Starting "ha-078118-m03" control-plane node in "ha-078118" cluster
	I0918 16:58:34.514457   60243 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 16:58:34.515762   60243 out.go:179] * Pulling base image v0.0.48 ...
	I0918 16:58:34.517107   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:58:34.517134   60243 cache.go:58] Caching tarball of preloaded images
	I0918 16:58:34.517177   60243 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 16:58:34.517230   60243 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 16:58:34.517241   60243 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 16:58:34.517325   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:58:34.538516   60243 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 16:58:34.538541   60243 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 16:58:34.538561   60243 cache.go:232] Successfully downloaded all kic artifacts
	I0918 16:58:34.538588   60243 start.go:360] acquireMachinesLock for ha-078118-m03: {Name:mk9d1c903c967299da898df87db82c277b1f732e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 16:58:34.538687   60243 start.go:364] duration metric: took 82.978µs to acquireMachinesLock for "ha-078118-m03"
	I0918 16:58:34.538711   60243 start.go:93] Provisioning new machine with config: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevi
rt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0
GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:58:34.538798   60243 start.go:125] createHost starting for "m03" (driver="docker")
	I0918 16:58:34.541070   60243 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
	I0918 16:58:34.541173   60243 start.go:159] libmachine.API.Create for "ha-078118" (driver="docker")
	I0918 16:58:34.541202   60243 client.go:168] LocalClient.Create starting
	I0918 16:58:34.541284   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 16:58:34.541320   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:58:34.541333   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:58:34.541387   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 16:58:34.541406   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:58:34.541417   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:58:34.541631   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:58:34.559076   60243 network_create.go:77] Found existing network {name:ha-078118 subnet:0xc00218f740 gateway:[0 0 0 0 0 0 0 0 0 0 255 255 192 168 49 1] mtu:1500}
	I0918 16:58:34.559115   60243 kic.go:121] calculated static IP "192.168.49.4" for the "ha-078118-m03" container
	I0918 16:58:34.559196   60243 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 16:58:34.577217   60243 cli_runner.go:164] Run: docker volume create ha-078118-m03 --label name.minikube.sigs.k8s.io=ha-078118-m03 --label created_by.minikube.sigs.k8s.io=true
	I0918 16:58:34.595827   60243 oci.go:103] Successfully created a docker volume ha-078118-m03
	I0918 16:58:34.595925   60243 cli_runner.go:164] Run: docker run --rm --name ha-078118-m03-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m03 --entrypoint /usr/bin/test -v ha-078118-m03:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 16:58:34.985370   60243 oci.go:107] Successfully prepared a docker volume ha-078118-m03
	I0918 16:58:34.985422   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:58:34.985448   60243 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 16:58:34.985570   60243 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m03:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 16:58:39.161109   60243 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m03:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.175489065s)
	I0918 16:58:39.161137   60243 kic.go:203] duration metric: took 4.175687859s to extract preloaded images to volume ...
	W0918 16:58:39.161212   60243 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 16:58:39.161242   60243 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 16:58:39.161279   60243 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 16:58:39.216265   60243 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ha-078118-m03 --name ha-078118-m03 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m03 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ha-078118-m03 --network ha-078118 --ip 192.168.49.4 --volume ha-078118-m03:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 16:58:39.490676   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Running}}
	I0918 16:58:39.509154   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 16:58:39.528283   60243 cli_runner.go:164] Run: docker exec ha-078118-m03 stat /var/lib/dpkg/alternatives/iptables
	I0918 16:58:39.585189   60243 oci.go:144] the created container "ha-078118-m03" has a running status.
	I0918 16:58:39.585228   60243 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa...
	I0918 16:58:39.733661   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0918 16:58:39.733704   60243 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 16:58:39.767524   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 16:58:39.791739   60243 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0918 16:58:39.791763   60243 kic_runner.go:114] Args: [docker exec --privileged ha-078118-m03 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0918 16:58:39.846675   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 16:58:39.867316   60243 machine.go:93] provisionDockerMachine start ...
	I0918 16:58:39.867429   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:39.888632   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:58:39.888885   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0918 16:58:39.888904   60243 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 16:58:40.029356   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m03
	
	I0918 16:58:40.029386   60243 ubuntu.go:182] provisioning hostname "ha-078118-m03"
	I0918 16:58:40.029443   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.049595   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:58:40.049807   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0918 16:58:40.049820   60243 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m03 && echo "ha-078118-m03" | sudo tee /etc/hostname
	I0918 16:58:40.200087   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m03
	
	I0918 16:58:40.200202   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.217994   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:58:40.218257   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0918 16:58:40.218286   60243 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m03' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m03/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m03' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 16:58:40.354076   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 16:58:40.354104   60243 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 16:58:40.354126   60243 ubuntu.go:190] setting up certificates
	I0918 16:58:40.354139   60243 provision.go:84] configureAuth start
	I0918 16:58:40.354197   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 16:58:40.373445   60243 provision.go:143] copyHostCerts
	I0918 16:58:40.373482   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:58:40.373528   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 16:58:40.373540   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:58:40.373612   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 16:58:40.373690   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:58:40.373708   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 16:58:40.373715   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:58:40.373745   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 16:58:40.373801   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:58:40.373825   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 16:58:40.373835   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:58:40.373871   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 16:58:40.373939   60243 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m03 san=[127.0.0.1 192.168.49.4 ha-078118-m03 localhost minikube]
	I0918 16:58:40.469151   60243 provision.go:177] copyRemoteCerts
	I0918 16:58:40.469228   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 16:58:40.469260   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.487441   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:40.584958   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 16:58:40.585042   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 16:58:40.612338   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 16:58:40.612405   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 16:58:40.638478   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 16:58:40.638557   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 16:58:40.664375   60243 provision.go:87] duration metric: took 310.211334ms to configureAuth
	I0918 16:58:40.664412   60243 ubuntu.go:206] setting minikube options for container-runtime
	I0918 16:58:40.664640   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:58:40.664727   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.684197   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:58:40.684440   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0918 16:58:40.684457   60243 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 16:58:40.917922   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 16:58:40.917947   60243 machine.go:96] duration metric: took 1.050610089s to provisionDockerMachine
	I0918 16:58:40.917958   60243 client.go:171] duration metric: took 6.376747043s to LocalClient.Create
	I0918 16:58:40.917977   60243 start.go:167] duration metric: took 6.376804493s to libmachine.API.Create "ha-078118"
	I0918 16:58:40.917987   60243 start.go:293] postStartSetup for "ha-078118-m03" (driver="docker")
	I0918 16:58:40.918001   60243 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 16:58:40.918071   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 16:58:40.918125   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.936966   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:41.036914   60243 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 16:58:41.040743   60243 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 16:58:41.040792   60243 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 16:58:41.040806   60243 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 16:58:41.040817   60243 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 16:58:41.040830   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 16:58:41.040889   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 16:58:41.040981   60243 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 16:58:41.040993   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 16:58:41.041109   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 16:58:41.050735   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:58:41.078178   60243 start.go:296] duration metric: took 160.175362ms for postStartSetup
	I0918 16:58:41.078562   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 16:58:41.096155   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:58:41.096446   60243 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:58:41.096487   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:41.114313   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:41.207561   60243 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 16:58:41.211752   60243 start.go:128] duration metric: took 6.672942573s to createHost
	I0918 16:58:41.211772   60243 start.go:83] releasing machines lock for "ha-078118-m03", held for 6.673074744s
	I0918 16:58:41.211824   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 16:58:41.231418   60243 out.go:179] * Found network options:
	I0918 16:58:41.233082   60243 out.go:179]   - NO_PROXY=192.168.49.2,192.168.49.3
	W0918 16:58:41.234375   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 16:58:41.234408   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 16:58:41.234439   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 16:58:41.234459   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 16:58:41.234591   60243 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 16:58:41.234624   60243 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 16:58:41.234645   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:41.234674   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:41.253204   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:41.253574   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:41.487834   60243 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 16:58:41.492986   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:58:41.516316   60243 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 16:58:41.516406   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:58:41.548254   60243 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0918 16:58:41.548282   60243 start.go:495] detecting cgroup driver to use...
	I0918 16:58:41.548320   60243 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 16:58:41.548374   60243 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 16:58:41.563666   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 16:58:41.575416   60243 docker.go:218] disabling cri-docker service (if available) ...
	I0918 16:58:41.575473   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 16:58:41.589676   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 16:58:41.604330   60243 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 16:58:41.669451   60243 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 16:58:41.744471   60243 docker.go:234] disabling docker service ...
	I0918 16:58:41.744566   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 16:58:41.762473   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 16:58:41.774931   60243 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 16:58:41.848307   60243 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 16:58:41.952604   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 16:58:41.964539   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 16:58:41.982943   60243 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 16:58:41.982998   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:41.997792   60243 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 16:58:41.997865   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.008724   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.019336   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.030192   60243 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 16:58:42.039767   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.050915   60243 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.067947   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.078882   60243 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 16:58:42.088304   60243 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 16:58:42.097143   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:58:42.205602   60243 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 16:58:42.295918   60243 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 16:58:42.295989   60243 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 16:58:42.300000   60243 start.go:563] Will wait 60s for crictl version
	I0918 16:58:42.300068   60243 ssh_runner.go:195] Run: which crictl
	I0918 16:58:42.303803   60243 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 16:58:42.338282   60243 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 16:58:42.338376   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:58:42.373030   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:58:42.410107   60243 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 16:58:42.411669   60243 out.go:179]   - env NO_PROXY=192.168.49.2
	I0918 16:58:42.413257   60243 out.go:179]   - env NO_PROXY=192.168.49.2,192.168.49.3
	I0918 16:58:42.415059   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:58:42.433045   60243 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 16:58:42.437153   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:58:42.449343   60243 mustload.go:65] Loading cluster: ha-078118
	I0918 16:58:42.449621   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:58:42.449891   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:58:42.468842   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:58:42.469136   60243 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.4
	I0918 16:58:42.469150   60243 certs.go:194] generating shared ca certs ...
	I0918 16:58:42.469170   60243 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:58:42.469308   60243 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 16:58:42.469358   60243 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 16:58:42.469373   60243 certs.go:256] generating profile certs ...
	I0918 16:58:42.469463   60243 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 16:58:42.469512   60243 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.4bf9a898
	I0918 16:58:42.469534   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.4bf9a898 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.3 192.168.49.4 192.168.49.254]
	I0918 16:58:42.495627   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.4bf9a898 ...
	I0918 16:58:42.495658   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.4bf9a898: {Name:mk68634cd7761667f3d175625830276296dacbf7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:58:42.495841   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.4bf9a898 ...
	I0918 16:58:42.495855   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.4bf9a898: {Name:mkaeb5ac6f7d0ea9f8347ea3ddec67699c073d9a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:58:42.495923   60243 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.4bf9a898 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 16:58:42.496068   60243 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.4bf9a898 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 16:58:42.496217   60243 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 16:58:42.496232   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 16:58:42.496244   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 16:58:42.496258   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 16:58:42.496271   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 16:58:42.496280   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 16:58:42.496293   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 16:58:42.496305   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 16:58:42.496317   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 16:58:42.496373   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 16:58:42.496401   60243 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 16:58:42.496411   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 16:58:42.496436   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 16:58:42.496457   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 16:58:42.496481   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 16:58:42.496534   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:58:42.496569   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:58:42.496580   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 16:58:42.496590   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 16:58:42.496636   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:58:42.515180   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:58:42.604836   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
	I0918 16:58:42.608908   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
	I0918 16:58:42.621875   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
	I0918 16:58:42.625619   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
	I0918 16:58:42.638496   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
	I0918 16:58:42.642068   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
	I0918 16:58:42.655358   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
	I0918 16:58:42.659079   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)
	I0918 16:58:42.671928   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
	I0918 16:58:42.675654   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
	I0918 16:58:42.689048   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
	I0918 16:58:42.692776   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
	I0918 16:58:42.705922   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 16:58:42.731686   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 16:58:42.757189   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 16:58:42.782344   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 16:58:42.808085   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)
	I0918 16:58:42.833677   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0918 16:58:42.860306   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 16:58:42.886762   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 16:58:42.911918   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 16:58:42.940030   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 16:58:42.965848   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 16:58:42.992346   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
	I0918 16:58:43.010924   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
	I0918 16:58:43.029944   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
	I0918 16:58:43.050253   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)
	I0918 16:58:43.069277   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
	I0918 16:58:43.089240   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
	I0918 16:58:43.108796   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
	I0918 16:58:43.127946   60243 ssh_runner.go:195] Run: openssl version
	I0918 16:58:43.134211   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 16:58:43.144901   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:58:43.148803   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:58:43.148864   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:58:43.155958   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 16:58:43.166216   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 16:58:43.176240   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 16:58:43.179779   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 16:58:43.179836   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 16:58:43.186793   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 16:58:43.196956   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 16:58:43.206631   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 16:58:43.210807   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 16:58:43.210895   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 16:58:43.219238   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 16:58:43.229939   60243 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 16:58:43.233807   60243 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0918 16:58:43.233861   60243 kubeadm.go:926] updating node {m03 192.168.49.4 8443 v1.34.0 crio true true} ...
	I0918 16:58:43.233942   60243 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.4
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 16:58:43.233965   60243 kube-vip.go:115] generating kube-vip config ...
	I0918 16:58:43.234001   60243 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 16:58:43.246584   60243 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 16:58:43.246654   60243 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 16:58:43.246708   60243 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 16:58:43.256222   60243 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 16:58:43.256294   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
	I0918 16:58:43.265642   60243 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0918 16:58:43.286766   60243 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 16:58:43.308984   60243 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 16:58:43.330666   60243 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 16:58:43.334512   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:58:43.346186   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:58:43.415160   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:58:43.438425   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:58:43.438701   60243 start.go:317] joinCluster: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]
DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false log
viewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPa
useInterval:1m0s}
	I0918 16:58:43.438806   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm token create --print-join-command --ttl=0"
	I0918 16:58:43.438859   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:58:43.458467   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:58:43.605780   60243 start.go:343] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:58:43.605839   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token izhn3y.empz64p3o3t4ob63 --discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-078118-m03 --control-plane --apiserver-advertise-address=192.168.49.4 --apiserver-bind-port=8443"
	I0918 16:58:54.699353   60243 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token izhn3y.empz64p3o3t4ob63 --discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-078118-m03 --control-plane --apiserver-advertise-address=192.168.49.4 --apiserver-bind-port=8443": (11.093493296s)
	I0918 16:58:54.699381   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"
	I0918 16:58:54.914238   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-078118-m03 minikube.k8s.io/updated_at=2025_09_18T16_58_54_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596 minikube.k8s.io/name=ha-078118 minikube.k8s.io/primary=false
	I0918 16:58:54.991429   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-078118-m03 node-role.kubernetes.io/control-plane:NoSchedule-
	I0918 16:58:55.068483   60243 start.go:319] duration metric: took 11.629778037s to joinCluster
	I0918 16:58:55.068573   60243 start.go:235] Will wait 6m0s for node &{Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:58:55.068917   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:58:55.070415   60243 out.go:179] * Verifying Kubernetes components...
	I0918 16:58:55.072098   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:58:55.171709   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:58:55.185623   60243 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	W0918 16:58:55.185688   60243 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.49.254:8443 with https://192.168.49.2:8443
	I0918 16:58:55.185879   60243 node_ready.go:35] waiting up to 6m0s for node "ha-078118-m03" to be "Ready" ...
	W0918 16:58:57.190925   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	W0918 16:58:59.689555   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	W0918 16:59:01.690108   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	W0918 16:59:04.189842   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	W0918 16:59:06.190032   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	I0918 16:59:06.690048   60243 node_ready.go:49] node "ha-078118-m03" is "Ready"
	I0918 16:59:06.690075   60243 node_ready.go:38] duration metric: took 11.50418456s for node "ha-078118-m03" to be "Ready" ...
	I0918 16:59:06.690089   60243 api_server.go:52] waiting for apiserver process to appear ...
	I0918 16:59:06.690136   60243 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 16:59:06.702758   60243 api_server.go:72] duration metric: took 11.634149066s to wait for apiserver process to appear ...
	I0918 16:59:06.702790   60243 api_server.go:88] waiting for apiserver healthz status ...
	I0918 16:59:06.702810   60243 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0918 16:59:06.707560   60243 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0918 16:59:06.708455   60243 api_server.go:141] control plane version: v1.34.0
	I0918 16:59:06.708480   60243 api_server.go:131] duration metric: took 5.681924ms to wait for apiserver health ...
	I0918 16:59:06.708491   60243 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 16:59:06.714696   60243 system_pods.go:59] 24 kube-system pods found
	I0918 16:59:06.714727   60243 system_pods.go:61] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 16:59:06.714733   60243 system_pods.go:61] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 16:59:06.714737   60243 system_pods.go:61] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 16:59:06.714740   60243 system_pods.go:61] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 16:59:06.714744   60243 system_pods.go:61] "etcd-ha-078118-m03" [ef27a91e-a220-4dcb-885c-2941742d985e] Running
	I0918 16:59:06.714747   60243 system_pods.go:61] "kindnet-f2b4b" [98c5afc6-e57e-488c-948a-e24ec24b97a7] Running
	I0918 16:59:06.714751   60243 system_pods.go:61] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 16:59:06.714756   60243 system_pods.go:61] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 16:59:06.714761   60243 system_pods.go:61] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 16:59:06.714765   60243 system_pods.go:61] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 16:59:06.714768   60243 system_pods.go:61] "kube-apiserver-ha-078118-m03" [1cc265d4-6f02-4291-b218-cfa76bcf557f] Running
	I0918 16:59:06.714772   60243 system_pods.go:61] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 16:59:06.714775   60243 system_pods.go:61] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 16:59:06.714778   60243 system_pods.go:61] "kube-controller-manager-ha-078118-m03" [43309df5-32b3-4ca8-a0a0-23bfcaac2138] Running
	I0918 16:59:06.714781   60243 system_pods.go:61] "kube-proxy-2pjrn" [490f3965-2c3c-42d8-89b3-d3d599ebf60e] Running
	I0918 16:59:06.714785   60243 system_pods.go:61] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 16:59:06.714787   60243 system_pods.go:61] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 16:59:06.714790   60243 system_pods.go:61] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 16:59:06.714794   60243 system_pods.go:61] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 16:59:06.714797   60243 system_pods.go:61] "kube-scheduler-ha-078118-m03" [93dfed73-cd97-4f3f-804e-ffdd528fd8ff] Running
	I0918 16:59:06.714802   60243 system_pods.go:61] "kube-vip-ha-078118" [9d6c9fdb-435c-43e0-b477-6ad4ac75fecf] Running
	I0918 16:59:06.714805   60243 system_pods.go:61] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 16:59:06.714809   60243 system_pods.go:61] "kube-vip-ha-078118-m03" [919fbb1f-4ca4-41e2-a8f7-6d2c73f81558] Running
	I0918 16:59:06.714813   60243 system_pods.go:61] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 16:59:06.714819   60243 system_pods.go:74] duration metric: took 6.323146ms to wait for pod list to return data ...
	I0918 16:59:06.714828   60243 default_sa.go:34] waiting for default service account to be created ...
	I0918 16:59:06.718387   60243 default_sa.go:45] found service account: "default"
	I0918 16:59:06.718417   60243 default_sa.go:55] duration metric: took 3.581681ms for default service account to be created ...
	I0918 16:59:06.718430   60243 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 16:59:06.724111   60243 system_pods.go:86] 24 kube-system pods found
	I0918 16:59:06.724142   60243 system_pods.go:89] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 16:59:06.724148   60243 system_pods.go:89] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 16:59:06.724152   60243 system_pods.go:89] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 16:59:06.724156   60243 system_pods.go:89] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 16:59:06.724159   60243 system_pods.go:89] "etcd-ha-078118-m03" [ef27a91e-a220-4dcb-885c-2941742d985e] Running
	I0918 16:59:06.724163   60243 system_pods.go:89] "kindnet-f2b4b" [98c5afc6-e57e-488c-948a-e24ec24b97a7] Running
	I0918 16:59:06.724167   60243 system_pods.go:89] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 16:59:06.724170   60243 system_pods.go:89] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 16:59:06.724175   60243 system_pods.go:89] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 16:59:06.724181   60243 system_pods.go:89] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 16:59:06.724186   60243 system_pods.go:89] "kube-apiserver-ha-078118-m03" [1cc265d4-6f02-4291-b218-cfa76bcf557f] Running
	I0918 16:59:06.724193   60243 system_pods.go:89] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 16:59:06.724199   60243 system_pods.go:89] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 16:59:06.724205   60243 system_pods.go:89] "kube-controller-manager-ha-078118-m03" [43309df5-32b3-4ca8-a0a0-23bfcaac2138] Running
	I0918 16:59:06.724211   60243 system_pods.go:89] "kube-proxy-2pjrn" [490f3965-2c3c-42d8-89b3-d3d599ebf60e] Running
	I0918 16:59:06.724220   60243 system_pods.go:89] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 16:59:06.724225   60243 system_pods.go:89] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 16:59:06.724239   60243 system_pods.go:89] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 16:59:06.724243   60243 system_pods.go:89] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 16:59:06.724246   60243 system_pods.go:89] "kube-scheduler-ha-078118-m03" [93dfed73-cd97-4f3f-804e-ffdd528fd8ff] Running
	I0918 16:59:06.724250   60243 system_pods.go:89] "kube-vip-ha-078118" [9d6c9fdb-435c-43e0-b477-6ad4ac75fecf] Running
	I0918 16:59:06.724254   60243 system_pods.go:89] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 16:59:06.724257   60243 system_pods.go:89] "kube-vip-ha-078118-m03" [919fbb1f-4ca4-41e2-a8f7-6d2c73f81558] Running
	I0918 16:59:06.724260   60243 system_pods.go:89] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 16:59:06.724267   60243 system_pods.go:126] duration metric: took 5.831309ms to wait for k8s-apps to be running ...
	I0918 16:59:06.724283   60243 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 16:59:06.724337   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 16:59:06.737206   60243 system_svc.go:56] duration metric: took 12.914941ms WaitForService to wait for kubelet
	I0918 16:59:06.737236   60243 kubeadm.go:578] duration metric: took 11.668634825s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 16:59:06.737259   60243 node_conditions.go:102] verifying NodePressure condition ...
	I0918 16:59:06.740948   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:59:06.740970   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:59:06.740982   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:59:06.740985   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:59:06.740989   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:59:06.740991   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:59:06.740995   60243 node_conditions.go:105] duration metric: took 3.731587ms to run NodePressure ...
	I0918 16:59:06.741004   60243 start.go:241] waiting for startup goroutines ...
	I0918 16:59:06.741023   60243 start.go:255] writing updated cluster config ...
	I0918 16:59:06.741314   60243 ssh_runner.go:195] Run: rm -f paused
	I0918 16:59:06.745246   60243 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
	I0918 16:59:06.745875   60243 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0918 16:59:06.755285   60243 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-g9xk6" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.761037   60243 pod_ready.go:94] pod "coredns-66bc5c9577-g9xk6" is "Ready"
	I0918 16:59:06.761068   60243 pod_ready.go:86] duration metric: took 5.756901ms for pod "coredns-66bc5c9577-g9xk6" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.761077   60243 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-q42l7" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.767008   60243 pod_ready.go:94] pod "coredns-66bc5c9577-q42l7" is "Ready"
	I0918 16:59:06.767034   60243 pod_ready.go:86] duration metric: took 5.951535ms for pod "coredns-66bc5c9577-q42l7" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.770112   60243 pod_ready.go:83] waiting for pod "etcd-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.775267   60243 pod_ready.go:94] pod "etcd-ha-078118" is "Ready"
	I0918 16:59:06.775293   60243 pod_ready.go:86] duration metric: took 5.152116ms for pod "etcd-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.775303   60243 pod_ready.go:83] waiting for pod "etcd-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.780471   60243 pod_ready.go:94] pod "etcd-ha-078118-m02" is "Ready"
	I0918 16:59:06.780496   60243 pod_ready.go:86] duration metric: took 5.187344ms for pod "etcd-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.780520   60243 pod_ready.go:83] waiting for pod "etcd-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.946978   60243 request.go:683] "Waited before sending request" delay="166.314978ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/etcd-ha-078118-m03"
	I0918 16:59:07.146449   60243 request.go:683] "Waited before sending request" delay="196.292592ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:07.149449   60243 pod_ready.go:94] pod "etcd-ha-078118-m03" is "Ready"
	I0918 16:59:07.149474   60243 pod_ready.go:86] duration metric: took 368.947616ms for pod "etcd-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:07.346915   60243 request.go:683] "Waited before sending request" delay="197.328502ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Dkube-apiserver"
	I0918 16:59:07.350725   60243 pod_ready.go:83] waiting for pod "kube-apiserver-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:07.547175   60243 request.go:683] "Waited before sending request" delay="196.345419ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-078118"
	I0918 16:59:07.746829   60243 request.go:683] "Waited before sending request" delay="196.329751ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118"
	I0918 16:59:07.749941   60243 pod_ready.go:94] pod "kube-apiserver-ha-078118" is "Ready"
	I0918 16:59:07.749966   60243 pod_ready.go:86] duration metric: took 399.217151ms for pod "kube-apiserver-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:07.749974   60243 pod_ready.go:83] waiting for pod "kube-apiserver-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:07.947401   60243 request.go:683] "Waited before sending request" delay="197.34038ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-078118-m02"
	I0918 16:59:08.147239   60243 request.go:683] "Waited before sending request" delay="196.36185ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m02"
	I0918 16:59:08.150202   60243 pod_ready.go:94] pod "kube-apiserver-ha-078118-m02" is "Ready"
	I0918 16:59:08.150227   60243 pod_ready.go:86] duration metric: took 400.248007ms for pod "kube-apiserver-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:08.150235   60243 pod_ready.go:83] waiting for pod "kube-apiserver-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:08.346585   60243 request.go:683] "Waited before sending request" delay="196.280443ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-078118-m03"
	I0918 16:59:08.547289   60243 request.go:683] "Waited before sending request" delay="197.397248ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:08.550234   60243 pod_ready.go:94] pod "kube-apiserver-ha-078118-m03" is "Ready"
	I0918 16:59:08.550261   60243 pod_ready.go:86] duration metric: took 400.020405ms for pod "kube-apiserver-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:08.746686   60243 request.go:683] "Waited before sending request" delay="196.336839ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Dkube-controller-manager"
	I0918 16:59:08.750717   60243 pod_ready.go:83] waiting for pod "kube-controller-manager-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:08.947162   60243 request.go:683] "Waited before sending request" delay="196.333247ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-078118"
	I0918 16:59:09.146966   60243 request.go:683] "Waited before sending request" delay="196.326126ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118"
	I0918 16:59:09.150067   60243 pod_ready.go:94] pod "kube-controller-manager-ha-078118" is "Ready"
	I0918 16:59:09.150092   60243 pod_ready.go:86] duration metric: took 399.351356ms for pod "kube-controller-manager-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:09.150102   60243 pod_ready.go:83] waiting for pod "kube-controller-manager-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:09.346457   60243 request.go:683] "Waited before sending request" delay="196.279389ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-078118-m02"
	I0918 16:59:09.547040   60243 request.go:683] "Waited before sending request" delay="197.354653ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m02"
	I0918 16:59:09.550374   60243 pod_ready.go:94] pod "kube-controller-manager-ha-078118-m02" is "Ready"
	I0918 16:59:09.550404   60243 pod_ready.go:86] duration metric: took 400.295786ms for pod "kube-controller-manager-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:09.550413   60243 pod_ready.go:83] waiting for pod "kube-controller-manager-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:09.746708   60243 request.go:683] "Waited before sending request" delay="196.202501ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-078118-m03"
	I0918 16:59:09.946436   60243 request.go:683] "Waited before sending request" delay="196.280211ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:09.949494   60243 pod_ready.go:94] pod "kube-controller-manager-ha-078118-m03" is "Ready"
	I0918 16:59:09.949530   60243 pod_ready.go:86] duration metric: took 399.112324ms for pod "kube-controller-manager-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.146961   60243 request.go:683] "Waited before sending request" delay="197.325522ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods?labelSelector=k8s-app%3Dkube-proxy"
	I0918 16:59:10.150701   60243 pod_ready.go:83] waiting for pod "kube-proxy-2pjrn" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.347162   60243 request.go:683] "Waited before sending request" delay="196.352062ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-proxy-2pjrn"
	I0918 16:59:10.547072   60243 request.go:683] "Waited before sending request" delay="196.358455ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:10.550523   60243 pod_ready.go:94] pod "kube-proxy-2pjrn" is "Ready"
	I0918 16:59:10.550553   60243 pod_ready.go:86] duration metric: took 399.827869ms for pod "kube-proxy-2pjrn" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.550565   60243 pod_ready.go:83] waiting for pod "kube-proxy-b98xh" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.746898   60243 request.go:683] "Waited before sending request" delay="196.251425ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-proxy-b98xh"
	I0918 16:59:10.946676   60243 request.go:683] "Waited before sending request" delay="196.176643ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118"
	I0918 16:59:10.950120   60243 pod_ready.go:94] pod "kube-proxy-b98xh" is "Ready"
	I0918 16:59:10.950149   60243 pod_ready.go:86] duration metric: took 399.577448ms for pod "kube-proxy-b98xh" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.950157   60243 pod_ready.go:83] waiting for pod "kube-proxy-t5wdg" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:11.146526   60243 request.go:683] "Waited before sending request" delay="196.259149ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-proxy-t5wdg"
	I0918 16:59:11.347110   60243 request.go:683] "Waited before sending request" delay="197.374002ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m02"
	I0918 16:59:11.350466   60243 pod_ready.go:94] pod "kube-proxy-t5wdg" is "Ready"
	I0918 16:59:11.350490   60243 pod_ready.go:86] duration metric: took 400.328216ms for pod "kube-proxy-t5wdg" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:11.546945   60243 request.go:683] "Waited before sending request" delay="196.317609ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Dkube-scheduler"
	I0918 16:59:11.550749   60243 pod_ready.go:83] waiting for pod "kube-scheduler-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:11.746977   60243 request.go:683] "Waited before sending request" delay="196.123839ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-078118"
	I0918 16:59:11.946489   60243 request.go:683] "Waited before sending request" delay="196.183652ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118"
	I0918 16:59:11.949628   60243 pod_ready.go:94] pod "kube-scheduler-ha-078118" is "Ready"
	I0918 16:59:11.949654   60243 pod_ready.go:86] duration metric: took 398.882401ms for pod "kube-scheduler-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:11.949664   60243 pod_ready.go:83] waiting for pod "kube-scheduler-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:12.147112   60243 request.go:683] "Waited before sending request" delay="197.344287ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-078118-m02"
	I0918 16:59:12.347169   60243 request.go:683] "Waited before sending request" delay="194.379019ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m02"
	I0918 16:59:12.350560   60243 pod_ready.go:94] pod "kube-scheduler-ha-078118-m02" is "Ready"
	I0918 16:59:12.350590   60243 pod_ready.go:86] duration metric: took 400.919858ms for pod "kube-scheduler-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:12.350599   60243 pod_ready.go:83] waiting for pod "kube-scheduler-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:12.547018   60243 request.go:683] "Waited before sending request" delay="196.33287ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-078118-m03"
	I0918 16:59:12.746565   60243 request.go:683] "Waited before sending request" delay="196.309682ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:12.749906   60243 pod_ready.go:94] pod "kube-scheduler-ha-078118-m03" is "Ready"
	I0918 16:59:12.749934   60243 pod_ready.go:86] duration metric: took 399.329614ms for pod "kube-scheduler-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:12.749945   60243 pod_ready.go:40] duration metric: took 6.004651446s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
	I0918 16:59:12.794689   60243 start.go:623] kubectl: 1.34.1, cluster: 1.34.0 (minor skew: 0)
	I0918 16:59:12.796689   60243 out.go:179] * Done! kubectl is now configured to use "ha-078118" cluster and "default" namespace by default
	
	
	==> CRI-O <==
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.765846307Z" level=info msg="Got pod network &{Name:coredns-66bc5c9577-q42l7 Namespace:kube-system ID:0f4c57d36fe625b73febbabe66c94a6fb7be96bd382b63dbe134a57a30fcc203 UID:c21094f1-585a-4109-b526-3a115d45f35f NetNS:/var/run/netns/ea110cd7-655f-4db5-9869-6caeb4e1e0b3 Networks:[] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.766003644Z" level=info msg="Checking pod kube-system_coredns-66bc5c9577-q42l7 for CNI network kindnet (type=ptp)"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.766404225Z" level=info msg="Checking image status: registry.k8s.io/coredns/coredns:v1.12.1" id=ef4ff467-d538-4946-933c-e5b5e907e1f3 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.766638638Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969,RepoTags:[registry.k8s.io/coredns/coredns:v1.12.1],RepoDigests:[registry.k8s.io/coredns/coredns@sha256:4f7a57135719628cf2070c5e3cbde64b013e90d4c560c5ecbf14004181f91998 registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c],Size_:76103547,Uid:nil,Username:nonroot,Spec:nil,},Info:map[string]string{},}" id=ef4ff467-d538-4946-933c-e5b5e907e1f3 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.767610373Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769256295Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/eec0c1a1e3f1faa7e681f72b6e678fe56d2fe548328908380b50105d4c4c5f9d/merged/etc/passwd: no such file or directory"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769296755Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/eec0c1a1e3f1faa7e681f72b6e678fe56d2fe548328908380b50105d4c4c5f9d/merged/etc/group: no such file or directory"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769333451Z" level=info msg="Creating container: kube-system/coredns-66bc5c9577-g9xk6/coredns" id=075f19de-1f75-4e06-b926-bfc1c8e7585c name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769428698Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769443027Z" level=info msg="Ran pod sandbox 0f4c57d36fe625b73febbabe66c94a6fb7be96bd382b63dbe134a57a30fcc203 with infra container: kube-system/coredns-66bc5c9577-q42l7/POD" id=000880e9-0203-43be-9f90-44bb795de328 name=/runtime.v1.RuntimeService/RunPodSandbox
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.770428742Z" level=info msg="Checking image status: registry.k8s.io/coredns/coredns:v1.12.1" id=95b3db0e-d1ae-4a3e-a514-6be61c509f71 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.775530535Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969,RepoTags:[registry.k8s.io/coredns/coredns:v1.12.1],RepoDigests:[registry.k8s.io/coredns/coredns@sha256:4f7a57135719628cf2070c5e3cbde64b013e90d4c560c5ecbf14004181f91998 registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c],Size_:76103547,Uid:nil,Username:nonroot,Spec:nil,},Info:map[string]string{},}" id=95b3db0e-d1ae-4a3e-a514-6be61c509f71 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.776278769Z" level=info msg="Checking image status: registry.k8s.io/coredns/coredns:v1.12.1" id=0b0dcec1-95b6-495b-9197-5f67161037dc name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.776462315Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969,RepoTags:[registry.k8s.io/coredns/coredns:v1.12.1],RepoDigests:[registry.k8s.io/coredns/coredns@sha256:4f7a57135719628cf2070c5e3cbde64b013e90d4c560c5ecbf14004181f91998 registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c],Size_:76103547,Uid:nil,Username:nonroot,Spec:nil,},Info:map[string]string{},}" id=0b0dcec1-95b6-495b-9197-5f67161037dc name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.779861607Z" level=info msg="Creating container: kube-system/coredns-66bc5c9577-q42l7/coredns" id=117c2489-b1bc-4e99-a3fa-ff10fa77c595 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.779940361Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.830159804Z" level=info msg="Created container 8adb6b34c613123531cf4233efc222dc4757692856895124a5e5db1a632a5b52: kube-system/storage-provisioner/storage-provisioner" id=5f7f2550-0b1b-47f1-b48c-5332a46450a7 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.830924779Z" level=info msg="Starting container: 8adb6b34c613123531cf4233efc222dc4757692856895124a5e5db1a632a5b52" id=52dc1dd3-f88a-484c-ab17-4d9f0b621779 name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.836679300Z" level=info msg="Created container 08391430590c253ff1b0064ee6c84e80981d5f041bc5ae9709bdf04d2b9aee8b: kube-system/coredns-66bc5c9577-g9xk6/coredns" id=075f19de-1f75-4e06-b926-bfc1c8e7585c name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.837315664Z" level=info msg="Starting container: 08391430590c253ff1b0064ee6c84e80981d5f041bc5ae9709bdf04d2b9aee8b" id=8bb023fd-89bf-411c-a6a6-6f2df8ddd77a name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.838803837Z" level=info msg="Started container" PID=2258 containerID=8adb6b34c613123531cf4233efc222dc4757692856895124a5e5db1a632a5b52 description=kube-system/storage-provisioner/storage-provisioner id=52dc1dd3-f88a-484c-ab17-4d9f0b621779 name=/runtime.v1.RuntimeService/StartContainer sandboxID=6928f50153d919aa3e3760ba1aa0739a387e79370881e9f1e54c731a0f3caea0
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.845287935Z" level=info msg="Started container" PID=2268 containerID=08391430590c253ff1b0064ee6c84e80981d5f041bc5ae9709bdf04d2b9aee8b description=kube-system/coredns-66bc5c9577-g9xk6/coredns id=8bb023fd-89bf-411c-a6a6-6f2df8ddd77a name=/runtime.v1.RuntimeService/StartContainer sandboxID=afde323910d94bea88be826de7977fce80c072eae58aba3bfd7c8d68a054031f
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.864792220Z" level=info msg="Created container aa37f0e0424d50f1f3f546dfdbacd705bc960545c699db9837bdf759142b77a6: kube-system/coredns-66bc5c9577-q42l7/coredns" id=117c2489-b1bc-4e99-a3fa-ff10fa77c595 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.865391067Z" level=info msg="Starting container: aa37f0e0424d50f1f3f546dfdbacd705bc960545c699db9837bdf759142b77a6" id=34f0c5a7-2503-4694-8c57-c675b57bdd4b name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.872859452Z" level=info msg="Started container" PID=2308 containerID=aa37f0e0424d50f1f3f546dfdbacd705bc960545c699db9837bdf759142b77a6 description=kube-system/coredns-66bc5c9577-q42l7/coredns id=34f0c5a7-2503-4694-8c57-c675b57bdd4b name=/runtime.v1.RuntimeService/StartContainer sandboxID=0f4c57d36fe625b73febbabe66c94a6fb7be96bd382b63dbe134a57a30fcc203
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                               CREATED             STATE               NAME                      ATTEMPT             POD ID              POD
	aa37f0e0424d5       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                    2 minutes ago       Running             coredns                   0                   0f4c57d36fe62       coredns-66bc5c9577-q42l7
	08391430590c2       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                    2 minutes ago       Running             coredns                   0                   afde323910d94       coredns-66bc5c9577-g9xk6
	8adb6b34c6131       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                    2 minutes ago       Running             storage-provisioner       0                   6928f50153d91       storage-provisioner
	9d8271cae4bea       df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce                                    2 minutes ago       Running             kube-proxy                0                   391ffd3ffc487       kube-proxy-b98xh
	ace9ff4888542       409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c                                    2 minutes ago       Running             kindnet-cni               0                   4f7dc3d8e273c       kindnet-vqp76
	b6c234acce33d       ghcr.io/kube-vip/kube-vip@sha256:4f256554a83a6d824ea9c5307450a2c3fd132e09c52b339326f94fefaf67155c   2 minutes ago       Running             kube-vip                  0                   23e85847e6956       kube-vip-ha-078118
	db2ea624fa9b6       46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc                                    2 minutes ago       Running             kube-scheduler            0                   b36f66256961f       kube-scheduler-ha-078118
	642183ab67e73       a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634                                    2 minutes ago       Running             kube-controller-manager   0                   36e9334424f59       kube-controller-manager-ha-078118
	585dfd4fc0ca4       90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90                                    2 minutes ago       Running             kube-apiserver            0                   237ac462ccd86       kube-apiserver-ha-078118
	e11573adbeb5b       5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115                                    2 minutes ago       Running             etcd                      0                   780b62a8fc57d       etcd-ha-078118
	
	
	==> coredns [08391430590c253ff1b0064ee6c84e80981d5f041bc5ae9709bdf04d2b9aee8b] <==
	[INFO] 10.244.2.2:48579 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000213733s
	[INFO] 10.244.2.2:38852 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000147704s
	[INFO] 10.244.2.2:49722 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000215281s
	[INFO] 10.244.2.2:50509 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000150614s
	[INFO] 10.244.2.2:36432 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000124749s
	[INFO] 10.244.1.3:48987 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 111 0.009640803s
	[INFO] 10.244.1.3:34978 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000185219s
	[INFO] 10.244.1.3:42844 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000118247s
	[INFO] 10.244.1.3:56800 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000144749s
	[INFO] 10.244.1.2:49805 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000131607s
	[INFO] 10.244.1.2:57672 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000175017s
	[INFO] 10.244.1.2:59217 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000076607s
	[INFO] 10.244.2.2:59905 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000198959s
	[INFO] 10.244.2.2:35101 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000161137s
	[INFO] 10.244.1.3:37941 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000169116s
	[INFO] 10.244.1.2:60488 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00024264s
	[INFO] 10.244.2.2:60234 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000151314s
	[INFO] 10.244.2.2:42839 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000121874s
	[INFO] 10.244.1.3:38379 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.00013483s
	[INFO] 10.244.1.3:58046 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000167227s
	[INFO] 10.244.1.3:44714 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000092544s
	[INFO] 10.244.1.3:35218 - 5 "PTR IN 1.49.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000113387s
	[INFO] 10.244.1.2:59456 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000135367s
	[INFO] 10.244.1.2:35335 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000085423s
	[INFO] 10.244.1.2:35400 - 5 "PTR IN 1.49.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000096216s
	
	
	==> coredns [aa37f0e0424d50f1f3f546dfdbacd705bc960545c699db9837bdf759142b77a6] <==
	[INFO] 10.244.1.3:44450 - 6 "PTR IN 90.167.197.15.in-addr.arpa. udp 44 false 512" NOERROR qr,rd,ra 126 0.000909376s
	[INFO] 10.244.1.2:44019 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 140 0.000135871s
	[INFO] 10.244.2.2:56869 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000130632s
	[INFO] 10.244.2.2:46287 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 111 0.012245391s
	[INFO] 10.244.2.2:35509 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 111 0.009452726s
	[INFO] 10.244.1.3:51577 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000132103s
	[INFO] 10.244.1.3:45622 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000167069s
	[INFO] 10.244.1.3:38225 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000085042s
	[INFO] 10.244.1.3:45379 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000129198s
	[INFO] 10.244.1.2:53174 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000146423s
	[INFO] 10.244.1.2:48602 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.00009464s
	[INFO] 10.244.1.2:58862 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000135263s
	[INFO] 10.244.1.2:44989 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000093968s
	[INFO] 10.244.1.2:38888 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000167556s
	[INFO] 10.244.2.2:53888 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000144401s
	[INFO] 10.244.2.2:56382 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000096741s
	[INFO] 10.244.1.3:34825 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000143164s
	[INFO] 10.244.1.3:37381 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000153037s
	[INFO] 10.244.1.3:57943 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000098689s
	[INFO] 10.244.1.2:51449 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000134731s
	[INFO] 10.244.1.2:40898 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000183095s
	[INFO] 10.244.1.2:36063 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00011511s
	[INFO] 10.244.2.2:55350 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000152924s
	[INFO] 10.244.2.2:53746 - 5 "PTR IN 1.49.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000142562s
	[INFO] 10.244.1.2:36341 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000127988s
	
	
	==> describe nodes <==
	Name:               ha-078118
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2025_09_18T16_57_20_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:57:14 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 16:59:42 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 16:57:34 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 16:57:34 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 16:57:34 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 16:57:34 +0000   Thu, 18 Sep 2025 16:57:34 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ha-078118
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 37066c4af2194678a9f70f4417168319
	  System UUID:                910bee46-adcd-4833-91ec-cea7d3c2588c
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (10 in total)
	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---
	  kube-system                 coredns-66bc5c9577-g9xk6             100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     2m27s
	  kube-system                 coredns-66bc5c9577-q42l7             100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     2m27s
	  kube-system                 etcd-ha-078118                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         2m31s
	  kube-system                 kindnet-vqp76                        100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      2m27s
	  kube-system                 kube-apiserver-ha-078118             250m (3%)     0 (0%)      0 (0%)           0 (0%)         2m31s
	  kube-system                 kube-controller-manager-ha-078118    200m (2%)     0 (0%)      0 (0%)           0 (0%)         2m31s
	  kube-system                 kube-proxy-b98xh                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m27s
	  kube-system                 kube-scheduler-ha-078118             100m (1%)     0 (0%)      0 (0%)           0 (0%)         2m31s
	  kube-system                 kube-vip-ha-078118                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m35s
	  kube-system                 storage-provisioner                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m27s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (11%)  100m (1%)
	  memory             290Mi (0%)  390Mi (1%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                    From             Message
	  ----    ------                   ----                   ----             -------
	  Normal  Starting                 2m26s                  kube-proxy       
	  Normal  NodeHasSufficientPID     2m38s (x8 over 2m38s)  kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  Starting                 2m38s                  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  2m38s (x8 over 2m38s)  kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m38s (x8 over 2m38s)  kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 2m31s                  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  2m31s                  kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m31s                  kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     2m31s                  kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           2m29s                  node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  NodeReady                2m16s                  kubelet          Node ha-078118 status is now: NodeReady
	  Normal  RegisteredNode           2m2s                   node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           58s                    node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	
	
	Name:               ha-078118-m02
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118-m02
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=false
	                    minikube.k8s.io/updated_at=2025_09_18T16_57_51_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:57:50 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118-m02
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 16:59:42 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 16:59:42 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 16:59:42 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 16:59:42 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 16:59:42 +0000   Thu, 18 Sep 2025 16:58:34 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.3
	  Hostname:    ha-078118-m02
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 882d2104d1f448dc91d641e38cc92424
	  System UUID:                0093212b-e7dd-4bdc-8376-480f39da7714
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.1.0/24
	PodCIDRs:                     10.244.1.0/24
	Non-terminated Pods:          (9 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     busybox-7b57f96db7-bzrv2                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         37s
	  default                     busybox-7b57f96db7-t7rzr                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         37s
	  kube-system                 etcd-ha-078118-m02                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         118s
	  kube-system                 kindnet-jnlbr                            100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      2m
	  kube-system                 kube-apiserver-ha-078118-m02             250m (3%)     0 (0%)      0 (0%)           0 (0%)         118s
	  kube-system                 kube-controller-manager-ha-078118-m02    200m (2%)     0 (0%)      0 (0%)           0 (0%)         118s
	  kube-system                 kube-proxy-t5wdg                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m
	  kube-system                 kube-scheduler-ha-078118-m02             100m (1%)     0 (0%)      0 (0%)           0 (0%)         118s
	  kube-system                 kube-vip-ha-078118-m02                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         118s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%)   100m (1%)
	  memory             150Mi (0%)  50Mi (0%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason          Age   From             Message
	  ----    ------          ----  ----             -------
	  Normal  Starting        116s  kube-proxy       
	  Normal  RegisteredNode  119s  node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode  117s  node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode  58s   node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	
	
	Name:               ha-078118-m03
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118-m03
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=false
	                    minikube.k8s.io/updated_at=2025_09_18T16_58_54_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:58:54 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118-m03
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 16:59:44 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 16:59:24 +0000   Thu, 18 Sep 2025 16:58:54 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 16:59:24 +0000   Thu, 18 Sep 2025 16:58:54 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 16:59:24 +0000   Thu, 18 Sep 2025 16:58:54 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 16:59:24 +0000   Thu, 18 Sep 2025 16:59:06 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.4
	  Hostname:    ha-078118-m03
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 1cf4ae8c7cb4403a9f1c3d032956eb17
	  System UUID:                aad5bb9a-fbfa-4299-aec8-4ade9724e58c
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.2.0/24
	PodCIDRs:                     10.244.2.0/24
	Non-terminated Pods:          (8 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     busybox-7b57f96db7-95578                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         37s
	  kube-system                 etcd-ha-078118-m03                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         55s
	  kube-system                 kindnet-f2b4b                            100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      56s
	  kube-system                 kube-apiserver-ha-078118-m03             250m (3%)     0 (0%)      0 (0%)           0 (0%)         55s
	  kube-system                 kube-controller-manager-ha-078118-m03    200m (2%)     0 (0%)      0 (0%)           0 (0%)         55s
	  kube-system                 kube-proxy-2pjrn                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         56s
	  kube-system                 kube-scheduler-ha-078118-m03             100m (1%)     0 (0%)      0 (0%)           0 (0%)         55s
	  kube-system                 kube-vip-ha-078118-m03                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         55s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%)   100m (1%)
	  memory             150Mi (0%)  50Mi (0%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason          Age   From             Message
	  ----    ------          ----  ----             -------
	  Normal  Starting        54s   kube-proxy       
	  Normal  RegisteredNode  53s   node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	  Normal  RegisteredNode  53s   node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	  Normal  RegisteredNode  52s   node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	
	
	==> dmesg <==
	[  +0.089038] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
	[  +0.028015] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
	[  +7.570818] kauditd_printk_skb: 47 callbacks suppressed
	[Sep18 16:41] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.013586] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023854] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023944] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023869] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023927] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000033] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +2.047789] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +4.031621] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000030] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +8.127251] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[Sep18 16:42] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[ +32.253146] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	
	
	==> etcd [e11573adbeb5b82db9b0ef3e45c8776e5669152b9e1194fc07eb290c619b2bf5] <==
	{"level":"warn","ts":"2025-09-18T16:58:47.196637Z","caller":"rafthttp/stream.go:420","msg":"lost TCP streaming connection with remote peer","stream-reader-type":"stream Message","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","error":"EOF"}
	{"level":"info","ts":"2025-09-18T16:58:47.208054Z","caller":"rafthttp/stream.go:248","msg":"set message encoder","from":"aec36adc501070cc","to":"4e0bda6b41205435","stream-type":"stream Message"}
	{"level":"warn","ts":"2025-09-18T16:58:47.208093Z","caller":"rafthttp/stream.go:264","msg":"closed TCP streaming connection with remote peer","stream-writer-type":"stream Message","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:47.208105Z","caller":"rafthttp/stream.go:273","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream Message","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:47.210022Z","caller":"rafthttp/stream.go:248","msg":"set message encoder","from":"aec36adc501070cc","to":"4e0bda6b41205435","stream-type":"stream MsgApp v2"}
	{"level":"warn","ts":"2025-09-18T16:58:47.210054Z","caller":"rafthttp/stream.go:264","msg":"closed TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:47.210067Z","caller":"rafthttp/stream.go:273","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:47.272389Z","caller":"rafthttp/stream.go:411","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:47.275409Z","caller":"rafthttp/stream.go:411","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream Message","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:47.603892Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1981","msg":"aec36adc501070cc switched to configuration voters=(1461813452239848210 5623828713891189813 12593026477526642892)"}
	{"level":"info","ts":"2025-09-18T16:58:47.604044Z","caller":"membership/cluster.go:550","msg":"promote member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","promoted-member-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:47.604085Z","caller":"etcdserver/server.go:1752","msg":"applied a configuration change through raft","local-member-id":"aec36adc501070cc","raft-conf-change":"ConfChangeAddNode","raft-conf-change-node-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:51.324691Z","caller":"etcdserver/server.go:2246","msg":"skip compaction since there is an inflight snapshot"}
	{"level":"info","ts":"2025-09-18T16:58:54.543741Z","caller":"etcdserver/server.go:2246","msg":"skip compaction since there is an inflight snapshot"}
	{"level":"info","ts":"2025-09-18T16:59:05.386133Z","caller":"etcdserver/server.go:2246","msg":"skip compaction since there is an inflight snapshot"}
	{"level":"info","ts":"2025-09-18T16:59:13.871097Z","caller":"etcdserver/server.go:2246","msg":"skip compaction since there is an inflight snapshot"}
	{"level":"info","ts":"2025-09-18T16:59:16.560165Z","caller":"etcdserver/server.go:2246","msg":"skip compaction since there is an inflight snapshot"}
	{"level":"info","ts":"2025-09-18T16:59:17.187746Z","caller":"etcdserver/server.go:1856","msg":"sent merged snapshot","from":"aec36adc501070cc","to":"4e0bda6b41205435","bytes":1573398,"size":"1.6 MB","took":"30.017552691s"}
	{"level":"warn","ts":"2025-09-18T16:59:25.341873Z","caller":"etcdserver/raft.go:387","msg":"leader failed to send out heartbeat on time; took too long, leader is overloaded likely from slow disk","to":"4e0bda6b41205435","heartbeat-interval":"100ms","expected-duration":"200ms","exceeded-duration":"155.750963ms"}
	{"level":"warn","ts":"2025-09-18T16:59:25.341928Z","caller":"etcdserver/raft.go:387","msg":"leader failed to send out heartbeat on time; took too long, leader is overloaded likely from slow disk","to":"14496796fca4c312","heartbeat-interval":"100ms","expected-duration":"200ms","exceeded-duration":"155.814769ms"}
	{"level":"info","ts":"2025-09-18T16:59:25.342422Z","caller":"traceutil/trace.go:172","msg":"trace[706354734] linearizableReadLoop","detail":"{readStateIndex:1267; appliedIndex:1268; }","duration":"297.991952ms","start":"2025-09-18T16:59:25.044410Z","end":"2025-09-18T16:59:25.342402Z","steps":["trace[706354734] 'read index received'  (duration: 297.98539ms)","trace[706354734] 'applied index is now lower than readState.Index'  (duration: 4.701µs)"],"step_count":2}
	{"level":"warn","ts":"2025-09-18T16:59:25.342562Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"298.122579ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2025-09-18T16:59:25.342634Z","caller":"traceutil/trace.go:172","msg":"trace[1382353479] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1069; }","duration":"298.217452ms","start":"2025-09-18T16:59:25.044400Z","end":"2025-09-18T16:59:25.342617Z","steps":["trace[1382353479] 'agreement among raft nodes before linearized reading'  (duration: 298.046799ms)"],"step_count":1}
	{"level":"warn","ts":"2025-09-18T16:59:25.445389Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"100.440633ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2025-09-18T16:59:25.445467Z","caller":"traceutil/trace.go:172","msg":"trace[1927163165] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1069; }","duration":"100.536026ms","start":"2025-09-18T16:59:25.344915Z","end":"2025-09-18T16:59:25.445451Z","steps":["trace[1927163165] 'agreement among raft nodes before linearized reading'  (duration: 71.069732ms)","trace[1927163165] 'range keys from in-memory index tree'  (duration: 29.345037ms)"],"step_count":2}
	
	
	==> kernel <==
	 16:59:50 up 42 min,  0 users,  load average: 1.40, 0.72, 0.45
	Linux ha-078118 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [ace9ff48885424be2f8facd8cbf5492de4495d890b080eb415e9e2c3e73bf84a] <==
	I0918 16:59:03.955583       1 routes.go:62] Adding route {Ifindex: 0 Dst: 10.244.2.0/24 Src: <nil> Gw: 192.168.49.4 Flags: [] Table: 0 Realm: 0} 
	I0918 16:59:13.952847       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:59:13.953149       1 main.go:301] handling current node
	I0918 16:59:13.953183       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 16:59:13.953197       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 16:59:13.953625       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 16:59:13.953686       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 16:59:23.956933       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:59:23.956980       1 main.go:301] handling current node
	I0918 16:59:23.957002       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 16:59:23.957019       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 16:59:23.957236       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 16:59:23.957252       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 16:59:33.960335       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:59:33.960382       1 main.go:301] handling current node
	I0918 16:59:33.960405       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 16:59:33.960410       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 16:59:33.960654       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 16:59:33.960668       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 16:59:43.952681       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 16:59:43.952733       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 16:59:43.952938       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:59:43.952951       1 main.go:301] handling current node
	I0918 16:59:43.952967       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 16:59:43.952974       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	
	
	==> kube-apiserver [585dfd4fc0ca43249f7d7bbc2f741d26128a1d13b2fc082db1eafbe1df6a50ad] <==
	I0918 16:57:19.858558       1 controller.go:667] quota admission added evaluator for: daemonsets.apps
	I0918 16:57:22.699949       1 controller.go:667] quota admission added evaluator for: replicasets.apps
	I0918 16:57:22.851659       1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
	I0918 16:57:22.858581       1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
	I0918 16:57:23.049475       1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
	I0918 16:57:23.049475       1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
	I0918 16:58:18.352060       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:58:35.569702       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	E0918 16:59:18.376823       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38134: use of closed network connection
	E0918 16:59:18.542476       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38154: use of closed network connection
	E0918 16:59:18.708555       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38184: use of closed network connection
	E0918 16:59:18.891237       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38202: use of closed network connection
	E0918 16:59:19.063367       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38222: use of closed network connection
	E0918 16:59:19.219859       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38248: use of closed network connection
	E0918 16:59:19.374345       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38266: use of closed network connection
	E0918 16:59:19.528245       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38290: use of closed network connection
	E0918 16:59:19.686890       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38294: use of closed network connection
	E0918 16:59:19.960717       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38322: use of closed network connection
	E0918 16:59:20.128027       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38350: use of closed network connection
	E0918 16:59:20.286654       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38362: use of closed network connection
	E0918 16:59:20.443716       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38382: use of closed network connection
	E0918 16:59:20.608349       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38406: use of closed network connection
	E0918 16:59:20.762819       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38416: use of closed network connection
	I0918 16:59:23.504820       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:59:44.133401       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	
	
	==> kube-controller-manager [642183ab67e7396340c3ad521e32b9cc18b992cf199597510b44396413805c56] <==
	I0918 16:57:21.996127       1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
	I0918 16:57:21.996161       1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
	I0918 16:57:21.996195       1 shared_informer.go:356] "Caches are synced" controller="attach detach"
	I0918 16:57:21.996207       1 shared_informer.go:356] "Caches are synced" controller="ReplicationController"
	I0918 16:57:21.996244       1 shared_informer.go:356] "Caches are synced" controller="taint-eviction-controller"
	I0918 16:57:21.996548       1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
	I0918 16:57:21.998625       1 shared_informer.go:356] "Caches are synced" controller="TTL after finished"
	I0918 16:57:21.998653       1 shared_informer.go:356] "Caches are synced" controller="stateful set"
	I0918 16:57:21.999787       1 shared_informer.go:356] "Caches are synced" controller="node"
	I0918 16:57:21.999840       1 range_allocator.go:177] "Sending events to api server" logger="node-ipam-controller"
	I0918 16:57:21.999874       1 range_allocator.go:183] "Starting range CIDR allocator" logger="node-ipam-controller"
	I0918 16:57:21.999884       1 shared_informer.go:349] "Waiting for caches to sync" controller="cidrallocator"
	I0918 16:57:21.999891       1 shared_informer.go:356] "Caches are synced" controller="cidrallocator"
	I0918 16:57:22.003084       1 shared_informer.go:356] "Caches are synced" controller="resource quota"
	I0918 16:57:22.005449       1 shared_informer.go:356] "Caches are synced" controller="crt configmap"
	I0918 16:57:22.007795       1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="ha-078118" podCIDRs=["10.244.0.0/24"]
	I0918 16:57:22.014810       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	I0918 16:57:36.949312       1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
	I0918 16:57:50.908088       1 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-078118-m02\" does not exist"
	I0918 16:57:50.920374       1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="ha-078118-m02" podCIDRs=["10.244.1.0/24"]
	I0918 16:57:51.951916       1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-078118-m02"
	E0918 16:58:53.029464       1 certificate_controller.go:151] "Unhandled Error" err="Sync csr-ns7n2 failed with : error updating signature for csr: Operation cannot be fulfilled on certificatesigningrequests.certificates.k8s.io \"csr-ns7n2\": the object has been modified; please apply your changes to the latest version and try again" logger="UnhandledError"
	I0918 16:58:54.398116       1 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-078118-m03\" does not exist"
	I0918 16:58:54.408644       1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="ha-078118-m03" podCIDRs=["10.244.2.0/24"]
	I0918 16:58:57.035270       1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-078118-m03"
	
	
	==> kube-proxy [9d8271cae4bea6871005fa5672799aa187936aa79b11a2ceee4b632f181632d9] <==
	I0918 16:57:23.552129       1 server_linux.go:53] "Using iptables proxy"
	I0918 16:57:23.618582       1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
	I0918 16:57:23.719415       1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
	I0918 16:57:23.719477       1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.49.2"]
	E0918 16:57:23.719603       1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
	I0918 16:57:23.742365       1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0918 16:57:23.742445       1 server_linux.go:132] "Using iptables Proxier"
	I0918 16:57:23.749399       1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
	I0918 16:57:23.749845       1 server.go:527] "Version info" version="v1.34.0"
	I0918 16:57:23.749872       1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 16:57:23.751257       1 config.go:403] "Starting serviceCIDR config controller"
	I0918 16:57:23.751277       1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
	I0918 16:57:23.751307       1 config.go:200] "Starting service config controller"
	I0918 16:57:23.751312       1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
	I0918 16:57:23.751338       1 config.go:309] "Starting node config controller"
	I0918 16:57:23.751344       1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
	I0918 16:57:23.752416       1 config.go:106] "Starting endpoint slice config controller"
	I0918 16:57:23.752752       1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
	I0918 16:57:23.851721       1 shared_informer.go:356] "Caches are synced" controller="service config"
	I0918 16:57:23.851721       1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
	I0918 16:57:23.851724       1 shared_informer.go:356] "Caches are synced" controller="node config"
	I0918 16:57:23.852869       1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
	
	
	==> kube-scheduler [db2ea624fa9b69b8338be3fd1f439edd2f934d1bb03c166e93576e563be0e8fa] <==
	E0918 16:57:14.963359       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
	E0918 16:57:15.879600       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
	E0918 16:57:15.986882       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
	E0918 16:57:15.993286       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
	E0918 16:57:15.994165       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
	E0918 16:57:16.023788       1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
	E0918 16:57:16.047113       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
	E0918 16:57:16.071789       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
	E0918 16:57:16.077882       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
	E0918 16:57:16.154294       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
	E0918 16:57:16.219883       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
	E0918 16:57:16.270378       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
	E0918 16:57:16.276428       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
	I0918 16:57:18.258571       1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	E0918 16:57:50.963316       1 framework.go:1400] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-gbrxz\": pod kindnet-gbrxz is already assigned to node \"ha-078118-m02\"" plugin="DefaultBinder" pod="kube-system/kindnet-gbrxz" node="ha-078118-m02"
	E0918 16:57:50.963458       1 schedule_one.go:1079] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-gbrxz\": pod kindnet-gbrxz is already assigned to node \"ha-078118-m02\"" logger="UnhandledError" pod="kube-system/kindnet-gbrxz"
	E0918 16:58:54.440393       1 framework.go:1400] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-tghfn\": pod kindnet-tghfn is already assigned to node \"ha-078118-m03\"" plugin="DefaultBinder" pod="kube-system/kindnet-tghfn" node="ha-078118-m03"
	E0918 16:58:54.440466       1 schedule_one.go:379] "scheduler cache ForgetPod failed" err="pod 22e6ba4d-8bbb-45e6-8e87-9527b52452e1(kube-system/kindnet-tghfn) wasn't assumed so cannot be forgotten" logger="UnhandledError" pod="kube-system/kindnet-tghfn"
	E0918 16:58:54.440493       1 schedule_one.go:1079] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-tghfn\": pod kindnet-tghfn is already assigned to node \"ha-078118-m03\"" logger="UnhandledError" pod="kube-system/kindnet-tghfn"
	I0918 16:58:54.441957       1 schedule_one.go:1092] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-tghfn" node="ha-078118-m03"
	I0918 16:59:13.788974       1 cache.go:512] "Pod was added to a different node than it was assumed" podKey="38c4aa96-8e5c-4bc7-a350-64f32c7e0774" pod="default/busybox-7b57f96db7-bzrv2" assumedNode="ha-078118-m02" currentNode="ha-078118"
	E0918 16:59:13.789425       1 framework.go:1400] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-7b57f96db7-bzrv2\": pod busybox-7b57f96db7-bzrv2 is already assigned to node \"ha-078118-m02\"" plugin="DefaultBinder" pod="default/busybox-7b57f96db7-bzrv2" node="ha-078118"
	E0918 16:59:13.789639       1 schedule_one.go:379] "scheduler cache ForgetPod failed" err="pod 38c4aa96-8e5c-4bc7-a350-64f32c7e0774(default/busybox-7b57f96db7-bzrv2) was assumed on ha-078118 but assigned to ha-078118-m02" logger="UnhandledError" pod="default/busybox-7b57f96db7-bzrv2"
	E0918 16:59:13.789660       1 schedule_one.go:1079] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-7b57f96db7-bzrv2\": pod busybox-7b57f96db7-bzrv2 is already assigned to node \"ha-078118-m02\"" logger="UnhandledError" pod="default/busybox-7b57f96db7-bzrv2"
	I0918 16:59:13.790820       1 schedule_one.go:1092] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-7b57f96db7-bzrv2" node="ha-078118-m02"
	
	
	==> kubelet <==
	Sep 18 16:58:49 ha-078118 kubelet[1671]: E0918 16:58:49.677683    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214729677385979  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:58:59 ha-078118 kubelet[1671]: E0918 16:58:59.678818    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214739678612986  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:58:59 ha-078118 kubelet[1671]: E0918 16:58:59.678847    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214739678612986  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:09 ha-078118 kubelet[1671]: E0918 16:59:09.680329    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214749680097499  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:09 ha-078118 kubelet[1671]: E0918 16:59:09.680382    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214749680097499  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:13 ha-078118 kubelet[1671]: E0918 16:59:13.843774    1671 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-nssns], unattached volumes=[], failed to process volumes=[kube-api-access-nssns]: context canceled" pod="default/busybox-7b57f96db7-6lbn8" podUID="bc6485bb-dcea-454a-81bb-b9d71c73f2f5"
	Sep 18 16:59:13 ha-078118 kubelet[1671]: E0918 16:59:13.847406    1671 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5jljj], unattached volumes=[], failed to process volumes=[kube-api-access-5jljj]: context canceled" pod="default/busybox-7b57f96db7-bm55m" podUID="13d73e93-6fa6-4541-85bc-f9a8fbaed905"
	Sep 18 16:59:13 ha-078118 kubelet[1671]: I0918 16:59:13.946870    1671 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jljj\" (UniqueName: \"kubernetes.io/projected/13d73e93-6fa6-4541-85bc-f9a8fbaed905-kube-api-access-5jljj\") pod \"busybox-7b57f96db7-bm55m\" (UID: \"13d73e93-6fa6-4541-85bc-f9a8fbaed905\") " pod="default/busybox-7b57f96db7-bm55m"
	Sep 18 16:59:13 ha-078118 kubelet[1671]: I0918 16:59:13.947034    1671 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nssns\" (UniqueName: \"kubernetes.io/projected/bc6485bb-dcea-454a-81bb-b9d71c73f2f5-kube-api-access-nssns\") pod \"busybox-7b57f96db7-6lbn8\" (UID: \"bc6485bb-dcea-454a-81bb-b9d71c73f2f5\") " pod="default/busybox-7b57f96db7-6lbn8"
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.147735    1671 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jljj\" (UniqueName: \"kubernetes.io/projected/13d73e93-6fa6-4541-85bc-f9a8fbaed905-kube-api-access-5jljj\") pod \"13d73e93-6fa6-4541-85bc-f9a8fbaed905\" (UID: \"13d73e93-6fa6-4541-85bc-f9a8fbaed905\") "
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.147786    1671 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nssns\" (UniqueName: \"kubernetes.io/projected/bc6485bb-dcea-454a-81bb-b9d71c73f2f5-kube-api-access-nssns\") pod \"bc6485bb-dcea-454a-81bb-b9d71c73f2f5\" (UID: \"bc6485bb-dcea-454a-81bb-b9d71c73f2f5\") "
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.149862    1671 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13d73e93-6fa6-4541-85bc-f9a8fbaed905-kube-api-access-5jljj" (OuterVolumeSpecName: "kube-api-access-5jljj") pod "13d73e93-6fa6-4541-85bc-f9a8fbaed905" (UID: "13d73e93-6fa6-4541-85bc-f9a8fbaed905"). InnerVolumeSpecName "kube-api-access-5jljj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.150028    1671 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc6485bb-dcea-454a-81bb-b9d71c73f2f5-kube-api-access-nssns" (OuterVolumeSpecName: "kube-api-access-nssns") pod "bc6485bb-dcea-454a-81bb-b9d71c73f2f5" (UID: "bc6485bb-dcea-454a-81bb-b9d71c73f2f5"). InnerVolumeSpecName "kube-api-access-nssns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.248480    1671 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jljj\" (UniqueName: \"kubernetes.io/projected/13d73e93-6fa6-4541-85bc-f9a8fbaed905-kube-api-access-5jljj\") on node \"ha-078118\" DevicePath \"\""
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.248556    1671 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nssns\" (UniqueName: \"kubernetes.io/projected/bc6485bb-dcea-454a-81bb-b9d71c73f2f5-kube-api-access-nssns\") on node \"ha-078118\" DevicePath \"\""
	Sep 18 16:59:15 ha-078118 kubelet[1671]: I0918 16:59:15.660472    1671 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13d73e93-6fa6-4541-85bc-f9a8fbaed905" path="/var/lib/kubelet/pods/13d73e93-6fa6-4541-85bc-f9a8fbaed905/volumes"
	Sep 18 16:59:15 ha-078118 kubelet[1671]: I0918 16:59:15.660724    1671 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc6485bb-dcea-454a-81bb-b9d71c73f2f5" path="/var/lib/kubelet/pods/bc6485bb-dcea-454a-81bb-b9d71c73f2f5/volumes"
	Sep 18 16:59:19 ha-078118 kubelet[1671]: E0918 16:59:19.682422    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214759682138930  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:19 ha-078118 kubelet[1671]: E0918 16:59:19.682458    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214759682138930  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:29 ha-078118 kubelet[1671]: E0918 16:59:29.683746    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214769683420730  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:29 ha-078118 kubelet[1671]: E0918 16:59:29.683784    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214769683420730  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:39 ha-078118 kubelet[1671]: E0918 16:59:39.685040    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214779684726563  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:39 ha-078118 kubelet[1671]: E0918 16:59:39.685111    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214779684726563  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:49 ha-078118 kubelet[1671]: E0918 16:59:49.686597    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214789686357189  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:49 ha-078118 kubelet[1671]: E0918 16:59:49.686637    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214789686357189  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	

                                                
                                                
-- /stdout --
helpers_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-078118 -n ha-078118
helpers_test.go:269: (dbg) Run:  kubectl --context ha-078118 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestMultiControlPlane/serial/AddWorkerNode FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestMultiControlPlane/serial/AddWorkerNode (30.64s)

                                                
                                    
x
+
TestMultiControlPlane/serial/CopyFile (15.46s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/CopyFile
ha_test.go:328: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 status --output json --alsologtostderr -v 5
ha_test.go:328: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 status --output json --alsologtostderr -v 5: exit status 7 (715.463292ms)

                                                
                                                
-- stdout --
	[{"Name":"ha-078118","Host":"Running","Kubelet":"Running","APIServer":"Running","Kubeconfig":"Configured","Worker":false},{"Name":"ha-078118-m02","Host":"Running","Kubelet":"Running","APIServer":"Running","Kubeconfig":"Configured","Worker":false},{"Name":"ha-078118-m03","Host":"Running","Kubelet":"Running","APIServer":"Running","Kubeconfig":"Configured","Worker":false},{"Name":"ha-078118-m04","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":true}]

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 16:59:52.255246   73632 out.go:360] Setting OutFile to fd 1 ...
	I0918 16:59:52.255550   73632 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:59:52.255562   73632 out.go:374] Setting ErrFile to fd 2...
	I0918 16:59:52.255568   73632 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:59:52.255797   73632 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 16:59:52.255986   73632 out.go:368] Setting JSON to true
	I0918 16:59:52.256027   73632 mustload.go:65] Loading cluster: ha-078118
	I0918 16:59:52.256126   73632 notify.go:220] Checking for updates...
	I0918 16:59:52.256418   73632 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:59:52.256438   73632 status.go:174] checking status of ha-078118 ...
	I0918 16:59:52.257118   73632 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:59:52.277546   73632 status.go:371] ha-078118 host status = "Running" (err=<nil>)
	I0918 16:59:52.277590   73632 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:59:52.277905   73632 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 16:59:52.296148   73632 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:59:52.296433   73632 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:59:52.296488   73632 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:59:52.315767   73632 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:59:52.409041   73632 ssh_runner.go:195] Run: systemctl --version
	I0918 16:59:52.413646   73632 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 16:59:52.426318   73632 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:59:52.483747   73632 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:64 OomKillDisable:false NGoroutines:75 SystemTime:2025-09-18 16:59:52.472756858 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:59:52.484283   73632 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 16:59:52.484328   73632 api_server.go:166] Checking apiserver status ...
	I0918 16:59:52.484362   73632 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 16:59:52.500107   73632 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup
	W0918 16:59:52.511090   73632 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 16:59:52.511147   73632 ssh_runner.go:195] Run: ls
	I0918 16:59:52.514952   73632 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 16:59:52.520032   73632 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 16:59:52.520059   73632 status.go:463] ha-078118 apiserver status = Running (err=<nil>)
	I0918 16:59:52.520072   73632 status.go:176] ha-078118 status: &{Name:ha-078118 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 16:59:52.520090   73632 status.go:174] checking status of ha-078118-m02 ...
	I0918 16:59:52.520438   73632 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 16:59:52.538753   73632 status.go:371] ha-078118-m02 host status = "Running" (err=<nil>)
	I0918 16:59:52.538778   73632 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 16:59:52.539010   73632 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 16:59:52.556811   73632 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 16:59:52.557097   73632 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:59:52.557167   73632 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:59:52.574576   73632 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:59:52.668888   73632 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 16:59:52.681690   73632 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 16:59:52.681722   73632 api_server.go:166] Checking apiserver status ...
	I0918 16:59:52.681755   73632 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 16:59:52.693463   73632 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1367/cgroup
	W0918 16:59:52.703327   73632 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1367/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 16:59:52.703385   73632 ssh_runner.go:195] Run: ls
	I0918 16:59:52.706779   73632 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 16:59:52.710954   73632 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 16:59:52.710979   73632 status.go:463] ha-078118-m02 apiserver status = Running (err=<nil>)
	I0918 16:59:52.710989   73632 status.go:176] ha-078118-m02 status: &{Name:ha-078118-m02 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 16:59:52.711008   73632 status.go:174] checking status of ha-078118-m03 ...
	I0918 16:59:52.711244   73632 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 16:59:52.729028   73632 status.go:371] ha-078118-m03 host status = "Running" (err=<nil>)
	I0918 16:59:52.729049   73632 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 16:59:52.729342   73632 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 16:59:52.748782   73632 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 16:59:52.749044   73632 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:59:52.749153   73632 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:59:52.769160   73632 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:59:52.862853   73632 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 16:59:52.875608   73632 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 16:59:52.875633   73632 api_server.go:166] Checking apiserver status ...
	I0918 16:59:52.875664   73632 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 16:59:52.887007   73632 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup
	W0918 16:59:52.896791   73632 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 16:59:52.896855   73632 ssh_runner.go:195] Run: ls
	I0918 16:59:52.900401   73632 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 16:59:52.904972   73632 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 16:59:52.904996   73632 status.go:463] ha-078118-m03 apiserver status = Running (err=<nil>)
	I0918 16:59:52.905005   73632 status.go:176] ha-078118-m03 status: &{Name:ha-078118-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 16:59:52.905024   73632 status.go:174] checking status of ha-078118-m04 ...
	I0918 16:59:52.905266   73632 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 16:59:52.924167   73632 status.go:371] ha-078118-m04 host status = "Stopped" (err=<nil>)
	I0918 16:59:52.924188   73632 status.go:384] host is not running, skipping remaining checks
	I0918 16:59:52.924196   73632 status.go:176] ha-078118-m04 status: &{Name:ha-078118-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp testdata/cp-test.txt ha-078118:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp ha-078118:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1931775572/001/cp-test_ha-078118.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp ha-078118:/home/docker/cp-test.txt ha-078118-m02:/home/docker/cp-test_ha-078118_ha-078118-m02.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m02 "sudo cat /home/docker/cp-test_ha-078118_ha-078118-m02.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp ha-078118:/home/docker/cp-test.txt ha-078118-m03:/home/docker/cp-test_ha-078118_ha-078118-m03.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m03 "sudo cat /home/docker/cp-test_ha-078118_ha-078118-m03.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp ha-078118:/home/docker/cp-test.txt ha-078118-m04:/home/docker/cp-test_ha-078118_ha-078118-m04.txt
helpers_test.go:573: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 cp ha-078118:/home/docker/cp-test.txt ha-078118-m04:/home/docker/cp-test_ha-078118_ha-078118-m04.txt: exit status 1 (140.876767ms)

                                                
                                                
** stderr ** 
	getting host: "ha-078118-m04" is not running

                                                
                                                
** /stderr **
helpers_test.go:578: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 cp ha-078118:/home/docker/cp-test.txt ha-078118-m04:/home/docker/cp-test_ha-078118_ha-078118-m04.txt" : exit status 1
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 "sudo cat /home/docker/cp-test_ha-078118_ha-078118-m04.txt"
helpers_test.go:551: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 "sudo cat /home/docker/cp-test_ha-078118_ha-078118-m04.txt": exit status 1 (137.58611ms)

                                                
                                                
** stderr ** 
	ssh: "ha-078118-m04" is not running

                                                
                                                
** /stderr **
helpers_test.go:556: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 \"sudo cat /home/docker/cp-test_ha-078118_ha-078118-m04.txt\"" : exit status 1
helpers_test.go:590: /testdata/cp-test.txt content mismatch (-want +got):
string(
- 	"Test file for checking file cp process",
+ 	"",
)
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp testdata/cp-test.txt ha-078118-m02:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m02:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1931775572/001/cp-test_ha-078118-m02.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m02:/home/docker/cp-test.txt ha-078118:/home/docker/cp-test_ha-078118-m02_ha-078118.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118 "sudo cat /home/docker/cp-test_ha-078118-m02_ha-078118.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m02:/home/docker/cp-test.txt ha-078118-m03:/home/docker/cp-test_ha-078118-m02_ha-078118-m03.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m03 "sudo cat /home/docker/cp-test_ha-078118-m02_ha-078118-m03.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m02:/home/docker/cp-test.txt ha-078118-m04:/home/docker/cp-test_ha-078118-m02_ha-078118-m04.txt
helpers_test.go:573: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m02:/home/docker/cp-test.txt ha-078118-m04:/home/docker/cp-test_ha-078118-m02_ha-078118-m04.txt: exit status 1 (142.90933ms)

                                                
                                                
** stderr ** 
	getting host: "ha-078118-m04" is not running

                                                
                                                
** /stderr **
helpers_test.go:578: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m02:/home/docker/cp-test.txt ha-078118-m04:/home/docker/cp-test_ha-078118-m02_ha-078118-m04.txt" : exit status 1
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 "sudo cat /home/docker/cp-test_ha-078118-m02_ha-078118-m04.txt"
helpers_test.go:551: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 "sudo cat /home/docker/cp-test_ha-078118-m02_ha-078118-m04.txt": exit status 1 (146.480658ms)

                                                
                                                
** stderr ** 
	ssh: "ha-078118-m04" is not running

                                                
                                                
** /stderr **
helpers_test.go:556: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 \"sudo cat /home/docker/cp-test_ha-078118-m02_ha-078118-m04.txt\"" : exit status 1
helpers_test.go:590: /testdata/cp-test.txt content mismatch (-want +got):
string(
- 	"Test file for checking file cp process",
+ 	"",
)
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp testdata/cp-test.txt ha-078118-m03:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1931775572/001/cp-test_ha-078118-m03.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118:/home/docker/cp-test_ha-078118-m03_ha-078118.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118 "sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118-m02:/home/docker/cp-test_ha-078118-m03_ha-078118-m02.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m02 "sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m02.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118-m04:/home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt
helpers_test.go:573: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118-m04:/home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt: exit status 1 (144.802031ms)

                                                
                                                
** stderr ** 
	getting host: "ha-078118-m04" is not running

                                                
                                                
** /stderr **
helpers_test.go:578: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118-m04:/home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt" : exit status 1
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 "sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt"
helpers_test.go:551: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 "sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt": exit status 1 (138.466537ms)

                                                
                                                
** stderr ** 
	ssh: "ha-078118-m04" is not running

                                                
                                                
** /stderr **
helpers_test.go:556: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 \"sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt\"" : exit status 1
helpers_test.go:590: /testdata/cp-test.txt content mismatch (-want +got):
string(
- 	"Test file for checking file cp process",
+ 	"",
)
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp testdata/cp-test.txt ha-078118-m04:/home/docker/cp-test.txt
helpers_test.go:573: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 cp testdata/cp-test.txt ha-078118-m04:/home/docker/cp-test.txt: exit status 1 (140.281157ms)

                                                
                                                
** stderr ** 
	getting host: "ha-078118-m04" is not running

                                                
                                                
** /stderr **
helpers_test.go:578: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 cp testdata/cp-test.txt ha-078118-m04:/home/docker/cp-test.txt" : exit status 1
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 "sudo cat /home/docker/cp-test.txt": exit status 1 (141.976479ms)

                                                
                                                
** stderr ** 
	ssh: "ha-078118-m04" is not running

                                                
                                                
** /stderr **
helpers_test.go:556: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 \"sudo cat /home/docker/cp-test.txt\"" : exit status 1
helpers_test.go:590: /testdata/cp-test.txt content mismatch (-want +got):
string(
- 	"Test file for checking file cp process",
+ 	"",
)
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1931775572/001/cp-test_ha-078118-m04.txt
helpers_test.go:573: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1931775572/001/cp-test_ha-078118-m04.txt: exit status 1 (139.317152ms)

                                                
                                                
** stderr ** 
	getting host: "ha-078118-m04" is not running

                                                
                                                
** /stderr **
helpers_test.go:578: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1931775572/001/cp-test_ha-078118-m04.txt" : exit status 1
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 "sudo cat /home/docker/cp-test.txt": exit status 1 (146.960699ms)

                                                
                                                
** stderr ** 
	ssh: "ha-078118-m04" is not running

                                                
                                                
** /stderr **
helpers_test.go:556: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 \"sudo cat /home/docker/cp-test.txt\"" : exit status 1
helpers_test.go:545: failed to read test file 'testdata/cp-test.txt' : open /tmp/TestMultiControlPlaneserialCopyFile1931775572/001/cp-test_ha-078118-m04.txt: no such file or directory
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118:/home/docker/cp-test_ha-078118-m04_ha-078118.txt
helpers_test.go:573: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118:/home/docker/cp-test_ha-078118-m04_ha-078118.txt: exit status 1 (156.584558ms)

                                                
                                                
** stderr ** 
	getting host: "ha-078118-m04" is not running

                                                
                                                
** /stderr **
helpers_test.go:578: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118:/home/docker/cp-test_ha-078118-m04_ha-078118.txt" : exit status 1
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 "sudo cat /home/docker/cp-test.txt": exit status 1 (137.481329ms)

                                                
                                                
** stderr ** 
	ssh: "ha-078118-m04" is not running

                                                
                                                
** /stderr **
helpers_test.go:556: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 \"sudo cat /home/docker/cp-test.txt\"" : exit status 1
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118 "sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118.txt"
helpers_test.go:551: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118 "sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118.txt": exit status 1 (254.15232ms)

                                                
                                                
-- stdout --
	cat: /home/docker/cp-test_ha-078118-m04_ha-078118.txt: No such file or directory

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
helpers_test.go:556: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118 \"sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118.txt\"" : exit status 1
helpers_test.go:590: /testdata/cp-test.txt content mismatch (-want +got):
string(
- 	"",
+ 	"cat: /home/docker/cp-test_ha-078118-m04_ha-078118.txt: No such file or directory\r\n",
)
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m02:/home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt
helpers_test.go:573: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m02:/home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt: exit status 1 (155.379264ms)

                                                
                                                
** stderr ** 
	getting host: "ha-078118-m04" is not running

                                                
                                                
** /stderr **
helpers_test.go:578: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m02:/home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt" : exit status 1
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 "sudo cat /home/docker/cp-test.txt": exit status 1 (137.247528ms)

                                                
                                                
** stderr ** 
	ssh: "ha-078118-m04" is not running

                                                
                                                
** /stderr **
helpers_test.go:556: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 \"sudo cat /home/docker/cp-test.txt\"" : exit status 1
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m02 "sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt"
helpers_test.go:551: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m02 "sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt": exit status 1 (258.873501ms)

                                                
                                                
-- stdout --
	cat: /home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt: No such file or directory

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
helpers_test.go:556: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m02 \"sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt\"" : exit status 1
helpers_test.go:590: /testdata/cp-test.txt content mismatch (-want +got):
string(
- 	"",
+ 	"cat: /home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt: No such file or directory\r\n",
)
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m03:/home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt
helpers_test.go:573: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m03:/home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt: exit status 1 (155.1971ms)

                                                
                                                
** stderr ** 
	getting host: "ha-078118-m04" is not running

                                                
                                                
** /stderr **
helpers_test.go:578: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m03:/home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt" : exit status 1
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 "sudo cat /home/docker/cp-test.txt": exit status 1 (138.747675ms)

                                                
                                                
** stderr ** 
	ssh: "ha-078118-m04" is not running

                                                
                                                
** /stderr **
helpers_test.go:556: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m04 \"sudo cat /home/docker/cp-test.txt\"" : exit status 1
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m03 "sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt"
helpers_test.go:551: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m03 "sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt": exit status 1 (256.217583ms)

                                                
                                                
-- stdout --
	cat: /home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt: No such file or directory

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
helpers_test.go:556: failed to run an cp command. args "out/minikube-linux-amd64 -p ha-078118 ssh -n ha-078118-m03 \"sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt\"" : exit status 1
helpers_test.go:590: /testdata/cp-test.txt content mismatch (-want +got):
string(
- 	"",
+ 	"cat: /home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt: No such file or directory\r\n",
)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======>  post-mortem[TestMultiControlPlane/serial/CopyFile]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======>  post-mortem[TestMultiControlPlane/serial/CopyFile]: docker inspect <======
helpers_test.go:239: (dbg) Run:  docker inspect ha-078118
helpers_test.go:243: (dbg) docker inspect ha-078118:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7",
	        "Created": "2025-09-18T16:57:02.681891976Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 60804,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2025-09-18T16:57:02.720947584Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:c6b5532e987b5b4f5fc9cb0336e378ed49c0542bad8cbfc564b71e977a6269de",
	        "ResolvConfPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/hostname",
	        "HostsPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/hosts",
	        "LogPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7-json.log",
	        "Name": "/ha-078118",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ha-078118:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "ha-078118",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "private",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 3221225472,
	            "NanoCpus": 0,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 6442450944,
	            "MemorySwappiness": null,
	            "OomKillDisable": null,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "ID": "0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7",
	                "LowerDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91-init/diff:/var/lib/docker/overlay2/1fd2bbb67ab9e5bb8d4549665a1a228eadda56df39fee53908cd735ea16a4e10/diff",
	                "MergedDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/merged",
	                "UpperDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/diff",
	                "WorkDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "ha-078118",
	                "Source": "/var/lib/docker/volumes/ha-078118/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "ha-078118",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ha-078118",
	                "name.minikube.sigs.k8s.io": "ha-078118",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "46c241f4f759650d3d72325bd2e71329577f7cf9aeedeb6d33ceecff2db46b27",
	            "SandboxKey": "/var/run/docker/netns/46c241f4f759",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32783"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32784"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32787"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32785"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32786"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ha-078118": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "7a:b0:8a:ae:56:9b",
	                    "DriverOpts": null,
	                    "GwPriority": 0,
	                    "NetworkID": "0aa191750de6e44eaf49073a9e05a52994c63ccafcb0870d32aaf105d93cb724",
	                    "EndpointID": "4a33baf269d5fab1a605edfe7de39d655fdf3c152c658d8c6eca8c3ca23635ea",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "ha-078118",
	                        "0cb187fb2895"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-078118 -n ha-078118
helpers_test.go:252: <<< TestMultiControlPlane/serial/CopyFile FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======>  post-mortem[TestMultiControlPlane/serial/CopyFile]: minikube logs <======
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p ha-078118 logs -n 25: (1.184669161s)
helpers_test.go:260: TestMultiControlPlane/serial/CopyFile logs: 
-- stdout --
	
	==> Audit <==
	┌─────────┬──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬───────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
	│ COMMAND │                                                                 ARGS                                                                 │  PROFILE  │  USER   │ VERSION │     START TIME      │      END TIME       │
	├─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼───────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ cp      │ ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1931775572/001/cp-test_ha-078118-m03.txt │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ cp      │ ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118:/home/docker/cp-test_ha-078118-m03_ha-078118.txt                       │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118 sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118.txt                                                 │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ cp      │ ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118-m02:/home/docker/cp-test_ha-078118-m03_ha-078118-m02.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m02 sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m02.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ cp      │ ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118-m04:/home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp testdata/cp-test.txt ha-078118-m04:/home/docker/cp-test.txt                                                             │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1931775572/001/cp-test_ha-078118-m04.txt │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118:/home/docker/cp-test_ha-078118-m04_ha-078118.txt                       │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118.txt                                                 │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m02:/home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m02 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m03:/home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	└─────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴───────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
	
	
	==> Last Start <==
	Log file created at: 2025/09/18 16:56:57
	Running on machine: ubuntu-20-agent-4
	Binary: Built with gc go1.24.6 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0918 16:56:57.574799   60243 out.go:360] Setting OutFile to fd 1 ...
	I0918 16:56:57.575055   60243 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:56:57.575064   60243 out.go:374] Setting ErrFile to fd 2...
	I0918 16:56:57.575068   60243 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:56:57.575239   60243 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 16:56:57.575752   60243 out.go:368] Setting JSON to false
	I0918 16:56:57.576663   60243 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":2369,"bootTime":1758212249,"procs":182,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 16:56:57.576763   60243 start.go:140] virtualization: kvm guest
	I0918 16:56:57.579065   60243 out.go:179] * [ha-078118] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 16:56:57.580589   60243 notify.go:220] Checking for updates...
	I0918 16:56:57.580637   60243 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 16:56:57.582251   60243 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 16:56:57.583930   60243 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 16:56:57.585344   60243 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 16:56:57.586681   60243 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 16:56:57.588118   60243 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 16:56:57.589868   60243 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 16:56:57.616949   60243 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 16:56:57.617226   60243 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:56:57.672926   60243 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 16:56:57.662881749 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:56:57.673067   60243 docker.go:318] overlay module found
	I0918 16:56:57.674951   60243 out.go:179] * Using the docker driver based on user configuration
	I0918 16:56:57.676488   60243 start.go:304] selected driver: docker
	I0918 16:56:57.676533   60243 start.go:924] validating driver "docker" against <nil>
	I0918 16:56:57.676551   60243 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 16:56:57.677232   60243 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:56:57.735443   60243 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 16:56:57.725396122 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:56:57.735617   60243 start_flags.go:327] no existing cluster config was found, will generate one from the flags 
	I0918 16:56:57.735836   60243 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 16:56:57.737842   60243 out.go:179] * Using Docker driver with root privileges
	I0918 16:56:57.739170   60243 cni.go:84] Creating CNI manager for ""
	I0918 16:56:57.739238   60243 cni.go:136] multinode detected (0 nodes found), recommending kindnet
	I0918 16:56:57.739249   60243 start_flags.go:336] Found "CNI" CNI - setting NetworkPlugin=cni
	I0918 16:56:57.739334   60243 start.go:348] cluster config:
	{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:c
ni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:56:57.740825   60243 out.go:179] * Starting "ha-078118" primary control-plane node in "ha-078118" cluster
	I0918 16:56:57.742276   60243 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 16:56:57.743877   60243 out.go:179] * Pulling base image v0.0.48 ...
	I0918 16:56:57.745428   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:56:57.745480   60243 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
	I0918 16:56:57.745487   60243 cache.go:58] Caching tarball of preloaded images
	I0918 16:56:57.745560   60243 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 16:56:57.745653   60243 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 16:56:57.745669   60243 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 16:56:57.745990   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:56:57.746019   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json: {Name:mke5d1dac7b5b198fe436d519c900523bef38bac Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:56:57.768293   60243 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 16:56:57.768319   60243 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 16:56:57.768342   60243 cache.go:232] Successfully downloaded all kic artifacts
	I0918 16:56:57.768380   60243 start.go:360] acquireMachinesLock for ha-078118: {Name:mk24a1b2c9ed1c42e9ffd635727b36c75401a437 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 16:56:57.768479   60243 start.go:364] duration metric: took 78.905µs to acquireMachinesLock for "ha-078118"
	I0918 16:56:57.768533   60243 start.go:93] Provisioning new machine with config: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APISer
verIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMne
tPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:56:57.768610   60243 start.go:125] createHost starting for "" (driver="docker")
	I0918 16:56:57.770671   60243 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
	I0918 16:56:57.770887   60243 start.go:159] libmachine.API.Create for "ha-078118" (driver="docker")
	I0918 16:56:57.770915   60243 client.go:168] LocalClient.Create starting
	I0918 16:56:57.771017   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 16:56:57.771052   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:56:57.771063   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:56:57.771109   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 16:56:57.771128   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:56:57.771139   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:56:57.771472   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0918 16:56:57.788966   60243 cli_runner.go:211] docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0918 16:56:57.789055   60243 network_create.go:284] running [docker network inspect ha-078118] to gather additional debugging logs...
	I0918 16:56:57.789082   60243 cli_runner.go:164] Run: docker network inspect ha-078118
	W0918 16:56:57.806227   60243 cli_runner.go:211] docker network inspect ha-078118 returned with exit code 1
	I0918 16:56:57.806257   60243 network_create.go:287] error running [docker network inspect ha-078118]: docker network inspect ha-078118: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network ha-078118 not found
	I0918 16:56:57.806269   60243 network_create.go:289] output of [docker network inspect ha-078118]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network ha-078118 not found
	
	** /stderr **
	I0918 16:56:57.806367   60243 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:56:57.825048   60243 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000b6fd40}
	I0918 16:56:57.825108   60243 network_create.go:124] attempt to create docker network ha-078118 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0918 16:56:57.825168   60243 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=ha-078118 ha-078118
	I0918 16:56:57.883807   60243 network_create.go:108] docker network ha-078118 192.168.49.0/24 created
	I0918 16:56:57.883839   60243 kic.go:121] calculated static IP "192.168.49.2" for the "ha-078118" container
	I0918 16:56:57.883907   60243 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 16:56:57.901150   60243 cli_runner.go:164] Run: docker volume create ha-078118 --label name.minikube.sigs.k8s.io=ha-078118 --label created_by.minikube.sigs.k8s.io=true
	I0918 16:56:57.920292   60243 oci.go:103] Successfully created a docker volume ha-078118
	I0918 16:56:57.920371   60243 cli_runner.go:164] Run: docker run --rm --name ha-078118-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118 --entrypoint /usr/bin/test -v ha-078118:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 16:56:58.331429   60243 oci.go:107] Successfully prepared a docker volume ha-078118
	I0918 16:56:58.331493   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:56:58.331538   60243 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 16:56:58.331609   60243 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 16:57:02.609752   60243 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.278086372s)
	I0918 16:57:02.609786   60243 kic.go:203] duration metric: took 4.278244507s to extract preloaded images to volume ...
	W0918 16:57:02.609879   60243 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 16:57:02.609928   60243 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 16:57:02.609985   60243 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 16:57:02.664799   60243 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ha-078118 --name ha-078118 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ha-078118 --network ha-078118 --ip 192.168.49.2 --volume ha-078118:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 16:57:02.939918   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Running}}
	I0918 16:57:02.960880   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:02.979302   60243 cli_runner.go:164] Run: docker exec ha-078118 stat /var/lib/dpkg/alternatives/iptables
	I0918 16:57:03.031279   60243 oci.go:144] the created container "ha-078118" has a running status.
	I0918 16:57:03.031320   60243 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa...
	I0918 16:57:03.339176   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0918 16:57:03.339260   60243 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 16:57:03.367335   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:03.386757   60243 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0918 16:57:03.386779   60243 kic_runner.go:114] Args: [docker exec --privileged ha-078118 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0918 16:57:03.436474   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:03.454883   60243 machine.go:93] provisionDockerMachine start ...
	I0918 16:57:03.454973   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:03.473294   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:03.473657   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32783 <nil> <nil>}
	I0918 16:57:03.473681   60243 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 16:57:03.614090   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 16:57:03.614134   60243 ubuntu.go:182] provisioning hostname "ha-078118"
	I0918 16:57:03.614194   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:03.632632   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:03.632839   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32783 <nil> <nil>}
	I0918 16:57:03.632853   60243 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118 && echo "ha-078118" | sudo tee /etc/hostname
	I0918 16:57:03.782762   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 16:57:03.782829   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:03.801381   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:03.801652   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32783 <nil> <nil>}
	I0918 16:57:03.801672   60243 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 16:57:03.939426   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 16:57:03.939465   60243 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 16:57:03.939512   60243 ubuntu.go:190] setting up certificates
	I0918 16:57:03.939523   60243 provision.go:84] configureAuth start
	I0918 16:57:03.939572   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 16:57:03.957335   60243 provision.go:143] copyHostCerts
	I0918 16:57:03.957375   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:57:03.957408   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 16:57:03.957416   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:57:03.957515   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 16:57:03.957636   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:57:03.957667   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 16:57:03.957676   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:57:03.957723   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 16:57:03.957805   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:57:03.957831   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 16:57:03.957840   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:57:03.957878   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 16:57:03.957967   60243 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118 san=[127.0.0.1 192.168.49.2 ha-078118 localhost minikube]
	I0918 16:57:04.446406   60243 provision.go:177] copyRemoteCerts
	I0918 16:57:04.446467   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 16:57:04.446516   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:04.464707   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:04.562243   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 16:57:04.562316   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 16:57:04.588874   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 16:57:04.588947   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)
	I0918 16:57:04.614556   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 16:57:04.614618   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0918 16:57:04.639365   60243 provision.go:87] duration metric: took 699.826763ms to configureAuth
	I0918 16:57:04.639398   60243 ubuntu.go:206] setting minikube options for container-runtime
	I0918 16:57:04.639604   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:04.639701   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:04.656946   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:04.657177   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32783 <nil> <nil>}
	I0918 16:57:04.657195   60243 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 16:57:04.894695   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 16:57:04.894721   60243 machine.go:96] duration metric: took 1.439819388s to provisionDockerMachine
	I0918 16:57:04.894730   60243 client.go:171] duration metric: took 7.123809117s to LocalClient.Create
	I0918 16:57:04.894745   60243 start.go:167] duration metric: took 7.123860389s to libmachine.API.Create "ha-078118"
	I0918 16:57:04.894752   60243 start.go:293] postStartSetup for "ha-078118" (driver="docker")
	I0918 16:57:04.894761   60243 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 16:57:04.894810   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 16:57:04.894846   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:04.912730   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:05.012590   60243 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 16:57:05.016311   60243 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 16:57:05.016343   60243 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 16:57:05.016356   60243 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 16:57:05.016365   60243 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 16:57:05.016390   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 16:57:05.016463   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 16:57:05.016587   60243 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 16:57:05.016603   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 16:57:05.016747   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 16:57:05.026453   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:57:05.054679   60243 start.go:296] duration metric: took 159.911183ms for postStartSetup
	I0918 16:57:05.055125   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 16:57:05.073363   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:57:05.073657   60243 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:57:05.073698   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:05.091184   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:05.183583   60243 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 16:57:05.187892   60243 start.go:128] duration metric: took 7.419268686s to createHost
	I0918 16:57:05.187925   60243 start.go:83] releasing machines lock for "ha-078118", held for 7.419435528s
	I0918 16:57:05.187997   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 16:57:05.206007   60243 ssh_runner.go:195] Run: cat /version.json
	I0918 16:57:05.206061   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:05.206078   60243 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 16:57:05.206128   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:05.226344   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:05.226582   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:05.390376   60243 ssh_runner.go:195] Run: systemctl --version
	I0918 16:57:05.395210   60243 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 16:57:05.535393   60243 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 16:57:05.540215   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:57:05.563699   60243 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 16:57:05.563777   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:57:05.593610   60243 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0918 16:57:05.593635   60243 start.go:495] detecting cgroup driver to use...
	I0918 16:57:05.593682   60243 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 16:57:05.593755   60243 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 16:57:05.609690   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 16:57:05.621084   60243 docker.go:218] disabling cri-docker service (if available) ...
	I0918 16:57:05.621139   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 16:57:05.634236   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 16:57:05.649602   60243 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 16:57:05.717704   60243 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 16:57:05.791536   60243 docker.go:234] disabling docker service ...
	I0918 16:57:05.791597   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 16:57:05.809456   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 16:57:05.821093   60243 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 16:57:05.891934   60243 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 16:57:05.996308   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 16:57:06.008290   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 16:57:06.025752   60243 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 16:57:06.025802   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.039023   60243 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 16:57:06.039085   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.049537   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.059941   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.070049   60243 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 16:57:06.079646   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.089835   60243 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.106740   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.116937   60243 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 16:57:06.125702   60243 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 16:57:06.136246   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:06.241697   60243 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 16:57:06.338653   60243 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 16:57:06.338718   60243 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 16:57:06.342873   60243 start.go:563] Will wait 60s for crictl version
	I0918 16:57:06.342929   60243 ssh_runner.go:195] Run: which crictl
	I0918 16:57:06.346790   60243 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 16:57:06.382517   60243 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 16:57:06.382605   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:57:06.419798   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:57:06.456221   60243 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 16:57:06.457601   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:57:06.475395   60243 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 16:57:06.479436   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:57:06.491469   60243 kubeadm.go:875] updating cluster {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIP
s:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: Soc
ketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0918 16:57:06.491586   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:57:06.491632   60243 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 16:57:06.560467   60243 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 16:57:06.560490   60243 crio.go:433] Images already preloaded, skipping extraction
	I0918 16:57:06.560565   60243 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 16:57:06.596435   60243 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 16:57:06.596457   60243 cache_images.go:85] Images are preloaded, skipping loading
	I0918 16:57:06.596465   60243 kubeadm.go:926] updating node { 192.168.49.2 8443 v1.34.0 crio true true} ...
	I0918 16:57:06.596593   60243 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 16:57:06.596663   60243 ssh_runner.go:195] Run: crio config
	I0918 16:57:06.638379   60243 cni.go:84] Creating CNI manager for ""
	I0918 16:57:06.638415   60243 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0918 16:57:06.638485   60243 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0918 16:57:06.638551   60243 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.34.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-078118 NodeName:ha-078118 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manif
ests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0918 16:57:06.638713   60243 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "ha-078118"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.49.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	kubernetesVersion: v1.34.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: systemd
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0918 16:57:06.638746   60243 kube-vip.go:115] generating kube-vip config ...
	I0918 16:57:06.638798   60243 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 16:57:06.651869   60243 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 16:57:06.652012   60243 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/super-admin.conf"
	    name: kubeconfig
	status: {}
	I0918 16:57:06.652164   60243 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 16:57:06.661798   60243 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 16:57:06.661868   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
	I0918 16:57:06.671425   60243 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (359 bytes)
	I0918 16:57:06.690684   60243 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 16:57:06.712365   60243 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2205 bytes)
	I0918 16:57:06.730837   60243 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1364 bytes)
	I0918 16:57:06.751634   60243 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 16:57:06.755620   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:57:06.767580   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:06.834874   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:57:06.856024   60243 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.2
	I0918 16:57:06.856044   60243 certs.go:194] generating shared ca certs ...
	I0918 16:57:06.856058   60243 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:06.856204   60243 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 16:57:06.856251   60243 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 16:57:06.856269   60243 certs.go:256] generating profile certs ...
	I0918 16:57:06.856336   60243 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 16:57:06.856374   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt with IP's: []
	I0918 16:57:07.092454   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt ...
	I0918 16:57:07.092487   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt: {Name:mk19062e6a12c311074ac12acf7e6f0d17c6d89a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.092685   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key ...
	I0918 16:57:07.092704   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key: {Name:mk318c046cc338ba0b28b363817d97a3070d94ed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.092818   60243 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.37f1b339
	I0918 16:57:07.092834   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.37f1b339 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.254]
	I0918 16:57:07.337211   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.37f1b339 ...
	I0918 16:57:07.337241   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.37f1b339: {Name:mk0b5e39f9123a2c4e24d5df860b2ac053c5a5e0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.337432   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.37f1b339 ...
	I0918 16:57:07.337456   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.37f1b339: {Name:mkf9155cc06cff6c926a6f1637026b23fbaea042 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.337590   60243 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.37f1b339 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 16:57:07.337708   60243 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.37f1b339 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 16:57:07.337789   60243 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 16:57:07.337811   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt with IP's: []
	I0918 16:57:07.508219   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt ...
	I0918 16:57:07.508250   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt: {Name:mk9be1072d013045d70f28d234a2966ed6a259eb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.508439   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key ...
	I0918 16:57:07.508459   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key: {Name:mk0fa849d3f79114700ec4346366d93036905ac9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.508586   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 16:57:07.508611   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 16:57:07.508632   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 16:57:07.508659   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 16:57:07.508679   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 16:57:07.508694   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 16:57:07.508710   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 16:57:07.508729   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 16:57:07.508805   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 16:57:07.508852   60243 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 16:57:07.508866   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 16:57:07.508898   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 16:57:07.508928   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 16:57:07.508964   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 16:57:07.509027   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:57:07.509070   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 16:57:07.509093   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:07.509106   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 16:57:07.509647   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 16:57:07.536147   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 16:57:07.563252   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 16:57:07.590602   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 16:57:07.616431   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
	I0918 16:57:07.642036   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 16:57:07.668728   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 16:57:07.695297   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 16:57:07.720300   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 16:57:07.748223   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 16:57:07.774345   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 16:57:07.799523   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0918 16:57:07.818102   60243 ssh_runner.go:195] Run: openssl version
	I0918 16:57:07.823677   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 16:57:07.833790   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:07.837671   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:07.837733   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:07.844558   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 16:57:07.854483   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 16:57:07.864206   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 16:57:07.868068   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 16:57:07.868131   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 16:57:07.875355   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 16:57:07.885526   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 16:57:07.895494   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 16:57:07.899217   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 16:57:07.899266   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 16:57:07.906421   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 16:57:07.916547   60243 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 16:57:07.920046   60243 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0918 16:57:07.920125   60243 kubeadm.go:392] StartCluster: {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[
] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: Socket
VMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:57:07.920228   60243 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0918 16:57:07.920275   60243 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0918 16:57:07.956205   60243 cri.go:89] found id: ""
	I0918 16:57:07.956268   60243 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0918 16:57:07.965688   60243 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0918 16:57:07.975065   60243 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
	I0918 16:57:07.975155   60243 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0918 16:57:07.984553   60243 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0918 16:57:07.984571   60243 kubeadm.go:157] found existing configuration files:
	
	I0918 16:57:07.984632   60243 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0918 16:57:07.993826   60243 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0918 16:57:07.993878   60243 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0918 16:57:08.002980   60243 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0918 16:57:08.012468   60243 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0918 16:57:08.012566   60243 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0918 16:57:08.021925   60243 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0918 16:57:08.031367   60243 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0918 16:57:08.031459   60243 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0918 16:57:08.040660   60243 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0918 16:57:08.050415   60243 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0918 16:57:08.050490   60243 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0918 16:57:08.059624   60243 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0918 16:57:08.100277   60243 kubeadm.go:310] [init] Using Kubernetes version: v1.34.0
	I0918 16:57:08.100331   60243 kubeadm.go:310] [preflight] Running pre-flight checks
	I0918 16:57:08.116038   60243 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
	I0918 16:57:08.116128   60243 kubeadm.go:310] KERNEL_VERSION: 6.8.0-1037-gcp
	I0918 16:57:08.116186   60243 kubeadm.go:310] OS: Linux
	I0918 16:57:08.116266   60243 kubeadm.go:310] CGROUPS_CPU: enabled
	I0918 16:57:08.116315   60243 kubeadm.go:310] CGROUPS_CPUSET: enabled
	I0918 16:57:08.116373   60243 kubeadm.go:310] CGROUPS_DEVICES: enabled
	I0918 16:57:08.116443   60243 kubeadm.go:310] CGROUPS_FREEZER: enabled
	I0918 16:57:08.116522   60243 kubeadm.go:310] CGROUPS_MEMORY: enabled
	I0918 16:57:08.116571   60243 kubeadm.go:310] CGROUPS_PIDS: enabled
	I0918 16:57:08.116615   60243 kubeadm.go:310] CGROUPS_HUGETLB: enabled
	I0918 16:57:08.116655   60243 kubeadm.go:310] CGROUPS_IO: enabled
	I0918 16:57:08.171905   60243 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0918 16:57:08.172043   60243 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0918 16:57:08.172141   60243 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
	I0918 16:57:08.179444   60243 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0918 16:57:08.181874   60243 out.go:252]   - Generating certificates and keys ...
	I0918 16:57:08.181988   60243 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0918 16:57:08.182109   60243 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0918 16:57:08.384218   60243 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0918 16:57:08.699741   60243 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
	I0918 16:57:08.825486   60243 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
	I0918 16:57:09.371495   60243 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
	I0918 16:57:09.773350   60243 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
	I0918 16:57:09.773540   60243 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [ha-078118 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0918 16:57:09.808553   60243 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
	I0918 16:57:09.808791   60243 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [ha-078118 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0918 16:57:10.030134   60243 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0918 16:57:10.543694   60243 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
	I0918 16:57:10.609235   60243 kubeadm.go:310] [certs] Generating "sa" key and public key
	I0918 16:57:10.609444   60243 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0918 16:57:10.844107   60243 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0918 16:57:10.880658   60243 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
	I0918 16:57:11.137641   60243 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0918 16:57:11.532580   60243 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0918 16:57:12.251321   60243 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0918 16:57:12.251715   60243 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0918 16:57:12.253897   60243 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0918 16:57:12.256755   60243 out.go:252]   - Booting up control plane ...
	I0918 16:57:12.256866   60243 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0918 16:57:12.256981   60243 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0918 16:57:12.257446   60243 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0918 16:57:12.266598   60243 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0918 16:57:12.266737   60243 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
	I0918 16:57:12.272623   60243 kubeadm.go:310] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
	I0918 16:57:12.272803   60243 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0918 16:57:12.272863   60243 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0918 16:57:12.350329   60243 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
	I0918 16:57:12.350484   60243 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
	I0918 16:57:12.852220   60243 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 502.00859ms
	I0918 16:57:12.854990   60243 kubeadm.go:310] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
	I0918 16:57:12.855092   60243 kubeadm.go:310] [control-plane-check] Checking kube-apiserver at https://192.168.49.2:8443/livez
	I0918 16:57:12.855203   60243 kubeadm.go:310] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
	I0918 16:57:12.855323   60243 kubeadm.go:310] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
	I0918 16:57:14.965273   60243 kubeadm.go:310] [control-plane-check] kube-scheduler is healthy after 2.110264832s
	I0918 16:57:14.984462   60243 kubeadm.go:310] [control-plane-check] kube-controller-manager is healthy after 2.1294049s
	I0918 16:57:19.024541   60243 kubeadm.go:310] [control-plane-check] kube-apiserver is healthy after 6.169430817s
	I0918 16:57:19.036534   60243 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0918 16:57:19.048658   60243 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0918 16:57:19.058561   60243 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0918 16:57:19.058849   60243 kubeadm.go:310] [mark-control-plane] Marking the node ha-078118 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0918 16:57:19.067655   60243 kubeadm.go:310] [bootstrap-token] Using token: u1re3r.382xtbpelzb2vqn2
	I0918 16:57:19.069664   60243 out.go:252]   - Configuring RBAC rules ...
	I0918 16:57:19.069828   60243 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0918 16:57:19.073078   60243 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0918 16:57:19.080001   60243 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0918 16:57:19.082815   60243 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0918 16:57:19.085370   60243 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0918 16:57:19.088075   60243 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0918 16:57:19.430480   60243 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0918 16:57:19.851385   60243 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0918 16:57:20.430959   60243 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0918 16:57:20.432013   60243 kubeadm.go:310] 
	I0918 16:57:20.432090   60243 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0918 16:57:20.432099   60243 kubeadm.go:310] 
	I0918 16:57:20.432181   60243 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0918 16:57:20.432188   60243 kubeadm.go:310] 
	I0918 16:57:20.432210   60243 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0918 16:57:20.432276   60243 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0918 16:57:20.432337   60243 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0918 16:57:20.432348   60243 kubeadm.go:310] 
	I0918 16:57:20.432441   60243 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0918 16:57:20.432460   60243 kubeadm.go:310] 
	I0918 16:57:20.432557   60243 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0918 16:57:20.432567   60243 kubeadm.go:310] 
	I0918 16:57:20.432631   60243 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0918 16:57:20.432695   60243 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0918 16:57:20.432772   60243 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0918 16:57:20.432781   60243 kubeadm.go:310] 
	I0918 16:57:20.432883   60243 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0918 16:57:20.433004   60243 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0918 16:57:20.433043   60243 kubeadm.go:310] 
	I0918 16:57:20.433148   60243 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token u1re3r.382xtbpelzb2vqn2 \
	I0918 16:57:20.433277   60243 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 \
	I0918 16:57:20.433309   60243 kubeadm.go:310] 	--control-plane 
	I0918 16:57:20.433319   60243 kubeadm.go:310] 
	I0918 16:57:20.433422   60243 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0918 16:57:20.433430   60243 kubeadm.go:310] 
	I0918 16:57:20.433578   60243 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token u1re3r.382xtbpelzb2vqn2 \
	I0918 16:57:20.433727   60243 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 
	I0918 16:57:20.436674   60243 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1037-gcp\n", err: exit status 1
	I0918 16:57:20.436833   60243 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0918 16:57:20.436876   60243 cni.go:84] Creating CNI manager for ""
	I0918 16:57:20.436887   60243 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0918 16:57:20.439722   60243 out.go:179] * Configuring CNI (Container Networking Interface) ...
	I0918 16:57:20.441111   60243 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0918 16:57:20.445728   60243 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.0/kubectl ...
	I0918 16:57:20.445756   60243 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
	I0918 16:57:20.465315   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0918 16:57:20.690521   60243 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0918 16:57:20.690609   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:20.690640   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-078118 minikube.k8s.io/updated_at=2025_09_18T16_57_20_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596 minikube.k8s.io/name=ha-078118 minikube.k8s.io/primary=true
	I0918 16:57:20.700737   60243 ops.go:34] apiserver oom_adj: -16
	I0918 16:57:20.767604   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:21.268560   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:21.768089   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:22.268176   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:22.767676   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:22.839542   60243 kubeadm.go:1105] duration metric: took 2.149001453s to wait for elevateKubeSystemPrivileges
	I0918 16:57:22.839581   60243 kubeadm.go:394] duration metric: took 14.919472386s to StartCluster
	I0918 16:57:22.839607   60243 settings.go:142] acquiring lock: {Name:mk72fea03aefe901db9522a467405d86665fedd0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:22.839682   60243 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 16:57:22.840462   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:22.840735   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0918 16:57:22.840750   60243 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:57:22.840775   60243 start.go:241] waiting for startup goroutines ...
	I0918 16:57:22.840788   60243 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0918 16:57:22.840876   60243 addons.go:69] Setting storage-provisioner=true in profile "ha-078118"
	I0918 16:57:22.840891   60243 addons.go:69] Setting default-storageclass=true in profile "ha-078118"
	I0918 16:57:22.840905   60243 addons.go:238] Setting addon storage-provisioner=true in "ha-078118"
	I0918 16:57:22.840939   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:57:22.840991   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:22.840941   60243 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-078118"
	I0918 16:57:22.841392   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:22.841558   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:22.865202   60243 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0918 16:57:22.865763   60243 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
	I0918 16:57:22.865795   60243 cert_rotation.go:141] "Starting client certificate rotation controller" logger="tls-transport-cache"
	I0918 16:57:22.865809   60243 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I0918 16:57:22.865816   60243 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
	I0918 16:57:22.865822   60243 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I0918 16:57:22.865828   60243 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
	I0918 16:57:22.866253   60243 addons.go:238] Setting addon default-storageclass=true in "ha-078118"
	I0918 16:57:22.866295   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:57:22.866582   60243 out.go:179]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0918 16:57:22.866825   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:22.868241   60243 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 16:57:22.868262   60243 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0918 16:57:22.868342   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:22.887359   60243 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
	I0918 16:57:22.887382   60243 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0918 16:57:22.887455   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:22.887753   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:22.910642   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:22.923544   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0918 16:57:23.006833   60243 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 16:57:23.025178   60243 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0918 16:57:23.102314   60243 start.go:976] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0918 16:57:23.320187   60243 out.go:179] * Enabled addons: storage-provisioner, default-storageclass
	I0918 16:57:23.321629   60243 addons.go:514] duration metric: took 480.833788ms for enable addons: enabled=[storage-provisioner default-storageclass]
	I0918 16:57:23.321670   60243 start.go:246] waiting for cluster config update ...
	I0918 16:57:23.321686   60243 start.go:255] writing updated cluster config ...
	I0918 16:57:23.323424   60243 out.go:203] 
	I0918 16:57:23.325109   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:23.325199   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:57:23.327022   60243 out.go:179] * Starting "ha-078118-m02" control-plane node in "ha-078118" cluster
	I0918 16:57:23.328400   60243 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 16:57:23.329828   60243 out.go:179] * Pulling base image v0.0.48 ...
	I0918 16:57:23.331236   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:57:23.331263   60243 cache.go:58] Caching tarball of preloaded images
	I0918 16:57:23.331263   60243 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 16:57:23.331360   60243 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 16:57:23.331373   60243 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 16:57:23.331452   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:57:23.352040   60243 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 16:57:23.352060   60243 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 16:57:23.352072   60243 cache.go:232] Successfully downloaded all kic artifacts
	I0918 16:57:23.352116   60243 start.go:360] acquireMachinesLock for ha-078118-m02: {Name:mk65f6a883861f2032241e1132c63effea2ab61f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 16:57:23.352223   60243 start.go:364] duration metric: took 88.663µs to acquireMachinesLock for "ha-078118-m02"
	I0918 16:57:23.352254   60243 start.go:93] Provisioning new machine with config: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:57:23.352328   60243 start.go:125] createHost starting for "m02" (driver="docker")
	I0918 16:57:23.354398   60243 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
	I0918 16:57:23.354538   60243 start.go:159] libmachine.API.Create for "ha-078118" (driver="docker")
	I0918 16:57:23.354572   60243 client.go:168] LocalClient.Create starting
	I0918 16:57:23.354639   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 16:57:23.354680   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:57:23.354700   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:57:23.354772   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 16:57:23.354801   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:57:23.354818   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:57:23.355707   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:57:23.373229   60243 network_create.go:77] Found existing network {name:ha-078118 subnet:0xc002073950 gateway:[0 0 0 0 0 0 0 0 0 0 255 255 192 168 49 1] mtu:1500}
	I0918 16:57:23.373281   60243 kic.go:121] calculated static IP "192.168.49.3" for the "ha-078118-m02" container
	I0918 16:57:23.373335   60243 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 16:57:23.392406   60243 cli_runner.go:164] Run: docker volume create ha-078118-m02 --label name.minikube.sigs.k8s.io=ha-078118-m02 --label created_by.minikube.sigs.k8s.io=true
	I0918 16:57:23.414767   60243 oci.go:103] Successfully created a docker volume ha-078118-m02
	I0918 16:57:23.414860   60243 cli_runner.go:164] Run: docker run --rm --name ha-078118-m02-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m02 --entrypoint /usr/bin/test -v ha-078118-m02:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 16:57:23.852088   60243 oci.go:107] Successfully prepared a docker volume ha-078118-m02
	I0918 16:57:23.852142   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:57:23.852165   60243 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 16:57:23.852243   60243 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m02:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 16:57:28.049263   60243 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m02:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.19696985s)
	I0918 16:57:28.049296   60243 kic.go:203] duration metric: took 4.197127441s to extract preloaded images to volume ...
	W0918 16:57:28.049399   60243 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 16:57:28.049426   60243 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 16:57:28.049461   60243 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 16:57:28.104457   60243 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ha-078118-m02 --name ha-078118-m02 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m02 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ha-078118-m02 --network ha-078118 --ip 192.168.49.3 --volume ha-078118-m02:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 16:57:28.377133   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Running}}
	I0918 16:57:28.396963   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 16:57:28.416714   60243 cli_runner.go:164] Run: docker exec ha-078118-m02 stat /var/lib/dpkg/alternatives/iptables
	I0918 16:57:28.473951   60243 oci.go:144] the created container "ha-078118-m02" has a running status.
	I0918 16:57:28.473985   60243 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa...
	I0918 16:57:29.190216   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0918 16:57:29.190259   60243 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 16:57:29.215556   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 16:57:29.233891   60243 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0918 16:57:29.233912   60243 kic_runner.go:114] Args: [docker exec --privileged ha-078118-m02 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0918 16:57:29.288122   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 16:57:29.305873   60243 machine.go:93] provisionDockerMachine start ...
	I0918 16:57:29.305960   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:29.324234   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:29.324468   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32788 <nil> <nil>}
	I0918 16:57:29.324480   60243 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 16:57:29.460587   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 16:57:29.460616   60243 ubuntu.go:182] provisioning hostname "ha-078118-m02"
	I0918 16:57:29.460684   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:29.479097   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:29.479306   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32788 <nil> <nil>}
	I0918 16:57:29.479323   60243 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m02 && echo "ha-078118-m02" | sudo tee /etc/hostname
	I0918 16:57:29.628691   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 16:57:29.628814   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:29.647616   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:29.647872   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32788 <nil> <nil>}
	I0918 16:57:29.647893   60243 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m02' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m02/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m02' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 16:57:29.784402   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 16:57:29.784431   60243 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 16:57:29.784448   60243 ubuntu.go:190] setting up certificates
	I0918 16:57:29.784457   60243 provision.go:84] configureAuth start
	I0918 16:57:29.784531   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 16:57:29.803424   60243 provision.go:143] copyHostCerts
	I0918 16:57:29.803462   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:57:29.803520   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 16:57:29.803535   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:57:29.803621   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 16:57:29.803783   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:57:29.803815   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 16:57:29.803822   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:57:29.803868   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 16:57:29.803949   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:57:29.803975   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 16:57:29.803981   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:57:29.804020   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 16:57:29.804097   60243 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m02 san=[127.0.0.1 192.168.49.3 ha-078118-m02 localhost minikube]
	I0918 16:57:29.933774   60243 provision.go:177] copyRemoteCerts
	I0918 16:57:29.933834   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 16:57:29.933864   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:29.952199   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.053380   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 16:57:30.053448   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 16:57:30.079586   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 16:57:30.079652   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 16:57:30.106162   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 16:57:30.106215   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0918 16:57:30.131599   60243 provision.go:87] duration metric: took 347.131672ms to configureAuth
	I0918 16:57:30.131623   60243 ubuntu.go:206] setting minikube options for container-runtime
	I0918 16:57:30.131803   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:30.131903   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.151255   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:30.151466   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32788 <nil> <nil>}
	I0918 16:57:30.151481   60243 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 16:57:30.393377   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 16:57:30.393406   60243 machine.go:96] duration metric: took 1.08751272s to provisionDockerMachine
	I0918 16:57:30.393419   60243 client.go:171] duration metric: took 7.038837191s to LocalClient.Create
	I0918 16:57:30.393445   60243 start.go:167] duration metric: took 7.038908487s to libmachine.API.Create "ha-078118"
	I0918 16:57:30.393465   60243 start.go:293] postStartSetup for "ha-078118-m02" (driver="docker")
	I0918 16:57:30.393489   60243 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 16:57:30.393583   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 16:57:30.393629   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.412821   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.513018   60243 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 16:57:30.516819   60243 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 16:57:30.516868   60243 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 16:57:30.516888   60243 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 16:57:30.516896   60243 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 16:57:30.516914   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 16:57:30.516990   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 16:57:30.517127   60243 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 16:57:30.517140   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 16:57:30.517261   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 16:57:30.528368   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:57:30.556419   60243 start.go:296] duration metric: took 162.941822ms for postStartSetup
	I0918 16:57:30.556822   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 16:57:30.575320   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:57:30.575623   60243 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:57:30.575666   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.593574   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.686828   60243 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 16:57:30.691487   60243 start.go:128] duration metric: took 7.339144526s to createHost
	I0918 16:57:30.691534   60243 start.go:83] releasing machines lock for "ha-078118-m02", held for 7.33929551s
	I0918 16:57:30.691607   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 16:57:30.712513   60243 out.go:179] * Found network options:
	I0918 16:57:30.713751   60243 out.go:179]   - NO_PROXY=192.168.49.2
	W0918 16:57:30.714978   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 16:57:30.715016   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 16:57:30.715086   60243 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 16:57:30.715123   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.715166   60243 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 16:57:30.715216   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.734742   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.735055   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.962897   60243 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 16:57:30.967520   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:57:30.990153   60243 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 16:57:30.990237   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:57:31.019088   60243 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0918 16:57:31.019116   60243 start.go:495] detecting cgroup driver to use...
	I0918 16:57:31.019152   60243 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 16:57:31.019210   60243 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 16:57:31.034083   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 16:57:31.047475   60243 docker.go:218] disabling cri-docker service (if available) ...
	I0918 16:57:31.047603   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 16:57:31.061869   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 16:57:31.076170   60243 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 16:57:31.145517   60243 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 16:57:31.219386   60243 docker.go:234] disabling docker service ...
	I0918 16:57:31.219457   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 16:57:31.237791   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 16:57:31.250673   60243 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 16:57:31.317780   60243 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 16:57:31.430074   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 16:57:31.441929   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 16:57:31.459420   60243 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 16:57:31.459485   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.472552   60243 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 16:57:31.472626   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.483632   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.494315   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.505031   60243 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 16:57:31.515002   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.526242   60243 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.543262   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.554050   60243 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 16:57:31.563178   60243 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 16:57:31.572111   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:31.678605   60243 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 16:57:31.775150   60243 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 16:57:31.775210   60243 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 16:57:31.778938   60243 start.go:563] Will wait 60s for crictl version
	I0918 16:57:31.778989   60243 ssh_runner.go:195] Run: which crictl
	I0918 16:57:31.782593   60243 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 16:57:31.816289   60243 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 16:57:31.816365   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:57:31.851649   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:57:31.888680   60243 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 16:57:31.890365   60243 out.go:179]   - env NO_PROXY=192.168.49.2
	I0918 16:57:31.891835   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:57:31.909279   60243 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 16:57:31.913221   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:57:31.925293   60243 mustload.go:65] Loading cluster: ha-078118
	I0918 16:57:31.925540   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:31.925802   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:31.943863   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:57:31.944113   60243 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.3
	I0918 16:57:31.944124   60243 certs.go:194] generating shared ca certs ...
	I0918 16:57:31.944136   60243 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:31.944251   60243 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 16:57:31.944295   60243 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 16:57:31.944304   60243 certs.go:256] generating profile certs ...
	I0918 16:57:31.944380   60243 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 16:57:31.944412   60243 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd
	I0918 16:57:31.944425   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.77376cdd with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.3 192.168.49.254]
	I0918 16:57:32.168102   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.77376cdd ...
	I0918 16:57:32.168133   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.77376cdd: {Name:mk632021bef8af557693dc3ec289ba5200d429d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:32.168315   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd ...
	I0918 16:57:32.168329   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd: {Name:mk6495f27d17861f263fd496e8789375ecd02b96 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:32.168403   60243 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.77376cdd -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 16:57:32.168560   60243 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 16:57:32.168697   60243 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 16:57:32.168717   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 16:57:32.168729   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 16:57:32.168744   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 16:57:32.168757   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 16:57:32.168772   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 16:57:32.168785   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 16:57:32.168797   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 16:57:32.168806   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 16:57:32.168853   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 16:57:32.168877   60243 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 16:57:32.168887   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 16:57:32.168911   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 16:57:32.168937   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 16:57:32.168963   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 16:57:32.169007   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:57:32.169032   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 16:57:32.169052   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 16:57:32.169066   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:32.169122   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:32.187428   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:32.275908   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
	I0918 16:57:32.280174   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
	I0918 16:57:32.293804   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
	I0918 16:57:32.297921   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
	I0918 16:57:32.312674   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
	I0918 16:57:32.317137   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
	I0918 16:57:32.332012   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
	I0918 16:57:32.335910   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)
	I0918 16:57:32.349818   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
	I0918 16:57:32.353706   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
	I0918 16:57:32.367328   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
	I0918 16:57:32.371320   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
	I0918 16:57:32.384442   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 16:57:32.410849   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 16:57:32.436643   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 16:57:32.463000   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 16:57:32.489057   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)
	I0918 16:57:32.515291   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0918 16:57:32.541234   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 16:57:32.566259   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 16:57:32.591152   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 16:57:32.619176   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 16:57:32.645865   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 16:57:32.672086   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
	I0918 16:57:32.691464   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
	I0918 16:57:32.711184   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
	I0918 16:57:32.730444   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)
	I0918 16:57:32.749620   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
	I0918 16:57:32.768643   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
	I0918 16:57:32.788328   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
	I0918 16:57:32.807884   60243 ssh_runner.go:195] Run: openssl version
	I0918 16:57:32.813660   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 16:57:32.823960   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 16:57:32.828123   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 16:57:32.828191   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 16:57:32.835458   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 16:57:32.846026   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 16:57:32.856631   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 16:57:32.860308   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 16:57:32.860358   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 16:57:32.866856   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 16:57:32.876690   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 16:57:32.886762   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:32.890660   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:32.890731   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:32.897540   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 16:57:32.907932   60243 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 16:57:32.911973   60243 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0918 16:57:32.912038   60243 kubeadm.go:926] updating node {m02 192.168.49.3 8443 v1.34.0 crio true true} ...
	I0918 16:57:32.912131   60243 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.3
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 16:57:32.912158   60243 kube-vip.go:115] generating kube-vip config ...
	I0918 16:57:32.912205   60243 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 16:57:32.924930   60243 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 16:57:32.924991   60243 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 16:57:32.925053   60243 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 16:57:32.934340   60243 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 16:57:32.934404   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
	I0918 16:57:32.944100   60243 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0918 16:57:32.964172   60243 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 16:57:32.986017   60243 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 16:57:33.007415   60243 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 16:57:33.011436   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:57:33.023696   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:33.094414   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:57:33.122168   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:57:33.122460   60243 start.go:317] joinCluster: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]
DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mount
Type:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:57:33.122601   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm token create --print-join-command --ttl=0"
	I0918 16:57:33.122663   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:33.143661   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:33.287975   60243 start.go:343] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:57:33.288021   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token zhmybn.ylv6f2k1dop39m4s --discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-078118-m02 --control-plane --apiserver-advertise-address=192.168.49.3 --apiserver-bind-port=8443"
	I0918 16:57:50.957307   60243 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token zhmybn.ylv6f2k1dop39m4s --discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-078118-m02 --control-plane --apiserver-advertise-address=192.168.49.3 --apiserver-bind-port=8443": (17.669258722s)
	I0918 16:57:50.957347   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"
	I0918 16:57:51.183198   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-078118-m02 minikube.k8s.io/updated_at=2025_09_18T16_57_51_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596 minikube.k8s.io/name=ha-078118 minikube.k8s.io/primary=false
	I0918 16:57:51.257842   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-078118-m02 node-role.kubernetes.io/control-plane:NoSchedule-
	I0918 16:57:51.333794   60243 start.go:319] duration metric: took 18.211330608s to joinCluster
	I0918 16:57:51.333873   60243 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:57:51.334134   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:51.335826   60243 out.go:179] * Verifying Kubernetes components...
	I0918 16:57:51.337317   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:51.433888   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:57:51.448166   60243 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	W0918 16:57:51.448229   60243 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.49.254:8443 with https://192.168.49.2:8443
	I0918 16:57:51.448458   60243 node_ready.go:35] waiting up to 6m0s for node "ha-078118-m02" to be "Ready" ...
	W0918 16:57:53.452514   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:57:55.954646   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:57:58.452847   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:00.951914   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:02.952603   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:04.952691   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:06.953510   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:09.452614   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:11.951583   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:13.952555   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:16.452462   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:18.951818   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:20.952078   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:22.952626   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:25.452581   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:27.952333   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:30.452627   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:32.452894   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	I0918 16:58:34.452216   60243 node_ready.go:49] node "ha-078118-m02" is "Ready"
	I0918 16:58:34.452242   60243 node_ready.go:38] duration metric: took 43.00375648s for node "ha-078118-m02" to be "Ready" ...
	I0918 16:58:34.452256   60243 api_server.go:52] waiting for apiserver process to appear ...
	I0918 16:58:34.452305   60243 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 16:58:34.464123   60243 api_server.go:72] duration metric: took 43.130215918s to wait for apiserver process to appear ...
	I0918 16:58:34.464146   60243 api_server.go:88] waiting for apiserver healthz status ...
	I0918 16:58:34.464162   60243 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0918 16:58:34.469944   60243 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0918 16:58:34.470928   60243 api_server.go:141] control plane version: v1.34.0
	I0918 16:58:34.470956   60243 api_server.go:131] duration metric: took 6.803903ms to wait for apiserver health ...
	I0918 16:58:34.470975   60243 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 16:58:34.475258   60243 system_pods.go:59] 17 kube-system pods found
	I0918 16:58:34.475292   60243 system_pods.go:61] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 16:58:34.475298   60243 system_pods.go:61] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 16:58:34.475301   60243 system_pods.go:61] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 16:58:34.475306   60243 system_pods.go:61] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 16:58:34.475310   60243 system_pods.go:61] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 16:58:34.475313   60243 system_pods.go:61] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 16:58:34.475318   60243 system_pods.go:61] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 16:58:34.475322   60243 system_pods.go:61] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 16:58:34.475325   60243 system_pods.go:61] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 16:58:34.475328   60243 system_pods.go:61] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 16:58:34.475332   60243 system_pods.go:61] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 16:58:34.475334   60243 system_pods.go:61] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 16:58:34.475337   60243 system_pods.go:61] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 16:58:34.475340   60243 system_pods.go:61] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 16:58:34.475343   60243 system_pods.go:61] "kube-vip-ha-078118" [9d6c9fdb-435c-43e0-b477-6ad4ac75fecf] Running
	I0918 16:58:34.475346   60243 system_pods.go:61] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 16:58:34.475349   60243 system_pods.go:61] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 16:58:34.475354   60243 system_pods.go:74] duration metric: took 4.373062ms to wait for pod list to return data ...
	I0918 16:58:34.475363   60243 default_sa.go:34] waiting for default service account to be created ...
	I0918 16:58:34.478310   60243 default_sa.go:45] found service account: "default"
	I0918 16:58:34.478331   60243 default_sa.go:55] duration metric: took 2.963019ms for default service account to be created ...
	I0918 16:58:34.478340   60243 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 16:58:34.481978   60243 system_pods.go:86] 17 kube-system pods found
	I0918 16:58:34.482005   60243 system_pods.go:89] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 16:58:34.482013   60243 system_pods.go:89] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 16:58:34.482019   60243 system_pods.go:89] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 16:58:34.482024   60243 system_pods.go:89] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 16:58:34.482029   60243 system_pods.go:89] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 16:58:34.482034   60243 system_pods.go:89] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 16:58:34.482041   60243 system_pods.go:89] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 16:58:34.482047   60243 system_pods.go:89] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 16:58:34.482055   60243 system_pods.go:89] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 16:58:34.482062   60243 system_pods.go:89] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 16:58:34.482071   60243 system_pods.go:89] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 16:58:34.482077   60243 system_pods.go:89] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 16:58:34.482086   60243 system_pods.go:89] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 16:58:34.482098   60243 system_pods.go:89] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 16:58:34.482106   60243 system_pods.go:89] "kube-vip-ha-078118" [9d6c9fdb-435c-43e0-b477-6ad4ac75fecf] Running
	I0918 16:58:34.482112   60243 system_pods.go:89] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 16:58:34.482120   60243 system_pods.go:89] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 16:58:34.482128   60243 system_pods.go:126] duration metric: took 3.781721ms to wait for k8s-apps to be running ...
	I0918 16:58:34.482140   60243 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 16:58:34.482192   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 16:58:34.503029   60243 system_svc.go:56] duration metric: took 20.8799ms WaitForService to wait for kubelet
	I0918 16:58:34.503062   60243 kubeadm.go:578] duration metric: took 43.169159629s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 16:58:34.503098   60243 node_conditions.go:102] verifying NodePressure condition ...
	I0918 16:58:34.506955   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:58:34.506981   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:58:34.506999   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:58:34.507002   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:58:34.507009   60243 node_conditions.go:105] duration metric: took 3.904235ms to run NodePressure ...
	I0918 16:58:34.507023   60243 start.go:241] waiting for startup goroutines ...
	I0918 16:58:34.507059   60243 start.go:255] writing updated cluster config ...
	I0918 16:58:34.509378   60243 out.go:203] 
	I0918 16:58:34.511211   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:58:34.511316   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:58:34.513091   60243 out.go:179] * Starting "ha-078118-m03" control-plane node in "ha-078118" cluster
	I0918 16:58:34.514457   60243 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 16:58:34.515762   60243 out.go:179] * Pulling base image v0.0.48 ...
	I0918 16:58:34.517107   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:58:34.517134   60243 cache.go:58] Caching tarball of preloaded images
	I0918 16:58:34.517177   60243 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 16:58:34.517230   60243 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 16:58:34.517241   60243 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 16:58:34.517325   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:58:34.538516   60243 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 16:58:34.538541   60243 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 16:58:34.538561   60243 cache.go:232] Successfully downloaded all kic artifacts
	I0918 16:58:34.538588   60243 start.go:360] acquireMachinesLock for ha-078118-m03: {Name:mk9d1c903c967299da898df87db82c277b1f732e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 16:58:34.538687   60243 start.go:364] duration metric: took 82.978µs to acquireMachinesLock for "ha-078118-m03"
	I0918 16:58:34.538711   60243 start.go:93] Provisioning new machine with config: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevi
rt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0
GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:58:34.538798   60243 start.go:125] createHost starting for "m03" (driver="docker")
	I0918 16:58:34.541070   60243 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
	I0918 16:58:34.541173   60243 start.go:159] libmachine.API.Create for "ha-078118" (driver="docker")
	I0918 16:58:34.541202   60243 client.go:168] LocalClient.Create starting
	I0918 16:58:34.541284   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 16:58:34.541320   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:58:34.541333   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:58:34.541387   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 16:58:34.541406   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:58:34.541417   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:58:34.541631   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:58:34.559076   60243 network_create.go:77] Found existing network {name:ha-078118 subnet:0xc00218f740 gateway:[0 0 0 0 0 0 0 0 0 0 255 255 192 168 49 1] mtu:1500}
	I0918 16:58:34.559115   60243 kic.go:121] calculated static IP "192.168.49.4" for the "ha-078118-m03" container
	I0918 16:58:34.559196   60243 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 16:58:34.577217   60243 cli_runner.go:164] Run: docker volume create ha-078118-m03 --label name.minikube.sigs.k8s.io=ha-078118-m03 --label created_by.minikube.sigs.k8s.io=true
	I0918 16:58:34.595827   60243 oci.go:103] Successfully created a docker volume ha-078118-m03
	I0918 16:58:34.595925   60243 cli_runner.go:164] Run: docker run --rm --name ha-078118-m03-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m03 --entrypoint /usr/bin/test -v ha-078118-m03:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 16:58:34.985370   60243 oci.go:107] Successfully prepared a docker volume ha-078118-m03
	I0918 16:58:34.985422   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:58:34.985448   60243 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 16:58:34.985570   60243 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m03:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 16:58:39.161109   60243 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m03:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.175489065s)
	I0918 16:58:39.161137   60243 kic.go:203] duration metric: took 4.175687859s to extract preloaded images to volume ...
	W0918 16:58:39.161212   60243 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 16:58:39.161242   60243 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 16:58:39.161279   60243 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 16:58:39.216265   60243 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ha-078118-m03 --name ha-078118-m03 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m03 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ha-078118-m03 --network ha-078118 --ip 192.168.49.4 --volume ha-078118-m03:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 16:58:39.490676   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Running}}
	I0918 16:58:39.509154   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 16:58:39.528283   60243 cli_runner.go:164] Run: docker exec ha-078118-m03 stat /var/lib/dpkg/alternatives/iptables
	I0918 16:58:39.585189   60243 oci.go:144] the created container "ha-078118-m03" has a running status.
	I0918 16:58:39.585228   60243 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa...
	I0918 16:58:39.733661   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0918 16:58:39.733704   60243 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 16:58:39.767524   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 16:58:39.791739   60243 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0918 16:58:39.791763   60243 kic_runner.go:114] Args: [docker exec --privileged ha-078118-m03 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0918 16:58:39.846675   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 16:58:39.867316   60243 machine.go:93] provisionDockerMachine start ...
	I0918 16:58:39.867429   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:39.888632   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:58:39.888885   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0918 16:58:39.888904   60243 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 16:58:40.029356   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m03
	
	I0918 16:58:40.029386   60243 ubuntu.go:182] provisioning hostname "ha-078118-m03"
	I0918 16:58:40.029443   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.049595   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:58:40.049807   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0918 16:58:40.049820   60243 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m03 && echo "ha-078118-m03" | sudo tee /etc/hostname
	I0918 16:58:40.200087   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m03
	
	I0918 16:58:40.200202   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.217994   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:58:40.218257   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0918 16:58:40.218286   60243 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m03' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m03/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m03' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 16:58:40.354076   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 16:58:40.354104   60243 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 16:58:40.354126   60243 ubuntu.go:190] setting up certificates
	I0918 16:58:40.354139   60243 provision.go:84] configureAuth start
	I0918 16:58:40.354197   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 16:58:40.373445   60243 provision.go:143] copyHostCerts
	I0918 16:58:40.373482   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:58:40.373528   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 16:58:40.373540   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:58:40.373612   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 16:58:40.373690   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:58:40.373708   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 16:58:40.373715   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:58:40.373745   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 16:58:40.373801   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:58:40.373825   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 16:58:40.373835   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:58:40.373871   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 16:58:40.373939   60243 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m03 san=[127.0.0.1 192.168.49.4 ha-078118-m03 localhost minikube]
	I0918 16:58:40.469151   60243 provision.go:177] copyRemoteCerts
	I0918 16:58:40.469228   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 16:58:40.469260   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.487441   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:40.584958   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 16:58:40.585042   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 16:58:40.612338   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 16:58:40.612405   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 16:58:40.638478   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 16:58:40.638557   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 16:58:40.664375   60243 provision.go:87] duration metric: took 310.211334ms to configureAuth
	I0918 16:58:40.664412   60243 ubuntu.go:206] setting minikube options for container-runtime
	I0918 16:58:40.664640   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:58:40.664727   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.684197   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:58:40.684440   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0918 16:58:40.684457   60243 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 16:58:40.917922   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 16:58:40.917947   60243 machine.go:96] duration metric: took 1.050610089s to provisionDockerMachine
	I0918 16:58:40.917958   60243 client.go:171] duration metric: took 6.376747043s to LocalClient.Create
	I0918 16:58:40.917977   60243 start.go:167] duration metric: took 6.376804493s to libmachine.API.Create "ha-078118"
	I0918 16:58:40.917987   60243 start.go:293] postStartSetup for "ha-078118-m03" (driver="docker")
	I0918 16:58:40.918001   60243 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 16:58:40.918071   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 16:58:40.918125   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.936966   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:41.036914   60243 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 16:58:41.040743   60243 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 16:58:41.040792   60243 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 16:58:41.040806   60243 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 16:58:41.040817   60243 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 16:58:41.040830   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 16:58:41.040889   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 16:58:41.040981   60243 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 16:58:41.040993   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 16:58:41.041109   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 16:58:41.050735   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:58:41.078178   60243 start.go:296] duration metric: took 160.175362ms for postStartSetup
	I0918 16:58:41.078562   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 16:58:41.096155   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:58:41.096446   60243 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:58:41.096487   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:41.114313   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:41.207561   60243 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 16:58:41.211752   60243 start.go:128] duration metric: took 6.672942573s to createHost
	I0918 16:58:41.211772   60243 start.go:83] releasing machines lock for "ha-078118-m03", held for 6.673074744s
	I0918 16:58:41.211824   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 16:58:41.231418   60243 out.go:179] * Found network options:
	I0918 16:58:41.233082   60243 out.go:179]   - NO_PROXY=192.168.49.2,192.168.49.3
	W0918 16:58:41.234375   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 16:58:41.234408   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 16:58:41.234439   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 16:58:41.234459   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 16:58:41.234591   60243 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 16:58:41.234624   60243 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 16:58:41.234645   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:41.234674   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:41.253204   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:41.253574   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:41.487834   60243 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 16:58:41.492986   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:58:41.516316   60243 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 16:58:41.516406   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:58:41.548254   60243 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0918 16:58:41.548282   60243 start.go:495] detecting cgroup driver to use...
	I0918 16:58:41.548320   60243 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 16:58:41.548374   60243 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 16:58:41.563666   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 16:58:41.575416   60243 docker.go:218] disabling cri-docker service (if available) ...
	I0918 16:58:41.575473   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 16:58:41.589676   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 16:58:41.604330   60243 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 16:58:41.669451   60243 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 16:58:41.744471   60243 docker.go:234] disabling docker service ...
	I0918 16:58:41.744566   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 16:58:41.762473   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 16:58:41.774931   60243 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 16:58:41.848307   60243 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 16:58:41.952604   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 16:58:41.964539   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 16:58:41.982943   60243 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 16:58:41.982998   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:41.997792   60243 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 16:58:41.997865   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.008724   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.019336   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.030192   60243 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 16:58:42.039767   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.050915   60243 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.067947   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.078882   60243 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 16:58:42.088304   60243 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 16:58:42.097143   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:58:42.205602   60243 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 16:58:42.295918   60243 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 16:58:42.295989   60243 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 16:58:42.300000   60243 start.go:563] Will wait 60s for crictl version
	I0918 16:58:42.300068   60243 ssh_runner.go:195] Run: which crictl
	I0918 16:58:42.303803   60243 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 16:58:42.338282   60243 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 16:58:42.338376   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:58:42.373030   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:58:42.410107   60243 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 16:58:42.411669   60243 out.go:179]   - env NO_PROXY=192.168.49.2
	I0918 16:58:42.413257   60243 out.go:179]   - env NO_PROXY=192.168.49.2,192.168.49.3
	I0918 16:58:42.415059   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:58:42.433045   60243 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 16:58:42.437153   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:58:42.449343   60243 mustload.go:65] Loading cluster: ha-078118
	I0918 16:58:42.449621   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:58:42.449891   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:58:42.468842   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:58:42.469136   60243 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.4
	I0918 16:58:42.469150   60243 certs.go:194] generating shared ca certs ...
	I0918 16:58:42.469170   60243 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:58:42.469308   60243 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 16:58:42.469358   60243 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 16:58:42.469373   60243 certs.go:256] generating profile certs ...
	I0918 16:58:42.469463   60243 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 16:58:42.469512   60243 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.4bf9a898
	I0918 16:58:42.469534   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.4bf9a898 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.3 192.168.49.4 192.168.49.254]
	I0918 16:58:42.495627   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.4bf9a898 ...
	I0918 16:58:42.495658   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.4bf9a898: {Name:mk68634cd7761667f3d175625830276296dacbf7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:58:42.495841   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.4bf9a898 ...
	I0918 16:58:42.495855   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.4bf9a898: {Name:mkaeb5ac6f7d0ea9f8347ea3ddec67699c073d9a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:58:42.495923   60243 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.4bf9a898 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 16:58:42.496068   60243 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.4bf9a898 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 16:58:42.496217   60243 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 16:58:42.496232   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 16:58:42.496244   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 16:58:42.496258   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 16:58:42.496271   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 16:58:42.496280   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 16:58:42.496293   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 16:58:42.496305   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 16:58:42.496317   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 16:58:42.496373   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 16:58:42.496401   60243 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 16:58:42.496411   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 16:58:42.496436   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 16:58:42.496457   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 16:58:42.496481   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 16:58:42.496534   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:58:42.496569   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:58:42.496580   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 16:58:42.496590   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 16:58:42.496636   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:58:42.515180   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:58:42.604836   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
	I0918 16:58:42.608908   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
	I0918 16:58:42.621875   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
	I0918 16:58:42.625619   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
	I0918 16:58:42.638496   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
	I0918 16:58:42.642068   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
	I0918 16:58:42.655358   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
	I0918 16:58:42.659079   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)
	I0918 16:58:42.671928   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
	I0918 16:58:42.675654   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
	I0918 16:58:42.689048   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
	I0918 16:58:42.692776   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
	I0918 16:58:42.705922   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 16:58:42.731686   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 16:58:42.757189   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 16:58:42.782344   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 16:58:42.808085   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)
	I0918 16:58:42.833677   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0918 16:58:42.860306   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 16:58:42.886762   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 16:58:42.911918   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 16:58:42.940030   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 16:58:42.965848   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 16:58:42.992346   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
	I0918 16:58:43.010924   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
	I0918 16:58:43.029944   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
	I0918 16:58:43.050253   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)
	I0918 16:58:43.069277   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
	I0918 16:58:43.089240   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
	I0918 16:58:43.108796   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
	I0918 16:58:43.127946   60243 ssh_runner.go:195] Run: openssl version
	I0918 16:58:43.134211   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 16:58:43.144901   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:58:43.148803   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:58:43.148864   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:58:43.155958   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 16:58:43.166216   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 16:58:43.176240   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 16:58:43.179779   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 16:58:43.179836   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 16:58:43.186793   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 16:58:43.196956   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 16:58:43.206631   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 16:58:43.210807   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 16:58:43.210895   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 16:58:43.219238   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 16:58:43.229939   60243 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 16:58:43.233807   60243 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0918 16:58:43.233861   60243 kubeadm.go:926] updating node {m03 192.168.49.4 8443 v1.34.0 crio true true} ...
	I0918 16:58:43.233942   60243 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.4
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 16:58:43.233965   60243 kube-vip.go:115] generating kube-vip config ...
	I0918 16:58:43.234001   60243 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 16:58:43.246584   60243 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 16:58:43.246654   60243 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 16:58:43.246708   60243 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 16:58:43.256222   60243 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 16:58:43.256294   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
	I0918 16:58:43.265642   60243 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0918 16:58:43.286766   60243 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 16:58:43.308984   60243 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 16:58:43.330666   60243 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 16:58:43.334512   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:58:43.346186   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:58:43.415160   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:58:43.438425   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:58:43.438701   60243 start.go:317] joinCluster: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]
DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false log
viewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPa
useInterval:1m0s}
	I0918 16:58:43.438806   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm token create --print-join-command --ttl=0"
	I0918 16:58:43.438859   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:58:43.458467   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:58:43.605780   60243 start.go:343] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:58:43.605839   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token izhn3y.empz64p3o3t4ob63 --discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-078118-m03 --control-plane --apiserver-advertise-address=192.168.49.4 --apiserver-bind-port=8443"
	I0918 16:58:54.699353   60243 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token izhn3y.empz64p3o3t4ob63 --discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-078118-m03 --control-plane --apiserver-advertise-address=192.168.49.4 --apiserver-bind-port=8443": (11.093493296s)
	I0918 16:58:54.699381   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"
	I0918 16:58:54.914238   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-078118-m03 minikube.k8s.io/updated_at=2025_09_18T16_58_54_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596 minikube.k8s.io/name=ha-078118 minikube.k8s.io/primary=false
	I0918 16:58:54.991429   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-078118-m03 node-role.kubernetes.io/control-plane:NoSchedule-
	I0918 16:58:55.068483   60243 start.go:319] duration metric: took 11.629778037s to joinCluster
	I0918 16:58:55.068573   60243 start.go:235] Will wait 6m0s for node &{Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:58:55.068917   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:58:55.070415   60243 out.go:179] * Verifying Kubernetes components...
	I0918 16:58:55.072098   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:58:55.171709   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:58:55.185623   60243 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	W0918 16:58:55.185688   60243 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.49.254:8443 with https://192.168.49.2:8443
	I0918 16:58:55.185879   60243 node_ready.go:35] waiting up to 6m0s for node "ha-078118-m03" to be "Ready" ...
	W0918 16:58:57.190925   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	W0918 16:58:59.689555   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	W0918 16:59:01.690108   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	W0918 16:59:04.189842   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	W0918 16:59:06.190032   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	I0918 16:59:06.690048   60243 node_ready.go:49] node "ha-078118-m03" is "Ready"
	I0918 16:59:06.690075   60243 node_ready.go:38] duration metric: took 11.50418456s for node "ha-078118-m03" to be "Ready" ...
	I0918 16:59:06.690089   60243 api_server.go:52] waiting for apiserver process to appear ...
	I0918 16:59:06.690136   60243 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 16:59:06.702758   60243 api_server.go:72] duration metric: took 11.634149066s to wait for apiserver process to appear ...
	I0918 16:59:06.702790   60243 api_server.go:88] waiting for apiserver healthz status ...
	I0918 16:59:06.702810   60243 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0918 16:59:06.707560   60243 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0918 16:59:06.708455   60243 api_server.go:141] control plane version: v1.34.0
	I0918 16:59:06.708480   60243 api_server.go:131] duration metric: took 5.681924ms to wait for apiserver health ...
	I0918 16:59:06.708491   60243 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 16:59:06.714696   60243 system_pods.go:59] 24 kube-system pods found
	I0918 16:59:06.714727   60243 system_pods.go:61] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 16:59:06.714733   60243 system_pods.go:61] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 16:59:06.714737   60243 system_pods.go:61] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 16:59:06.714740   60243 system_pods.go:61] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 16:59:06.714744   60243 system_pods.go:61] "etcd-ha-078118-m03" [ef27a91e-a220-4dcb-885c-2941742d985e] Running
	I0918 16:59:06.714747   60243 system_pods.go:61] "kindnet-f2b4b" [98c5afc6-e57e-488c-948a-e24ec24b97a7] Running
	I0918 16:59:06.714751   60243 system_pods.go:61] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 16:59:06.714756   60243 system_pods.go:61] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 16:59:06.714761   60243 system_pods.go:61] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 16:59:06.714765   60243 system_pods.go:61] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 16:59:06.714768   60243 system_pods.go:61] "kube-apiserver-ha-078118-m03" [1cc265d4-6f02-4291-b218-cfa76bcf557f] Running
	I0918 16:59:06.714772   60243 system_pods.go:61] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 16:59:06.714775   60243 system_pods.go:61] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 16:59:06.714778   60243 system_pods.go:61] "kube-controller-manager-ha-078118-m03" [43309df5-32b3-4ca8-a0a0-23bfcaac2138] Running
	I0918 16:59:06.714781   60243 system_pods.go:61] "kube-proxy-2pjrn" [490f3965-2c3c-42d8-89b3-d3d599ebf60e] Running
	I0918 16:59:06.714785   60243 system_pods.go:61] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 16:59:06.714787   60243 system_pods.go:61] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 16:59:06.714790   60243 system_pods.go:61] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 16:59:06.714794   60243 system_pods.go:61] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 16:59:06.714797   60243 system_pods.go:61] "kube-scheduler-ha-078118-m03" [93dfed73-cd97-4f3f-804e-ffdd528fd8ff] Running
	I0918 16:59:06.714802   60243 system_pods.go:61] "kube-vip-ha-078118" [9d6c9fdb-435c-43e0-b477-6ad4ac75fecf] Running
	I0918 16:59:06.714805   60243 system_pods.go:61] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 16:59:06.714809   60243 system_pods.go:61] "kube-vip-ha-078118-m03" [919fbb1f-4ca4-41e2-a8f7-6d2c73f81558] Running
	I0918 16:59:06.714813   60243 system_pods.go:61] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 16:59:06.714819   60243 system_pods.go:74] duration metric: took 6.323146ms to wait for pod list to return data ...
	I0918 16:59:06.714828   60243 default_sa.go:34] waiting for default service account to be created ...
	I0918 16:59:06.718387   60243 default_sa.go:45] found service account: "default"
	I0918 16:59:06.718417   60243 default_sa.go:55] duration metric: took 3.581681ms for default service account to be created ...
	I0918 16:59:06.718430   60243 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 16:59:06.724111   60243 system_pods.go:86] 24 kube-system pods found
	I0918 16:59:06.724142   60243 system_pods.go:89] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 16:59:06.724148   60243 system_pods.go:89] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 16:59:06.724152   60243 system_pods.go:89] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 16:59:06.724156   60243 system_pods.go:89] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 16:59:06.724159   60243 system_pods.go:89] "etcd-ha-078118-m03" [ef27a91e-a220-4dcb-885c-2941742d985e] Running
	I0918 16:59:06.724163   60243 system_pods.go:89] "kindnet-f2b4b" [98c5afc6-e57e-488c-948a-e24ec24b97a7] Running
	I0918 16:59:06.724167   60243 system_pods.go:89] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 16:59:06.724170   60243 system_pods.go:89] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 16:59:06.724175   60243 system_pods.go:89] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 16:59:06.724181   60243 system_pods.go:89] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 16:59:06.724186   60243 system_pods.go:89] "kube-apiserver-ha-078118-m03" [1cc265d4-6f02-4291-b218-cfa76bcf557f] Running
	I0918 16:59:06.724193   60243 system_pods.go:89] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 16:59:06.724199   60243 system_pods.go:89] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 16:59:06.724205   60243 system_pods.go:89] "kube-controller-manager-ha-078118-m03" [43309df5-32b3-4ca8-a0a0-23bfcaac2138] Running
	I0918 16:59:06.724211   60243 system_pods.go:89] "kube-proxy-2pjrn" [490f3965-2c3c-42d8-89b3-d3d599ebf60e] Running
	I0918 16:59:06.724220   60243 system_pods.go:89] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 16:59:06.724225   60243 system_pods.go:89] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 16:59:06.724239   60243 system_pods.go:89] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 16:59:06.724243   60243 system_pods.go:89] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 16:59:06.724246   60243 system_pods.go:89] "kube-scheduler-ha-078118-m03" [93dfed73-cd97-4f3f-804e-ffdd528fd8ff] Running
	I0918 16:59:06.724250   60243 system_pods.go:89] "kube-vip-ha-078118" [9d6c9fdb-435c-43e0-b477-6ad4ac75fecf] Running
	I0918 16:59:06.724254   60243 system_pods.go:89] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 16:59:06.724257   60243 system_pods.go:89] "kube-vip-ha-078118-m03" [919fbb1f-4ca4-41e2-a8f7-6d2c73f81558] Running
	I0918 16:59:06.724260   60243 system_pods.go:89] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 16:59:06.724267   60243 system_pods.go:126] duration metric: took 5.831309ms to wait for k8s-apps to be running ...
	I0918 16:59:06.724283   60243 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 16:59:06.724337   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 16:59:06.737206   60243 system_svc.go:56] duration metric: took 12.914941ms WaitForService to wait for kubelet
	I0918 16:59:06.737236   60243 kubeadm.go:578] duration metric: took 11.668634825s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 16:59:06.737259   60243 node_conditions.go:102] verifying NodePressure condition ...
	I0918 16:59:06.740948   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:59:06.740970   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:59:06.740982   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:59:06.740985   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:59:06.740989   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:59:06.740991   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:59:06.740995   60243 node_conditions.go:105] duration metric: took 3.731587ms to run NodePressure ...
	I0918 16:59:06.741004   60243 start.go:241] waiting for startup goroutines ...
	I0918 16:59:06.741023   60243 start.go:255] writing updated cluster config ...
	I0918 16:59:06.741314   60243 ssh_runner.go:195] Run: rm -f paused
	I0918 16:59:06.745246   60243 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
	I0918 16:59:06.745875   60243 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0918 16:59:06.755285   60243 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-g9xk6" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.761037   60243 pod_ready.go:94] pod "coredns-66bc5c9577-g9xk6" is "Ready"
	I0918 16:59:06.761068   60243 pod_ready.go:86] duration metric: took 5.756901ms for pod "coredns-66bc5c9577-g9xk6" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.761077   60243 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-q42l7" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.767008   60243 pod_ready.go:94] pod "coredns-66bc5c9577-q42l7" is "Ready"
	I0918 16:59:06.767034   60243 pod_ready.go:86] duration metric: took 5.951535ms for pod "coredns-66bc5c9577-q42l7" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.770112   60243 pod_ready.go:83] waiting for pod "etcd-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.775267   60243 pod_ready.go:94] pod "etcd-ha-078118" is "Ready"
	I0918 16:59:06.775293   60243 pod_ready.go:86] duration metric: took 5.152116ms for pod "etcd-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.775303   60243 pod_ready.go:83] waiting for pod "etcd-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.780471   60243 pod_ready.go:94] pod "etcd-ha-078118-m02" is "Ready"
	I0918 16:59:06.780496   60243 pod_ready.go:86] duration metric: took 5.187344ms for pod "etcd-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.780520   60243 pod_ready.go:83] waiting for pod "etcd-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.946978   60243 request.go:683] "Waited before sending request" delay="166.314978ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/etcd-ha-078118-m03"
	I0918 16:59:07.146449   60243 request.go:683] "Waited before sending request" delay="196.292592ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:07.149449   60243 pod_ready.go:94] pod "etcd-ha-078118-m03" is "Ready"
	I0918 16:59:07.149474   60243 pod_ready.go:86] duration metric: took 368.947616ms for pod "etcd-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:07.346915   60243 request.go:683] "Waited before sending request" delay="197.328502ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Dkube-apiserver"
	I0918 16:59:07.350725   60243 pod_ready.go:83] waiting for pod "kube-apiserver-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:07.547175   60243 request.go:683] "Waited before sending request" delay="196.345419ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-078118"
	I0918 16:59:07.746829   60243 request.go:683] "Waited before sending request" delay="196.329751ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118"
	I0918 16:59:07.749941   60243 pod_ready.go:94] pod "kube-apiserver-ha-078118" is "Ready"
	I0918 16:59:07.749966   60243 pod_ready.go:86] duration metric: took 399.217151ms for pod "kube-apiserver-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:07.749974   60243 pod_ready.go:83] waiting for pod "kube-apiserver-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:07.947401   60243 request.go:683] "Waited before sending request" delay="197.34038ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-078118-m02"
	I0918 16:59:08.147239   60243 request.go:683] "Waited before sending request" delay="196.36185ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m02"
	I0918 16:59:08.150202   60243 pod_ready.go:94] pod "kube-apiserver-ha-078118-m02" is "Ready"
	I0918 16:59:08.150227   60243 pod_ready.go:86] duration metric: took 400.248007ms for pod "kube-apiserver-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:08.150235   60243 pod_ready.go:83] waiting for pod "kube-apiserver-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:08.346585   60243 request.go:683] "Waited before sending request" delay="196.280443ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-078118-m03"
	I0918 16:59:08.547289   60243 request.go:683] "Waited before sending request" delay="197.397248ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:08.550234   60243 pod_ready.go:94] pod "kube-apiserver-ha-078118-m03" is "Ready"
	I0918 16:59:08.550261   60243 pod_ready.go:86] duration metric: took 400.020405ms for pod "kube-apiserver-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:08.746686   60243 request.go:683] "Waited before sending request" delay="196.336839ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Dkube-controller-manager"
	I0918 16:59:08.750717   60243 pod_ready.go:83] waiting for pod "kube-controller-manager-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:08.947162   60243 request.go:683] "Waited before sending request" delay="196.333247ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-078118"
	I0918 16:59:09.146966   60243 request.go:683] "Waited before sending request" delay="196.326126ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118"
	I0918 16:59:09.150067   60243 pod_ready.go:94] pod "kube-controller-manager-ha-078118" is "Ready"
	I0918 16:59:09.150092   60243 pod_ready.go:86] duration metric: took 399.351356ms for pod "kube-controller-manager-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:09.150102   60243 pod_ready.go:83] waiting for pod "kube-controller-manager-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:09.346457   60243 request.go:683] "Waited before sending request" delay="196.279389ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-078118-m02"
	I0918 16:59:09.547040   60243 request.go:683] "Waited before sending request" delay="197.354653ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m02"
	I0918 16:59:09.550374   60243 pod_ready.go:94] pod "kube-controller-manager-ha-078118-m02" is "Ready"
	I0918 16:59:09.550404   60243 pod_ready.go:86] duration metric: took 400.295786ms for pod "kube-controller-manager-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:09.550413   60243 pod_ready.go:83] waiting for pod "kube-controller-manager-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:09.746708   60243 request.go:683] "Waited before sending request" delay="196.202501ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-078118-m03"
	I0918 16:59:09.946436   60243 request.go:683] "Waited before sending request" delay="196.280211ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:09.949494   60243 pod_ready.go:94] pod "kube-controller-manager-ha-078118-m03" is "Ready"
	I0918 16:59:09.949530   60243 pod_ready.go:86] duration metric: took 399.112324ms for pod "kube-controller-manager-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.146961   60243 request.go:683] "Waited before sending request" delay="197.325522ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods?labelSelector=k8s-app%3Dkube-proxy"
	I0918 16:59:10.150701   60243 pod_ready.go:83] waiting for pod "kube-proxy-2pjrn" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.347162   60243 request.go:683] "Waited before sending request" delay="196.352062ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-proxy-2pjrn"
	I0918 16:59:10.547072   60243 request.go:683] "Waited before sending request" delay="196.358455ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:10.550523   60243 pod_ready.go:94] pod "kube-proxy-2pjrn" is "Ready"
	I0918 16:59:10.550553   60243 pod_ready.go:86] duration metric: took 399.827869ms for pod "kube-proxy-2pjrn" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.550565   60243 pod_ready.go:83] waiting for pod "kube-proxy-b98xh" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.746898   60243 request.go:683] "Waited before sending request" delay="196.251425ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-proxy-b98xh"
	I0918 16:59:10.946676   60243 request.go:683] "Waited before sending request" delay="196.176643ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118"
	I0918 16:59:10.950120   60243 pod_ready.go:94] pod "kube-proxy-b98xh" is "Ready"
	I0918 16:59:10.950149   60243 pod_ready.go:86] duration metric: took 399.577448ms for pod "kube-proxy-b98xh" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.950157   60243 pod_ready.go:83] waiting for pod "kube-proxy-t5wdg" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:11.146526   60243 request.go:683] "Waited before sending request" delay="196.259149ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-proxy-t5wdg"
	I0918 16:59:11.347110   60243 request.go:683] "Waited before sending request" delay="197.374002ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m02"
	I0918 16:59:11.350466   60243 pod_ready.go:94] pod "kube-proxy-t5wdg" is "Ready"
	I0918 16:59:11.350490   60243 pod_ready.go:86] duration metric: took 400.328216ms for pod "kube-proxy-t5wdg" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:11.546945   60243 request.go:683] "Waited before sending request" delay="196.317609ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Dkube-scheduler"
	I0918 16:59:11.550749   60243 pod_ready.go:83] waiting for pod "kube-scheduler-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:11.746977   60243 request.go:683] "Waited before sending request" delay="196.123839ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-078118"
	I0918 16:59:11.946489   60243 request.go:683] "Waited before sending request" delay="196.183652ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118"
	I0918 16:59:11.949628   60243 pod_ready.go:94] pod "kube-scheduler-ha-078118" is "Ready"
	I0918 16:59:11.949654   60243 pod_ready.go:86] duration metric: took 398.882401ms for pod "kube-scheduler-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:11.949664   60243 pod_ready.go:83] waiting for pod "kube-scheduler-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:12.147112   60243 request.go:683] "Waited before sending request" delay="197.344287ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-078118-m02"
	I0918 16:59:12.347169   60243 request.go:683] "Waited before sending request" delay="194.379019ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m02"
	I0918 16:59:12.350560   60243 pod_ready.go:94] pod "kube-scheduler-ha-078118-m02" is "Ready"
	I0918 16:59:12.350590   60243 pod_ready.go:86] duration metric: took 400.919858ms for pod "kube-scheduler-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:12.350599   60243 pod_ready.go:83] waiting for pod "kube-scheduler-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:12.547018   60243 request.go:683] "Waited before sending request" delay="196.33287ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-078118-m03"
	I0918 16:59:12.746565   60243 request.go:683] "Waited before sending request" delay="196.309682ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:12.749906   60243 pod_ready.go:94] pod "kube-scheduler-ha-078118-m03" is "Ready"
	I0918 16:59:12.749934   60243 pod_ready.go:86] duration metric: took 399.329614ms for pod "kube-scheduler-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:12.749945   60243 pod_ready.go:40] duration metric: took 6.004651446s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
	I0918 16:59:12.794689   60243 start.go:623] kubectl: 1.34.1, cluster: 1.34.0 (minor skew: 0)
	I0918 16:59:12.796689   60243 out.go:179] * Done! kubectl is now configured to use "ha-078118" cluster and "default" namespace by default
	
	
	==> CRI-O <==
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.765846307Z" level=info msg="Got pod network &{Name:coredns-66bc5c9577-q42l7 Namespace:kube-system ID:0f4c57d36fe625b73febbabe66c94a6fb7be96bd382b63dbe134a57a30fcc203 UID:c21094f1-585a-4109-b526-3a115d45f35f NetNS:/var/run/netns/ea110cd7-655f-4db5-9869-6caeb4e1e0b3 Networks:[] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.766003644Z" level=info msg="Checking pod kube-system_coredns-66bc5c9577-q42l7 for CNI network kindnet (type=ptp)"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.766404225Z" level=info msg="Checking image status: registry.k8s.io/coredns/coredns:v1.12.1" id=ef4ff467-d538-4946-933c-e5b5e907e1f3 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.766638638Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969,RepoTags:[registry.k8s.io/coredns/coredns:v1.12.1],RepoDigests:[registry.k8s.io/coredns/coredns@sha256:4f7a57135719628cf2070c5e3cbde64b013e90d4c560c5ecbf14004181f91998 registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c],Size_:76103547,Uid:nil,Username:nonroot,Spec:nil,},Info:map[string]string{},}" id=ef4ff467-d538-4946-933c-e5b5e907e1f3 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.767610373Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769256295Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/eec0c1a1e3f1faa7e681f72b6e678fe56d2fe548328908380b50105d4c4c5f9d/merged/etc/passwd: no such file or directory"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769296755Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/eec0c1a1e3f1faa7e681f72b6e678fe56d2fe548328908380b50105d4c4c5f9d/merged/etc/group: no such file or directory"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769333451Z" level=info msg="Creating container: kube-system/coredns-66bc5c9577-g9xk6/coredns" id=075f19de-1f75-4e06-b926-bfc1c8e7585c name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769428698Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769443027Z" level=info msg="Ran pod sandbox 0f4c57d36fe625b73febbabe66c94a6fb7be96bd382b63dbe134a57a30fcc203 with infra container: kube-system/coredns-66bc5c9577-q42l7/POD" id=000880e9-0203-43be-9f90-44bb795de328 name=/runtime.v1.RuntimeService/RunPodSandbox
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.770428742Z" level=info msg="Checking image status: registry.k8s.io/coredns/coredns:v1.12.1" id=95b3db0e-d1ae-4a3e-a514-6be61c509f71 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.775530535Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969,RepoTags:[registry.k8s.io/coredns/coredns:v1.12.1],RepoDigests:[registry.k8s.io/coredns/coredns@sha256:4f7a57135719628cf2070c5e3cbde64b013e90d4c560c5ecbf14004181f91998 registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c],Size_:76103547,Uid:nil,Username:nonroot,Spec:nil,},Info:map[string]string{},}" id=95b3db0e-d1ae-4a3e-a514-6be61c509f71 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.776278769Z" level=info msg="Checking image status: registry.k8s.io/coredns/coredns:v1.12.1" id=0b0dcec1-95b6-495b-9197-5f67161037dc name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.776462315Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969,RepoTags:[registry.k8s.io/coredns/coredns:v1.12.1],RepoDigests:[registry.k8s.io/coredns/coredns@sha256:4f7a57135719628cf2070c5e3cbde64b013e90d4c560c5ecbf14004181f91998 registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c],Size_:76103547,Uid:nil,Username:nonroot,Spec:nil,},Info:map[string]string{},}" id=0b0dcec1-95b6-495b-9197-5f67161037dc name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.779861607Z" level=info msg="Creating container: kube-system/coredns-66bc5c9577-q42l7/coredns" id=117c2489-b1bc-4e99-a3fa-ff10fa77c595 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.779940361Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.830159804Z" level=info msg="Created container 8adb6b34c613123531cf4233efc222dc4757692856895124a5e5db1a632a5b52: kube-system/storage-provisioner/storage-provisioner" id=5f7f2550-0b1b-47f1-b48c-5332a46450a7 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.830924779Z" level=info msg="Starting container: 8adb6b34c613123531cf4233efc222dc4757692856895124a5e5db1a632a5b52" id=52dc1dd3-f88a-484c-ab17-4d9f0b621779 name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.836679300Z" level=info msg="Created container 08391430590c253ff1b0064ee6c84e80981d5f041bc5ae9709bdf04d2b9aee8b: kube-system/coredns-66bc5c9577-g9xk6/coredns" id=075f19de-1f75-4e06-b926-bfc1c8e7585c name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.837315664Z" level=info msg="Starting container: 08391430590c253ff1b0064ee6c84e80981d5f041bc5ae9709bdf04d2b9aee8b" id=8bb023fd-89bf-411c-a6a6-6f2df8ddd77a name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.838803837Z" level=info msg="Started container" PID=2258 containerID=8adb6b34c613123531cf4233efc222dc4757692856895124a5e5db1a632a5b52 description=kube-system/storage-provisioner/storage-provisioner id=52dc1dd3-f88a-484c-ab17-4d9f0b621779 name=/runtime.v1.RuntimeService/StartContainer sandboxID=6928f50153d919aa3e3760ba1aa0739a387e79370881e9f1e54c731a0f3caea0
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.845287935Z" level=info msg="Started container" PID=2268 containerID=08391430590c253ff1b0064ee6c84e80981d5f041bc5ae9709bdf04d2b9aee8b description=kube-system/coredns-66bc5c9577-g9xk6/coredns id=8bb023fd-89bf-411c-a6a6-6f2df8ddd77a name=/runtime.v1.RuntimeService/StartContainer sandboxID=afde323910d94bea88be826de7977fce80c072eae58aba3bfd7c8d68a054031f
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.864792220Z" level=info msg="Created container aa37f0e0424d50f1f3f546dfdbacd705bc960545c699db9837bdf759142b77a6: kube-system/coredns-66bc5c9577-q42l7/coredns" id=117c2489-b1bc-4e99-a3fa-ff10fa77c595 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.865391067Z" level=info msg="Starting container: aa37f0e0424d50f1f3f546dfdbacd705bc960545c699db9837bdf759142b77a6" id=34f0c5a7-2503-4694-8c57-c675b57bdd4b name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.872859452Z" level=info msg="Started container" PID=2308 containerID=aa37f0e0424d50f1f3f546dfdbacd705bc960545c699db9837bdf759142b77a6 description=kube-system/coredns-66bc5c9577-q42l7/coredns id=34f0c5a7-2503-4694-8c57-c675b57bdd4b name=/runtime.v1.RuntimeService/StartContainer sandboxID=0f4c57d36fe625b73febbabe66c94a6fb7be96bd382b63dbe134a57a30fcc203
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                               CREATED             STATE               NAME                      ATTEMPT             POD ID              POD
	aa37f0e0424d5       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                    2 minutes ago       Running             coredns                   0                   0f4c57d36fe62       coredns-66bc5c9577-q42l7
	08391430590c2       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                    2 minutes ago       Running             coredns                   0                   afde323910d94       coredns-66bc5c9577-g9xk6
	8adb6b34c6131       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                    2 minutes ago       Running             storage-provisioner       0                   6928f50153d91       storage-provisioner
	9d8271cae4bea       df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce                                    2 minutes ago       Running             kube-proxy                0                   391ffd3ffc487       kube-proxy-b98xh
	ace9ff4888542       409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c                                    2 minutes ago       Running             kindnet-cni               0                   4f7dc3d8e273c       kindnet-vqp76
	b6c234acce33d       ghcr.io/kube-vip/kube-vip@sha256:4f256554a83a6d824ea9c5307450a2c3fd132e09c52b339326f94fefaf67155c   2 minutes ago       Running             kube-vip                  0                   23e85847e6956       kube-vip-ha-078118
	db2ea624fa9b6       46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc                                    2 minutes ago       Running             kube-scheduler            0                   b36f66256961f       kube-scheduler-ha-078118
	642183ab67e73       a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634                                    2 minutes ago       Running             kube-controller-manager   0                   36e9334424f59       kube-controller-manager-ha-078118
	585dfd4fc0ca4       90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90                                    2 minutes ago       Running             kube-apiserver            0                   237ac462ccd86       kube-apiserver-ha-078118
	e11573adbeb5b       5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115                                    2 minutes ago       Running             etcd                      0                   780b62a8fc57d       etcd-ha-078118
	
	
	==> coredns [08391430590c253ff1b0064ee6c84e80981d5f041bc5ae9709bdf04d2b9aee8b] <==
	[INFO] 10.244.2.2:48579 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000213733s
	[INFO] 10.244.2.2:38852 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000147704s
	[INFO] 10.244.2.2:49722 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000215281s
	[INFO] 10.244.2.2:50509 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000150614s
	[INFO] 10.244.2.2:36432 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000124749s
	[INFO] 10.244.1.3:48987 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 111 0.009640803s
	[INFO] 10.244.1.3:34978 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000185219s
	[INFO] 10.244.1.3:42844 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000118247s
	[INFO] 10.244.1.3:56800 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000144749s
	[INFO] 10.244.1.2:49805 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000131607s
	[INFO] 10.244.1.2:57672 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000175017s
	[INFO] 10.244.1.2:59217 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000076607s
	[INFO] 10.244.2.2:59905 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000198959s
	[INFO] 10.244.2.2:35101 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000161137s
	[INFO] 10.244.1.3:37941 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000169116s
	[INFO] 10.244.1.2:60488 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00024264s
	[INFO] 10.244.2.2:60234 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000151314s
	[INFO] 10.244.2.2:42839 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000121874s
	[INFO] 10.244.1.3:38379 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.00013483s
	[INFO] 10.244.1.3:58046 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000167227s
	[INFO] 10.244.1.3:44714 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000092544s
	[INFO] 10.244.1.3:35218 - 5 "PTR IN 1.49.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000113387s
	[INFO] 10.244.1.2:59456 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000135367s
	[INFO] 10.244.1.2:35335 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000085423s
	[INFO] 10.244.1.2:35400 - 5 "PTR IN 1.49.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000096216s
	
	
	==> coredns [aa37f0e0424d50f1f3f546dfdbacd705bc960545c699db9837bdf759142b77a6] <==
	[INFO] 10.244.1.3:44450 - 6 "PTR IN 90.167.197.15.in-addr.arpa. udp 44 false 512" NOERROR qr,rd,ra 126 0.000909376s
	[INFO] 10.244.1.2:44019 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 140 0.000135871s
	[INFO] 10.244.2.2:56869 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000130632s
	[INFO] 10.244.2.2:46287 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 111 0.012245391s
	[INFO] 10.244.2.2:35509 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 111 0.009452726s
	[INFO] 10.244.1.3:51577 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000132103s
	[INFO] 10.244.1.3:45622 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000167069s
	[INFO] 10.244.1.3:38225 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000085042s
	[INFO] 10.244.1.3:45379 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000129198s
	[INFO] 10.244.1.2:53174 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000146423s
	[INFO] 10.244.1.2:48602 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.00009464s
	[INFO] 10.244.1.2:58862 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000135263s
	[INFO] 10.244.1.2:44989 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000093968s
	[INFO] 10.244.1.2:38888 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000167556s
	[INFO] 10.244.2.2:53888 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000144401s
	[INFO] 10.244.2.2:56382 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000096741s
	[INFO] 10.244.1.3:34825 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000143164s
	[INFO] 10.244.1.3:37381 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000153037s
	[INFO] 10.244.1.3:57943 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000098689s
	[INFO] 10.244.1.2:51449 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000134731s
	[INFO] 10.244.1.2:40898 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000183095s
	[INFO] 10.244.1.2:36063 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00011511s
	[INFO] 10.244.2.2:55350 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000152924s
	[INFO] 10.244.2.2:53746 - 5 "PTR IN 1.49.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000142562s
	[INFO] 10.244.1.2:36341 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000127988s
	
	
	==> describe nodes <==
	Name:               ha-078118
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2025_09_18T16_57_20_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:57:14 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:00:02 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 16:57:34 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 16:57:34 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 16:57:34 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 16:57:34 +0000   Thu, 18 Sep 2025 16:57:34 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ha-078118
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 37066c4af2194678a9f70f4417168319
	  System UUID:                910bee46-adcd-4833-91ec-cea7d3c2588c
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (10 in total)
	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---
	  kube-system                 coredns-66bc5c9577-g9xk6             100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     2m43s
	  kube-system                 coredns-66bc5c9577-q42l7             100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     2m43s
	  kube-system                 etcd-ha-078118                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         2m47s
	  kube-system                 kindnet-vqp76                        100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      2m43s
	  kube-system                 kube-apiserver-ha-078118             250m (3%)     0 (0%)      0 (0%)           0 (0%)         2m47s
	  kube-system                 kube-controller-manager-ha-078118    200m (2%)     0 (0%)      0 (0%)           0 (0%)         2m47s
	  kube-system                 kube-proxy-b98xh                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m43s
	  kube-system                 kube-scheduler-ha-078118             100m (1%)     0 (0%)      0 (0%)           0 (0%)         2m47s
	  kube-system                 kube-vip-ha-078118                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m51s
	  kube-system                 storage-provisioner                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m43s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (11%)  100m (1%)
	  memory             290Mi (0%)  390Mi (1%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                    From             Message
	  ----    ------                   ----                   ----             -------
	  Normal  Starting                 2m43s                  kube-proxy       
	  Normal  NodeHasSufficientPID     2m54s (x8 over 2m54s)  kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  Starting                 2m54s                  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  2m54s (x8 over 2m54s)  kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m54s (x8 over 2m54s)  kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 2m47s                  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  2m47s                  kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    2m47s                  kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     2m47s                  kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           2m45s                  node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  NodeReady                2m32s                  kubelet          Node ha-078118 status is now: NodeReady
	  Normal  RegisteredNode           2m18s                  node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           74s                    node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	
	
	Name:               ha-078118-m02
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118-m02
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=false
	                    minikube.k8s.io/updated_at=2025_09_18T16_57_51_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:57:50 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118-m02
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:00:03 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 16:59:42 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 16:59:42 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 16:59:42 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 16:59:42 +0000   Thu, 18 Sep 2025 16:58:34 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.3
	  Hostname:    ha-078118-m02
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 882d2104d1f448dc91d641e38cc92424
	  System UUID:                0093212b-e7dd-4bdc-8376-480f39da7714
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.1.0/24
	PodCIDRs:                     10.244.1.0/24
	Non-terminated Pods:          (9 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     busybox-7b57f96db7-bzrv2                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         53s
	  default                     busybox-7b57f96db7-t7rzr                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         53s
	  kube-system                 etcd-ha-078118-m02                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         2m14s
	  kube-system                 kindnet-jnlbr                            100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      2m16s
	  kube-system                 kube-apiserver-ha-078118-m02             250m (3%)     0 (0%)      0 (0%)           0 (0%)         2m14s
	  kube-system                 kube-controller-manager-ha-078118-m02    200m (2%)     0 (0%)      0 (0%)           0 (0%)         2m14s
	  kube-system                 kube-proxy-t5wdg                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m16s
	  kube-system                 kube-scheduler-ha-078118-m02             100m (1%)     0 (0%)      0 (0%)           0 (0%)         2m14s
	  kube-system                 kube-vip-ha-078118-m02                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m14s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%)   100m (1%)
	  memory             150Mi (0%)  50Mi (0%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason          Age    From             Message
	  ----    ------          ----   ----             -------
	  Normal  Starting        2m12s  kube-proxy       
	  Normal  RegisteredNode  2m15s  node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode  2m13s  node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode  74s    node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	
	
	Name:               ha-078118-m03
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118-m03
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=false
	                    minikube.k8s.io/updated_at=2025_09_18T16_58_54_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:58:54 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118-m03
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:00:04 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 16:59:24 +0000   Thu, 18 Sep 2025 16:58:54 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 16:59:24 +0000   Thu, 18 Sep 2025 16:58:54 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 16:59:24 +0000   Thu, 18 Sep 2025 16:58:54 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 16:59:24 +0000   Thu, 18 Sep 2025 16:59:06 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.4
	  Hostname:    ha-078118-m03
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 1cf4ae8c7cb4403a9f1c3d032956eb17
	  System UUID:                aad5bb9a-fbfa-4299-aec8-4ade9724e58c
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.2.0/24
	PodCIDRs:                     10.244.2.0/24
	Non-terminated Pods:          (8 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     busybox-7b57f96db7-95578                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         53s
	  kube-system                 etcd-ha-078118-m03                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         71s
	  kube-system                 kindnet-f2b4b                            100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      72s
	  kube-system                 kube-apiserver-ha-078118-m03             250m (3%)     0 (0%)      0 (0%)           0 (0%)         71s
	  kube-system                 kube-controller-manager-ha-078118-m03    200m (2%)     0 (0%)      0 (0%)           0 (0%)         71s
	  kube-system                 kube-proxy-2pjrn                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         72s
	  kube-system                 kube-scheduler-ha-078118-m03             100m (1%)     0 (0%)      0 (0%)           0 (0%)         71s
	  kube-system                 kube-vip-ha-078118-m03                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         71s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%)   100m (1%)
	  memory             150Mi (0%)  50Mi (0%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason          Age   From             Message
	  ----    ------          ----  ----             -------
	  Normal  Starting        70s   kube-proxy       
	  Normal  RegisteredNode  69s   node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	  Normal  RegisteredNode  69s   node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	  Normal  RegisteredNode  68s   node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	
	
	==> dmesg <==
	[  +0.089038] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
	[  +0.028015] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
	[  +7.570818] kauditd_printk_skb: 47 callbacks suppressed
	[Sep18 16:41] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.013586] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023854] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023944] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023869] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023927] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000033] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +2.047789] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +4.031621] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000030] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +8.127251] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[Sep18 16:42] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[ +32.253146] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	
	
	==> etcd [e11573adbeb5b82db9b0ef3e45c8776e5669152b9e1194fc07eb290c619b2bf5] <==
	{"level":"warn","ts":"2025-09-18T16:58:47.196637Z","caller":"rafthttp/stream.go:420","msg":"lost TCP streaming connection with remote peer","stream-reader-type":"stream Message","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","error":"EOF"}
	{"level":"info","ts":"2025-09-18T16:58:47.208054Z","caller":"rafthttp/stream.go:248","msg":"set message encoder","from":"aec36adc501070cc","to":"4e0bda6b41205435","stream-type":"stream Message"}
	{"level":"warn","ts":"2025-09-18T16:58:47.208093Z","caller":"rafthttp/stream.go:264","msg":"closed TCP streaming connection with remote peer","stream-writer-type":"stream Message","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:47.208105Z","caller":"rafthttp/stream.go:273","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream Message","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:47.210022Z","caller":"rafthttp/stream.go:248","msg":"set message encoder","from":"aec36adc501070cc","to":"4e0bda6b41205435","stream-type":"stream MsgApp v2"}
	{"level":"warn","ts":"2025-09-18T16:58:47.210054Z","caller":"rafthttp/stream.go:264","msg":"closed TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:47.210067Z","caller":"rafthttp/stream.go:273","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:47.272389Z","caller":"rafthttp/stream.go:411","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:47.275409Z","caller":"rafthttp/stream.go:411","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream Message","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:47.603892Z","logger":"raft","caller":"v3@v3.6.0/raft.go:1981","msg":"aec36adc501070cc switched to configuration voters=(1461813452239848210 5623828713891189813 12593026477526642892)"}
	{"level":"info","ts":"2025-09-18T16:58:47.604044Z","caller":"membership/cluster.go:550","msg":"promote member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","promoted-member-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:47.604085Z","caller":"etcdserver/server.go:1752","msg":"applied a configuration change through raft","local-member-id":"aec36adc501070cc","raft-conf-change":"ConfChangeAddNode","raft-conf-change-node-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:51.324691Z","caller":"etcdserver/server.go:2246","msg":"skip compaction since there is an inflight snapshot"}
	{"level":"info","ts":"2025-09-18T16:58:54.543741Z","caller":"etcdserver/server.go:2246","msg":"skip compaction since there is an inflight snapshot"}
	{"level":"info","ts":"2025-09-18T16:59:05.386133Z","caller":"etcdserver/server.go:2246","msg":"skip compaction since there is an inflight snapshot"}
	{"level":"info","ts":"2025-09-18T16:59:13.871097Z","caller":"etcdserver/server.go:2246","msg":"skip compaction since there is an inflight snapshot"}
	{"level":"info","ts":"2025-09-18T16:59:16.560165Z","caller":"etcdserver/server.go:2246","msg":"skip compaction since there is an inflight snapshot"}
	{"level":"info","ts":"2025-09-18T16:59:17.187746Z","caller":"etcdserver/server.go:1856","msg":"sent merged snapshot","from":"aec36adc501070cc","to":"4e0bda6b41205435","bytes":1573398,"size":"1.6 MB","took":"30.017552691s"}
	{"level":"warn","ts":"2025-09-18T16:59:25.341873Z","caller":"etcdserver/raft.go:387","msg":"leader failed to send out heartbeat on time; took too long, leader is overloaded likely from slow disk","to":"4e0bda6b41205435","heartbeat-interval":"100ms","expected-duration":"200ms","exceeded-duration":"155.750963ms"}
	{"level":"warn","ts":"2025-09-18T16:59:25.341928Z","caller":"etcdserver/raft.go:387","msg":"leader failed to send out heartbeat on time; took too long, leader is overloaded likely from slow disk","to":"14496796fca4c312","heartbeat-interval":"100ms","expected-duration":"200ms","exceeded-duration":"155.814769ms"}
	{"level":"info","ts":"2025-09-18T16:59:25.342422Z","caller":"traceutil/trace.go:172","msg":"trace[706354734] linearizableReadLoop","detail":"{readStateIndex:1267; appliedIndex:1268; }","duration":"297.991952ms","start":"2025-09-18T16:59:25.044410Z","end":"2025-09-18T16:59:25.342402Z","steps":["trace[706354734] 'read index received'  (duration: 297.98539ms)","trace[706354734] 'applied index is now lower than readState.Index'  (duration: 4.701µs)"],"step_count":2}
	{"level":"warn","ts":"2025-09-18T16:59:25.342562Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"298.122579ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2025-09-18T16:59:25.342634Z","caller":"traceutil/trace.go:172","msg":"trace[1382353479] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1069; }","duration":"298.217452ms","start":"2025-09-18T16:59:25.044400Z","end":"2025-09-18T16:59:25.342617Z","steps":["trace[1382353479] 'agreement among raft nodes before linearized reading'  (duration: 298.046799ms)"],"step_count":1}
	{"level":"warn","ts":"2025-09-18T16:59:25.445389Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"100.440633ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2025-09-18T16:59:25.445467Z","caller":"traceutil/trace.go:172","msg":"trace[1927163165] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1069; }","duration":"100.536026ms","start":"2025-09-18T16:59:25.344915Z","end":"2025-09-18T16:59:25.445451Z","steps":["trace[1927163165] 'agreement among raft nodes before linearized reading'  (duration: 71.069732ms)","trace[1927163165] 'range keys from in-memory index tree'  (duration: 29.345037ms)"],"step_count":2}
	
	
	==> kernel <==
	 17:00:06 up 42 min,  0 users,  load average: 1.31, 0.73, 0.46
	Linux ha-078118 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [ace9ff48885424be2f8facd8cbf5492de4495d890b080eb415e9e2c3e73bf84a] <==
	I0918 16:59:23.957252       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 16:59:33.960335       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:59:33.960382       1 main.go:301] handling current node
	I0918 16:59:33.960405       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 16:59:33.960410       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 16:59:33.960654       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 16:59:33.960668       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 16:59:43.952681       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 16:59:43.952733       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 16:59:43.952938       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:59:43.952951       1 main.go:301] handling current node
	I0918 16:59:43.952967       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 16:59:43.952974       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 16:59:53.961167       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:59:53.961199       1 main.go:301] handling current node
	I0918 16:59:53.961220       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 16:59:53.961226       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 16:59:53.961437       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 16:59:53.961449       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 17:00:03.959597       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:00:03.959642       1 main.go:301] handling current node
	I0918 17:00:03.959663       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:00:03.959671       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:00:03.959962       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 17:00:03.959977       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	
	
	==> kube-apiserver [585dfd4fc0ca43249f7d7bbc2f741d26128a1d13b2fc082db1eafbe1df6a50ad] <==
	I0918 16:57:19.858558       1 controller.go:667] quota admission added evaluator for: daemonsets.apps
	I0918 16:57:22.699949       1 controller.go:667] quota admission added evaluator for: replicasets.apps
	I0918 16:57:22.851659       1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
	I0918 16:57:22.858581       1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
	I0918 16:57:23.049475       1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
	I0918 16:57:23.049475       1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
	I0918 16:58:18.352060       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:58:35.569702       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	E0918 16:59:18.376823       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38134: use of closed network connection
	E0918 16:59:18.542476       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38154: use of closed network connection
	E0918 16:59:18.708555       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38184: use of closed network connection
	E0918 16:59:18.891237       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38202: use of closed network connection
	E0918 16:59:19.063367       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38222: use of closed network connection
	E0918 16:59:19.219859       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38248: use of closed network connection
	E0918 16:59:19.374345       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38266: use of closed network connection
	E0918 16:59:19.528245       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38290: use of closed network connection
	E0918 16:59:19.686890       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38294: use of closed network connection
	E0918 16:59:19.960717       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38322: use of closed network connection
	E0918 16:59:20.128027       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38350: use of closed network connection
	E0918 16:59:20.286654       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38362: use of closed network connection
	E0918 16:59:20.443716       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38382: use of closed network connection
	E0918 16:59:20.608349       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38406: use of closed network connection
	E0918 16:59:20.762819       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38416: use of closed network connection
	I0918 16:59:23.504820       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:59:44.133401       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	
	
	==> kube-controller-manager [642183ab67e7396340c3ad521e32b9cc18b992cf199597510b44396413805c56] <==
	I0918 16:57:21.996127       1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
	I0918 16:57:21.996161       1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
	I0918 16:57:21.996195       1 shared_informer.go:356] "Caches are synced" controller="attach detach"
	I0918 16:57:21.996207       1 shared_informer.go:356] "Caches are synced" controller="ReplicationController"
	I0918 16:57:21.996244       1 shared_informer.go:356] "Caches are synced" controller="taint-eviction-controller"
	I0918 16:57:21.996548       1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
	I0918 16:57:21.998625       1 shared_informer.go:356] "Caches are synced" controller="TTL after finished"
	I0918 16:57:21.998653       1 shared_informer.go:356] "Caches are synced" controller="stateful set"
	I0918 16:57:21.999787       1 shared_informer.go:356] "Caches are synced" controller="node"
	I0918 16:57:21.999840       1 range_allocator.go:177] "Sending events to api server" logger="node-ipam-controller"
	I0918 16:57:21.999874       1 range_allocator.go:183] "Starting range CIDR allocator" logger="node-ipam-controller"
	I0918 16:57:21.999884       1 shared_informer.go:349] "Waiting for caches to sync" controller="cidrallocator"
	I0918 16:57:21.999891       1 shared_informer.go:356] "Caches are synced" controller="cidrallocator"
	I0918 16:57:22.003084       1 shared_informer.go:356] "Caches are synced" controller="resource quota"
	I0918 16:57:22.005449       1 shared_informer.go:356] "Caches are synced" controller="crt configmap"
	I0918 16:57:22.007795       1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="ha-078118" podCIDRs=["10.244.0.0/24"]
	I0918 16:57:22.014810       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	I0918 16:57:36.949312       1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
	I0918 16:57:50.908088       1 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-078118-m02\" does not exist"
	I0918 16:57:50.920374       1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="ha-078118-m02" podCIDRs=["10.244.1.0/24"]
	I0918 16:57:51.951916       1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-078118-m02"
	E0918 16:58:53.029464       1 certificate_controller.go:151] "Unhandled Error" err="Sync csr-ns7n2 failed with : error updating signature for csr: Operation cannot be fulfilled on certificatesigningrequests.certificates.k8s.io \"csr-ns7n2\": the object has been modified; please apply your changes to the latest version and try again" logger="UnhandledError"
	I0918 16:58:54.398116       1 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-078118-m03\" does not exist"
	I0918 16:58:54.408644       1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="ha-078118-m03" podCIDRs=["10.244.2.0/24"]
	I0918 16:58:57.035270       1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-078118-m03"
	
	
	==> kube-proxy [9d8271cae4bea6871005fa5672799aa187936aa79b11a2ceee4b632f181632d9] <==
	I0918 16:57:23.552129       1 server_linux.go:53] "Using iptables proxy"
	I0918 16:57:23.618582       1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
	I0918 16:57:23.719415       1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
	I0918 16:57:23.719477       1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.49.2"]
	E0918 16:57:23.719603       1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
	I0918 16:57:23.742365       1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0918 16:57:23.742445       1 server_linux.go:132] "Using iptables Proxier"
	I0918 16:57:23.749399       1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
	I0918 16:57:23.749845       1 server.go:527] "Version info" version="v1.34.0"
	I0918 16:57:23.749872       1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 16:57:23.751257       1 config.go:403] "Starting serviceCIDR config controller"
	I0918 16:57:23.751277       1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
	I0918 16:57:23.751307       1 config.go:200] "Starting service config controller"
	I0918 16:57:23.751312       1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
	I0918 16:57:23.751338       1 config.go:309] "Starting node config controller"
	I0918 16:57:23.751344       1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
	I0918 16:57:23.752416       1 config.go:106] "Starting endpoint slice config controller"
	I0918 16:57:23.752752       1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
	I0918 16:57:23.851721       1 shared_informer.go:356] "Caches are synced" controller="service config"
	I0918 16:57:23.851721       1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
	I0918 16:57:23.851724       1 shared_informer.go:356] "Caches are synced" controller="node config"
	I0918 16:57:23.852869       1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
	
	
	==> kube-scheduler [db2ea624fa9b69b8338be3fd1f439edd2f934d1bb03c166e93576e563be0e8fa] <==
	E0918 16:57:14.963359       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
	E0918 16:57:15.879600       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
	E0918 16:57:15.986882       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
	E0918 16:57:15.993286       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
	E0918 16:57:15.994165       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
	E0918 16:57:16.023788       1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
	E0918 16:57:16.047113       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
	E0918 16:57:16.071789       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
	E0918 16:57:16.077882       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
	E0918 16:57:16.154294       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
	E0918 16:57:16.219883       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
	E0918 16:57:16.270378       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
	E0918 16:57:16.276428       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
	I0918 16:57:18.258571       1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	E0918 16:57:50.963316       1 framework.go:1400] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-gbrxz\": pod kindnet-gbrxz is already assigned to node \"ha-078118-m02\"" plugin="DefaultBinder" pod="kube-system/kindnet-gbrxz" node="ha-078118-m02"
	E0918 16:57:50.963458       1 schedule_one.go:1079] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-gbrxz\": pod kindnet-gbrxz is already assigned to node \"ha-078118-m02\"" logger="UnhandledError" pod="kube-system/kindnet-gbrxz"
	E0918 16:58:54.440393       1 framework.go:1400] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-tghfn\": pod kindnet-tghfn is already assigned to node \"ha-078118-m03\"" plugin="DefaultBinder" pod="kube-system/kindnet-tghfn" node="ha-078118-m03"
	E0918 16:58:54.440466       1 schedule_one.go:379] "scheduler cache ForgetPod failed" err="pod 22e6ba4d-8bbb-45e6-8e87-9527b52452e1(kube-system/kindnet-tghfn) wasn't assumed so cannot be forgotten" logger="UnhandledError" pod="kube-system/kindnet-tghfn"
	E0918 16:58:54.440493       1 schedule_one.go:1079] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-tghfn\": pod kindnet-tghfn is already assigned to node \"ha-078118-m03\"" logger="UnhandledError" pod="kube-system/kindnet-tghfn"
	I0918 16:58:54.441957       1 schedule_one.go:1092] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-tghfn" node="ha-078118-m03"
	I0918 16:59:13.788974       1 cache.go:512] "Pod was added to a different node than it was assumed" podKey="38c4aa96-8e5c-4bc7-a350-64f32c7e0774" pod="default/busybox-7b57f96db7-bzrv2" assumedNode="ha-078118-m02" currentNode="ha-078118"
	E0918 16:59:13.789425       1 framework.go:1400] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-7b57f96db7-bzrv2\": pod busybox-7b57f96db7-bzrv2 is already assigned to node \"ha-078118-m02\"" plugin="DefaultBinder" pod="default/busybox-7b57f96db7-bzrv2" node="ha-078118"
	E0918 16:59:13.789639       1 schedule_one.go:379] "scheduler cache ForgetPod failed" err="pod 38c4aa96-8e5c-4bc7-a350-64f32c7e0774(default/busybox-7b57f96db7-bzrv2) was assumed on ha-078118 but assigned to ha-078118-m02" logger="UnhandledError" pod="default/busybox-7b57f96db7-bzrv2"
	E0918 16:59:13.789660       1 schedule_one.go:1079] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-7b57f96db7-bzrv2\": pod busybox-7b57f96db7-bzrv2 is already assigned to node \"ha-078118-m02\"" logger="UnhandledError" pod="default/busybox-7b57f96db7-bzrv2"
	I0918 16:59:13.790820       1 schedule_one.go:1092] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-7b57f96db7-bzrv2" node="ha-078118-m02"
	
	
	==> kubelet <==
	Sep 18 16:58:59 ha-078118 kubelet[1671]: E0918 16:58:59.678847    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214739678612986  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:09 ha-078118 kubelet[1671]: E0918 16:59:09.680329    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214749680097499  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:09 ha-078118 kubelet[1671]: E0918 16:59:09.680382    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214749680097499  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:13 ha-078118 kubelet[1671]: E0918 16:59:13.843774    1671 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-nssns], unattached volumes=[], failed to process volumes=[kube-api-access-nssns]: context canceled" pod="default/busybox-7b57f96db7-6lbn8" podUID="bc6485bb-dcea-454a-81bb-b9d71c73f2f5"
	Sep 18 16:59:13 ha-078118 kubelet[1671]: E0918 16:59:13.847406    1671 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5jljj], unattached volumes=[], failed to process volumes=[kube-api-access-5jljj]: context canceled" pod="default/busybox-7b57f96db7-bm55m" podUID="13d73e93-6fa6-4541-85bc-f9a8fbaed905"
	Sep 18 16:59:13 ha-078118 kubelet[1671]: I0918 16:59:13.946870    1671 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jljj\" (UniqueName: \"kubernetes.io/projected/13d73e93-6fa6-4541-85bc-f9a8fbaed905-kube-api-access-5jljj\") pod \"busybox-7b57f96db7-bm55m\" (UID: \"13d73e93-6fa6-4541-85bc-f9a8fbaed905\") " pod="default/busybox-7b57f96db7-bm55m"
	Sep 18 16:59:13 ha-078118 kubelet[1671]: I0918 16:59:13.947034    1671 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nssns\" (UniqueName: \"kubernetes.io/projected/bc6485bb-dcea-454a-81bb-b9d71c73f2f5-kube-api-access-nssns\") pod \"busybox-7b57f96db7-6lbn8\" (UID: \"bc6485bb-dcea-454a-81bb-b9d71c73f2f5\") " pod="default/busybox-7b57f96db7-6lbn8"
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.147735    1671 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jljj\" (UniqueName: \"kubernetes.io/projected/13d73e93-6fa6-4541-85bc-f9a8fbaed905-kube-api-access-5jljj\") pod \"13d73e93-6fa6-4541-85bc-f9a8fbaed905\" (UID: \"13d73e93-6fa6-4541-85bc-f9a8fbaed905\") "
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.147786    1671 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nssns\" (UniqueName: \"kubernetes.io/projected/bc6485bb-dcea-454a-81bb-b9d71c73f2f5-kube-api-access-nssns\") pod \"bc6485bb-dcea-454a-81bb-b9d71c73f2f5\" (UID: \"bc6485bb-dcea-454a-81bb-b9d71c73f2f5\") "
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.149862    1671 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13d73e93-6fa6-4541-85bc-f9a8fbaed905-kube-api-access-5jljj" (OuterVolumeSpecName: "kube-api-access-5jljj") pod "13d73e93-6fa6-4541-85bc-f9a8fbaed905" (UID: "13d73e93-6fa6-4541-85bc-f9a8fbaed905"). InnerVolumeSpecName "kube-api-access-5jljj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.150028    1671 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc6485bb-dcea-454a-81bb-b9d71c73f2f5-kube-api-access-nssns" (OuterVolumeSpecName: "kube-api-access-nssns") pod "bc6485bb-dcea-454a-81bb-b9d71c73f2f5" (UID: "bc6485bb-dcea-454a-81bb-b9d71c73f2f5"). InnerVolumeSpecName "kube-api-access-nssns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.248480    1671 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jljj\" (UniqueName: \"kubernetes.io/projected/13d73e93-6fa6-4541-85bc-f9a8fbaed905-kube-api-access-5jljj\") on node \"ha-078118\" DevicePath \"\""
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.248556    1671 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nssns\" (UniqueName: \"kubernetes.io/projected/bc6485bb-dcea-454a-81bb-b9d71c73f2f5-kube-api-access-nssns\") on node \"ha-078118\" DevicePath \"\""
	Sep 18 16:59:15 ha-078118 kubelet[1671]: I0918 16:59:15.660472    1671 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13d73e93-6fa6-4541-85bc-f9a8fbaed905" path="/var/lib/kubelet/pods/13d73e93-6fa6-4541-85bc-f9a8fbaed905/volumes"
	Sep 18 16:59:15 ha-078118 kubelet[1671]: I0918 16:59:15.660724    1671 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc6485bb-dcea-454a-81bb-b9d71c73f2f5" path="/var/lib/kubelet/pods/bc6485bb-dcea-454a-81bb-b9d71c73f2f5/volumes"
	Sep 18 16:59:19 ha-078118 kubelet[1671]: E0918 16:59:19.682422    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214759682138930  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:19 ha-078118 kubelet[1671]: E0918 16:59:19.682458    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214759682138930  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:29 ha-078118 kubelet[1671]: E0918 16:59:29.683746    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214769683420730  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:29 ha-078118 kubelet[1671]: E0918 16:59:29.683784    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214769683420730  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:39 ha-078118 kubelet[1671]: E0918 16:59:39.685040    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214779684726563  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:39 ha-078118 kubelet[1671]: E0918 16:59:39.685111    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214779684726563  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:49 ha-078118 kubelet[1671]: E0918 16:59:49.686597    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214789686357189  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:49 ha-078118 kubelet[1671]: E0918 16:59:49.686637    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214789686357189  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:59 ha-078118 kubelet[1671]: E0918 16:59:59.687988    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214799687737931  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:59 ha-078118 kubelet[1671]: E0918 16:59:59.688025    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214799687737931  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	

                                                
                                                
-- /stdout --
helpers_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-078118 -n ha-078118
helpers_test.go:269: (dbg) Run:  kubectl --context ha-078118 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestMultiControlPlane/serial/CopyFile FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestMultiControlPlane/serial/CopyFile (15.46s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopSecondaryNode (15.15s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopSecondaryNode
ha_test.go:365: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 node stop m02 --alsologtostderr -v 5
ha_test.go:365: (dbg) Done: out/minikube-linux-amd64 -p ha-078118 node stop m02 --alsologtostderr -v 5: (12.638687893s)
ha_test.go:371: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5
ha_test.go:371: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5: exit status 7 (527.762026ms)

                                                
                                                
-- stdout --
	ha-078118
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-078118-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:00:20.353400   80486 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:00:20.353688   80486 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:00:20.353698   80486 out.go:374] Setting ErrFile to fd 2...
	I0918 17:00:20.353703   80486 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:00:20.353920   80486 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:00:20.354139   80486 out.go:368] Setting JSON to false
	I0918 17:00:20.354172   80486 mustload.go:65] Loading cluster: ha-078118
	I0918 17:00:20.354328   80486 notify.go:220] Checking for updates...
	I0918 17:00:20.354629   80486 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:00:20.354648   80486 status.go:174] checking status of ha-078118 ...
	I0918 17:00:20.355117   80486 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:00:20.375056   80486 status.go:371] ha-078118 host status = "Running" (err=<nil>)
	I0918 17:00:20.375084   80486 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:00:20.375365   80486 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:00:20.394101   80486 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:00:20.394388   80486 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:20.394425   80486 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:00:20.414423   80486 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:00:20.507827   80486 ssh_runner.go:195] Run: systemctl --version
	I0918 17:00:20.512197   80486 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:20.524976   80486 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:00:20.578562   80486 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:2 ContainersPaused:0 ContainersStopped:2 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:51 OomKillDisable:false NGoroutines:65 SystemTime:2025-09-18 17:00:20.568532382 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:00:20.579042   80486 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:20.579069   80486 api_server.go:166] Checking apiserver status ...
	I0918 17:00:20.579117   80486 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:20.590840   80486 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup
	W0918 17:00:20.601004   80486 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:20.601058   80486 ssh_runner.go:195] Run: ls
	I0918 17:00:20.604848   80486 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:20.609210   80486 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:20.609232   80486 status.go:463] ha-078118 apiserver status = Running (err=<nil>)
	I0918 17:00:20.609240   80486 status.go:176] ha-078118 status: &{Name:ha-078118 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:20.609279   80486 status.go:174] checking status of ha-078118-m02 ...
	I0918 17:00:20.609531   80486 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:00:20.627437   80486 status.go:371] ha-078118-m02 host status = "Stopped" (err=<nil>)
	I0918 17:00:20.627460   80486 status.go:384] host is not running, skipping remaining checks
	I0918 17:00:20.627468   80486 status.go:176] ha-078118-m02 status: &{Name:ha-078118-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:20.627491   80486 status.go:174] checking status of ha-078118-m03 ...
	I0918 17:00:20.627745   80486 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:00:20.645878   80486 status.go:371] ha-078118-m03 host status = "Running" (err=<nil>)
	I0918 17:00:20.645901   80486 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:00:20.646160   80486 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:00:20.663900   80486 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:00:20.664233   80486 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:20.664277   80486 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:00:20.682457   80486 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:00:20.774769   80486 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:20.786585   80486 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:20.786610   80486 api_server.go:166] Checking apiserver status ...
	I0918 17:00:20.786642   80486 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:20.797459   80486 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup
	W0918 17:00:20.807580   80486 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:20.807637   80486 ssh_runner.go:195] Run: ls
	I0918 17:00:20.811322   80486 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:20.815541   80486 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:20.815562   80486 status.go:463] ha-078118-m03 apiserver status = Running (err=<nil>)
	I0918 17:00:20.815570   80486 status.go:176] ha-078118-m03 status: &{Name:ha-078118-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:20.815585   80486 status.go:174] checking status of ha-078118-m04 ...
	I0918 17:00:20.815811   80486 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:00:20.833937   80486 status.go:371] ha-078118-m04 host status = "Stopped" (err=<nil>)
	I0918 17:00:20.833963   80486 status.go:384] host is not running, skipping remaining checks
	I0918 17:00:20.833971   80486 status.go:176] ha-078118-m04 status: &{Name:ha-078118-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:380: status says not three hosts are running: args "out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5": ha-078118
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured

                                                
                                                
ha-078118-m02
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha-078118-m03
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured

                                                
                                                
ha-078118-m04
type: Worker
host: Stopped
kubelet: Stopped

                                                
                                                
ha_test.go:383: status says not three kubelets are running: args "out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5": ha-078118
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured

                                                
                                                
ha-078118-m02
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha-078118-m03
type: Control Plane
host: Running
kubelet: Running
apiserver: Running
kubeconfig: Configured

                                                
                                                
ha-078118-m04
type: Worker
host: Stopped
kubelet: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======>  post-mortem[TestMultiControlPlane/serial/StopSecondaryNode]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======>  post-mortem[TestMultiControlPlane/serial/StopSecondaryNode]: docker inspect <======
helpers_test.go:239: (dbg) Run:  docker inspect ha-078118
helpers_test.go:243: (dbg) docker inspect ha-078118:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7",
	        "Created": "2025-09-18T16:57:02.681891976Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 60804,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2025-09-18T16:57:02.720947584Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:c6b5532e987b5b4f5fc9cb0336e378ed49c0542bad8cbfc564b71e977a6269de",
	        "ResolvConfPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/hostname",
	        "HostsPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/hosts",
	        "LogPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7-json.log",
	        "Name": "/ha-078118",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ha-078118:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "ha-078118",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "private",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 3221225472,
	            "NanoCpus": 0,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 6442450944,
	            "MemorySwappiness": null,
	            "OomKillDisable": null,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "ID": "0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7",
	                "LowerDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91-init/diff:/var/lib/docker/overlay2/1fd2bbb67ab9e5bb8d4549665a1a228eadda56df39fee53908cd735ea16a4e10/diff",
	                "MergedDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/merged",
	                "UpperDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/diff",
	                "WorkDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "ha-078118",
	                "Source": "/var/lib/docker/volumes/ha-078118/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "ha-078118",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ha-078118",
	                "name.minikube.sigs.k8s.io": "ha-078118",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "46c241f4f759650d3d72325bd2e71329577f7cf9aeedeb6d33ceecff2db46b27",
	            "SandboxKey": "/var/run/docker/netns/46c241f4f759",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32783"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32784"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32787"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32785"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32786"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ha-078118": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "7a:b0:8a:ae:56:9b",
	                    "DriverOpts": null,
	                    "GwPriority": 0,
	                    "NetworkID": "0aa191750de6e44eaf49073a9e05a52994c63ccafcb0870d32aaf105d93cb724",
	                    "EndpointID": "4a33baf269d5fab1a605edfe7de39d655fdf3c152c658d8c6eca8c3ca23635ea",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "ha-078118",
	                        "0cb187fb2895"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-078118 -n ha-078118
helpers_test.go:252: <<< TestMultiControlPlane/serial/StopSecondaryNode FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======>  post-mortem[TestMultiControlPlane/serial/StopSecondaryNode]: minikube logs <======
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p ha-078118 logs -n 25: (1.161541523s)
helpers_test.go:260: TestMultiControlPlane/serial/StopSecondaryNode logs: 
-- stdout --
	
	==> Audit <==
	┌─────────┬──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬───────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
	│ COMMAND │                                                                 ARGS                                                                 │  PROFILE  │  USER   │ VERSION │     START TIME      │      END TIME       │
	├─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼───────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
	│ cp      │ ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1931775572/001/cp-test_ha-078118-m03.txt │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ cp      │ ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118:/home/docker/cp-test_ha-078118-m03_ha-078118.txt                       │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118 sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118.txt                                                 │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ cp      │ ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118-m02:/home/docker/cp-test_ha-078118-m03_ha-078118-m02.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m02 sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m02.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ cp      │ ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118-m04:/home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp testdata/cp-test.txt ha-078118-m04:/home/docker/cp-test.txt                                                             │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1931775572/001/cp-test_ha-078118-m04.txt │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118:/home/docker/cp-test_ha-078118-m04_ha-078118.txt                       │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118.txt                                                 │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m02:/home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m02 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m03:/home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ node    │ ha-078118 node stop m02 --alsologtostderr -v 5                                                                                       │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	└─────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴───────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
	
	
	==> Last Start <==
	Log file created at: 2025/09/18 16:56:57
	Running on machine: ubuntu-20-agent-4
	Binary: Built with gc go1.24.6 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0918 16:56:57.574799   60243 out.go:360] Setting OutFile to fd 1 ...
	I0918 16:56:57.575055   60243 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:56:57.575064   60243 out.go:374] Setting ErrFile to fd 2...
	I0918 16:56:57.575068   60243 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:56:57.575239   60243 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 16:56:57.575752   60243 out.go:368] Setting JSON to false
	I0918 16:56:57.576663   60243 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":2369,"bootTime":1758212249,"procs":182,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 16:56:57.576763   60243 start.go:140] virtualization: kvm guest
	I0918 16:56:57.579065   60243 out.go:179] * [ha-078118] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 16:56:57.580589   60243 notify.go:220] Checking for updates...
	I0918 16:56:57.580637   60243 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 16:56:57.582251   60243 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 16:56:57.583930   60243 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 16:56:57.585344   60243 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 16:56:57.586681   60243 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 16:56:57.588118   60243 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 16:56:57.589868   60243 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 16:56:57.616949   60243 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 16:56:57.617226   60243 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:56:57.672926   60243 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 16:56:57.662881749 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:56:57.673067   60243 docker.go:318] overlay module found
	I0918 16:56:57.674951   60243 out.go:179] * Using the docker driver based on user configuration
	I0918 16:56:57.676488   60243 start.go:304] selected driver: docker
	I0918 16:56:57.676533   60243 start.go:924] validating driver "docker" against <nil>
	I0918 16:56:57.676551   60243 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 16:56:57.677232   60243 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:56:57.735443   60243 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 16:56:57.725396122 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:56:57.735617   60243 start_flags.go:327] no existing cluster config was found, will generate one from the flags 
	I0918 16:56:57.735836   60243 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 16:56:57.737842   60243 out.go:179] * Using Docker driver with root privileges
	I0918 16:56:57.739170   60243 cni.go:84] Creating CNI manager for ""
	I0918 16:56:57.739238   60243 cni.go:136] multinode detected (0 nodes found), recommending kindnet
	I0918 16:56:57.739249   60243 start_flags.go:336] Found "CNI" CNI - setting NetworkPlugin=cni
	I0918 16:56:57.739334   60243 start.go:348] cluster config:
	{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:c
ni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:56:57.740825   60243 out.go:179] * Starting "ha-078118" primary control-plane node in "ha-078118" cluster
	I0918 16:56:57.742276   60243 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 16:56:57.743877   60243 out.go:179] * Pulling base image v0.0.48 ...
	I0918 16:56:57.745428   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:56:57.745480   60243 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
	I0918 16:56:57.745487   60243 cache.go:58] Caching tarball of preloaded images
	I0918 16:56:57.745560   60243 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 16:56:57.745653   60243 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 16:56:57.745669   60243 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 16:56:57.745990   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:56:57.746019   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json: {Name:mke5d1dac7b5b198fe436d519c900523bef38bac Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:56:57.768293   60243 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 16:56:57.768319   60243 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 16:56:57.768342   60243 cache.go:232] Successfully downloaded all kic artifacts
	I0918 16:56:57.768380   60243 start.go:360] acquireMachinesLock for ha-078118: {Name:mk24a1b2c9ed1c42e9ffd635727b36c75401a437 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 16:56:57.768479   60243 start.go:364] duration metric: took 78.905µs to acquireMachinesLock for "ha-078118"
	I0918 16:56:57.768533   60243 start.go:93] Provisioning new machine with config: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APISer
verIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMne
tPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:56:57.768610   60243 start.go:125] createHost starting for "" (driver="docker")
	I0918 16:56:57.770671   60243 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
	I0918 16:56:57.770887   60243 start.go:159] libmachine.API.Create for "ha-078118" (driver="docker")
	I0918 16:56:57.770915   60243 client.go:168] LocalClient.Create starting
	I0918 16:56:57.771017   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 16:56:57.771052   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:56:57.771063   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:56:57.771109   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 16:56:57.771128   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:56:57.771139   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:56:57.771472   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0918 16:56:57.788966   60243 cli_runner.go:211] docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0918 16:56:57.789055   60243 network_create.go:284] running [docker network inspect ha-078118] to gather additional debugging logs...
	I0918 16:56:57.789082   60243 cli_runner.go:164] Run: docker network inspect ha-078118
	W0918 16:56:57.806227   60243 cli_runner.go:211] docker network inspect ha-078118 returned with exit code 1
	I0918 16:56:57.806257   60243 network_create.go:287] error running [docker network inspect ha-078118]: docker network inspect ha-078118: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network ha-078118 not found
	I0918 16:56:57.806269   60243 network_create.go:289] output of [docker network inspect ha-078118]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network ha-078118 not found
	
	** /stderr **
	I0918 16:56:57.806367   60243 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:56:57.825048   60243 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000b6fd40}
	I0918 16:56:57.825108   60243 network_create.go:124] attempt to create docker network ha-078118 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0918 16:56:57.825168   60243 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=ha-078118 ha-078118
	I0918 16:56:57.883807   60243 network_create.go:108] docker network ha-078118 192.168.49.0/24 created
	I0918 16:56:57.883839   60243 kic.go:121] calculated static IP "192.168.49.2" for the "ha-078118" container
	I0918 16:56:57.883907   60243 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 16:56:57.901150   60243 cli_runner.go:164] Run: docker volume create ha-078118 --label name.minikube.sigs.k8s.io=ha-078118 --label created_by.minikube.sigs.k8s.io=true
	I0918 16:56:57.920292   60243 oci.go:103] Successfully created a docker volume ha-078118
	I0918 16:56:57.920371   60243 cli_runner.go:164] Run: docker run --rm --name ha-078118-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118 --entrypoint /usr/bin/test -v ha-078118:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 16:56:58.331429   60243 oci.go:107] Successfully prepared a docker volume ha-078118
	I0918 16:56:58.331493   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:56:58.331538   60243 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 16:56:58.331609   60243 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 16:57:02.609752   60243 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.278086372s)
	I0918 16:57:02.609786   60243 kic.go:203] duration metric: took 4.278244507s to extract preloaded images to volume ...
	W0918 16:57:02.609879   60243 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 16:57:02.609928   60243 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 16:57:02.609985   60243 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 16:57:02.664799   60243 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ha-078118 --name ha-078118 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ha-078118 --network ha-078118 --ip 192.168.49.2 --volume ha-078118:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 16:57:02.939918   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Running}}
	I0918 16:57:02.960880   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:02.979302   60243 cli_runner.go:164] Run: docker exec ha-078118 stat /var/lib/dpkg/alternatives/iptables
	I0918 16:57:03.031279   60243 oci.go:144] the created container "ha-078118" has a running status.
	I0918 16:57:03.031320   60243 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa...
	I0918 16:57:03.339176   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0918 16:57:03.339260   60243 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 16:57:03.367335   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:03.386757   60243 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0918 16:57:03.386779   60243 kic_runner.go:114] Args: [docker exec --privileged ha-078118 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0918 16:57:03.436474   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:03.454883   60243 machine.go:93] provisionDockerMachine start ...
	I0918 16:57:03.454973   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:03.473294   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:03.473657   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32783 <nil> <nil>}
	I0918 16:57:03.473681   60243 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 16:57:03.614090   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 16:57:03.614134   60243 ubuntu.go:182] provisioning hostname "ha-078118"
	I0918 16:57:03.614194   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:03.632632   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:03.632839   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32783 <nil> <nil>}
	I0918 16:57:03.632853   60243 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118 && echo "ha-078118" | sudo tee /etc/hostname
	I0918 16:57:03.782762   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 16:57:03.782829   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:03.801381   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:03.801652   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32783 <nil> <nil>}
	I0918 16:57:03.801672   60243 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 16:57:03.939426   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 16:57:03.939465   60243 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 16:57:03.939512   60243 ubuntu.go:190] setting up certificates
	I0918 16:57:03.939523   60243 provision.go:84] configureAuth start
	I0918 16:57:03.939572   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 16:57:03.957335   60243 provision.go:143] copyHostCerts
	I0918 16:57:03.957375   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:57:03.957408   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 16:57:03.957416   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:57:03.957515   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 16:57:03.957636   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:57:03.957667   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 16:57:03.957676   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:57:03.957723   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 16:57:03.957805   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:57:03.957831   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 16:57:03.957840   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:57:03.957878   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 16:57:03.957967   60243 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118 san=[127.0.0.1 192.168.49.2 ha-078118 localhost minikube]
	I0918 16:57:04.446406   60243 provision.go:177] copyRemoteCerts
	I0918 16:57:04.446467   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 16:57:04.446516   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:04.464707   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:04.562243   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 16:57:04.562316   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 16:57:04.588874   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 16:57:04.588947   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)
	I0918 16:57:04.614556   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 16:57:04.614618   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0918 16:57:04.639365   60243 provision.go:87] duration metric: took 699.826763ms to configureAuth
	I0918 16:57:04.639398   60243 ubuntu.go:206] setting minikube options for container-runtime
	I0918 16:57:04.639604   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:04.639701   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:04.656946   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:04.657177   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32783 <nil> <nil>}
	I0918 16:57:04.657195   60243 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 16:57:04.894695   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 16:57:04.894721   60243 machine.go:96] duration metric: took 1.439819388s to provisionDockerMachine
	I0918 16:57:04.894730   60243 client.go:171] duration metric: took 7.123809117s to LocalClient.Create
	I0918 16:57:04.894745   60243 start.go:167] duration metric: took 7.123860389s to libmachine.API.Create "ha-078118"
	I0918 16:57:04.894752   60243 start.go:293] postStartSetup for "ha-078118" (driver="docker")
	I0918 16:57:04.894761   60243 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 16:57:04.894810   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 16:57:04.894846   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:04.912730   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:05.012590   60243 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 16:57:05.016311   60243 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 16:57:05.016343   60243 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 16:57:05.016356   60243 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 16:57:05.016365   60243 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 16:57:05.016390   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 16:57:05.016463   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 16:57:05.016587   60243 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 16:57:05.016603   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 16:57:05.016747   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 16:57:05.026453   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:57:05.054679   60243 start.go:296] duration metric: took 159.911183ms for postStartSetup
	I0918 16:57:05.055125   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 16:57:05.073363   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:57:05.073657   60243 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:57:05.073698   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:05.091184   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:05.183583   60243 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 16:57:05.187892   60243 start.go:128] duration metric: took 7.419268686s to createHost
	I0918 16:57:05.187925   60243 start.go:83] releasing machines lock for "ha-078118", held for 7.419435528s
	I0918 16:57:05.187997   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 16:57:05.206007   60243 ssh_runner.go:195] Run: cat /version.json
	I0918 16:57:05.206061   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:05.206078   60243 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 16:57:05.206128   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:05.226344   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:05.226582   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:05.390376   60243 ssh_runner.go:195] Run: systemctl --version
	I0918 16:57:05.395210   60243 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 16:57:05.535393   60243 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 16:57:05.540215   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:57:05.563699   60243 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 16:57:05.563777   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:57:05.593610   60243 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0918 16:57:05.593635   60243 start.go:495] detecting cgroup driver to use...
	I0918 16:57:05.593682   60243 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 16:57:05.593755   60243 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 16:57:05.609690   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 16:57:05.621084   60243 docker.go:218] disabling cri-docker service (if available) ...
	I0918 16:57:05.621139   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 16:57:05.634236   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 16:57:05.649602   60243 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 16:57:05.717704   60243 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 16:57:05.791536   60243 docker.go:234] disabling docker service ...
	I0918 16:57:05.791597   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 16:57:05.809456   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 16:57:05.821093   60243 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 16:57:05.891934   60243 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 16:57:05.996308   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 16:57:06.008290   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 16:57:06.025752   60243 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 16:57:06.025802   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.039023   60243 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 16:57:06.039085   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.049537   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.059941   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.070049   60243 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 16:57:06.079646   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.089835   60243 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.106740   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.116937   60243 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 16:57:06.125702   60243 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 16:57:06.136246   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:06.241697   60243 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 16:57:06.338653   60243 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 16:57:06.338718   60243 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 16:57:06.342873   60243 start.go:563] Will wait 60s for crictl version
	I0918 16:57:06.342929   60243 ssh_runner.go:195] Run: which crictl
	I0918 16:57:06.346790   60243 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 16:57:06.382517   60243 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 16:57:06.382605   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:57:06.419798   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:57:06.456221   60243 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 16:57:06.457601   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:57:06.475395   60243 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 16:57:06.479436   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:57:06.491469   60243 kubeadm.go:875] updating cluster {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIP
s:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: Soc
ketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0918 16:57:06.491586   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:57:06.491632   60243 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 16:57:06.560467   60243 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 16:57:06.560490   60243 crio.go:433] Images already preloaded, skipping extraction
	I0918 16:57:06.560565   60243 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 16:57:06.596435   60243 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 16:57:06.596457   60243 cache_images.go:85] Images are preloaded, skipping loading
	I0918 16:57:06.596465   60243 kubeadm.go:926] updating node { 192.168.49.2 8443 v1.34.0 crio true true} ...
	I0918 16:57:06.596593   60243 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 16:57:06.596663   60243 ssh_runner.go:195] Run: crio config
	I0918 16:57:06.638379   60243 cni.go:84] Creating CNI manager for ""
	I0918 16:57:06.638415   60243 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0918 16:57:06.638485   60243 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0918 16:57:06.638551   60243 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.34.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-078118 NodeName:ha-078118 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manif
ests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0918 16:57:06.638713   60243 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "ha-078118"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.49.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	kubernetesVersion: v1.34.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: systemd
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0918 16:57:06.638746   60243 kube-vip.go:115] generating kube-vip config ...
	I0918 16:57:06.638798   60243 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 16:57:06.651869   60243 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 16:57:06.652012   60243 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/super-admin.conf"
	    name: kubeconfig
	status: {}
	I0918 16:57:06.652164   60243 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 16:57:06.661798   60243 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 16:57:06.661868   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
	I0918 16:57:06.671425   60243 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (359 bytes)
	I0918 16:57:06.690684   60243 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 16:57:06.712365   60243 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2205 bytes)
	I0918 16:57:06.730837   60243 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1364 bytes)
	I0918 16:57:06.751634   60243 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 16:57:06.755620   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:57:06.767580   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:06.834874   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:57:06.856024   60243 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.2
	I0918 16:57:06.856044   60243 certs.go:194] generating shared ca certs ...
	I0918 16:57:06.856058   60243 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:06.856204   60243 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 16:57:06.856251   60243 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 16:57:06.856269   60243 certs.go:256] generating profile certs ...
	I0918 16:57:06.856336   60243 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 16:57:06.856374   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt with IP's: []
	I0918 16:57:07.092454   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt ...
	I0918 16:57:07.092487   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt: {Name:mk19062e6a12c311074ac12acf7e6f0d17c6d89a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.092685   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key ...
	I0918 16:57:07.092704   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key: {Name:mk318c046cc338ba0b28b363817d97a3070d94ed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.092818   60243 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.37f1b339
	I0918 16:57:07.092834   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.37f1b339 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.254]
	I0918 16:57:07.337211   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.37f1b339 ...
	I0918 16:57:07.337241   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.37f1b339: {Name:mk0b5e39f9123a2c4e24d5df860b2ac053c5a5e0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.337432   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.37f1b339 ...
	I0918 16:57:07.337456   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.37f1b339: {Name:mkf9155cc06cff6c926a6f1637026b23fbaea042 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.337590   60243 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.37f1b339 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 16:57:07.337708   60243 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.37f1b339 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 16:57:07.337789   60243 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 16:57:07.337811   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt with IP's: []
	I0918 16:57:07.508219   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt ...
	I0918 16:57:07.508250   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt: {Name:mk9be1072d013045d70f28d234a2966ed6a259eb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.508439   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key ...
	I0918 16:57:07.508459   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key: {Name:mk0fa849d3f79114700ec4346366d93036905ac9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.508586   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 16:57:07.508611   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 16:57:07.508632   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 16:57:07.508659   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 16:57:07.508679   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 16:57:07.508694   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 16:57:07.508710   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 16:57:07.508729   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 16:57:07.508805   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 16:57:07.508852   60243 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 16:57:07.508866   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 16:57:07.508898   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 16:57:07.508928   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 16:57:07.508964   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 16:57:07.509027   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:57:07.509070   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 16:57:07.509093   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:07.509106   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 16:57:07.509647   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 16:57:07.536147   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 16:57:07.563252   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 16:57:07.590602   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 16:57:07.616431   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
	I0918 16:57:07.642036   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 16:57:07.668728   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 16:57:07.695297   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 16:57:07.720300   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 16:57:07.748223   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 16:57:07.774345   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 16:57:07.799523   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0918 16:57:07.818102   60243 ssh_runner.go:195] Run: openssl version
	I0918 16:57:07.823677   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 16:57:07.833790   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:07.837671   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:07.837733   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:07.844558   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 16:57:07.854483   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 16:57:07.864206   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 16:57:07.868068   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 16:57:07.868131   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 16:57:07.875355   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 16:57:07.885526   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 16:57:07.895494   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 16:57:07.899217   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 16:57:07.899266   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 16:57:07.906421   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 16:57:07.916547   60243 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 16:57:07.920046   60243 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0918 16:57:07.920125   60243 kubeadm.go:392] StartCluster: {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[
] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: Socket
VMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:57:07.920228   60243 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0918 16:57:07.920275   60243 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0918 16:57:07.956205   60243 cri.go:89] found id: ""
	I0918 16:57:07.956268   60243 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0918 16:57:07.965688   60243 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0918 16:57:07.975065   60243 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
	I0918 16:57:07.975155   60243 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0918 16:57:07.984553   60243 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0918 16:57:07.984571   60243 kubeadm.go:157] found existing configuration files:
	
	I0918 16:57:07.984632   60243 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0918 16:57:07.993826   60243 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0918 16:57:07.993878   60243 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0918 16:57:08.002980   60243 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0918 16:57:08.012468   60243 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0918 16:57:08.012566   60243 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0918 16:57:08.021925   60243 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0918 16:57:08.031367   60243 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0918 16:57:08.031459   60243 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0918 16:57:08.040660   60243 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0918 16:57:08.050415   60243 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0918 16:57:08.050490   60243 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0918 16:57:08.059624   60243 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0918 16:57:08.100277   60243 kubeadm.go:310] [init] Using Kubernetes version: v1.34.0
	I0918 16:57:08.100331   60243 kubeadm.go:310] [preflight] Running pre-flight checks
	I0918 16:57:08.116038   60243 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
	I0918 16:57:08.116128   60243 kubeadm.go:310] KERNEL_VERSION: 6.8.0-1037-gcp
	I0918 16:57:08.116186   60243 kubeadm.go:310] OS: Linux
	I0918 16:57:08.116266   60243 kubeadm.go:310] CGROUPS_CPU: enabled
	I0918 16:57:08.116315   60243 kubeadm.go:310] CGROUPS_CPUSET: enabled
	I0918 16:57:08.116373   60243 kubeadm.go:310] CGROUPS_DEVICES: enabled
	I0918 16:57:08.116443   60243 kubeadm.go:310] CGROUPS_FREEZER: enabled
	I0918 16:57:08.116522   60243 kubeadm.go:310] CGROUPS_MEMORY: enabled
	I0918 16:57:08.116571   60243 kubeadm.go:310] CGROUPS_PIDS: enabled
	I0918 16:57:08.116615   60243 kubeadm.go:310] CGROUPS_HUGETLB: enabled
	I0918 16:57:08.116655   60243 kubeadm.go:310] CGROUPS_IO: enabled
	I0918 16:57:08.171905   60243 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0918 16:57:08.172043   60243 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0918 16:57:08.172141   60243 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
	I0918 16:57:08.179444   60243 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0918 16:57:08.181874   60243 out.go:252]   - Generating certificates and keys ...
	I0918 16:57:08.181988   60243 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0918 16:57:08.182109   60243 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0918 16:57:08.384218   60243 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0918 16:57:08.699741   60243 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
	I0918 16:57:08.825486   60243 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
	I0918 16:57:09.371495   60243 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
	I0918 16:57:09.773350   60243 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
	I0918 16:57:09.773540   60243 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [ha-078118 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0918 16:57:09.808553   60243 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
	I0918 16:57:09.808791   60243 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [ha-078118 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0918 16:57:10.030134   60243 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0918 16:57:10.543694   60243 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
	I0918 16:57:10.609235   60243 kubeadm.go:310] [certs] Generating "sa" key and public key
	I0918 16:57:10.609444   60243 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0918 16:57:10.844107   60243 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0918 16:57:10.880658   60243 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
	I0918 16:57:11.137641   60243 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0918 16:57:11.532580   60243 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0918 16:57:12.251321   60243 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0918 16:57:12.251715   60243 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0918 16:57:12.253897   60243 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0918 16:57:12.256755   60243 out.go:252]   - Booting up control plane ...
	I0918 16:57:12.256866   60243 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0918 16:57:12.256981   60243 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0918 16:57:12.257446   60243 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0918 16:57:12.266598   60243 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0918 16:57:12.266737   60243 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
	I0918 16:57:12.272623   60243 kubeadm.go:310] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
	I0918 16:57:12.272803   60243 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0918 16:57:12.272863   60243 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0918 16:57:12.350329   60243 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
	I0918 16:57:12.350484   60243 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
	I0918 16:57:12.852220   60243 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 502.00859ms
	I0918 16:57:12.854990   60243 kubeadm.go:310] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
	I0918 16:57:12.855092   60243 kubeadm.go:310] [control-plane-check] Checking kube-apiserver at https://192.168.49.2:8443/livez
	I0918 16:57:12.855203   60243 kubeadm.go:310] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
	I0918 16:57:12.855323   60243 kubeadm.go:310] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
	I0918 16:57:14.965273   60243 kubeadm.go:310] [control-plane-check] kube-scheduler is healthy after 2.110264832s
	I0918 16:57:14.984462   60243 kubeadm.go:310] [control-plane-check] kube-controller-manager is healthy after 2.1294049s
	I0918 16:57:19.024541   60243 kubeadm.go:310] [control-plane-check] kube-apiserver is healthy after 6.169430817s
	I0918 16:57:19.036534   60243 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0918 16:57:19.048658   60243 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0918 16:57:19.058561   60243 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0918 16:57:19.058849   60243 kubeadm.go:310] [mark-control-plane] Marking the node ha-078118 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0918 16:57:19.067655   60243 kubeadm.go:310] [bootstrap-token] Using token: u1re3r.382xtbpelzb2vqn2
	I0918 16:57:19.069664   60243 out.go:252]   - Configuring RBAC rules ...
	I0918 16:57:19.069828   60243 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0918 16:57:19.073078   60243 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0918 16:57:19.080001   60243 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0918 16:57:19.082815   60243 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0918 16:57:19.085370   60243 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0918 16:57:19.088075   60243 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0918 16:57:19.430480   60243 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0918 16:57:19.851385   60243 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0918 16:57:20.430959   60243 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0918 16:57:20.432013   60243 kubeadm.go:310] 
	I0918 16:57:20.432090   60243 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0918 16:57:20.432099   60243 kubeadm.go:310] 
	I0918 16:57:20.432181   60243 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0918 16:57:20.432188   60243 kubeadm.go:310] 
	I0918 16:57:20.432210   60243 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0918 16:57:20.432276   60243 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0918 16:57:20.432337   60243 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0918 16:57:20.432348   60243 kubeadm.go:310] 
	I0918 16:57:20.432441   60243 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0918 16:57:20.432460   60243 kubeadm.go:310] 
	I0918 16:57:20.432557   60243 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0918 16:57:20.432567   60243 kubeadm.go:310] 
	I0918 16:57:20.432631   60243 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0918 16:57:20.432695   60243 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0918 16:57:20.432772   60243 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0918 16:57:20.432781   60243 kubeadm.go:310] 
	I0918 16:57:20.432883   60243 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0918 16:57:20.433004   60243 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0918 16:57:20.433043   60243 kubeadm.go:310] 
	I0918 16:57:20.433148   60243 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token u1re3r.382xtbpelzb2vqn2 \
	I0918 16:57:20.433277   60243 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 \
	I0918 16:57:20.433309   60243 kubeadm.go:310] 	--control-plane 
	I0918 16:57:20.433319   60243 kubeadm.go:310] 
	I0918 16:57:20.433422   60243 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0918 16:57:20.433430   60243 kubeadm.go:310] 
	I0918 16:57:20.433578   60243 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token u1re3r.382xtbpelzb2vqn2 \
	I0918 16:57:20.433727   60243 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 
	I0918 16:57:20.436674   60243 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1037-gcp\n", err: exit status 1
	I0918 16:57:20.436833   60243 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0918 16:57:20.436876   60243 cni.go:84] Creating CNI manager for ""
	I0918 16:57:20.436887   60243 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0918 16:57:20.439722   60243 out.go:179] * Configuring CNI (Container Networking Interface) ...
	I0918 16:57:20.441111   60243 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0918 16:57:20.445728   60243 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.0/kubectl ...
	I0918 16:57:20.445756   60243 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
	I0918 16:57:20.465315   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0918 16:57:20.690521   60243 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0918 16:57:20.690609   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:20.690640   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-078118 minikube.k8s.io/updated_at=2025_09_18T16_57_20_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596 minikube.k8s.io/name=ha-078118 minikube.k8s.io/primary=true
	I0918 16:57:20.700737   60243 ops.go:34] apiserver oom_adj: -16
	I0918 16:57:20.767604   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:21.268560   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:21.768089   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:22.268176   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:22.767676   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:22.839542   60243 kubeadm.go:1105] duration metric: took 2.149001453s to wait for elevateKubeSystemPrivileges
	I0918 16:57:22.839581   60243 kubeadm.go:394] duration metric: took 14.919472386s to StartCluster
	I0918 16:57:22.839607   60243 settings.go:142] acquiring lock: {Name:mk72fea03aefe901db9522a467405d86665fedd0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:22.839682   60243 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 16:57:22.840462   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:22.840735   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0918 16:57:22.840750   60243 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:57:22.840775   60243 start.go:241] waiting for startup goroutines ...
	I0918 16:57:22.840788   60243 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0918 16:57:22.840876   60243 addons.go:69] Setting storage-provisioner=true in profile "ha-078118"
	I0918 16:57:22.840891   60243 addons.go:69] Setting default-storageclass=true in profile "ha-078118"
	I0918 16:57:22.840905   60243 addons.go:238] Setting addon storage-provisioner=true in "ha-078118"
	I0918 16:57:22.840939   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:57:22.840991   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:22.840941   60243 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-078118"
	I0918 16:57:22.841392   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:22.841558   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:22.865202   60243 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0918 16:57:22.865763   60243 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
	I0918 16:57:22.865795   60243 cert_rotation.go:141] "Starting client certificate rotation controller" logger="tls-transport-cache"
	I0918 16:57:22.865809   60243 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I0918 16:57:22.865816   60243 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
	I0918 16:57:22.865822   60243 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I0918 16:57:22.865828   60243 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
	I0918 16:57:22.866253   60243 addons.go:238] Setting addon default-storageclass=true in "ha-078118"
	I0918 16:57:22.866295   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:57:22.866582   60243 out.go:179]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0918 16:57:22.866825   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:22.868241   60243 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 16:57:22.868262   60243 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0918 16:57:22.868342   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:22.887359   60243 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
	I0918 16:57:22.887382   60243 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0918 16:57:22.887455   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:22.887753   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:22.910642   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:22.923544   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0918 16:57:23.006833   60243 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 16:57:23.025178   60243 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0918 16:57:23.102314   60243 start.go:976] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0918 16:57:23.320187   60243 out.go:179] * Enabled addons: storage-provisioner, default-storageclass
	I0918 16:57:23.321629   60243 addons.go:514] duration metric: took 480.833788ms for enable addons: enabled=[storage-provisioner default-storageclass]
	I0918 16:57:23.321670   60243 start.go:246] waiting for cluster config update ...
	I0918 16:57:23.321686   60243 start.go:255] writing updated cluster config ...
	I0918 16:57:23.323424   60243 out.go:203] 
	I0918 16:57:23.325109   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:23.325199   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:57:23.327022   60243 out.go:179] * Starting "ha-078118-m02" control-plane node in "ha-078118" cluster
	I0918 16:57:23.328400   60243 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 16:57:23.329828   60243 out.go:179] * Pulling base image v0.0.48 ...
	I0918 16:57:23.331236   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:57:23.331263   60243 cache.go:58] Caching tarball of preloaded images
	I0918 16:57:23.331263   60243 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 16:57:23.331360   60243 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 16:57:23.331373   60243 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 16:57:23.331452   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:57:23.352040   60243 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 16:57:23.352060   60243 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 16:57:23.352072   60243 cache.go:232] Successfully downloaded all kic artifacts
	I0918 16:57:23.352116   60243 start.go:360] acquireMachinesLock for ha-078118-m02: {Name:mk65f6a883861f2032241e1132c63effea2ab61f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 16:57:23.352223   60243 start.go:364] duration metric: took 88.663µs to acquireMachinesLock for "ha-078118-m02"
	I0918 16:57:23.352254   60243 start.go:93] Provisioning new machine with config: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:57:23.352328   60243 start.go:125] createHost starting for "m02" (driver="docker")
	I0918 16:57:23.354398   60243 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
	I0918 16:57:23.354538   60243 start.go:159] libmachine.API.Create for "ha-078118" (driver="docker")
	I0918 16:57:23.354572   60243 client.go:168] LocalClient.Create starting
	I0918 16:57:23.354639   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 16:57:23.354680   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:57:23.354700   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:57:23.354772   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 16:57:23.354801   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:57:23.354818   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:57:23.355707   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:57:23.373229   60243 network_create.go:77] Found existing network {name:ha-078118 subnet:0xc002073950 gateway:[0 0 0 0 0 0 0 0 0 0 255 255 192 168 49 1] mtu:1500}
	I0918 16:57:23.373281   60243 kic.go:121] calculated static IP "192.168.49.3" for the "ha-078118-m02" container
	I0918 16:57:23.373335   60243 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 16:57:23.392406   60243 cli_runner.go:164] Run: docker volume create ha-078118-m02 --label name.minikube.sigs.k8s.io=ha-078118-m02 --label created_by.minikube.sigs.k8s.io=true
	I0918 16:57:23.414767   60243 oci.go:103] Successfully created a docker volume ha-078118-m02
	I0918 16:57:23.414860   60243 cli_runner.go:164] Run: docker run --rm --name ha-078118-m02-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m02 --entrypoint /usr/bin/test -v ha-078118-m02:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 16:57:23.852088   60243 oci.go:107] Successfully prepared a docker volume ha-078118-m02
	I0918 16:57:23.852142   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:57:23.852165   60243 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 16:57:23.852243   60243 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m02:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 16:57:28.049263   60243 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m02:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.19696985s)
	I0918 16:57:28.049296   60243 kic.go:203] duration metric: took 4.197127441s to extract preloaded images to volume ...
	W0918 16:57:28.049399   60243 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 16:57:28.049426   60243 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 16:57:28.049461   60243 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 16:57:28.104457   60243 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ha-078118-m02 --name ha-078118-m02 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m02 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ha-078118-m02 --network ha-078118 --ip 192.168.49.3 --volume ha-078118-m02:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 16:57:28.377133   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Running}}
	I0918 16:57:28.396963   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 16:57:28.416714   60243 cli_runner.go:164] Run: docker exec ha-078118-m02 stat /var/lib/dpkg/alternatives/iptables
	I0918 16:57:28.473951   60243 oci.go:144] the created container "ha-078118-m02" has a running status.
	I0918 16:57:28.473985   60243 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa...
	I0918 16:57:29.190216   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0918 16:57:29.190259   60243 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 16:57:29.215556   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 16:57:29.233891   60243 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0918 16:57:29.233912   60243 kic_runner.go:114] Args: [docker exec --privileged ha-078118-m02 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0918 16:57:29.288122   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 16:57:29.305873   60243 machine.go:93] provisionDockerMachine start ...
	I0918 16:57:29.305960   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:29.324234   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:29.324468   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32788 <nil> <nil>}
	I0918 16:57:29.324480   60243 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 16:57:29.460587   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 16:57:29.460616   60243 ubuntu.go:182] provisioning hostname "ha-078118-m02"
	I0918 16:57:29.460684   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:29.479097   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:29.479306   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32788 <nil> <nil>}
	I0918 16:57:29.479323   60243 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m02 && echo "ha-078118-m02" | sudo tee /etc/hostname
	I0918 16:57:29.628691   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 16:57:29.628814   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:29.647616   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:29.647872   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32788 <nil> <nil>}
	I0918 16:57:29.647893   60243 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m02' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m02/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m02' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 16:57:29.784402   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 16:57:29.784431   60243 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 16:57:29.784448   60243 ubuntu.go:190] setting up certificates
	I0918 16:57:29.784457   60243 provision.go:84] configureAuth start
	I0918 16:57:29.784531   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 16:57:29.803424   60243 provision.go:143] copyHostCerts
	I0918 16:57:29.803462   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:57:29.803520   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 16:57:29.803535   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:57:29.803621   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 16:57:29.803783   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:57:29.803815   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 16:57:29.803822   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:57:29.803868   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 16:57:29.803949   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:57:29.803975   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 16:57:29.803981   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:57:29.804020   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 16:57:29.804097   60243 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m02 san=[127.0.0.1 192.168.49.3 ha-078118-m02 localhost minikube]
	I0918 16:57:29.933774   60243 provision.go:177] copyRemoteCerts
	I0918 16:57:29.933834   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 16:57:29.933864   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:29.952199   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.053380   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 16:57:30.053448   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 16:57:30.079586   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 16:57:30.079652   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 16:57:30.106162   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 16:57:30.106215   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0918 16:57:30.131599   60243 provision.go:87] duration metric: took 347.131672ms to configureAuth
	I0918 16:57:30.131623   60243 ubuntu.go:206] setting minikube options for container-runtime
	I0918 16:57:30.131803   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:30.131903   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.151255   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:30.151466   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32788 <nil> <nil>}
	I0918 16:57:30.151481   60243 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 16:57:30.393377   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 16:57:30.393406   60243 machine.go:96] duration metric: took 1.08751272s to provisionDockerMachine
	I0918 16:57:30.393419   60243 client.go:171] duration metric: took 7.038837191s to LocalClient.Create
	I0918 16:57:30.393445   60243 start.go:167] duration metric: took 7.038908487s to libmachine.API.Create "ha-078118"
	I0918 16:57:30.393465   60243 start.go:293] postStartSetup for "ha-078118-m02" (driver="docker")
	I0918 16:57:30.393489   60243 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 16:57:30.393583   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 16:57:30.393629   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.412821   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.513018   60243 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 16:57:30.516819   60243 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 16:57:30.516868   60243 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 16:57:30.516888   60243 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 16:57:30.516896   60243 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 16:57:30.516914   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 16:57:30.516990   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 16:57:30.517127   60243 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 16:57:30.517140   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 16:57:30.517261   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 16:57:30.528368   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:57:30.556419   60243 start.go:296] duration metric: took 162.941822ms for postStartSetup
	I0918 16:57:30.556822   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 16:57:30.575320   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:57:30.575623   60243 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:57:30.575666   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.593574   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.686828   60243 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 16:57:30.691487   60243 start.go:128] duration metric: took 7.339144526s to createHost
	I0918 16:57:30.691534   60243 start.go:83] releasing machines lock for "ha-078118-m02", held for 7.33929551s
	I0918 16:57:30.691607   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 16:57:30.712513   60243 out.go:179] * Found network options:
	I0918 16:57:30.713751   60243 out.go:179]   - NO_PROXY=192.168.49.2
	W0918 16:57:30.714978   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 16:57:30.715016   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 16:57:30.715086   60243 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 16:57:30.715123   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.715166   60243 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 16:57:30.715216   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.734742   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.735055   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.962897   60243 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 16:57:30.967520   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:57:30.990153   60243 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 16:57:30.990237   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:57:31.019088   60243 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0918 16:57:31.019116   60243 start.go:495] detecting cgroup driver to use...
	I0918 16:57:31.019152   60243 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 16:57:31.019210   60243 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 16:57:31.034083   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 16:57:31.047475   60243 docker.go:218] disabling cri-docker service (if available) ...
	I0918 16:57:31.047603   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 16:57:31.061869   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 16:57:31.076170   60243 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 16:57:31.145517   60243 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 16:57:31.219386   60243 docker.go:234] disabling docker service ...
	I0918 16:57:31.219457   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 16:57:31.237791   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 16:57:31.250673   60243 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 16:57:31.317780   60243 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 16:57:31.430074   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 16:57:31.441929   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 16:57:31.459420   60243 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 16:57:31.459485   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.472552   60243 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 16:57:31.472626   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.483632   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.494315   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.505031   60243 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 16:57:31.515002   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.526242   60243 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.543262   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.554050   60243 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 16:57:31.563178   60243 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 16:57:31.572111   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:31.678605   60243 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 16:57:31.775150   60243 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 16:57:31.775210   60243 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 16:57:31.778938   60243 start.go:563] Will wait 60s for crictl version
	I0918 16:57:31.778989   60243 ssh_runner.go:195] Run: which crictl
	I0918 16:57:31.782593   60243 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 16:57:31.816289   60243 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 16:57:31.816365   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:57:31.851649   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:57:31.888680   60243 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 16:57:31.890365   60243 out.go:179]   - env NO_PROXY=192.168.49.2
	I0918 16:57:31.891835   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:57:31.909279   60243 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 16:57:31.913221   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:57:31.925293   60243 mustload.go:65] Loading cluster: ha-078118
	I0918 16:57:31.925540   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:31.925802   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:31.943863   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:57:31.944113   60243 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.3
	I0918 16:57:31.944124   60243 certs.go:194] generating shared ca certs ...
	I0918 16:57:31.944136   60243 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:31.944251   60243 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 16:57:31.944295   60243 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 16:57:31.944304   60243 certs.go:256] generating profile certs ...
	I0918 16:57:31.944380   60243 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 16:57:31.944412   60243 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd
	I0918 16:57:31.944425   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.77376cdd with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.3 192.168.49.254]
	I0918 16:57:32.168102   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.77376cdd ...
	I0918 16:57:32.168133   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.77376cdd: {Name:mk632021bef8af557693dc3ec289ba5200d429d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:32.168315   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd ...
	I0918 16:57:32.168329   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd: {Name:mk6495f27d17861f263fd496e8789375ecd02b96 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:32.168403   60243 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.77376cdd -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 16:57:32.168560   60243 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 16:57:32.168697   60243 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 16:57:32.168717   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 16:57:32.168729   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 16:57:32.168744   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 16:57:32.168757   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 16:57:32.168772   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 16:57:32.168785   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 16:57:32.168797   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 16:57:32.168806   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 16:57:32.168853   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 16:57:32.168877   60243 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 16:57:32.168887   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 16:57:32.168911   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 16:57:32.168937   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 16:57:32.168963   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 16:57:32.169007   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:57:32.169032   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 16:57:32.169052   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 16:57:32.169066   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:32.169122   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:32.187428   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:32.275908   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
	I0918 16:57:32.280174   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
	I0918 16:57:32.293804   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
	I0918 16:57:32.297921   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
	I0918 16:57:32.312674   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
	I0918 16:57:32.317137   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
	I0918 16:57:32.332012   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
	I0918 16:57:32.335910   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)
	I0918 16:57:32.349818   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
	I0918 16:57:32.353706   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
	I0918 16:57:32.367328   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
	I0918 16:57:32.371320   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
	I0918 16:57:32.384442   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 16:57:32.410849   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 16:57:32.436643   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 16:57:32.463000   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 16:57:32.489057   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)
	I0918 16:57:32.515291   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0918 16:57:32.541234   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 16:57:32.566259   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 16:57:32.591152   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 16:57:32.619176   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 16:57:32.645865   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 16:57:32.672086   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
	I0918 16:57:32.691464   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
	I0918 16:57:32.711184   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
	I0918 16:57:32.730444   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)
	I0918 16:57:32.749620   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
	I0918 16:57:32.768643   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
	I0918 16:57:32.788328   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
	I0918 16:57:32.807884   60243 ssh_runner.go:195] Run: openssl version
	I0918 16:57:32.813660   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 16:57:32.823960   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 16:57:32.828123   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 16:57:32.828191   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 16:57:32.835458   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 16:57:32.846026   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 16:57:32.856631   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 16:57:32.860308   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 16:57:32.860358   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 16:57:32.866856   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 16:57:32.876690   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 16:57:32.886762   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:32.890660   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:32.890731   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:32.897540   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 16:57:32.907932   60243 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 16:57:32.911973   60243 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0918 16:57:32.912038   60243 kubeadm.go:926] updating node {m02 192.168.49.3 8443 v1.34.0 crio true true} ...
	I0918 16:57:32.912131   60243 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.3
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 16:57:32.912158   60243 kube-vip.go:115] generating kube-vip config ...
	I0918 16:57:32.912205   60243 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 16:57:32.924930   60243 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 16:57:32.924991   60243 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 16:57:32.925053   60243 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 16:57:32.934340   60243 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 16:57:32.934404   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
	I0918 16:57:32.944100   60243 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0918 16:57:32.964172   60243 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 16:57:32.986017   60243 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 16:57:33.007415   60243 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 16:57:33.011436   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:57:33.023696   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:33.094414   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:57:33.122168   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:57:33.122460   60243 start.go:317] joinCluster: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]
DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mount
Type:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:57:33.122601   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm token create --print-join-command --ttl=0"
	I0918 16:57:33.122663   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:33.143661   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:33.287975   60243 start.go:343] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:57:33.288021   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token zhmybn.ylv6f2k1dop39m4s --discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-078118-m02 --control-plane --apiserver-advertise-address=192.168.49.3 --apiserver-bind-port=8443"
	I0918 16:57:50.957307   60243 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token zhmybn.ylv6f2k1dop39m4s --discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-078118-m02 --control-plane --apiserver-advertise-address=192.168.49.3 --apiserver-bind-port=8443": (17.669258722s)
	I0918 16:57:50.957347   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"
	I0918 16:57:51.183198   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-078118-m02 minikube.k8s.io/updated_at=2025_09_18T16_57_51_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596 minikube.k8s.io/name=ha-078118 minikube.k8s.io/primary=false
	I0918 16:57:51.257842   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-078118-m02 node-role.kubernetes.io/control-plane:NoSchedule-
	I0918 16:57:51.333794   60243 start.go:319] duration metric: took 18.211330608s to joinCluster
	I0918 16:57:51.333873   60243 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:57:51.334134   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:51.335826   60243 out.go:179] * Verifying Kubernetes components...
	I0918 16:57:51.337317   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:51.433888   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:57:51.448166   60243 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	W0918 16:57:51.448229   60243 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.49.254:8443 with https://192.168.49.2:8443
	I0918 16:57:51.448458   60243 node_ready.go:35] waiting up to 6m0s for node "ha-078118-m02" to be "Ready" ...
	W0918 16:57:53.452514   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:57:55.954646   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:57:58.452847   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:00.951914   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:02.952603   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:04.952691   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:06.953510   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:09.452614   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:11.951583   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:13.952555   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:16.452462   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:18.951818   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:20.952078   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:22.952626   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:25.452581   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:27.952333   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:30.452627   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:32.452894   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	I0918 16:58:34.452216   60243 node_ready.go:49] node "ha-078118-m02" is "Ready"
	I0918 16:58:34.452242   60243 node_ready.go:38] duration metric: took 43.00375648s for node "ha-078118-m02" to be "Ready" ...
	I0918 16:58:34.452256   60243 api_server.go:52] waiting for apiserver process to appear ...
	I0918 16:58:34.452305   60243 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 16:58:34.464123   60243 api_server.go:72] duration metric: took 43.130215918s to wait for apiserver process to appear ...
	I0918 16:58:34.464146   60243 api_server.go:88] waiting for apiserver healthz status ...
	I0918 16:58:34.464162   60243 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0918 16:58:34.469944   60243 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0918 16:58:34.470928   60243 api_server.go:141] control plane version: v1.34.0
	I0918 16:58:34.470956   60243 api_server.go:131] duration metric: took 6.803903ms to wait for apiserver health ...
	I0918 16:58:34.470975   60243 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 16:58:34.475258   60243 system_pods.go:59] 17 kube-system pods found
	I0918 16:58:34.475292   60243 system_pods.go:61] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 16:58:34.475298   60243 system_pods.go:61] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 16:58:34.475301   60243 system_pods.go:61] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 16:58:34.475306   60243 system_pods.go:61] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 16:58:34.475310   60243 system_pods.go:61] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 16:58:34.475313   60243 system_pods.go:61] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 16:58:34.475318   60243 system_pods.go:61] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 16:58:34.475322   60243 system_pods.go:61] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 16:58:34.475325   60243 system_pods.go:61] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 16:58:34.475328   60243 system_pods.go:61] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 16:58:34.475332   60243 system_pods.go:61] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 16:58:34.475334   60243 system_pods.go:61] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 16:58:34.475337   60243 system_pods.go:61] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 16:58:34.475340   60243 system_pods.go:61] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 16:58:34.475343   60243 system_pods.go:61] "kube-vip-ha-078118" [9d6c9fdb-435c-43e0-b477-6ad4ac75fecf] Running
	I0918 16:58:34.475346   60243 system_pods.go:61] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 16:58:34.475349   60243 system_pods.go:61] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 16:58:34.475354   60243 system_pods.go:74] duration metric: took 4.373062ms to wait for pod list to return data ...
	I0918 16:58:34.475363   60243 default_sa.go:34] waiting for default service account to be created ...
	I0918 16:58:34.478310   60243 default_sa.go:45] found service account: "default"
	I0918 16:58:34.478331   60243 default_sa.go:55] duration metric: took 2.963019ms for default service account to be created ...
	I0918 16:58:34.478340   60243 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 16:58:34.481978   60243 system_pods.go:86] 17 kube-system pods found
	I0918 16:58:34.482005   60243 system_pods.go:89] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 16:58:34.482013   60243 system_pods.go:89] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 16:58:34.482019   60243 system_pods.go:89] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 16:58:34.482024   60243 system_pods.go:89] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 16:58:34.482029   60243 system_pods.go:89] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 16:58:34.482034   60243 system_pods.go:89] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 16:58:34.482041   60243 system_pods.go:89] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 16:58:34.482047   60243 system_pods.go:89] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 16:58:34.482055   60243 system_pods.go:89] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 16:58:34.482062   60243 system_pods.go:89] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 16:58:34.482071   60243 system_pods.go:89] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 16:58:34.482077   60243 system_pods.go:89] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 16:58:34.482086   60243 system_pods.go:89] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 16:58:34.482098   60243 system_pods.go:89] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 16:58:34.482106   60243 system_pods.go:89] "kube-vip-ha-078118" [9d6c9fdb-435c-43e0-b477-6ad4ac75fecf] Running
	I0918 16:58:34.482112   60243 system_pods.go:89] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 16:58:34.482120   60243 system_pods.go:89] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 16:58:34.482128   60243 system_pods.go:126] duration metric: took 3.781721ms to wait for k8s-apps to be running ...
	I0918 16:58:34.482140   60243 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 16:58:34.482192   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 16:58:34.503029   60243 system_svc.go:56] duration metric: took 20.8799ms WaitForService to wait for kubelet
	I0918 16:58:34.503062   60243 kubeadm.go:578] duration metric: took 43.169159629s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 16:58:34.503098   60243 node_conditions.go:102] verifying NodePressure condition ...
	I0918 16:58:34.506955   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:58:34.506981   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:58:34.506999   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:58:34.507002   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:58:34.507009   60243 node_conditions.go:105] duration metric: took 3.904235ms to run NodePressure ...
	I0918 16:58:34.507023   60243 start.go:241] waiting for startup goroutines ...
	I0918 16:58:34.507059   60243 start.go:255] writing updated cluster config ...
	I0918 16:58:34.509378   60243 out.go:203] 
	I0918 16:58:34.511211   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:58:34.511316   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:58:34.513091   60243 out.go:179] * Starting "ha-078118-m03" control-plane node in "ha-078118" cluster
	I0918 16:58:34.514457   60243 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 16:58:34.515762   60243 out.go:179] * Pulling base image v0.0.48 ...
	I0918 16:58:34.517107   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:58:34.517134   60243 cache.go:58] Caching tarball of preloaded images
	I0918 16:58:34.517177   60243 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 16:58:34.517230   60243 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 16:58:34.517241   60243 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 16:58:34.517325   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:58:34.538516   60243 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 16:58:34.538541   60243 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 16:58:34.538561   60243 cache.go:232] Successfully downloaded all kic artifacts
	I0918 16:58:34.538588   60243 start.go:360] acquireMachinesLock for ha-078118-m03: {Name:mk9d1c903c967299da898df87db82c277b1f732e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 16:58:34.538687   60243 start.go:364] duration metric: took 82.978µs to acquireMachinesLock for "ha-078118-m03"
	I0918 16:58:34.538711   60243 start.go:93] Provisioning new machine with config: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevi
rt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0
GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:58:34.538798   60243 start.go:125] createHost starting for "m03" (driver="docker")
	I0918 16:58:34.541070   60243 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
	I0918 16:58:34.541173   60243 start.go:159] libmachine.API.Create for "ha-078118" (driver="docker")
	I0918 16:58:34.541202   60243 client.go:168] LocalClient.Create starting
	I0918 16:58:34.541284   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 16:58:34.541320   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:58:34.541333   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:58:34.541387   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 16:58:34.541406   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:58:34.541417   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:58:34.541631   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:58:34.559076   60243 network_create.go:77] Found existing network {name:ha-078118 subnet:0xc00218f740 gateway:[0 0 0 0 0 0 0 0 0 0 255 255 192 168 49 1] mtu:1500}
	I0918 16:58:34.559115   60243 kic.go:121] calculated static IP "192.168.49.4" for the "ha-078118-m03" container
	I0918 16:58:34.559196   60243 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 16:58:34.577217   60243 cli_runner.go:164] Run: docker volume create ha-078118-m03 --label name.minikube.sigs.k8s.io=ha-078118-m03 --label created_by.minikube.sigs.k8s.io=true
	I0918 16:58:34.595827   60243 oci.go:103] Successfully created a docker volume ha-078118-m03
	I0918 16:58:34.595925   60243 cli_runner.go:164] Run: docker run --rm --name ha-078118-m03-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m03 --entrypoint /usr/bin/test -v ha-078118-m03:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 16:58:34.985370   60243 oci.go:107] Successfully prepared a docker volume ha-078118-m03
	I0918 16:58:34.985422   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:58:34.985448   60243 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 16:58:34.985570   60243 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m03:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 16:58:39.161109   60243 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m03:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.175489065s)
	I0918 16:58:39.161137   60243 kic.go:203] duration metric: took 4.175687859s to extract preloaded images to volume ...
	W0918 16:58:39.161212   60243 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 16:58:39.161242   60243 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 16:58:39.161279   60243 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 16:58:39.216265   60243 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ha-078118-m03 --name ha-078118-m03 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m03 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ha-078118-m03 --network ha-078118 --ip 192.168.49.4 --volume ha-078118-m03:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 16:58:39.490676   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Running}}
	I0918 16:58:39.509154   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 16:58:39.528283   60243 cli_runner.go:164] Run: docker exec ha-078118-m03 stat /var/lib/dpkg/alternatives/iptables
	I0918 16:58:39.585189   60243 oci.go:144] the created container "ha-078118-m03" has a running status.
	I0918 16:58:39.585228   60243 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa...
	I0918 16:58:39.733661   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0918 16:58:39.733704   60243 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 16:58:39.767524   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 16:58:39.791739   60243 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0918 16:58:39.791763   60243 kic_runner.go:114] Args: [docker exec --privileged ha-078118-m03 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0918 16:58:39.846675   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 16:58:39.867316   60243 machine.go:93] provisionDockerMachine start ...
	I0918 16:58:39.867429   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:39.888632   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:58:39.888885   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0918 16:58:39.888904   60243 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 16:58:40.029356   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m03
	
	I0918 16:58:40.029386   60243 ubuntu.go:182] provisioning hostname "ha-078118-m03"
	I0918 16:58:40.029443   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.049595   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:58:40.049807   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0918 16:58:40.049820   60243 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m03 && echo "ha-078118-m03" | sudo tee /etc/hostname
	I0918 16:58:40.200087   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m03
	
	I0918 16:58:40.200202   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.217994   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:58:40.218257   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0918 16:58:40.218286   60243 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m03' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m03/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m03' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 16:58:40.354076   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 16:58:40.354104   60243 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 16:58:40.354126   60243 ubuntu.go:190] setting up certificates
	I0918 16:58:40.354139   60243 provision.go:84] configureAuth start
	I0918 16:58:40.354197   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 16:58:40.373445   60243 provision.go:143] copyHostCerts
	I0918 16:58:40.373482   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:58:40.373528   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 16:58:40.373540   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:58:40.373612   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 16:58:40.373690   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:58:40.373708   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 16:58:40.373715   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:58:40.373745   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 16:58:40.373801   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:58:40.373825   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 16:58:40.373835   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:58:40.373871   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 16:58:40.373939   60243 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m03 san=[127.0.0.1 192.168.49.4 ha-078118-m03 localhost minikube]
	I0918 16:58:40.469151   60243 provision.go:177] copyRemoteCerts
	I0918 16:58:40.469228   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 16:58:40.469260   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.487441   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:40.584958   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 16:58:40.585042   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 16:58:40.612338   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 16:58:40.612405   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 16:58:40.638478   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 16:58:40.638557   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 16:58:40.664375   60243 provision.go:87] duration metric: took 310.211334ms to configureAuth
	I0918 16:58:40.664412   60243 ubuntu.go:206] setting minikube options for container-runtime
	I0918 16:58:40.664640   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:58:40.664727   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.684197   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:58:40.684440   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0918 16:58:40.684457   60243 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 16:58:40.917922   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 16:58:40.917947   60243 machine.go:96] duration metric: took 1.050610089s to provisionDockerMachine
	I0918 16:58:40.917958   60243 client.go:171] duration metric: took 6.376747043s to LocalClient.Create
	I0918 16:58:40.917977   60243 start.go:167] duration metric: took 6.376804493s to libmachine.API.Create "ha-078118"
	I0918 16:58:40.917987   60243 start.go:293] postStartSetup for "ha-078118-m03" (driver="docker")
	I0918 16:58:40.918001   60243 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 16:58:40.918071   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 16:58:40.918125   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.936966   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:41.036914   60243 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 16:58:41.040743   60243 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 16:58:41.040792   60243 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 16:58:41.040806   60243 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 16:58:41.040817   60243 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 16:58:41.040830   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 16:58:41.040889   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 16:58:41.040981   60243 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 16:58:41.040993   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 16:58:41.041109   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 16:58:41.050735   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:58:41.078178   60243 start.go:296] duration metric: took 160.175362ms for postStartSetup
	I0918 16:58:41.078562   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 16:58:41.096155   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:58:41.096446   60243 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:58:41.096487   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:41.114313   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:41.207561   60243 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 16:58:41.211752   60243 start.go:128] duration metric: took 6.672942573s to createHost
	I0918 16:58:41.211772   60243 start.go:83] releasing machines lock for "ha-078118-m03", held for 6.673074744s
	I0918 16:58:41.211824   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 16:58:41.231418   60243 out.go:179] * Found network options:
	I0918 16:58:41.233082   60243 out.go:179]   - NO_PROXY=192.168.49.2,192.168.49.3
	W0918 16:58:41.234375   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 16:58:41.234408   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 16:58:41.234439   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 16:58:41.234459   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 16:58:41.234591   60243 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 16:58:41.234624   60243 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 16:58:41.234645   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:41.234674   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:41.253204   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:41.253574   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:41.487834   60243 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 16:58:41.492986   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:58:41.516316   60243 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 16:58:41.516406   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:58:41.548254   60243 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0918 16:58:41.548282   60243 start.go:495] detecting cgroup driver to use...
	I0918 16:58:41.548320   60243 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 16:58:41.548374   60243 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 16:58:41.563666   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 16:58:41.575416   60243 docker.go:218] disabling cri-docker service (if available) ...
	I0918 16:58:41.575473   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 16:58:41.589676   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 16:58:41.604330   60243 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 16:58:41.669451   60243 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 16:58:41.744471   60243 docker.go:234] disabling docker service ...
	I0918 16:58:41.744566   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 16:58:41.762473   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 16:58:41.774931   60243 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 16:58:41.848307   60243 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 16:58:41.952604   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 16:58:41.964539   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 16:58:41.982943   60243 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 16:58:41.982998   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:41.997792   60243 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 16:58:41.997865   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.008724   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.019336   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.030192   60243 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 16:58:42.039767   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.050915   60243 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.067947   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.078882   60243 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 16:58:42.088304   60243 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 16:58:42.097143   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:58:42.205602   60243 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 16:58:42.295918   60243 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 16:58:42.295989   60243 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 16:58:42.300000   60243 start.go:563] Will wait 60s for crictl version
	I0918 16:58:42.300068   60243 ssh_runner.go:195] Run: which crictl
	I0918 16:58:42.303803   60243 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 16:58:42.338282   60243 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 16:58:42.338376   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:58:42.373030   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:58:42.410107   60243 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 16:58:42.411669   60243 out.go:179]   - env NO_PROXY=192.168.49.2
	I0918 16:58:42.413257   60243 out.go:179]   - env NO_PROXY=192.168.49.2,192.168.49.3
	I0918 16:58:42.415059   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:58:42.433045   60243 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 16:58:42.437153   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:58:42.449343   60243 mustload.go:65] Loading cluster: ha-078118
	I0918 16:58:42.449621   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:58:42.449891   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:58:42.468842   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:58:42.469136   60243 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.4
	I0918 16:58:42.469150   60243 certs.go:194] generating shared ca certs ...
	I0918 16:58:42.469170   60243 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:58:42.469308   60243 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 16:58:42.469358   60243 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 16:58:42.469373   60243 certs.go:256] generating profile certs ...
	I0918 16:58:42.469463   60243 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 16:58:42.469512   60243 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.4bf9a898
	I0918 16:58:42.469534   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.4bf9a898 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.3 192.168.49.4 192.168.49.254]
	I0918 16:58:42.495627   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.4bf9a898 ...
	I0918 16:58:42.495658   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.4bf9a898: {Name:mk68634cd7761667f3d175625830276296dacbf7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:58:42.495841   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.4bf9a898 ...
	I0918 16:58:42.495855   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.4bf9a898: {Name:mkaeb5ac6f7d0ea9f8347ea3ddec67699c073d9a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:58:42.495923   60243 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.4bf9a898 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 16:58:42.496068   60243 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.4bf9a898 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 16:58:42.496217   60243 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 16:58:42.496232   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 16:58:42.496244   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 16:58:42.496258   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 16:58:42.496271   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 16:58:42.496280   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 16:58:42.496293   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 16:58:42.496305   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 16:58:42.496317   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 16:58:42.496373   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 16:58:42.496401   60243 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 16:58:42.496411   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 16:58:42.496436   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 16:58:42.496457   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 16:58:42.496481   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 16:58:42.496534   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:58:42.496569   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:58:42.496580   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 16:58:42.496590   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 16:58:42.496636   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:58:42.515180   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:58:42.604836   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
	I0918 16:58:42.608908   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
	I0918 16:58:42.621875   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
	I0918 16:58:42.625619   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
	I0918 16:58:42.638496   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
	I0918 16:58:42.642068   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
	I0918 16:58:42.655358   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
	I0918 16:58:42.659079   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)
	I0918 16:58:42.671928   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
	I0918 16:58:42.675654   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
	I0918 16:58:42.689048   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
	I0918 16:58:42.692776   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
	I0918 16:58:42.705922   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 16:58:42.731686   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 16:58:42.757189   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 16:58:42.782344   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 16:58:42.808085   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)
	I0918 16:58:42.833677   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0918 16:58:42.860306   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 16:58:42.886762   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 16:58:42.911918   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 16:58:42.940030   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 16:58:42.965848   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 16:58:42.992346   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
	I0918 16:58:43.010924   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
	I0918 16:58:43.029944   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
	I0918 16:58:43.050253   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)
	I0918 16:58:43.069277   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
	I0918 16:58:43.089240   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
	I0918 16:58:43.108796   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
	I0918 16:58:43.127946   60243 ssh_runner.go:195] Run: openssl version
	I0918 16:58:43.134211   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 16:58:43.144901   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:58:43.148803   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:58:43.148864   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:58:43.155958   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 16:58:43.166216   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 16:58:43.176240   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 16:58:43.179779   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 16:58:43.179836   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 16:58:43.186793   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 16:58:43.196956   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 16:58:43.206631   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 16:58:43.210807   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 16:58:43.210895   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 16:58:43.219238   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 16:58:43.229939   60243 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 16:58:43.233807   60243 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0918 16:58:43.233861   60243 kubeadm.go:926] updating node {m03 192.168.49.4 8443 v1.34.0 crio true true} ...
	I0918 16:58:43.233942   60243 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.4
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 16:58:43.233965   60243 kube-vip.go:115] generating kube-vip config ...
	I0918 16:58:43.234001   60243 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 16:58:43.246584   60243 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 16:58:43.246654   60243 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 16:58:43.246708   60243 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 16:58:43.256222   60243 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 16:58:43.256294   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
	I0918 16:58:43.265642   60243 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0918 16:58:43.286766   60243 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 16:58:43.308984   60243 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 16:58:43.330666   60243 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 16:58:43.334512   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:58:43.346186   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:58:43.415160   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:58:43.438425   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:58:43.438701   60243 start.go:317] joinCluster: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]
DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false log
viewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPa
useInterval:1m0s}
	I0918 16:58:43.438806   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm token create --print-join-command --ttl=0"
	I0918 16:58:43.438859   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:58:43.458467   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:58:43.605780   60243 start.go:343] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:58:43.605839   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token izhn3y.empz64p3o3t4ob63 --discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-078118-m03 --control-plane --apiserver-advertise-address=192.168.49.4 --apiserver-bind-port=8443"
	I0918 16:58:54.699353   60243 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token izhn3y.empz64p3o3t4ob63 --discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-078118-m03 --control-plane --apiserver-advertise-address=192.168.49.4 --apiserver-bind-port=8443": (11.093493296s)
	I0918 16:58:54.699381   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"
	I0918 16:58:54.914238   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-078118-m03 minikube.k8s.io/updated_at=2025_09_18T16_58_54_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596 minikube.k8s.io/name=ha-078118 minikube.k8s.io/primary=false
	I0918 16:58:54.991429   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-078118-m03 node-role.kubernetes.io/control-plane:NoSchedule-
	I0918 16:58:55.068483   60243 start.go:319] duration metric: took 11.629778037s to joinCluster
	I0918 16:58:55.068573   60243 start.go:235] Will wait 6m0s for node &{Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:58:55.068917   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:58:55.070415   60243 out.go:179] * Verifying Kubernetes components...
	I0918 16:58:55.072098   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:58:55.171709   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:58:55.185623   60243 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	W0918 16:58:55.185688   60243 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.49.254:8443 with https://192.168.49.2:8443
	I0918 16:58:55.185879   60243 node_ready.go:35] waiting up to 6m0s for node "ha-078118-m03" to be "Ready" ...
	W0918 16:58:57.190925   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	W0918 16:58:59.689555   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	W0918 16:59:01.690108   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	W0918 16:59:04.189842   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	W0918 16:59:06.190032   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	I0918 16:59:06.690048   60243 node_ready.go:49] node "ha-078118-m03" is "Ready"
	I0918 16:59:06.690075   60243 node_ready.go:38] duration metric: took 11.50418456s for node "ha-078118-m03" to be "Ready" ...
	I0918 16:59:06.690089   60243 api_server.go:52] waiting for apiserver process to appear ...
	I0918 16:59:06.690136   60243 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 16:59:06.702758   60243 api_server.go:72] duration metric: took 11.634149066s to wait for apiserver process to appear ...
	I0918 16:59:06.702790   60243 api_server.go:88] waiting for apiserver healthz status ...
	I0918 16:59:06.702810   60243 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0918 16:59:06.707560   60243 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0918 16:59:06.708455   60243 api_server.go:141] control plane version: v1.34.0
	I0918 16:59:06.708480   60243 api_server.go:131] duration metric: took 5.681924ms to wait for apiserver health ...
	I0918 16:59:06.708491   60243 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 16:59:06.714696   60243 system_pods.go:59] 24 kube-system pods found
	I0918 16:59:06.714727   60243 system_pods.go:61] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 16:59:06.714733   60243 system_pods.go:61] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 16:59:06.714737   60243 system_pods.go:61] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 16:59:06.714740   60243 system_pods.go:61] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 16:59:06.714744   60243 system_pods.go:61] "etcd-ha-078118-m03" [ef27a91e-a220-4dcb-885c-2941742d985e] Running
	I0918 16:59:06.714747   60243 system_pods.go:61] "kindnet-f2b4b" [98c5afc6-e57e-488c-948a-e24ec24b97a7] Running
	I0918 16:59:06.714751   60243 system_pods.go:61] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 16:59:06.714756   60243 system_pods.go:61] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 16:59:06.714761   60243 system_pods.go:61] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 16:59:06.714765   60243 system_pods.go:61] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 16:59:06.714768   60243 system_pods.go:61] "kube-apiserver-ha-078118-m03" [1cc265d4-6f02-4291-b218-cfa76bcf557f] Running
	I0918 16:59:06.714772   60243 system_pods.go:61] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 16:59:06.714775   60243 system_pods.go:61] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 16:59:06.714778   60243 system_pods.go:61] "kube-controller-manager-ha-078118-m03" [43309df5-32b3-4ca8-a0a0-23bfcaac2138] Running
	I0918 16:59:06.714781   60243 system_pods.go:61] "kube-proxy-2pjrn" [490f3965-2c3c-42d8-89b3-d3d599ebf60e] Running
	I0918 16:59:06.714785   60243 system_pods.go:61] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 16:59:06.714787   60243 system_pods.go:61] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 16:59:06.714790   60243 system_pods.go:61] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 16:59:06.714794   60243 system_pods.go:61] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 16:59:06.714797   60243 system_pods.go:61] "kube-scheduler-ha-078118-m03" [93dfed73-cd97-4f3f-804e-ffdd528fd8ff] Running
	I0918 16:59:06.714802   60243 system_pods.go:61] "kube-vip-ha-078118" [9d6c9fdb-435c-43e0-b477-6ad4ac75fecf] Running
	I0918 16:59:06.714805   60243 system_pods.go:61] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 16:59:06.714809   60243 system_pods.go:61] "kube-vip-ha-078118-m03" [919fbb1f-4ca4-41e2-a8f7-6d2c73f81558] Running
	I0918 16:59:06.714813   60243 system_pods.go:61] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 16:59:06.714819   60243 system_pods.go:74] duration metric: took 6.323146ms to wait for pod list to return data ...
	I0918 16:59:06.714828   60243 default_sa.go:34] waiting for default service account to be created ...
	I0918 16:59:06.718387   60243 default_sa.go:45] found service account: "default"
	I0918 16:59:06.718417   60243 default_sa.go:55] duration metric: took 3.581681ms for default service account to be created ...
	I0918 16:59:06.718430   60243 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 16:59:06.724111   60243 system_pods.go:86] 24 kube-system pods found
	I0918 16:59:06.724142   60243 system_pods.go:89] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 16:59:06.724148   60243 system_pods.go:89] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 16:59:06.724152   60243 system_pods.go:89] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 16:59:06.724156   60243 system_pods.go:89] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 16:59:06.724159   60243 system_pods.go:89] "etcd-ha-078118-m03" [ef27a91e-a220-4dcb-885c-2941742d985e] Running
	I0918 16:59:06.724163   60243 system_pods.go:89] "kindnet-f2b4b" [98c5afc6-e57e-488c-948a-e24ec24b97a7] Running
	I0918 16:59:06.724167   60243 system_pods.go:89] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 16:59:06.724170   60243 system_pods.go:89] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 16:59:06.724175   60243 system_pods.go:89] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 16:59:06.724181   60243 system_pods.go:89] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 16:59:06.724186   60243 system_pods.go:89] "kube-apiserver-ha-078118-m03" [1cc265d4-6f02-4291-b218-cfa76bcf557f] Running
	I0918 16:59:06.724193   60243 system_pods.go:89] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 16:59:06.724199   60243 system_pods.go:89] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 16:59:06.724205   60243 system_pods.go:89] "kube-controller-manager-ha-078118-m03" [43309df5-32b3-4ca8-a0a0-23bfcaac2138] Running
	I0918 16:59:06.724211   60243 system_pods.go:89] "kube-proxy-2pjrn" [490f3965-2c3c-42d8-89b3-d3d599ebf60e] Running
	I0918 16:59:06.724220   60243 system_pods.go:89] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 16:59:06.724225   60243 system_pods.go:89] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 16:59:06.724239   60243 system_pods.go:89] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 16:59:06.724243   60243 system_pods.go:89] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 16:59:06.724246   60243 system_pods.go:89] "kube-scheduler-ha-078118-m03" [93dfed73-cd97-4f3f-804e-ffdd528fd8ff] Running
	I0918 16:59:06.724250   60243 system_pods.go:89] "kube-vip-ha-078118" [9d6c9fdb-435c-43e0-b477-6ad4ac75fecf] Running
	I0918 16:59:06.724254   60243 system_pods.go:89] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 16:59:06.724257   60243 system_pods.go:89] "kube-vip-ha-078118-m03" [919fbb1f-4ca4-41e2-a8f7-6d2c73f81558] Running
	I0918 16:59:06.724260   60243 system_pods.go:89] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 16:59:06.724267   60243 system_pods.go:126] duration metric: took 5.831309ms to wait for k8s-apps to be running ...
	I0918 16:59:06.724283   60243 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 16:59:06.724337   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 16:59:06.737206   60243 system_svc.go:56] duration metric: took 12.914941ms WaitForService to wait for kubelet
	I0918 16:59:06.737236   60243 kubeadm.go:578] duration metric: took 11.668634825s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 16:59:06.737259   60243 node_conditions.go:102] verifying NodePressure condition ...
	I0918 16:59:06.740948   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:59:06.740970   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:59:06.740982   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:59:06.740985   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:59:06.740989   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:59:06.740991   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:59:06.740995   60243 node_conditions.go:105] duration metric: took 3.731587ms to run NodePressure ...
	I0918 16:59:06.741004   60243 start.go:241] waiting for startup goroutines ...
	I0918 16:59:06.741023   60243 start.go:255] writing updated cluster config ...
	I0918 16:59:06.741314   60243 ssh_runner.go:195] Run: rm -f paused
	I0918 16:59:06.745246   60243 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
	I0918 16:59:06.745875   60243 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0918 16:59:06.755285   60243 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-g9xk6" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.761037   60243 pod_ready.go:94] pod "coredns-66bc5c9577-g9xk6" is "Ready"
	I0918 16:59:06.761068   60243 pod_ready.go:86] duration metric: took 5.756901ms for pod "coredns-66bc5c9577-g9xk6" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.761077   60243 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-q42l7" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.767008   60243 pod_ready.go:94] pod "coredns-66bc5c9577-q42l7" is "Ready"
	I0918 16:59:06.767034   60243 pod_ready.go:86] duration metric: took 5.951535ms for pod "coredns-66bc5c9577-q42l7" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.770112   60243 pod_ready.go:83] waiting for pod "etcd-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.775267   60243 pod_ready.go:94] pod "etcd-ha-078118" is "Ready"
	I0918 16:59:06.775293   60243 pod_ready.go:86] duration metric: took 5.152116ms for pod "etcd-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.775303   60243 pod_ready.go:83] waiting for pod "etcd-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.780471   60243 pod_ready.go:94] pod "etcd-ha-078118-m02" is "Ready"
	I0918 16:59:06.780496   60243 pod_ready.go:86] duration metric: took 5.187344ms for pod "etcd-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.780520   60243 pod_ready.go:83] waiting for pod "etcd-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.946978   60243 request.go:683] "Waited before sending request" delay="166.314978ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/etcd-ha-078118-m03"
	I0918 16:59:07.146449   60243 request.go:683] "Waited before sending request" delay="196.292592ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:07.149449   60243 pod_ready.go:94] pod "etcd-ha-078118-m03" is "Ready"
	I0918 16:59:07.149474   60243 pod_ready.go:86] duration metric: took 368.947616ms for pod "etcd-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:07.346915   60243 request.go:683] "Waited before sending request" delay="197.328502ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Dkube-apiserver"
	I0918 16:59:07.350725   60243 pod_ready.go:83] waiting for pod "kube-apiserver-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:07.547175   60243 request.go:683] "Waited before sending request" delay="196.345419ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-078118"
	I0918 16:59:07.746829   60243 request.go:683] "Waited before sending request" delay="196.329751ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118"
	I0918 16:59:07.749941   60243 pod_ready.go:94] pod "kube-apiserver-ha-078118" is "Ready"
	I0918 16:59:07.749966   60243 pod_ready.go:86] duration metric: took 399.217151ms for pod "kube-apiserver-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:07.749974   60243 pod_ready.go:83] waiting for pod "kube-apiserver-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:07.947401   60243 request.go:683] "Waited before sending request" delay="197.34038ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-078118-m02"
	I0918 16:59:08.147239   60243 request.go:683] "Waited before sending request" delay="196.36185ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m02"
	I0918 16:59:08.150202   60243 pod_ready.go:94] pod "kube-apiserver-ha-078118-m02" is "Ready"
	I0918 16:59:08.150227   60243 pod_ready.go:86] duration metric: took 400.248007ms for pod "kube-apiserver-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:08.150235   60243 pod_ready.go:83] waiting for pod "kube-apiserver-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:08.346585   60243 request.go:683] "Waited before sending request" delay="196.280443ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-078118-m03"
	I0918 16:59:08.547289   60243 request.go:683] "Waited before sending request" delay="197.397248ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:08.550234   60243 pod_ready.go:94] pod "kube-apiserver-ha-078118-m03" is "Ready"
	I0918 16:59:08.550261   60243 pod_ready.go:86] duration metric: took 400.020405ms for pod "kube-apiserver-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:08.746686   60243 request.go:683] "Waited before sending request" delay="196.336839ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Dkube-controller-manager"
	I0918 16:59:08.750717   60243 pod_ready.go:83] waiting for pod "kube-controller-manager-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:08.947162   60243 request.go:683] "Waited before sending request" delay="196.333247ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-078118"
	I0918 16:59:09.146966   60243 request.go:683] "Waited before sending request" delay="196.326126ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118"
	I0918 16:59:09.150067   60243 pod_ready.go:94] pod "kube-controller-manager-ha-078118" is "Ready"
	I0918 16:59:09.150092   60243 pod_ready.go:86] duration metric: took 399.351356ms for pod "kube-controller-manager-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:09.150102   60243 pod_ready.go:83] waiting for pod "kube-controller-manager-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:09.346457   60243 request.go:683] "Waited before sending request" delay="196.279389ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-078118-m02"
	I0918 16:59:09.547040   60243 request.go:683] "Waited before sending request" delay="197.354653ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m02"
	I0918 16:59:09.550374   60243 pod_ready.go:94] pod "kube-controller-manager-ha-078118-m02" is "Ready"
	I0918 16:59:09.550404   60243 pod_ready.go:86] duration metric: took 400.295786ms for pod "kube-controller-manager-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:09.550413   60243 pod_ready.go:83] waiting for pod "kube-controller-manager-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:09.746708   60243 request.go:683] "Waited before sending request" delay="196.202501ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-078118-m03"
	I0918 16:59:09.946436   60243 request.go:683] "Waited before sending request" delay="196.280211ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:09.949494   60243 pod_ready.go:94] pod "kube-controller-manager-ha-078118-m03" is "Ready"
	I0918 16:59:09.949530   60243 pod_ready.go:86] duration metric: took 399.112324ms for pod "kube-controller-manager-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.146961   60243 request.go:683] "Waited before sending request" delay="197.325522ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods?labelSelector=k8s-app%3Dkube-proxy"
	I0918 16:59:10.150701   60243 pod_ready.go:83] waiting for pod "kube-proxy-2pjrn" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.347162   60243 request.go:683] "Waited before sending request" delay="196.352062ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-proxy-2pjrn"
	I0918 16:59:10.547072   60243 request.go:683] "Waited before sending request" delay="196.358455ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:10.550523   60243 pod_ready.go:94] pod "kube-proxy-2pjrn" is "Ready"
	I0918 16:59:10.550553   60243 pod_ready.go:86] duration metric: took 399.827869ms for pod "kube-proxy-2pjrn" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.550565   60243 pod_ready.go:83] waiting for pod "kube-proxy-b98xh" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.746898   60243 request.go:683] "Waited before sending request" delay="196.251425ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-proxy-b98xh"
	I0918 16:59:10.946676   60243 request.go:683] "Waited before sending request" delay="196.176643ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118"
	I0918 16:59:10.950120   60243 pod_ready.go:94] pod "kube-proxy-b98xh" is "Ready"
	I0918 16:59:10.950149   60243 pod_ready.go:86] duration metric: took 399.577448ms for pod "kube-proxy-b98xh" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.950157   60243 pod_ready.go:83] waiting for pod "kube-proxy-t5wdg" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:11.146526   60243 request.go:683] "Waited before sending request" delay="196.259149ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-proxy-t5wdg"
	I0918 16:59:11.347110   60243 request.go:683] "Waited before sending request" delay="197.374002ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m02"
	I0918 16:59:11.350466   60243 pod_ready.go:94] pod "kube-proxy-t5wdg" is "Ready"
	I0918 16:59:11.350490   60243 pod_ready.go:86] duration metric: took 400.328216ms for pod "kube-proxy-t5wdg" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:11.546945   60243 request.go:683] "Waited before sending request" delay="196.317609ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Dkube-scheduler"
	I0918 16:59:11.550749   60243 pod_ready.go:83] waiting for pod "kube-scheduler-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:11.746977   60243 request.go:683] "Waited before sending request" delay="196.123839ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-078118"
	I0918 16:59:11.946489   60243 request.go:683] "Waited before sending request" delay="196.183652ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118"
	I0918 16:59:11.949628   60243 pod_ready.go:94] pod "kube-scheduler-ha-078118" is "Ready"
	I0918 16:59:11.949654   60243 pod_ready.go:86] duration metric: took 398.882401ms for pod "kube-scheduler-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:11.949664   60243 pod_ready.go:83] waiting for pod "kube-scheduler-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:12.147112   60243 request.go:683] "Waited before sending request" delay="197.344287ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-078118-m02"
	I0918 16:59:12.347169   60243 request.go:683] "Waited before sending request" delay="194.379019ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m02"
	I0918 16:59:12.350560   60243 pod_ready.go:94] pod "kube-scheduler-ha-078118-m02" is "Ready"
	I0918 16:59:12.350590   60243 pod_ready.go:86] duration metric: took 400.919858ms for pod "kube-scheduler-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:12.350599   60243 pod_ready.go:83] waiting for pod "kube-scheduler-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:12.547018   60243 request.go:683] "Waited before sending request" delay="196.33287ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-078118-m03"
	I0918 16:59:12.746565   60243 request.go:683] "Waited before sending request" delay="196.309682ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:12.749906   60243 pod_ready.go:94] pod "kube-scheduler-ha-078118-m03" is "Ready"
	I0918 16:59:12.749934   60243 pod_ready.go:86] duration metric: took 399.329614ms for pod "kube-scheduler-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:12.749945   60243 pod_ready.go:40] duration metric: took 6.004651446s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
	I0918 16:59:12.794689   60243 start.go:623] kubectl: 1.34.1, cluster: 1.34.0 (minor skew: 0)
	I0918 16:59:12.796689   60243 out.go:179] * Done! kubectl is now configured to use "ha-078118" cluster and "default" namespace by default
	
	
	==> CRI-O <==
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.765846307Z" level=info msg="Got pod network &{Name:coredns-66bc5c9577-q42l7 Namespace:kube-system ID:0f4c57d36fe625b73febbabe66c94a6fb7be96bd382b63dbe134a57a30fcc203 UID:c21094f1-585a-4109-b526-3a115d45f35f NetNS:/var/run/netns/ea110cd7-655f-4db5-9869-6caeb4e1e0b3 Networks:[] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.766003644Z" level=info msg="Checking pod kube-system_coredns-66bc5c9577-q42l7 for CNI network kindnet (type=ptp)"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.766404225Z" level=info msg="Checking image status: registry.k8s.io/coredns/coredns:v1.12.1" id=ef4ff467-d538-4946-933c-e5b5e907e1f3 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.766638638Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969,RepoTags:[registry.k8s.io/coredns/coredns:v1.12.1],RepoDigests:[registry.k8s.io/coredns/coredns@sha256:4f7a57135719628cf2070c5e3cbde64b013e90d4c560c5ecbf14004181f91998 registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c],Size_:76103547,Uid:nil,Username:nonroot,Spec:nil,},Info:map[string]string{},}" id=ef4ff467-d538-4946-933c-e5b5e907e1f3 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.767610373Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769256295Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/eec0c1a1e3f1faa7e681f72b6e678fe56d2fe548328908380b50105d4c4c5f9d/merged/etc/passwd: no such file or directory"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769296755Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/eec0c1a1e3f1faa7e681f72b6e678fe56d2fe548328908380b50105d4c4c5f9d/merged/etc/group: no such file or directory"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769333451Z" level=info msg="Creating container: kube-system/coredns-66bc5c9577-g9xk6/coredns" id=075f19de-1f75-4e06-b926-bfc1c8e7585c name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769428698Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769443027Z" level=info msg="Ran pod sandbox 0f4c57d36fe625b73febbabe66c94a6fb7be96bd382b63dbe134a57a30fcc203 with infra container: kube-system/coredns-66bc5c9577-q42l7/POD" id=000880e9-0203-43be-9f90-44bb795de328 name=/runtime.v1.RuntimeService/RunPodSandbox
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.770428742Z" level=info msg="Checking image status: registry.k8s.io/coredns/coredns:v1.12.1" id=95b3db0e-d1ae-4a3e-a514-6be61c509f71 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.775530535Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969,RepoTags:[registry.k8s.io/coredns/coredns:v1.12.1],RepoDigests:[registry.k8s.io/coredns/coredns@sha256:4f7a57135719628cf2070c5e3cbde64b013e90d4c560c5ecbf14004181f91998 registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c],Size_:76103547,Uid:nil,Username:nonroot,Spec:nil,},Info:map[string]string{},}" id=95b3db0e-d1ae-4a3e-a514-6be61c509f71 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.776278769Z" level=info msg="Checking image status: registry.k8s.io/coredns/coredns:v1.12.1" id=0b0dcec1-95b6-495b-9197-5f67161037dc name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.776462315Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969,RepoTags:[registry.k8s.io/coredns/coredns:v1.12.1],RepoDigests:[registry.k8s.io/coredns/coredns@sha256:4f7a57135719628cf2070c5e3cbde64b013e90d4c560c5ecbf14004181f91998 registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c],Size_:76103547,Uid:nil,Username:nonroot,Spec:nil,},Info:map[string]string{},}" id=0b0dcec1-95b6-495b-9197-5f67161037dc name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.779861607Z" level=info msg="Creating container: kube-system/coredns-66bc5c9577-q42l7/coredns" id=117c2489-b1bc-4e99-a3fa-ff10fa77c595 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.779940361Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.830159804Z" level=info msg="Created container 8adb6b34c613123531cf4233efc222dc4757692856895124a5e5db1a632a5b52: kube-system/storage-provisioner/storage-provisioner" id=5f7f2550-0b1b-47f1-b48c-5332a46450a7 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.830924779Z" level=info msg="Starting container: 8adb6b34c613123531cf4233efc222dc4757692856895124a5e5db1a632a5b52" id=52dc1dd3-f88a-484c-ab17-4d9f0b621779 name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.836679300Z" level=info msg="Created container 08391430590c253ff1b0064ee6c84e80981d5f041bc5ae9709bdf04d2b9aee8b: kube-system/coredns-66bc5c9577-g9xk6/coredns" id=075f19de-1f75-4e06-b926-bfc1c8e7585c name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.837315664Z" level=info msg="Starting container: 08391430590c253ff1b0064ee6c84e80981d5f041bc5ae9709bdf04d2b9aee8b" id=8bb023fd-89bf-411c-a6a6-6f2df8ddd77a name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.838803837Z" level=info msg="Started container" PID=2258 containerID=8adb6b34c613123531cf4233efc222dc4757692856895124a5e5db1a632a5b52 description=kube-system/storage-provisioner/storage-provisioner id=52dc1dd3-f88a-484c-ab17-4d9f0b621779 name=/runtime.v1.RuntimeService/StartContainer sandboxID=6928f50153d919aa3e3760ba1aa0739a387e79370881e9f1e54c731a0f3caea0
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.845287935Z" level=info msg="Started container" PID=2268 containerID=08391430590c253ff1b0064ee6c84e80981d5f041bc5ae9709bdf04d2b9aee8b description=kube-system/coredns-66bc5c9577-g9xk6/coredns id=8bb023fd-89bf-411c-a6a6-6f2df8ddd77a name=/runtime.v1.RuntimeService/StartContainer sandboxID=afde323910d94bea88be826de7977fce80c072eae58aba3bfd7c8d68a054031f
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.864792220Z" level=info msg="Created container aa37f0e0424d50f1f3f546dfdbacd705bc960545c699db9837bdf759142b77a6: kube-system/coredns-66bc5c9577-q42l7/coredns" id=117c2489-b1bc-4e99-a3fa-ff10fa77c595 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.865391067Z" level=info msg="Starting container: aa37f0e0424d50f1f3f546dfdbacd705bc960545c699db9837bdf759142b77a6" id=34f0c5a7-2503-4694-8c57-c675b57bdd4b name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.872859452Z" level=info msg="Started container" PID=2308 containerID=aa37f0e0424d50f1f3f546dfdbacd705bc960545c699db9837bdf759142b77a6 description=kube-system/coredns-66bc5c9577-q42l7/coredns id=34f0c5a7-2503-4694-8c57-c675b57bdd4b name=/runtime.v1.RuntimeService/StartContainer sandboxID=0f4c57d36fe625b73febbabe66c94a6fb7be96bd382b63dbe134a57a30fcc203
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                               CREATED             STATE               NAME                      ATTEMPT             POD ID              POD
	aa37f0e0424d5       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                    2 minutes ago       Running             coredns                   0                   0f4c57d36fe62       coredns-66bc5c9577-q42l7
	08391430590c2       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                    2 minutes ago       Running             coredns                   0                   afde323910d94       coredns-66bc5c9577-g9xk6
	8adb6b34c6131       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                    2 minutes ago       Running             storage-provisioner       0                   6928f50153d91       storage-provisioner
	9d8271cae4bea       df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce                                    2 minutes ago       Running             kube-proxy                0                   391ffd3ffc487       kube-proxy-b98xh
	ace9ff4888542       409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c                                    2 minutes ago       Running             kindnet-cni               0                   4f7dc3d8e273c       kindnet-vqp76
	b6c234acce33d       ghcr.io/kube-vip/kube-vip@sha256:4f256554a83a6d824ea9c5307450a2c3fd132e09c52b339326f94fefaf67155c   3 minutes ago       Running             kube-vip                  0                   23e85847e6956       kube-vip-ha-078118
	db2ea624fa9b6       46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc                                    3 minutes ago       Running             kube-scheduler            0                   b36f66256961f       kube-scheduler-ha-078118
	642183ab67e73       a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634                                    3 minutes ago       Running             kube-controller-manager   0                   36e9334424f59       kube-controller-manager-ha-078118
	585dfd4fc0ca4       90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90                                    3 minutes ago       Running             kube-apiserver            0                   237ac462ccd86       kube-apiserver-ha-078118
	e11573adbeb5b       5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115                                    3 minutes ago       Running             etcd                      0                   780b62a8fc57d       etcd-ha-078118
	
	
	==> coredns [08391430590c253ff1b0064ee6c84e80981d5f041bc5ae9709bdf04d2b9aee8b] <==
	[INFO] 10.244.2.2:48579 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000213733s
	[INFO] 10.244.2.2:38852 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000147704s
	[INFO] 10.244.2.2:49722 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000215281s
	[INFO] 10.244.2.2:50509 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000150614s
	[INFO] 10.244.2.2:36432 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000124749s
	[INFO] 10.244.1.3:48987 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 111 0.009640803s
	[INFO] 10.244.1.3:34978 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000185219s
	[INFO] 10.244.1.3:42844 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000118247s
	[INFO] 10.244.1.3:56800 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000144749s
	[INFO] 10.244.1.2:49805 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000131607s
	[INFO] 10.244.1.2:57672 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000175017s
	[INFO] 10.244.1.2:59217 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000076607s
	[INFO] 10.244.2.2:59905 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000198959s
	[INFO] 10.244.2.2:35101 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000161137s
	[INFO] 10.244.1.3:37941 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000169116s
	[INFO] 10.244.1.2:60488 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00024264s
	[INFO] 10.244.2.2:60234 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000151314s
	[INFO] 10.244.2.2:42839 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000121874s
	[INFO] 10.244.1.3:38379 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.00013483s
	[INFO] 10.244.1.3:58046 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000167227s
	[INFO] 10.244.1.3:44714 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000092544s
	[INFO] 10.244.1.3:35218 - 5 "PTR IN 1.49.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000113387s
	[INFO] 10.244.1.2:59456 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000135367s
	[INFO] 10.244.1.2:35335 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000085423s
	[INFO] 10.244.1.2:35400 - 5 "PTR IN 1.49.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000096216s
	
	
	==> coredns [aa37f0e0424d50f1f3f546dfdbacd705bc960545c699db9837bdf759142b77a6] <==
	[INFO] 10.244.1.3:44450 - 6 "PTR IN 90.167.197.15.in-addr.arpa. udp 44 false 512" NOERROR qr,rd,ra 126 0.000909376s
	[INFO] 10.244.1.2:44019 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 140 0.000135871s
	[INFO] 10.244.2.2:56869 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000130632s
	[INFO] 10.244.2.2:46287 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 111 0.012245391s
	[INFO] 10.244.2.2:35509 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 111 0.009452726s
	[INFO] 10.244.1.3:51577 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000132103s
	[INFO] 10.244.1.3:45622 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000167069s
	[INFO] 10.244.1.3:38225 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000085042s
	[INFO] 10.244.1.3:45379 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000129198s
	[INFO] 10.244.1.2:53174 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000146423s
	[INFO] 10.244.1.2:48602 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.00009464s
	[INFO] 10.244.1.2:58862 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000135263s
	[INFO] 10.244.1.2:44989 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000093968s
	[INFO] 10.244.1.2:38888 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000167556s
	[INFO] 10.244.2.2:53888 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000144401s
	[INFO] 10.244.2.2:56382 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000096741s
	[INFO] 10.244.1.3:34825 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000143164s
	[INFO] 10.244.1.3:37381 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000153037s
	[INFO] 10.244.1.3:57943 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000098689s
	[INFO] 10.244.1.2:51449 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000134731s
	[INFO] 10.244.1.2:40898 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000183095s
	[INFO] 10.244.1.2:36063 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00011511s
	[INFO] 10.244.2.2:55350 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000152924s
	[INFO] 10.244.2.2:53746 - 5 "PTR IN 1.49.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000142562s
	[INFO] 10.244.1.2:36341 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000127988s
	
	
	==> describe nodes <==
	Name:               ha-078118
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2025_09_18T16_57_20_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:57:14 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:00:12 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 16:57:34 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 16:57:34 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 16:57:34 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 16:57:34 +0000   Thu, 18 Sep 2025 16:57:34 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ha-078118
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 37066c4af2194678a9f70f4417168319
	  System UUID:                910bee46-adcd-4833-91ec-cea7d3c2588c
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (10 in total)
	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---
	  kube-system                 coredns-66bc5c9577-g9xk6             100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     2m58s
	  kube-system                 coredns-66bc5c9577-q42l7             100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     2m58s
	  kube-system                 etcd-ha-078118                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         3m2s
	  kube-system                 kindnet-vqp76                        100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      2m58s
	  kube-system                 kube-apiserver-ha-078118             250m (3%)     0 (0%)      0 (0%)           0 (0%)         3m2s
	  kube-system                 kube-controller-manager-ha-078118    200m (2%)     0 (0%)      0 (0%)           0 (0%)         3m2s
	  kube-system                 kube-proxy-b98xh                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m58s
	  kube-system                 kube-scheduler-ha-078118             100m (1%)     0 (0%)      0 (0%)           0 (0%)         3m2s
	  kube-system                 kube-vip-ha-078118                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m6s
	  kube-system                 storage-provisioner                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m58s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (11%)  100m (1%)
	  memory             290Mi (0%)  390Mi (1%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                  From             Message
	  ----    ------                   ----                 ----             -------
	  Normal  Starting                 2m58s                kube-proxy       
	  Normal  NodeHasSufficientPID     3m9s (x8 over 3m9s)  kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  Starting                 3m9s                 kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  3m9s (x8 over 3m9s)  kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    3m9s (x8 over 3m9s)  kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 3m2s                 kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  3m2s                 kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    3m2s                 kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     3m2s                 kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           3m                   node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  NodeReady                2m47s                kubelet          Node ha-078118 status is now: NodeReady
	  Normal  RegisteredNode           2m33s                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           89s                  node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	
	
	Name:               ha-078118-m02
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118-m02
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=false
	                    minikube.k8s.io/updated_at=2025_09_18T16_57_51_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:57:50 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118-m02
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:00:03 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 16:59:42 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 16:59:42 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 16:59:42 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 16:59:42 +0000   Thu, 18 Sep 2025 16:58:34 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.3
	  Hostname:    ha-078118-m02
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 882d2104d1f448dc91d641e38cc92424
	  System UUID:                0093212b-e7dd-4bdc-8376-480f39da7714
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.1.0/24
	PodCIDRs:                     10.244.1.0/24
	Non-terminated Pods:          (9 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     busybox-7b57f96db7-bzrv2                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         68s
	  default                     busybox-7b57f96db7-t7rzr                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         68s
	  kube-system                 etcd-ha-078118-m02                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         2m29s
	  kube-system                 kindnet-jnlbr                            100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      2m31s
	  kube-system                 kube-apiserver-ha-078118-m02             250m (3%)     0 (0%)      0 (0%)           0 (0%)         2m29s
	  kube-system                 kube-controller-manager-ha-078118-m02    200m (2%)     0 (0%)      0 (0%)           0 (0%)         2m29s
	  kube-system                 kube-proxy-t5wdg                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m31s
	  kube-system                 kube-scheduler-ha-078118-m02             100m (1%)     0 (0%)      0 (0%)           0 (0%)         2m29s
	  kube-system                 kube-vip-ha-078118-m02                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m29s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%)   100m (1%)
	  memory             150Mi (0%)  50Mi (0%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason          Age    From             Message
	  ----    ------          ----   ----             -------
	  Normal  Starting        2m27s  kube-proxy       
	  Normal  RegisteredNode  2m30s  node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode  2m28s  node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode  89s    node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	
	
	Name:               ha-078118-m03
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118-m03
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=false
	                    minikube.k8s.io/updated_at=2025_09_18T16_58_54_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:58:54 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118-m03
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:00:15 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 16:59:24 +0000   Thu, 18 Sep 2025 16:58:54 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 16:59:24 +0000   Thu, 18 Sep 2025 16:58:54 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 16:59:24 +0000   Thu, 18 Sep 2025 16:58:54 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 16:59:24 +0000   Thu, 18 Sep 2025 16:59:06 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.4
	  Hostname:    ha-078118-m03
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 1cf4ae8c7cb4403a9f1c3d032956eb17
	  System UUID:                aad5bb9a-fbfa-4299-aec8-4ade9724e58c
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.2.0/24
	PodCIDRs:                     10.244.2.0/24
	Non-terminated Pods:          (8 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     busybox-7b57f96db7-95578                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         69s
	  kube-system                 etcd-ha-078118-m03                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         87s
	  kube-system                 kindnet-f2b4b                            100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      88s
	  kube-system                 kube-apiserver-ha-078118-m03             250m (3%)     0 (0%)      0 (0%)           0 (0%)         87s
	  kube-system                 kube-controller-manager-ha-078118-m03    200m (2%)     0 (0%)      0 (0%)           0 (0%)         87s
	  kube-system                 kube-proxy-2pjrn                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         88s
	  kube-system                 kube-scheduler-ha-078118-m03             100m (1%)     0 (0%)      0 (0%)           0 (0%)         87s
	  kube-system                 kube-vip-ha-078118-m03                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         87s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%)   100m (1%)
	  memory             150Mi (0%)  50Mi (0%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason          Age   From             Message
	  ----    ------          ----  ----             -------
	  Normal  Starting        85s   kube-proxy       
	  Normal  RegisteredNode  85s   node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	  Normal  RegisteredNode  85s   node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	  Normal  RegisteredNode  84s   node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	
	
	==> dmesg <==
	[  +0.089038] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
	[  +0.028015] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
	[  +7.570818] kauditd_printk_skb: 47 callbacks suppressed
	[Sep18 16:41] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.013586] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023854] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023944] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023869] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023927] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000033] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +2.047789] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +4.031621] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000030] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +8.127251] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[Sep18 16:42] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[ +32.253146] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	
	
	==> etcd [e11573adbeb5b82db9b0ef3e45c8776e5669152b9e1194fc07eb290c619b2bf5] <==
	{"level":"info","ts":"2025-09-18T16:58:47.604085Z","caller":"etcdserver/server.go:1752","msg":"applied a configuration change through raft","local-member-id":"aec36adc501070cc","raft-conf-change":"ConfChangeAddNode","raft-conf-change-node-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T16:58:51.324691Z","caller":"etcdserver/server.go:2246","msg":"skip compaction since there is an inflight snapshot"}
	{"level":"info","ts":"2025-09-18T16:58:54.543741Z","caller":"etcdserver/server.go:2246","msg":"skip compaction since there is an inflight snapshot"}
	{"level":"info","ts":"2025-09-18T16:59:05.386133Z","caller":"etcdserver/server.go:2246","msg":"skip compaction since there is an inflight snapshot"}
	{"level":"info","ts":"2025-09-18T16:59:13.871097Z","caller":"etcdserver/server.go:2246","msg":"skip compaction since there is an inflight snapshot"}
	{"level":"info","ts":"2025-09-18T16:59:16.560165Z","caller":"etcdserver/server.go:2246","msg":"skip compaction since there is an inflight snapshot"}
	{"level":"info","ts":"2025-09-18T16:59:17.187746Z","caller":"etcdserver/server.go:1856","msg":"sent merged snapshot","from":"aec36adc501070cc","to":"4e0bda6b41205435","bytes":1573398,"size":"1.6 MB","took":"30.017552691s"}
	{"level":"warn","ts":"2025-09-18T16:59:25.341873Z","caller":"etcdserver/raft.go:387","msg":"leader failed to send out heartbeat on time; took too long, leader is overloaded likely from slow disk","to":"4e0bda6b41205435","heartbeat-interval":"100ms","expected-duration":"200ms","exceeded-duration":"155.750963ms"}
	{"level":"warn","ts":"2025-09-18T16:59:25.341928Z","caller":"etcdserver/raft.go:387","msg":"leader failed to send out heartbeat on time; took too long, leader is overloaded likely from slow disk","to":"14496796fca4c312","heartbeat-interval":"100ms","expected-duration":"200ms","exceeded-duration":"155.814769ms"}
	{"level":"info","ts":"2025-09-18T16:59:25.342422Z","caller":"traceutil/trace.go:172","msg":"trace[706354734] linearizableReadLoop","detail":"{readStateIndex:1267; appliedIndex:1268; }","duration":"297.991952ms","start":"2025-09-18T16:59:25.044410Z","end":"2025-09-18T16:59:25.342402Z","steps":["trace[706354734] 'read index received'  (duration: 297.98539ms)","trace[706354734] 'applied index is now lower than readState.Index'  (duration: 4.701µs)"],"step_count":2}
	{"level":"warn","ts":"2025-09-18T16:59:25.342562Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"298.122579ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2025-09-18T16:59:25.342634Z","caller":"traceutil/trace.go:172","msg":"trace[1382353479] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1069; }","duration":"298.217452ms","start":"2025-09-18T16:59:25.044400Z","end":"2025-09-18T16:59:25.342617Z","steps":["trace[1382353479] 'agreement among raft nodes before linearized reading'  (duration: 298.046799ms)"],"step_count":1}
	{"level":"warn","ts":"2025-09-18T16:59:25.445389Z","caller":"txn/util.go:93","msg":"apply request took too long","took":"100.440633ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2025-09-18T16:59:25.445467Z","caller":"traceutil/trace.go:172","msg":"trace[1927163165] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:1069; }","duration":"100.536026ms","start":"2025-09-18T16:59:25.344915Z","end":"2025-09-18T16:59:25.445451Z","steps":["trace[1927163165] 'agreement among raft nodes before linearized reading'  (duration: 71.069732ms)","trace[1927163165] 'range keys from in-memory index tree'  (duration: 29.345037ms)"],"step_count":2}
	{"level":"warn","ts":"2025-09-18T17:00:09.437143Z","caller":"rafthttp/stream.go:420","msg":"lost TCP streaming connection with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"aec36adc501070cc","remote-peer-id":"14496796fca4c312","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:00:09.437524Z","caller":"rafthttp/stream.go:420","msg":"lost TCP streaming connection with remote peer","stream-reader-type":"stream Message","local-member-id":"aec36adc501070cc","remote-peer-id":"14496796fca4c312","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:00:09.443359Z","caller":"rafthttp/peer_status.go:66","msg":"peer became inactive (message send to peer failed)","peer-id":"14496796fca4c312","error":"failed to dial 14496796fca4c312 on stream MsgApp v2 (EOF)"}
	{"level":"warn","ts":"2025-09-18T17:00:09.485718Z","caller":"etcdserver/cluster_util.go:259","msg":"failed to reach the peer URL","address":"https://192.168.49.3:2380/version","remote-member-id":"14496796fca4c312","error":"Get \"https://192.168.49.3:2380/version\": dial tcp 192.168.49.3:2380: connect: connection refused"}
	{"level":"warn","ts":"2025-09-18T17:00:09.485772Z","caller":"etcdserver/cluster_util.go:160","msg":"failed to get version","remote-member-id":"14496796fca4c312","error":"Get \"https://192.168.49.3:2380/version\": dial tcp 192.168.49.3:2380: connect: connection refused"}
	{"level":"warn","ts":"2025-09-18T17:00:09.613285Z","caller":"rafthttp/stream.go:222","msg":"lost TCP streaming connection with remote peer","stream-writer-type":"stream Message","local-member-id":"aec36adc501070cc","remote-peer-id":"14496796fca4c312"}
	{"level":"warn","ts":"2025-09-18T17:00:12.812751Z","caller":"rafthttp/stream.go:193","msg":"lost TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","local-member-id":"aec36adc501070cc","remote-peer-id":"14496796fca4c312"}
	{"level":"warn","ts":"2025-09-18T17:00:13.487209Z","caller":"etcdserver/cluster_util.go:259","msg":"failed to reach the peer URL","address":"https://192.168.49.3:2380/version","remote-member-id":"14496796fca4c312","error":"Get \"https://192.168.49.3:2380/version\": dial tcp 192.168.49.3:2380: connect: connection refused"}
	{"level":"warn","ts":"2025-09-18T17:00:13.487277Z","caller":"etcdserver/cluster_util.go:160","msg":"failed to get version","remote-member-id":"14496796fca4c312","error":"Get \"https://192.168.49.3:2380/version\": dial tcp 192.168.49.3:2380: connect: connection refused"}
	{"level":"warn","ts":"2025-09-18T17:00:17.488481Z","caller":"etcdserver/cluster_util.go:259","msg":"failed to reach the peer URL","address":"https://192.168.49.3:2380/version","remote-member-id":"14496796fca4c312","error":"Get \"https://192.168.49.3:2380/version\": dial tcp 192.168.49.3:2380: connect: connection refused"}
	{"level":"warn","ts":"2025-09-18T17:00:17.488564Z","caller":"etcdserver/cluster_util.go:160","msg":"failed to get version","remote-member-id":"14496796fca4c312","error":"Get \"https://192.168.49.3:2380/version\": dial tcp 192.168.49.3:2380: connect: connection refused"}
	
	
	==> kernel <==
	 17:00:22 up 42 min,  0 users,  load average: 1.63, 0.83, 0.50
	Linux ha-078118 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [ace9ff48885424be2f8facd8cbf5492de4495d890b080eb415e9e2c3e73bf84a] <==
	I0918 16:59:33.960668       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 16:59:43.952681       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 16:59:43.952733       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 16:59:43.952938       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:59:43.952951       1 main.go:301] handling current node
	I0918 16:59:43.952967       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 16:59:43.952974       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 16:59:53.961167       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 16:59:53.961199       1 main.go:301] handling current node
	I0918 16:59:53.961220       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 16:59:53.961226       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 16:59:53.961437       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 16:59:53.961449       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 17:00:03.959597       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:00:03.959642       1 main.go:301] handling current node
	I0918 17:00:03.959663       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:00:03.959671       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:00:03.959962       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 17:00:03.959977       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 17:00:13.951884       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:00:13.951925       1 main.go:301] handling current node
	I0918 17:00:13.951942       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:00:13.951947       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:00:13.952213       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 17:00:13.952225       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	
	
	==> kube-apiserver [585dfd4fc0ca43249f7d7bbc2f741d26128a1d13b2fc082db1eafbe1df6a50ad] <==
	I0918 16:57:19.858558       1 controller.go:667] quota admission added evaluator for: daemonsets.apps
	I0918 16:57:22.699949       1 controller.go:667] quota admission added evaluator for: replicasets.apps
	I0918 16:57:22.851659       1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
	I0918 16:57:22.858581       1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
	I0918 16:57:23.049475       1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
	I0918 16:57:23.049475       1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
	I0918 16:58:18.352060       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:58:35.569702       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	E0918 16:59:18.376823       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38134: use of closed network connection
	E0918 16:59:18.542476       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38154: use of closed network connection
	E0918 16:59:18.708555       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38184: use of closed network connection
	E0918 16:59:18.891237       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38202: use of closed network connection
	E0918 16:59:19.063367       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38222: use of closed network connection
	E0918 16:59:19.219859       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38248: use of closed network connection
	E0918 16:59:19.374345       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38266: use of closed network connection
	E0918 16:59:19.528245       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38290: use of closed network connection
	E0918 16:59:19.686890       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38294: use of closed network connection
	E0918 16:59:19.960717       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38322: use of closed network connection
	E0918 16:59:20.128027       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38350: use of closed network connection
	E0918 16:59:20.286654       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38362: use of closed network connection
	E0918 16:59:20.443716       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38382: use of closed network connection
	E0918 16:59:20.608349       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38406: use of closed network connection
	E0918 16:59:20.762819       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38416: use of closed network connection
	I0918 16:59:23.504820       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:59:44.133401       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	
	
	==> kube-controller-manager [642183ab67e7396340c3ad521e32b9cc18b992cf199597510b44396413805c56] <==
	I0918 16:57:21.996127       1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
	I0918 16:57:21.996161       1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
	I0918 16:57:21.996195       1 shared_informer.go:356] "Caches are synced" controller="attach detach"
	I0918 16:57:21.996207       1 shared_informer.go:356] "Caches are synced" controller="ReplicationController"
	I0918 16:57:21.996244       1 shared_informer.go:356] "Caches are synced" controller="taint-eviction-controller"
	I0918 16:57:21.996548       1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
	I0918 16:57:21.998625       1 shared_informer.go:356] "Caches are synced" controller="TTL after finished"
	I0918 16:57:21.998653       1 shared_informer.go:356] "Caches are synced" controller="stateful set"
	I0918 16:57:21.999787       1 shared_informer.go:356] "Caches are synced" controller="node"
	I0918 16:57:21.999840       1 range_allocator.go:177] "Sending events to api server" logger="node-ipam-controller"
	I0918 16:57:21.999874       1 range_allocator.go:183] "Starting range CIDR allocator" logger="node-ipam-controller"
	I0918 16:57:21.999884       1 shared_informer.go:349] "Waiting for caches to sync" controller="cidrallocator"
	I0918 16:57:21.999891       1 shared_informer.go:356] "Caches are synced" controller="cidrallocator"
	I0918 16:57:22.003084       1 shared_informer.go:356] "Caches are synced" controller="resource quota"
	I0918 16:57:22.005449       1 shared_informer.go:356] "Caches are synced" controller="crt configmap"
	I0918 16:57:22.007795       1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="ha-078118" podCIDRs=["10.244.0.0/24"]
	I0918 16:57:22.014810       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	I0918 16:57:36.949312       1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
	I0918 16:57:50.908088       1 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-078118-m02\" does not exist"
	I0918 16:57:50.920374       1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="ha-078118-m02" podCIDRs=["10.244.1.0/24"]
	I0918 16:57:51.951916       1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-078118-m02"
	E0918 16:58:53.029464       1 certificate_controller.go:151] "Unhandled Error" err="Sync csr-ns7n2 failed with : error updating signature for csr: Operation cannot be fulfilled on certificatesigningrequests.certificates.k8s.io \"csr-ns7n2\": the object has been modified; please apply your changes to the latest version and try again" logger="UnhandledError"
	I0918 16:58:54.398116       1 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-078118-m03\" does not exist"
	I0918 16:58:54.408644       1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="ha-078118-m03" podCIDRs=["10.244.2.0/24"]
	I0918 16:58:57.035270       1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-078118-m03"
	
	
	==> kube-proxy [9d8271cae4bea6871005fa5672799aa187936aa79b11a2ceee4b632f181632d9] <==
	I0918 16:57:23.552129       1 server_linux.go:53] "Using iptables proxy"
	I0918 16:57:23.618582       1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
	I0918 16:57:23.719415       1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
	I0918 16:57:23.719477       1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.49.2"]
	E0918 16:57:23.719603       1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
	I0918 16:57:23.742365       1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0918 16:57:23.742445       1 server_linux.go:132] "Using iptables Proxier"
	I0918 16:57:23.749399       1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
	I0918 16:57:23.749845       1 server.go:527] "Version info" version="v1.34.0"
	I0918 16:57:23.749872       1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 16:57:23.751257       1 config.go:403] "Starting serviceCIDR config controller"
	I0918 16:57:23.751277       1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
	I0918 16:57:23.751307       1 config.go:200] "Starting service config controller"
	I0918 16:57:23.751312       1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
	I0918 16:57:23.751338       1 config.go:309] "Starting node config controller"
	I0918 16:57:23.751344       1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
	I0918 16:57:23.752416       1 config.go:106] "Starting endpoint slice config controller"
	I0918 16:57:23.752752       1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
	I0918 16:57:23.851721       1 shared_informer.go:356] "Caches are synced" controller="service config"
	I0918 16:57:23.851721       1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
	I0918 16:57:23.851724       1 shared_informer.go:356] "Caches are synced" controller="node config"
	I0918 16:57:23.852869       1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
	
	
	==> kube-scheduler [db2ea624fa9b69b8338be3fd1f439edd2f934d1bb03c166e93576e563be0e8fa] <==
	E0918 16:57:14.963359       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
	E0918 16:57:15.879600       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
	E0918 16:57:15.986882       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
	E0918 16:57:15.993286       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
	E0918 16:57:15.994165       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
	E0918 16:57:16.023788       1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
	E0918 16:57:16.047113       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
	E0918 16:57:16.071789       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
	E0918 16:57:16.077882       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
	E0918 16:57:16.154294       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
	E0918 16:57:16.219883       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
	E0918 16:57:16.270378       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
	E0918 16:57:16.276428       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
	I0918 16:57:18.258571       1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	E0918 16:57:50.963316       1 framework.go:1400] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-gbrxz\": pod kindnet-gbrxz is already assigned to node \"ha-078118-m02\"" plugin="DefaultBinder" pod="kube-system/kindnet-gbrxz" node="ha-078118-m02"
	E0918 16:57:50.963458       1 schedule_one.go:1079] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-gbrxz\": pod kindnet-gbrxz is already assigned to node \"ha-078118-m02\"" logger="UnhandledError" pod="kube-system/kindnet-gbrxz"
	E0918 16:58:54.440393       1 framework.go:1400] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-tghfn\": pod kindnet-tghfn is already assigned to node \"ha-078118-m03\"" plugin="DefaultBinder" pod="kube-system/kindnet-tghfn" node="ha-078118-m03"
	E0918 16:58:54.440466       1 schedule_one.go:379] "scheduler cache ForgetPod failed" err="pod 22e6ba4d-8bbb-45e6-8e87-9527b52452e1(kube-system/kindnet-tghfn) wasn't assumed so cannot be forgotten" logger="UnhandledError" pod="kube-system/kindnet-tghfn"
	E0918 16:58:54.440493       1 schedule_one.go:1079] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-tghfn\": pod kindnet-tghfn is already assigned to node \"ha-078118-m03\"" logger="UnhandledError" pod="kube-system/kindnet-tghfn"
	I0918 16:58:54.441957       1 schedule_one.go:1092] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-tghfn" node="ha-078118-m03"
	I0918 16:59:13.788974       1 cache.go:512] "Pod was added to a different node than it was assumed" podKey="38c4aa96-8e5c-4bc7-a350-64f32c7e0774" pod="default/busybox-7b57f96db7-bzrv2" assumedNode="ha-078118-m02" currentNode="ha-078118"
	E0918 16:59:13.789425       1 framework.go:1400] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-7b57f96db7-bzrv2\": pod busybox-7b57f96db7-bzrv2 is already assigned to node \"ha-078118-m02\"" plugin="DefaultBinder" pod="default/busybox-7b57f96db7-bzrv2" node="ha-078118"
	E0918 16:59:13.789639       1 schedule_one.go:379] "scheduler cache ForgetPod failed" err="pod 38c4aa96-8e5c-4bc7-a350-64f32c7e0774(default/busybox-7b57f96db7-bzrv2) was assumed on ha-078118 but assigned to ha-078118-m02" logger="UnhandledError" pod="default/busybox-7b57f96db7-bzrv2"
	E0918 16:59:13.789660       1 schedule_one.go:1079] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-7b57f96db7-bzrv2\": pod busybox-7b57f96db7-bzrv2 is already assigned to node \"ha-078118-m02\"" logger="UnhandledError" pod="default/busybox-7b57f96db7-bzrv2"
	I0918 16:59:13.790820       1 schedule_one.go:1092] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-7b57f96db7-bzrv2" node="ha-078118-m02"
	
	
	==> kubelet <==
	Sep 18 16:59:13 ha-078118 kubelet[1671]: E0918 16:59:13.847406    1671 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5jljj], unattached volumes=[], failed to process volumes=[kube-api-access-5jljj]: context canceled" pod="default/busybox-7b57f96db7-bm55m" podUID="13d73e93-6fa6-4541-85bc-f9a8fbaed905"
	Sep 18 16:59:13 ha-078118 kubelet[1671]: I0918 16:59:13.946870    1671 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jljj\" (UniqueName: \"kubernetes.io/projected/13d73e93-6fa6-4541-85bc-f9a8fbaed905-kube-api-access-5jljj\") pod \"busybox-7b57f96db7-bm55m\" (UID: \"13d73e93-6fa6-4541-85bc-f9a8fbaed905\") " pod="default/busybox-7b57f96db7-bm55m"
	Sep 18 16:59:13 ha-078118 kubelet[1671]: I0918 16:59:13.947034    1671 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nssns\" (UniqueName: \"kubernetes.io/projected/bc6485bb-dcea-454a-81bb-b9d71c73f2f5-kube-api-access-nssns\") pod \"busybox-7b57f96db7-6lbn8\" (UID: \"bc6485bb-dcea-454a-81bb-b9d71c73f2f5\") " pod="default/busybox-7b57f96db7-6lbn8"
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.147735    1671 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jljj\" (UniqueName: \"kubernetes.io/projected/13d73e93-6fa6-4541-85bc-f9a8fbaed905-kube-api-access-5jljj\") pod \"13d73e93-6fa6-4541-85bc-f9a8fbaed905\" (UID: \"13d73e93-6fa6-4541-85bc-f9a8fbaed905\") "
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.147786    1671 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nssns\" (UniqueName: \"kubernetes.io/projected/bc6485bb-dcea-454a-81bb-b9d71c73f2f5-kube-api-access-nssns\") pod \"bc6485bb-dcea-454a-81bb-b9d71c73f2f5\" (UID: \"bc6485bb-dcea-454a-81bb-b9d71c73f2f5\") "
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.149862    1671 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13d73e93-6fa6-4541-85bc-f9a8fbaed905-kube-api-access-5jljj" (OuterVolumeSpecName: "kube-api-access-5jljj") pod "13d73e93-6fa6-4541-85bc-f9a8fbaed905" (UID: "13d73e93-6fa6-4541-85bc-f9a8fbaed905"). InnerVolumeSpecName "kube-api-access-5jljj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.150028    1671 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc6485bb-dcea-454a-81bb-b9d71c73f2f5-kube-api-access-nssns" (OuterVolumeSpecName: "kube-api-access-nssns") pod "bc6485bb-dcea-454a-81bb-b9d71c73f2f5" (UID: "bc6485bb-dcea-454a-81bb-b9d71c73f2f5"). InnerVolumeSpecName "kube-api-access-nssns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.248480    1671 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jljj\" (UniqueName: \"kubernetes.io/projected/13d73e93-6fa6-4541-85bc-f9a8fbaed905-kube-api-access-5jljj\") on node \"ha-078118\" DevicePath \"\""
	Sep 18 16:59:14 ha-078118 kubelet[1671]: I0918 16:59:14.248556    1671 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nssns\" (UniqueName: \"kubernetes.io/projected/bc6485bb-dcea-454a-81bb-b9d71c73f2f5-kube-api-access-nssns\") on node \"ha-078118\" DevicePath \"\""
	Sep 18 16:59:15 ha-078118 kubelet[1671]: I0918 16:59:15.660472    1671 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13d73e93-6fa6-4541-85bc-f9a8fbaed905" path="/var/lib/kubelet/pods/13d73e93-6fa6-4541-85bc-f9a8fbaed905/volumes"
	Sep 18 16:59:15 ha-078118 kubelet[1671]: I0918 16:59:15.660724    1671 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc6485bb-dcea-454a-81bb-b9d71c73f2f5" path="/var/lib/kubelet/pods/bc6485bb-dcea-454a-81bb-b9d71c73f2f5/volumes"
	Sep 18 16:59:19 ha-078118 kubelet[1671]: E0918 16:59:19.682422    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214759682138930  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:19 ha-078118 kubelet[1671]: E0918 16:59:19.682458    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214759682138930  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:29 ha-078118 kubelet[1671]: E0918 16:59:29.683746    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214769683420730  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:29 ha-078118 kubelet[1671]: E0918 16:59:29.683784    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214769683420730  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:39 ha-078118 kubelet[1671]: E0918 16:59:39.685040    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214779684726563  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:39 ha-078118 kubelet[1671]: E0918 16:59:39.685111    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214779684726563  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:49 ha-078118 kubelet[1671]: E0918 16:59:49.686597    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214789686357189  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:49 ha-078118 kubelet[1671]: E0918 16:59:49.686637    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214789686357189  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:59 ha-078118 kubelet[1671]: E0918 16:59:59.687988    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214799687737931  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:59 ha-078118 kubelet[1671]: E0918 16:59:59.688025    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214799687737931  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:00:09 ha-078118 kubelet[1671]: E0918 17:00:09.689196    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214809688933603  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:00:09 ha-078118 kubelet[1671]: E0918 17:00:09.689233    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214809688933603  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:00:19 ha-078118 kubelet[1671]: E0918 17:00:19.690293    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214819690057500  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:00:19 ha-078118 kubelet[1671]: E0918 17:00:19.690334    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214819690057500  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	

                                                
                                                
-- /stdout --
helpers_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-078118 -n ha-078118
helpers_test.go:269: (dbg) Run:  kubectl --context ha-078118 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestMultiControlPlane/serial/StopSecondaryNode FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestMultiControlPlane/serial/StopSecondaryNode (15.15s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartSecondaryNode (52.86s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode
ha_test.go:422: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 node start m02 --alsologtostderr -v 5
ha_test.go:422: (dbg) Done: out/minikube-linux-amd64 -p ha-078118 node start m02 --alsologtostderr -v 5: (8.380674471s)
ha_test.go:430: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5
ha_test.go:430: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5: exit status 7 (720.309231ms)

                                                
                                                
-- stdout --
	ha-078118
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m02
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:00:31.785302   83526 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:00:31.785926   83526 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:00:31.785943   83526 out.go:374] Setting ErrFile to fd 2...
	I0918 17:00:31.785950   83526 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:00:31.786435   83526 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:00:31.787081   83526 out.go:368] Setting JSON to false
	I0918 17:00:31.787138   83526 mustload.go:65] Loading cluster: ha-078118
	I0918 17:00:31.787233   83526 notify.go:220] Checking for updates...
	I0918 17:00:31.787598   83526 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:00:31.787618   83526 status.go:174] checking status of ha-078118 ...
	I0918 17:00:31.788080   83526 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:00:31.807921   83526 status.go:371] ha-078118 host status = "Running" (err=<nil>)
	I0918 17:00:31.807953   83526 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:00:31.808192   83526 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:00:31.827761   83526 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:00:31.828060   83526 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:31.828107   83526 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:00:31.847816   83526 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:00:31.942346   83526 ssh_runner.go:195] Run: systemctl --version
	I0918 17:00:31.947380   83526 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:31.960201   83526 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:00:32.018968   83526 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-09-18 17:00:32.007674984 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:00:32.019650   83526 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:32.019688   83526 api_server.go:166] Checking apiserver status ...
	I0918 17:00:32.019723   83526 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:32.031848   83526 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup
	W0918 17:00:32.042448   83526 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:32.042495   83526 ssh_runner.go:195] Run: ls
	I0918 17:00:32.047033   83526 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:32.051471   83526 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:32.051494   83526 status.go:463] ha-078118 apiserver status = Running (err=<nil>)
	I0918 17:00:32.051522   83526 status.go:176] ha-078118 status: &{Name:ha-078118 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:32.051549   83526 status.go:174] checking status of ha-078118-m02 ...
	I0918 17:00:32.051811   83526 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:00:32.070160   83526 status.go:371] ha-078118-m02 host status = "Running" (err=<nil>)
	I0918 17:00:32.070184   83526 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:00:32.070427   83526 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:00:32.088607   83526 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:00:32.088909   83526 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:32.088958   83526 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:00:32.107782   83526 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32808 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:00:32.201052   83526 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:32.213971   83526 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:32.213997   83526 api_server.go:166] Checking apiserver status ...
	I0918 17:00:32.214027   83526 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:32.225735   83526 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup
	W0918 17:00:32.236057   83526 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:32.236107   83526 ssh_runner.go:195] Run: ls
	I0918 17:00:32.239936   83526 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:32.244044   83526 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:32.244064   83526 status.go:463] ha-078118-m02 apiserver status = Running (err=<nil>)
	I0918 17:00:32.244073   83526 status.go:176] ha-078118-m02 status: &{Name:ha-078118-m02 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:32.244104   83526 status.go:174] checking status of ha-078118-m03 ...
	I0918 17:00:32.244366   83526 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:00:32.263467   83526 status.go:371] ha-078118-m03 host status = "Running" (err=<nil>)
	I0918 17:00:32.263487   83526 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:00:32.263782   83526 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:00:32.281653   83526 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:00:32.281920   83526 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:32.281965   83526 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:00:32.300356   83526 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:00:32.393757   83526 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:32.406376   83526 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:32.406402   83526 api_server.go:166] Checking apiserver status ...
	I0918 17:00:32.406433   83526 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:32.417842   83526 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup
	W0918 17:00:32.427709   83526 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:32.427767   83526 ssh_runner.go:195] Run: ls
	I0918 17:00:32.431468   83526 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:32.436919   83526 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:32.436956   83526 status.go:463] ha-078118-m03 apiserver status = Running (err=<nil>)
	I0918 17:00:32.436967   83526 status.go:176] ha-078118-m03 status: &{Name:ha-078118-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:32.436986   83526 status.go:174] checking status of ha-078118-m04 ...
	I0918 17:00:32.437279   83526 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:00:32.457603   83526 status.go:371] ha-078118-m04 host status = "Stopped" (err=<nil>)
	I0918 17:00:32.457631   83526 status.go:384] host is not running, skipping remaining checks
	I0918 17:00:32.457641   83526 status.go:176] ha-078118-m04 status: &{Name:ha-078118-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I0918 17:00:32.462927   11368 retry.go:31] will retry after 774.072554ms: exit status 7
ha_test.go:430: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5
ha_test.go:430: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5: exit status 7 (716.438596ms)

                                                
                                                
-- stdout --
	ha-078118
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m02
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:00:33.281030   83743 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:00:33.281171   83743 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:00:33.281179   83743 out.go:374] Setting ErrFile to fd 2...
	I0918 17:00:33.281186   83743 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:00:33.281374   83743 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:00:33.281612   83743 out.go:368] Setting JSON to false
	I0918 17:00:33.281655   83743 mustload.go:65] Loading cluster: ha-078118
	I0918 17:00:33.281760   83743 notify.go:220] Checking for updates...
	I0918 17:00:33.282106   83743 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:00:33.282128   83743 status.go:174] checking status of ha-078118 ...
	I0918 17:00:33.282574   83743 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:00:33.303642   83743 status.go:371] ha-078118 host status = "Running" (err=<nil>)
	I0918 17:00:33.303691   83743 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:00:33.303950   83743 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:00:33.322347   83743 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:00:33.322626   83743 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:33.322662   83743 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:00:33.340745   83743 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:00:33.433868   83743 ssh_runner.go:195] Run: systemctl --version
	I0918 17:00:33.438568   83743 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:33.451385   83743 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:00:33.509119   83743 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-09-18 17:00:33.498496386 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:00:33.509697   83743 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:33.509726   83743 api_server.go:166] Checking apiserver status ...
	I0918 17:00:33.509760   83743 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:33.523338   83743 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup
	W0918 17:00:33.533423   83743 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:33.533489   83743 ssh_runner.go:195] Run: ls
	I0918 17:00:33.537764   83743 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:33.543479   83743 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:33.543517   83743 status.go:463] ha-078118 apiserver status = Running (err=<nil>)
	I0918 17:00:33.543530   83743 status.go:176] ha-078118 status: &{Name:ha-078118 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:33.543559   83743 status.go:174] checking status of ha-078118-m02 ...
	I0918 17:00:33.543838   83743 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:00:33.562070   83743 status.go:371] ha-078118-m02 host status = "Running" (err=<nil>)
	I0918 17:00:33.562094   83743 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:00:33.562338   83743 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:00:33.579955   83743 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:00:33.580232   83743 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:33.580266   83743 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:00:33.598538   83743 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32808 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:00:33.691964   83743 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:33.704802   83743 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:33.704830   83743 api_server.go:166] Checking apiserver status ...
	I0918 17:00:33.704870   83743 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:33.717129   83743 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup
	W0918 17:00:33.728240   83743 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:33.728327   83743 ssh_runner.go:195] Run: ls
	I0918 17:00:33.732087   83743 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:33.736423   83743 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:33.736445   83743 status.go:463] ha-078118-m02 apiserver status = Running (err=<nil>)
	I0918 17:00:33.736454   83743 status.go:176] ha-078118-m02 status: &{Name:ha-078118-m02 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:33.736473   83743 status.go:174] checking status of ha-078118-m03 ...
	I0918 17:00:33.736750   83743 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:00:33.755798   83743 status.go:371] ha-078118-m03 host status = "Running" (err=<nil>)
	I0918 17:00:33.755824   83743 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:00:33.756137   83743 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:00:33.774071   83743 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:00:33.774350   83743 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:33.774386   83743 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:00:33.792302   83743 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:00:33.885836   83743 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:33.898773   83743 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:33.898810   83743 api_server.go:166] Checking apiserver status ...
	I0918 17:00:33.898844   83743 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:33.910816   83743 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup
	W0918 17:00:33.921767   83743 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:33.921828   83743 ssh_runner.go:195] Run: ls
	I0918 17:00:33.925557   83743 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:33.929963   83743 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:33.929987   83743 status.go:463] ha-078118-m03 apiserver status = Running (err=<nil>)
	I0918 17:00:33.929996   83743 status.go:176] ha-078118-m03 status: &{Name:ha-078118-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:33.930010   83743 status.go:174] checking status of ha-078118-m04 ...
	I0918 17:00:33.930236   83743 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:00:33.949688   83743 status.go:371] ha-078118-m04 host status = "Stopped" (err=<nil>)
	I0918 17:00:33.949709   83743 status.go:384] host is not running, skipping remaining checks
	I0918 17:00:33.949715   83743 status.go:176] ha-078118-m04 status: &{Name:ha-078118-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I0918 17:00:33.955179   11368 retry.go:31] will retry after 1.325592575s: exit status 7
ha_test.go:430: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5
ha_test.go:430: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5: exit status 7 (723.60231ms)

                                                
                                                
-- stdout --
	ha-078118
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m02
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:00:35.329892   83967 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:00:35.330179   83967 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:00:35.330190   83967 out.go:374] Setting ErrFile to fd 2...
	I0918 17:00:35.330194   83967 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:00:35.330399   83967 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:00:35.330584   83967 out.go:368] Setting JSON to false
	I0918 17:00:35.330621   83967 mustload.go:65] Loading cluster: ha-078118
	I0918 17:00:35.330700   83967 notify.go:220] Checking for updates...
	I0918 17:00:35.331144   83967 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:00:35.331166   83967 status.go:174] checking status of ha-078118 ...
	I0918 17:00:35.331721   83967 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:00:35.351179   83967 status.go:371] ha-078118 host status = "Running" (err=<nil>)
	I0918 17:00:35.351239   83967 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:00:35.351566   83967 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:00:35.370004   83967 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:00:35.370309   83967 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:35.370351   83967 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:00:35.389091   83967 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:00:35.482969   83967 ssh_runner.go:195] Run: systemctl --version
	I0918 17:00:35.487808   83967 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:35.500451   83967 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:00:35.560708   83967 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-09-18 17:00:35.550966175 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:00:35.561310   83967 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:35.561335   83967 api_server.go:166] Checking apiserver status ...
	I0918 17:00:35.561384   83967 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:35.573987   83967 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup
	W0918 17:00:35.584440   83967 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:35.584515   83967 ssh_runner.go:195] Run: ls
	I0918 17:00:35.588365   83967 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:35.592605   83967 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:35.592629   83967 status.go:463] ha-078118 apiserver status = Running (err=<nil>)
	I0918 17:00:35.592638   83967 status.go:176] ha-078118 status: &{Name:ha-078118 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:35.592656   83967 status.go:174] checking status of ha-078118-m02 ...
	I0918 17:00:35.592905   83967 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:00:35.611243   83967 status.go:371] ha-078118-m02 host status = "Running" (err=<nil>)
	I0918 17:00:35.611268   83967 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:00:35.611554   83967 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:00:35.629706   83967 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:00:35.629971   83967 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:35.630010   83967 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:00:35.649394   83967 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32808 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:00:35.742899   83967 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:35.755496   83967 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:35.755543   83967 api_server.go:166] Checking apiserver status ...
	I0918 17:00:35.755587   83967 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:35.767181   83967 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup
	W0918 17:00:35.777367   83967 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:35.777426   83967 ssh_runner.go:195] Run: ls
	I0918 17:00:35.781188   83967 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:35.785390   83967 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:35.785414   83967 status.go:463] ha-078118-m02 apiserver status = Running (err=<nil>)
	I0918 17:00:35.785423   83967 status.go:176] ha-078118-m02 status: &{Name:ha-078118-m02 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:35.785439   83967 status.go:174] checking status of ha-078118-m03 ...
	I0918 17:00:35.785682   83967 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:00:35.803170   83967 status.go:371] ha-078118-m03 host status = "Running" (err=<nil>)
	I0918 17:00:35.803193   83967 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:00:35.803428   83967 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:00:35.822453   83967 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:00:35.822716   83967 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:35.822756   83967 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:00:35.841922   83967 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:00:35.937229   83967 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:35.950787   83967 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:35.950819   83967 api_server.go:166] Checking apiserver status ...
	I0918 17:00:35.950864   83967 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:35.963032   83967 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup
	W0918 17:00:35.973667   83967 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:35.973733   83967 ssh_runner.go:195] Run: ls
	I0918 17:00:35.977568   83967 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:35.981950   83967 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:35.981975   83967 status.go:463] ha-078118-m03 apiserver status = Running (err=<nil>)
	I0918 17:00:35.981984   83967 status.go:176] ha-078118-m03 status: &{Name:ha-078118-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:35.981998   83967 status.go:174] checking status of ha-078118-m04 ...
	I0918 17:00:35.982280   83967 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:00:36.001088   83967 status.go:371] ha-078118-m04 host status = "Stopped" (err=<nil>)
	I0918 17:00:36.001118   83967 status.go:384] host is not running, skipping remaining checks
	I0918 17:00:36.001124   83967 status.go:176] ha-078118-m04 status: &{Name:ha-078118-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I0918 17:00:36.006162   11368 retry.go:31] will retry after 1.796697375s: exit status 7
ha_test.go:430: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5
ha_test.go:430: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5: exit status 7 (723.555819ms)

                                                
                                                
-- stdout --
	ha-078118
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m02
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:00:37.846002   84180 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:00:37.846270   84180 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:00:37.846280   84180 out.go:374] Setting ErrFile to fd 2...
	I0918 17:00:37.846284   84180 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:00:37.846477   84180 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:00:37.846685   84180 out.go:368] Setting JSON to false
	I0918 17:00:37.846725   84180 mustload.go:65] Loading cluster: ha-078118
	I0918 17:00:37.846857   84180 notify.go:220] Checking for updates...
	I0918 17:00:37.847226   84180 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:00:37.847253   84180 status.go:174] checking status of ha-078118 ...
	I0918 17:00:37.847882   84180 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:00:37.870849   84180 status.go:371] ha-078118 host status = "Running" (err=<nil>)
	I0918 17:00:37.870895   84180 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:00:37.871241   84180 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:00:37.889567   84180 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:00:37.889882   84180 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:37.889940   84180 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:00:37.907592   84180 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:00:38.003752   84180 ssh_runner.go:195] Run: systemctl --version
	I0918 17:00:38.008438   84180 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:38.020577   84180 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:00:38.081606   84180 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-09-18 17:00:38.071388657 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:00:38.082135   84180 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:38.082163   84180 api_server.go:166] Checking apiserver status ...
	I0918 17:00:38.082196   84180 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:38.094203   84180 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup
	W0918 17:00:38.104670   84180 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:38.104732   84180 ssh_runner.go:195] Run: ls
	I0918 17:00:38.108832   84180 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:38.113178   84180 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:38.113208   84180 status.go:463] ha-078118 apiserver status = Running (err=<nil>)
	I0918 17:00:38.113220   84180 status.go:176] ha-078118 status: &{Name:ha-078118 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:38.113239   84180 status.go:174] checking status of ha-078118-m02 ...
	I0918 17:00:38.113565   84180 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:00:38.132272   84180 status.go:371] ha-078118-m02 host status = "Running" (err=<nil>)
	I0918 17:00:38.132299   84180 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:00:38.132617   84180 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:00:38.151105   84180 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:00:38.151344   84180 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:38.151378   84180 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:00:38.169977   84180 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32808 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:00:38.263345   84180 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:38.276471   84180 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:38.276496   84180 api_server.go:166] Checking apiserver status ...
	I0918 17:00:38.276563   84180 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:38.288241   84180 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup
	W0918 17:00:38.298723   84180 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:38.298784   84180 ssh_runner.go:195] Run: ls
	I0918 17:00:38.302647   84180 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:38.306799   84180 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:38.306827   84180 status.go:463] ha-078118-m02 apiserver status = Running (err=<nil>)
	I0918 17:00:38.306838   84180 status.go:176] ha-078118-m02 status: &{Name:ha-078118-m02 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:38.306854   84180 status.go:174] checking status of ha-078118-m03 ...
	I0918 17:00:38.307145   84180 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:00:38.325862   84180 status.go:371] ha-078118-m03 host status = "Running" (err=<nil>)
	I0918 17:00:38.325886   84180 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:00:38.326112   84180 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:00:38.344712   84180 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:00:38.344944   84180 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:38.344982   84180 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:00:38.364314   84180 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:00:38.458070   84180 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:38.471964   84180 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:38.472015   84180 api_server.go:166] Checking apiserver status ...
	I0918 17:00:38.472057   84180 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:38.485041   84180 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup
	W0918 17:00:38.495290   84180 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:38.495351   84180 ssh_runner.go:195] Run: ls
	I0918 17:00:38.499456   84180 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:38.503918   84180 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:38.503941   84180 status.go:463] ha-078118-m03 apiserver status = Running (err=<nil>)
	I0918 17:00:38.503948   84180 status.go:176] ha-078118-m03 status: &{Name:ha-078118-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:38.503963   84180 status.go:174] checking status of ha-078118-m04 ...
	I0918 17:00:38.504240   84180 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:00:38.523381   84180 status.go:371] ha-078118-m04 host status = "Stopped" (err=<nil>)
	I0918 17:00:38.523404   84180 status.go:384] host is not running, skipping remaining checks
	I0918 17:00:38.523410   84180 status.go:176] ha-078118-m04 status: &{Name:ha-078118-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I0918 17:00:38.528530   11368 retry.go:31] will retry after 1.79614691s: exit status 7
ha_test.go:430: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5
ha_test.go:430: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5: exit status 7 (712.462262ms)

                                                
                                                
-- stdout --
	ha-078118
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m02
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:00:40.369303   84408 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:00:40.369615   84408 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:00:40.369626   84408 out.go:374] Setting ErrFile to fd 2...
	I0918 17:00:40.369629   84408 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:00:40.369839   84408 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:00:40.370028   84408 out.go:368] Setting JSON to false
	I0918 17:00:40.370094   84408 mustload.go:65] Loading cluster: ha-078118
	I0918 17:00:40.370219   84408 notify.go:220] Checking for updates...
	I0918 17:00:40.370563   84408 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:00:40.370585   84408 status.go:174] checking status of ha-078118 ...
	I0918 17:00:40.371088   84408 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:00:40.391617   84408 status.go:371] ha-078118 host status = "Running" (err=<nil>)
	I0918 17:00:40.391649   84408 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:00:40.391913   84408 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:00:40.410278   84408 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:00:40.410621   84408 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:40.410675   84408 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:00:40.429584   84408 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:00:40.524379   84408 ssh_runner.go:195] Run: systemctl --version
	I0918 17:00:40.528954   84408 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:40.541120   84408 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:00:40.596188   84408 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-09-18 17:00:40.58689166 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[ma
p[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:00:40.596738   84408 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:40.596767   84408 api_server.go:166] Checking apiserver status ...
	I0918 17:00:40.596799   84408 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:40.608816   84408 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup
	W0918 17:00:40.619201   84408 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:40.619252   84408 ssh_runner.go:195] Run: ls
	I0918 17:00:40.622977   84408 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:40.627111   84408 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:40.627139   84408 status.go:463] ha-078118 apiserver status = Running (err=<nil>)
	I0918 17:00:40.627153   84408 status.go:176] ha-078118 status: &{Name:ha-078118 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:40.627175   84408 status.go:174] checking status of ha-078118-m02 ...
	I0918 17:00:40.627421   84408 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:00:40.645865   84408 status.go:371] ha-078118-m02 host status = "Running" (err=<nil>)
	I0918 17:00:40.645890   84408 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:00:40.646185   84408 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:00:40.664075   84408 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:00:40.664327   84408 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:40.664362   84408 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:00:40.682634   84408 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32808 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:00:40.776512   84408 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:40.789667   84408 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:40.789692   84408 api_server.go:166] Checking apiserver status ...
	I0918 17:00:40.789725   84408 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:40.801426   84408 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup
	W0918 17:00:40.811781   84408 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:40.811826   84408 ssh_runner.go:195] Run: ls
	I0918 17:00:40.815816   84408 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:40.820011   84408 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:40.820031   84408 status.go:463] ha-078118-m02 apiserver status = Running (err=<nil>)
	I0918 17:00:40.820040   84408 status.go:176] ha-078118-m02 status: &{Name:ha-078118-m02 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:40.820055   84408 status.go:174] checking status of ha-078118-m03 ...
	I0918 17:00:40.820268   84408 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:00:40.839067   84408 status.go:371] ha-078118-m03 host status = "Running" (err=<nil>)
	I0918 17:00:40.839095   84408 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:00:40.839336   84408 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:00:40.857441   84408 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:00:40.857778   84408 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:40.857827   84408 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:00:40.876896   84408 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:00:40.972232   84408 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:40.985139   84408 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:40.985169   84408 api_server.go:166] Checking apiserver status ...
	I0918 17:00:40.985224   84408 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:40.996752   84408 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup
	W0918 17:00:41.006773   84408 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:41.006827   84408 ssh_runner.go:195] Run: ls
	I0918 17:00:41.010404   84408 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:41.014678   84408 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:41.014705   84408 status.go:463] ha-078118-m03 apiserver status = Running (err=<nil>)
	I0918 17:00:41.014716   84408 status.go:176] ha-078118-m03 status: &{Name:ha-078118-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:41.014735   84408 status.go:174] checking status of ha-078118-m04 ...
	I0918 17:00:41.014996   84408 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:00:41.034262   84408 status.go:371] ha-078118-m04 host status = "Stopped" (err=<nil>)
	I0918 17:00:41.034284   84408 status.go:384] host is not running, skipping remaining checks
	I0918 17:00:41.034290   84408 status.go:176] ha-078118-m04 status: &{Name:ha-078118-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I0918 17:00:41.039698   11368 retry.go:31] will retry after 3.783064129s: exit status 7
ha_test.go:430: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5
E0918 17:00:45.076849   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
ha_test.go:430: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5: exit status 7 (709.522351ms)

                                                
                                                
-- stdout --
	ha-078118
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m02
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:00:44.867231   84640 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:00:44.867634   84640 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:00:44.867649   84640 out.go:374] Setting ErrFile to fd 2...
	I0918 17:00:44.867655   84640 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:00:44.867974   84640 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:00:44.868208   84640 out.go:368] Setting JSON to false
	I0918 17:00:44.868251   84640 mustload.go:65] Loading cluster: ha-078118
	I0918 17:00:44.868355   84640 notify.go:220] Checking for updates...
	I0918 17:00:44.868775   84640 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:00:44.868797   84640 status.go:174] checking status of ha-078118 ...
	I0918 17:00:44.869415   84640 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:00:44.889900   84640 status.go:371] ha-078118 host status = "Running" (err=<nil>)
	I0918 17:00:44.889956   84640 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:00:44.890340   84640 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:00:44.909406   84640 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:00:44.909804   84640 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:44.909851   84640 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:00:44.929034   84640 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:00:45.021711   84640 ssh_runner.go:195] Run: systemctl --version
	I0918 17:00:45.026298   84640 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:45.038470   84640 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:00:45.095426   84640 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-09-18 17:00:45.085412582 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:00:45.095938   84640 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:45.095963   84640 api_server.go:166] Checking apiserver status ...
	I0918 17:00:45.095993   84640 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:45.108713   84640 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup
	W0918 17:00:45.119788   84640 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:45.119847   84640 ssh_runner.go:195] Run: ls
	I0918 17:00:45.123614   84640 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:45.127999   84640 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:45.128054   84640 status.go:463] ha-078118 apiserver status = Running (err=<nil>)
	I0918 17:00:45.128069   84640 status.go:176] ha-078118 status: &{Name:ha-078118 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:45.128105   84640 status.go:174] checking status of ha-078118-m02 ...
	I0918 17:00:45.128431   84640 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:00:45.146329   84640 status.go:371] ha-078118-m02 host status = "Running" (err=<nil>)
	I0918 17:00:45.146356   84640 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:00:45.146676   84640 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:00:45.164366   84640 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:00:45.164739   84640 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:45.164790   84640 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:00:45.182819   84640 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32808 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:00:45.275880   84640 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:45.288262   84640 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:45.288289   84640 api_server.go:166] Checking apiserver status ...
	I0918 17:00:45.288324   84640 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:45.299273   84640 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup
	W0918 17:00:45.308902   84640 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:45.308945   84640 ssh_runner.go:195] Run: ls
	I0918 17:00:45.312357   84640 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:45.317136   84640 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:45.317159   84640 status.go:463] ha-078118-m02 apiserver status = Running (err=<nil>)
	I0918 17:00:45.317169   84640 status.go:176] ha-078118-m02 status: &{Name:ha-078118-m02 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:45.317187   84640 status.go:174] checking status of ha-078118-m03 ...
	I0918 17:00:45.317578   84640 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:00:45.336525   84640 status.go:371] ha-078118-m03 host status = "Running" (err=<nil>)
	I0918 17:00:45.336549   84640 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:00:45.336835   84640 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:00:45.354268   84640 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:00:45.354544   84640 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:45.354593   84640 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:00:45.372757   84640 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:00:45.465793   84640 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:45.477984   84640 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:45.478010   84640 api_server.go:166] Checking apiserver status ...
	I0918 17:00:45.478051   84640 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:45.489454   84640 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup
	W0918 17:00:45.499749   84640 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:45.499814   84640 ssh_runner.go:195] Run: ls
	I0918 17:00:45.504073   84640 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:45.508736   84640 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:45.508766   84640 status.go:463] ha-078118-m03 apiserver status = Running (err=<nil>)
	I0918 17:00:45.508778   84640 status.go:176] ha-078118-m03 status: &{Name:ha-078118-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:45.508796   84640 status.go:174] checking status of ha-078118-m04 ...
	I0918 17:00:45.509134   84640 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:00:45.529691   84640 status.go:371] ha-078118-m04 host status = "Stopped" (err=<nil>)
	I0918 17:00:45.529714   84640 status.go:384] host is not running, skipping remaining checks
	I0918 17:00:45.529722   84640 status.go:176] ha-078118-m04 status: &{Name:ha-078118-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I0918 17:00:45.535863   11368 retry.go:31] will retry after 8.681126896s: exit status 7
ha_test.go:430: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5
ha_test.go:430: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5: exit status 7 (732.77616ms)

                                                
                                                
-- stdout --
	ha-078118
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m02
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:00:54.261448   84896 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:00:54.261736   84896 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:00:54.261747   84896 out.go:374] Setting ErrFile to fd 2...
	I0918 17:00:54.261751   84896 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:00:54.261963   84896 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:00:54.262130   84896 out.go:368] Setting JSON to false
	I0918 17:00:54.262164   84896 mustload.go:65] Loading cluster: ha-078118
	I0918 17:00:54.262246   84896 notify.go:220] Checking for updates...
	I0918 17:00:54.262737   84896 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:00:54.262767   84896 status.go:174] checking status of ha-078118 ...
	I0918 17:00:54.263228   84896 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:00:54.284417   84896 status.go:371] ha-078118 host status = "Running" (err=<nil>)
	I0918 17:00:54.284445   84896 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:00:54.284732   84896 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:00:54.304727   84896 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:00:54.305058   84896 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:54.305124   84896 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:00:54.325191   84896 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:00:54.420090   84896 ssh_runner.go:195] Run: systemctl --version
	I0918 17:00:54.425133   84896 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:54.437606   84896 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:00:54.501309   84896 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-09-18 17:00:54.489814888 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:00:54.501924   84896 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:54.501959   84896 api_server.go:166] Checking apiserver status ...
	I0918 17:00:54.501995   84896 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:54.514533   84896 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup
	W0918 17:00:54.525424   84896 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:54.525482   84896 ssh_runner.go:195] Run: ls
	I0918 17:00:54.529463   84896 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:54.535311   84896 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:54.535338   84896 status.go:463] ha-078118 apiserver status = Running (err=<nil>)
	I0918 17:00:54.535347   84896 status.go:176] ha-078118 status: &{Name:ha-078118 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:54.535363   84896 status.go:174] checking status of ha-078118-m02 ...
	I0918 17:00:54.535735   84896 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:00:54.554958   84896 status.go:371] ha-078118-m02 host status = "Running" (err=<nil>)
	I0918 17:00:54.554985   84896 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:00:54.555331   84896 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:00:54.575394   84896 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:00:54.575695   84896 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:54.575731   84896 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:00:54.594256   84896 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32808 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:00:54.688192   84896 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:54.700950   84896 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:54.700978   84896 api_server.go:166] Checking apiserver status ...
	I0918 17:00:54.701014   84896 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:54.712705   84896 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup
	W0918 17:00:54.724625   84896 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:54.724683   84896 ssh_runner.go:195] Run: ls
	I0918 17:00:54.728546   84896 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:54.732668   84896 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:54.732693   84896 status.go:463] ha-078118-m02 apiserver status = Running (err=<nil>)
	I0918 17:00:54.732704   84896 status.go:176] ha-078118-m02 status: &{Name:ha-078118-m02 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:54.732721   84896 status.go:174] checking status of ha-078118-m03 ...
	I0918 17:00:54.732966   84896 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:00:54.752264   84896 status.go:371] ha-078118-m03 host status = "Running" (err=<nil>)
	I0918 17:00:54.752286   84896 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:00:54.752582   84896 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:00:54.770514   84896 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:00:54.770780   84896 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:00:54.770820   84896 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:00:54.789333   84896 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:00:54.882978   84896 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:00:54.896328   84896 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:00:54.896396   84896 api_server.go:166] Checking apiserver status ...
	I0918 17:00:54.896450   84896 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:00:54.908444   84896 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup
	W0918 17:00:54.919819   84896 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:00:54.919875   84896 ssh_runner.go:195] Run: ls
	I0918 17:00:54.923951   84896 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:00:54.928154   84896 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:00:54.928177   84896 status.go:463] ha-078118-m03 apiserver status = Running (err=<nil>)
	I0918 17:00:54.928185   84896 status.go:176] ha-078118-m03 status: &{Name:ha-078118-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:00:54.928199   84896 status.go:174] checking status of ha-078118-m04 ...
	I0918 17:00:54.928458   84896 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:00:54.947292   84896 status.go:371] ha-078118-m04 host status = "Stopped" (err=<nil>)
	I0918 17:00:54.947320   84896 status.go:384] host is not running, skipping remaining checks
	I0918 17:00:54.947328   84896 status.go:176] ha-078118-m04 status: &{Name:ha-078118-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I0918 17:00:54.952427   11368 retry.go:31] will retry after 7.506210224s: exit status 7
ha_test.go:430: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5
ha_test.go:430: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5: exit status 7 (729.004595ms)

                                                
                                                
-- stdout --
	ha-078118
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m02
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:01:02.509384   85133 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:01:02.509494   85133 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:01:02.509522   85133 out.go:374] Setting ErrFile to fd 2...
	I0918 17:01:02.509528   85133 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:01:02.509769   85133 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:01:02.510014   85133 out.go:368] Setting JSON to false
	I0918 17:01:02.510058   85133 mustload.go:65] Loading cluster: ha-078118
	I0918 17:01:02.510136   85133 notify.go:220] Checking for updates...
	I0918 17:01:02.510483   85133 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:02.510522   85133 status.go:174] checking status of ha-078118 ...
	I0918 17:01:02.511022   85133 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:01:02.533878   85133 status.go:371] ha-078118 host status = "Running" (err=<nil>)
	I0918 17:01:02.533911   85133 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:01:02.534196   85133 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:01:02.554832   85133 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:01:02.555132   85133 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:01:02.555170   85133 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:02.576086   85133 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:02.671026   85133 ssh_runner.go:195] Run: systemctl --version
	I0918 17:01:02.676163   85133 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:01:02.689265   85133 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:01:02.745182   85133 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-09-18 17:01:02.734940441 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:01:02.745751   85133 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:01:02.745780   85133 api_server.go:166] Checking apiserver status ...
	I0918 17:01:02.745818   85133 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:01:02.757651   85133 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup
	W0918 17:01:02.768602   85133 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:01:02.768671   85133 ssh_runner.go:195] Run: ls
	I0918 17:01:02.772852   85133 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:01:02.777535   85133 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:01:02.777564   85133 status.go:463] ha-078118 apiserver status = Running (err=<nil>)
	I0918 17:01:02.777576   85133 status.go:176] ha-078118 status: &{Name:ha-078118 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:01:02.777606   85133 status.go:174] checking status of ha-078118-m02 ...
	I0918 17:01:02.777854   85133 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:01:02.796373   85133 status.go:371] ha-078118-m02 host status = "Running" (err=<nil>)
	I0918 17:01:02.796397   85133 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:01:02.796688   85133 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:01:02.814282   85133 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:01:02.814611   85133 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:01:02.814666   85133 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:01:02.833949   85133 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32808 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:01:02.926838   85133 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:01:02.939662   85133 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:01:02.939693   85133 api_server.go:166] Checking apiserver status ...
	I0918 17:01:02.939733   85133 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:01:02.951897   85133 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup
	W0918 17:01:02.962350   85133 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:01:02.962404   85133 ssh_runner.go:195] Run: ls
	I0918 17:01:02.966277   85133 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:01:02.970266   85133 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:01:02.970286   85133 status.go:463] ha-078118-m02 apiserver status = Running (err=<nil>)
	I0918 17:01:02.970294   85133 status.go:176] ha-078118-m02 status: &{Name:ha-078118-m02 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:01:02.970321   85133 status.go:174] checking status of ha-078118-m03 ...
	I0918 17:01:02.970569   85133 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:01:02.988601   85133 status.go:371] ha-078118-m03 host status = "Running" (err=<nil>)
	I0918 17:01:02.988625   85133 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:01:02.988914   85133 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:01:03.007279   85133 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:01:03.007570   85133 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:01:03.007607   85133 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:01:03.025894   85133 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:01:03.121913   85133 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:01:03.134755   85133 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:01:03.134788   85133 api_server.go:166] Checking apiserver status ...
	I0918 17:01:03.134840   85133 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:01:03.146530   85133 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup
	W0918 17:01:03.156551   85133 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:01:03.156617   85133 ssh_runner.go:195] Run: ls
	I0918 17:01:03.160291   85133 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:01:03.165807   85133 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:01:03.165831   85133 status.go:463] ha-078118-m03 apiserver status = Running (err=<nil>)
	I0918 17:01:03.165841   85133 status.go:176] ha-078118-m03 status: &{Name:ha-078118-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:01:03.165860   85133 status.go:174] checking status of ha-078118-m04 ...
	I0918 17:01:03.166185   85133 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:01:03.183987   85133 status.go:371] ha-078118-m04 host status = "Stopped" (err=<nil>)
	I0918 17:01:03.184011   85133 status.go:384] host is not running, skipping remaining checks
	I0918 17:01:03.184018   85133 status.go:176] ha-078118-m04 status: &{Name:ha-078118-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
I0918 17:01:03.188975   11368 retry.go:31] will retry after 10.311711241s: exit status 7
ha_test.go:430: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5
ha_test.go:430: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5: exit status 7 (731.649894ms)

                                                
                                                
-- stdout --
	ha-078118
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m02
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m03
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:01:13.545684   85383 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:01:13.545807   85383 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:01:13.545816   85383 out.go:374] Setting ErrFile to fd 2...
	I0918 17:01:13.545820   85383 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:01:13.546012   85383 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:01:13.546184   85383 out.go:368] Setting JSON to false
	I0918 17:01:13.546215   85383 mustload.go:65] Loading cluster: ha-078118
	I0918 17:01:13.546336   85383 notify.go:220] Checking for updates...
	I0918 17:01:13.546621   85383 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:13.546641   85383 status.go:174] checking status of ha-078118 ...
	I0918 17:01:13.547208   85383 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:01:13.566517   85383 status.go:371] ha-078118 host status = "Running" (err=<nil>)
	I0918 17:01:13.566549   85383 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:01:13.566770   85383 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:01:13.586001   85383 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:01:13.586260   85383 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:01:13.586298   85383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:13.605490   85383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:13.701195   85383 ssh_runner.go:195] Run: systemctl --version
	I0918 17:01:13.706009   85383 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:01:13.718344   85383 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:01:13.779796   85383 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:63 OomKillDisable:false NGoroutines:75 SystemTime:2025-09-18 17:01:13.769826845 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:01:13.780431   85383 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:01:13.780463   85383 api_server.go:166] Checking apiserver status ...
	I0918 17:01:13.780543   85383 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:01:13.793296   85383 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup
	W0918 17:01:13.803698   85383 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1443/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:01:13.803772   85383 ssh_runner.go:195] Run: ls
	I0918 17:01:13.807493   85383 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:01:13.811598   85383 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:01:13.811622   85383 status.go:463] ha-078118 apiserver status = Running (err=<nil>)
	I0918 17:01:13.811634   85383 status.go:176] ha-078118 status: &{Name:ha-078118 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:01:13.811654   85383 status.go:174] checking status of ha-078118-m02 ...
	I0918 17:01:13.811904   85383 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:01:13.832081   85383 status.go:371] ha-078118-m02 host status = "Running" (err=<nil>)
	I0918 17:01:13.832121   85383 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:01:13.832365   85383 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:01:13.850634   85383 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:01:13.850871   85383 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:01:13.850903   85383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:01:13.870112   85383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32808 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:01:13.964238   85383 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:01:13.976838   85383 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:01:13.976871   85383 api_server.go:166] Checking apiserver status ...
	I0918 17:01:13.976915   85383 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:01:13.989059   85383 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup
	W0918 17:01:13.998924   85383 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/399/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:01:13.998978   85383 ssh_runner.go:195] Run: ls
	I0918 17:01:14.003098   85383 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:01:14.008177   85383 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:01:14.008203   85383 status.go:463] ha-078118-m02 apiserver status = Running (err=<nil>)
	I0918 17:01:14.008211   85383 status.go:176] ha-078118-m02 status: &{Name:ha-078118-m02 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:01:14.008230   85383 status.go:174] checking status of ha-078118-m03 ...
	I0918 17:01:14.008480   85383 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:01:14.027919   85383 status.go:371] ha-078118-m03 host status = "Running" (err=<nil>)
	I0918 17:01:14.027942   85383 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:01:14.028217   85383 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:01:14.049277   85383 host.go:66] Checking if "ha-078118-m03" exists ...
	I0918 17:01:14.049638   85383 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:01:14.049705   85383 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:01:14.068178   85383 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:01:14.163804   85383 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:01:14.176264   85383 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:01:14.176305   85383 api_server.go:166] Checking apiserver status ...
	I0918 17:01:14.176347   85383 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:01:14.189896   85383 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup
	W0918 17:01:14.200379   85383 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1348/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:01:14.200443   85383 ssh_runner.go:195] Run: ls
	I0918 17:01:14.204386   85383 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:01:14.208819   85383 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:01:14.208846   85383 status.go:463] ha-078118-m03 apiserver status = Running (err=<nil>)
	I0918 17:01:14.208857   85383 status.go:176] ha-078118-m03 status: &{Name:ha-078118-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:01:14.208877   85383 status.go:174] checking status of ha-078118-m04 ...
	I0918 17:01:14.209121   85383 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:01:14.229038   85383 status.go:371] ha-078118-m04 host status = "Stopped" (err=<nil>)
	I0918 17:01:14.229077   85383 status.go:384] host is not running, skipping remaining checks
	I0918 17:01:14.229084   85383 status.go:176] ha-078118-m04 status: &{Name:ha-078118-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:434: failed to run minikube status. args "out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======>  post-mortem[TestMultiControlPlane/serial/RestartSecondaryNode]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======>  post-mortem[TestMultiControlPlane/serial/RestartSecondaryNode]: docker inspect <======
helpers_test.go:239: (dbg) Run:  docker inspect ha-078118
helpers_test.go:243: (dbg) docker inspect ha-078118:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7",
	        "Created": "2025-09-18T16:57:02.681891976Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 60804,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2025-09-18T16:57:02.720947584Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:c6b5532e987b5b4f5fc9cb0336e378ed49c0542bad8cbfc564b71e977a6269de",
	        "ResolvConfPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/hostname",
	        "HostsPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/hosts",
	        "LogPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7-json.log",
	        "Name": "/ha-078118",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ha-078118:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "ha-078118",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "private",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 3221225472,
	            "NanoCpus": 0,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 6442450944,
	            "MemorySwappiness": null,
	            "OomKillDisable": null,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "ID": "0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7",
	                "LowerDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91-init/diff:/var/lib/docker/overlay2/1fd2bbb67ab9e5bb8d4549665a1a228eadda56df39fee53908cd735ea16a4e10/diff",
	                "MergedDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/merged",
	                "UpperDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/diff",
	                "WorkDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "ha-078118",
	                "Source": "/var/lib/docker/volumes/ha-078118/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "ha-078118",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ha-078118",
	                "name.minikube.sigs.k8s.io": "ha-078118",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "46c241f4f759650d3d72325bd2e71329577f7cf9aeedeb6d33ceecff2db46b27",
	            "SandboxKey": "/var/run/docker/netns/46c241f4f759",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32783"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32784"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32787"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32785"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32786"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ha-078118": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "7a:b0:8a:ae:56:9b",
	                    "DriverOpts": null,
	                    "GwPriority": 0,
	                    "NetworkID": "0aa191750de6e44eaf49073a9e05a52994c63ccafcb0870d32aaf105d93cb724",
	                    "EndpointID": "4a33baf269d5fab1a605edfe7de39d655fdf3c152c658d8c6eca8c3ca23635ea",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "ha-078118",
	                        "0cb187fb2895"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-078118 -n ha-078118
helpers_test.go:252: <<< TestMultiControlPlane/serial/RestartSecondaryNode FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======>  post-mortem[TestMultiControlPlane/serial/RestartSecondaryNode]: minikube logs <======
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p ha-078118 logs -n 25: (1.17578777s)
helpers_test.go:260: TestMultiControlPlane/serial/RestartSecondaryNode logs: 
-- stdout --
	
	==> Audit <==
	┌─────────┬──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬───────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
	│ COMMAND │                                                                 ARGS                                                                 │  PROFILE  │  USER   │ VERSION │     START TIME      │      END TIME       │
	├─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼───────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ cp      │ ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118:/home/docker/cp-test_ha-078118-m03_ha-078118.txt                       │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118 sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118.txt                                                 │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ cp      │ ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118-m02:/home/docker/cp-test_ha-078118-m03_ha-078118-m02.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m02 sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m02.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ cp      │ ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118-m04:/home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp testdata/cp-test.txt ha-078118-m04:/home/docker/cp-test.txt                                                             │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1931775572/001/cp-test_ha-078118-m04.txt │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118:/home/docker/cp-test_ha-078118-m04_ha-078118.txt                       │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118.txt                                                 │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m02:/home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m02 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m03:/home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ node    │ ha-078118 node stop m02 --alsologtostderr -v 5                                                                                       │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ node    │ ha-078118 node start m02 --alsologtostderr -v 5                                                                                      │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	└─────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴───────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
	
	
	==> Last Start <==
	Log file created at: 2025/09/18 16:56:57
	Running on machine: ubuntu-20-agent-4
	Binary: Built with gc go1.24.6 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0918 16:56:57.574799   60243 out.go:360] Setting OutFile to fd 1 ...
	I0918 16:56:57.575055   60243 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:56:57.575064   60243 out.go:374] Setting ErrFile to fd 2...
	I0918 16:56:57.575068   60243 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:56:57.575239   60243 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 16:56:57.575752   60243 out.go:368] Setting JSON to false
	I0918 16:56:57.576663   60243 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":2369,"bootTime":1758212249,"procs":182,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 16:56:57.576763   60243 start.go:140] virtualization: kvm guest
	I0918 16:56:57.579065   60243 out.go:179] * [ha-078118] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 16:56:57.580589   60243 notify.go:220] Checking for updates...
	I0918 16:56:57.580637   60243 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 16:56:57.582251   60243 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 16:56:57.583930   60243 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 16:56:57.585344   60243 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 16:56:57.586681   60243 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 16:56:57.588118   60243 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 16:56:57.589868   60243 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 16:56:57.616949   60243 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 16:56:57.617226   60243 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:56:57.672926   60243 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 16:56:57.662881749 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:56:57.673067   60243 docker.go:318] overlay module found
	I0918 16:56:57.674951   60243 out.go:179] * Using the docker driver based on user configuration
	I0918 16:56:57.676488   60243 start.go:304] selected driver: docker
	I0918 16:56:57.676533   60243 start.go:924] validating driver "docker" against <nil>
	I0918 16:56:57.676551   60243 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 16:56:57.677232   60243 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:56:57.735443   60243 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 16:56:57.725396122 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:56:57.735617   60243 start_flags.go:327] no existing cluster config was found, will generate one from the flags 
	I0918 16:56:57.735836   60243 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 16:56:57.737842   60243 out.go:179] * Using Docker driver with root privileges
	I0918 16:56:57.739170   60243 cni.go:84] Creating CNI manager for ""
	I0918 16:56:57.739238   60243 cni.go:136] multinode detected (0 nodes found), recommending kindnet
	I0918 16:56:57.739249   60243 start_flags.go:336] Found "CNI" CNI - setting NetworkPlugin=cni
	I0918 16:56:57.739334   60243 start.go:348] cluster config:
	{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:c
ni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:56:57.740825   60243 out.go:179] * Starting "ha-078118" primary control-plane node in "ha-078118" cluster
	I0918 16:56:57.742276   60243 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 16:56:57.743877   60243 out.go:179] * Pulling base image v0.0.48 ...
	I0918 16:56:57.745428   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:56:57.745480   60243 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
	I0918 16:56:57.745487   60243 cache.go:58] Caching tarball of preloaded images
	I0918 16:56:57.745560   60243 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 16:56:57.745653   60243 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 16:56:57.745669   60243 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 16:56:57.745990   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:56:57.746019   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json: {Name:mke5d1dac7b5b198fe436d519c900523bef38bac Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:56:57.768293   60243 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 16:56:57.768319   60243 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 16:56:57.768342   60243 cache.go:232] Successfully downloaded all kic artifacts
	I0918 16:56:57.768380   60243 start.go:360] acquireMachinesLock for ha-078118: {Name:mk24a1b2c9ed1c42e9ffd635727b36c75401a437 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 16:56:57.768479   60243 start.go:364] duration metric: took 78.905µs to acquireMachinesLock for "ha-078118"
	I0918 16:56:57.768533   60243 start.go:93] Provisioning new machine with config: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APISer
verIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMne
tPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:56:57.768610   60243 start.go:125] createHost starting for "" (driver="docker")
	I0918 16:56:57.770671   60243 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
	I0918 16:56:57.770887   60243 start.go:159] libmachine.API.Create for "ha-078118" (driver="docker")
	I0918 16:56:57.770915   60243 client.go:168] LocalClient.Create starting
	I0918 16:56:57.771017   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 16:56:57.771052   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:56:57.771063   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:56:57.771109   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 16:56:57.771128   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:56:57.771139   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:56:57.771472   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0918 16:56:57.788966   60243 cli_runner.go:211] docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0918 16:56:57.789055   60243 network_create.go:284] running [docker network inspect ha-078118] to gather additional debugging logs...
	I0918 16:56:57.789082   60243 cli_runner.go:164] Run: docker network inspect ha-078118
	W0918 16:56:57.806227   60243 cli_runner.go:211] docker network inspect ha-078118 returned with exit code 1
	I0918 16:56:57.806257   60243 network_create.go:287] error running [docker network inspect ha-078118]: docker network inspect ha-078118: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network ha-078118 not found
	I0918 16:56:57.806269   60243 network_create.go:289] output of [docker network inspect ha-078118]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network ha-078118 not found
	
	** /stderr **
	I0918 16:56:57.806367   60243 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:56:57.825048   60243 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000b6fd40}
	I0918 16:56:57.825108   60243 network_create.go:124] attempt to create docker network ha-078118 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0918 16:56:57.825168   60243 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=ha-078118 ha-078118
	I0918 16:56:57.883807   60243 network_create.go:108] docker network ha-078118 192.168.49.0/24 created
	I0918 16:56:57.883839   60243 kic.go:121] calculated static IP "192.168.49.2" for the "ha-078118" container
	I0918 16:56:57.883907   60243 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 16:56:57.901150   60243 cli_runner.go:164] Run: docker volume create ha-078118 --label name.minikube.sigs.k8s.io=ha-078118 --label created_by.minikube.sigs.k8s.io=true
	I0918 16:56:57.920292   60243 oci.go:103] Successfully created a docker volume ha-078118
	I0918 16:56:57.920371   60243 cli_runner.go:164] Run: docker run --rm --name ha-078118-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118 --entrypoint /usr/bin/test -v ha-078118:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 16:56:58.331429   60243 oci.go:107] Successfully prepared a docker volume ha-078118
	I0918 16:56:58.331493   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:56:58.331538   60243 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 16:56:58.331609   60243 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 16:57:02.609752   60243 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.278086372s)
	I0918 16:57:02.609786   60243 kic.go:203] duration metric: took 4.278244507s to extract preloaded images to volume ...
	W0918 16:57:02.609879   60243 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 16:57:02.609928   60243 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 16:57:02.609985   60243 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 16:57:02.664799   60243 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ha-078118 --name ha-078118 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ha-078118 --network ha-078118 --ip 192.168.49.2 --volume ha-078118:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 16:57:02.939918   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Running}}
	I0918 16:57:02.960880   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:02.979302   60243 cli_runner.go:164] Run: docker exec ha-078118 stat /var/lib/dpkg/alternatives/iptables
	I0918 16:57:03.031279   60243 oci.go:144] the created container "ha-078118" has a running status.
	I0918 16:57:03.031320   60243 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa...
	I0918 16:57:03.339176   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0918 16:57:03.339260   60243 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 16:57:03.367335   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:03.386757   60243 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0918 16:57:03.386779   60243 kic_runner.go:114] Args: [docker exec --privileged ha-078118 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0918 16:57:03.436474   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:03.454883   60243 machine.go:93] provisionDockerMachine start ...
	I0918 16:57:03.454973   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:03.473294   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:03.473657   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32783 <nil> <nil>}
	I0918 16:57:03.473681   60243 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 16:57:03.614090   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 16:57:03.614134   60243 ubuntu.go:182] provisioning hostname "ha-078118"
	I0918 16:57:03.614194   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:03.632632   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:03.632839   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32783 <nil> <nil>}
	I0918 16:57:03.632853   60243 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118 && echo "ha-078118" | sudo tee /etc/hostname
	I0918 16:57:03.782762   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 16:57:03.782829   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:03.801381   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:03.801652   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32783 <nil> <nil>}
	I0918 16:57:03.801672   60243 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 16:57:03.939426   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 16:57:03.939465   60243 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 16:57:03.939512   60243 ubuntu.go:190] setting up certificates
	I0918 16:57:03.939523   60243 provision.go:84] configureAuth start
	I0918 16:57:03.939572   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 16:57:03.957335   60243 provision.go:143] copyHostCerts
	I0918 16:57:03.957375   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:57:03.957408   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 16:57:03.957416   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:57:03.957515   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 16:57:03.957636   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:57:03.957667   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 16:57:03.957676   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:57:03.957723   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 16:57:03.957805   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:57:03.957831   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 16:57:03.957840   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:57:03.957878   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 16:57:03.957967   60243 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118 san=[127.0.0.1 192.168.49.2 ha-078118 localhost minikube]
	I0918 16:57:04.446406   60243 provision.go:177] copyRemoteCerts
	I0918 16:57:04.446467   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 16:57:04.446516   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:04.464707   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:04.562243   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 16:57:04.562316   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 16:57:04.588874   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 16:57:04.588947   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)
	I0918 16:57:04.614556   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 16:57:04.614618   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0918 16:57:04.639365   60243 provision.go:87] duration metric: took 699.826763ms to configureAuth
	I0918 16:57:04.639398   60243 ubuntu.go:206] setting minikube options for container-runtime
	I0918 16:57:04.639604   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:04.639701   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:04.656946   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:04.657177   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32783 <nil> <nil>}
	I0918 16:57:04.657195   60243 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 16:57:04.894695   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 16:57:04.894721   60243 machine.go:96] duration metric: took 1.439819388s to provisionDockerMachine
	I0918 16:57:04.894730   60243 client.go:171] duration metric: took 7.123809117s to LocalClient.Create
	I0918 16:57:04.894745   60243 start.go:167] duration metric: took 7.123860389s to libmachine.API.Create "ha-078118"
	I0918 16:57:04.894752   60243 start.go:293] postStartSetup for "ha-078118" (driver="docker")
	I0918 16:57:04.894761   60243 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 16:57:04.894810   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 16:57:04.894846   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:04.912730   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:05.012590   60243 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 16:57:05.016311   60243 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 16:57:05.016343   60243 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 16:57:05.016356   60243 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 16:57:05.016365   60243 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 16:57:05.016390   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 16:57:05.016463   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 16:57:05.016587   60243 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 16:57:05.016603   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 16:57:05.016747   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 16:57:05.026453   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:57:05.054679   60243 start.go:296] duration metric: took 159.911183ms for postStartSetup
	I0918 16:57:05.055125   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 16:57:05.073363   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:57:05.073657   60243 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:57:05.073698   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:05.091184   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:05.183583   60243 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 16:57:05.187892   60243 start.go:128] duration metric: took 7.419268686s to createHost
	I0918 16:57:05.187925   60243 start.go:83] releasing machines lock for "ha-078118", held for 7.419435528s
	I0918 16:57:05.187997   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 16:57:05.206007   60243 ssh_runner.go:195] Run: cat /version.json
	I0918 16:57:05.206061   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:05.206078   60243 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 16:57:05.206128   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:05.226344   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:05.226582   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:05.390376   60243 ssh_runner.go:195] Run: systemctl --version
	I0918 16:57:05.395210   60243 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 16:57:05.535393   60243 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 16:57:05.540215   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:57:05.563699   60243 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 16:57:05.563777   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:57:05.593610   60243 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0918 16:57:05.593635   60243 start.go:495] detecting cgroup driver to use...
	I0918 16:57:05.593682   60243 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 16:57:05.593755   60243 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 16:57:05.609690   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 16:57:05.621084   60243 docker.go:218] disabling cri-docker service (if available) ...
	I0918 16:57:05.621139   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 16:57:05.634236   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 16:57:05.649602   60243 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 16:57:05.717704   60243 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 16:57:05.791536   60243 docker.go:234] disabling docker service ...
	I0918 16:57:05.791597   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 16:57:05.809456   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 16:57:05.821093   60243 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 16:57:05.891934   60243 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 16:57:05.996308   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 16:57:06.008290   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 16:57:06.025752   60243 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 16:57:06.025802   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.039023   60243 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 16:57:06.039085   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.049537   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.059941   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.070049   60243 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 16:57:06.079646   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.089835   60243 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.106740   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:06.116937   60243 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 16:57:06.125702   60243 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 16:57:06.136246   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:06.241697   60243 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 16:57:06.338653   60243 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 16:57:06.338718   60243 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 16:57:06.342873   60243 start.go:563] Will wait 60s for crictl version
	I0918 16:57:06.342929   60243 ssh_runner.go:195] Run: which crictl
	I0918 16:57:06.346790   60243 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 16:57:06.382517   60243 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 16:57:06.382605   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:57:06.419798   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:57:06.456221   60243 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 16:57:06.457601   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:57:06.475395   60243 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 16:57:06.479436   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:57:06.491469   60243 kubeadm.go:875] updating cluster {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIP
s:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: Soc
ketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0918 16:57:06.491586   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:57:06.491632   60243 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 16:57:06.560467   60243 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 16:57:06.560490   60243 crio.go:433] Images already preloaded, skipping extraction
	I0918 16:57:06.560565   60243 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 16:57:06.596435   60243 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 16:57:06.596457   60243 cache_images.go:85] Images are preloaded, skipping loading
	I0918 16:57:06.596465   60243 kubeadm.go:926] updating node { 192.168.49.2 8443 v1.34.0 crio true true} ...
	I0918 16:57:06.596593   60243 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 16:57:06.596663   60243 ssh_runner.go:195] Run: crio config
	I0918 16:57:06.638379   60243 cni.go:84] Creating CNI manager for ""
	I0918 16:57:06.638415   60243 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0918 16:57:06.638485   60243 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0918 16:57:06.638551   60243 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.34.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-078118 NodeName:ha-078118 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manif
ests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0918 16:57:06.638713   60243 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "ha-078118"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.49.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	kubernetesVersion: v1.34.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: systemd
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0918 16:57:06.638746   60243 kube-vip.go:115] generating kube-vip config ...
	I0918 16:57:06.638798   60243 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 16:57:06.651869   60243 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 16:57:06.652012   60243 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/super-admin.conf"
	    name: kubeconfig
	status: {}
	I0918 16:57:06.652164   60243 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 16:57:06.661798   60243 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 16:57:06.661868   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
	I0918 16:57:06.671425   60243 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (359 bytes)
	I0918 16:57:06.690684   60243 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 16:57:06.712365   60243 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2205 bytes)
	I0918 16:57:06.730837   60243 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1364 bytes)
	I0918 16:57:06.751634   60243 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 16:57:06.755620   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:57:06.767580   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:06.834874   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:57:06.856024   60243 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.2
	I0918 16:57:06.856044   60243 certs.go:194] generating shared ca certs ...
	I0918 16:57:06.856058   60243 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:06.856204   60243 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 16:57:06.856251   60243 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 16:57:06.856269   60243 certs.go:256] generating profile certs ...
	I0918 16:57:06.856336   60243 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 16:57:06.856374   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt with IP's: []
	I0918 16:57:07.092454   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt ...
	I0918 16:57:07.092487   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt: {Name:mk19062e6a12c311074ac12acf7e6f0d17c6d89a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.092685   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key ...
	I0918 16:57:07.092704   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key: {Name:mk318c046cc338ba0b28b363817d97a3070d94ed Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.092818   60243 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.37f1b339
	I0918 16:57:07.092834   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.37f1b339 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.254]
	I0918 16:57:07.337211   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.37f1b339 ...
	I0918 16:57:07.337241   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.37f1b339: {Name:mk0b5e39f9123a2c4e24d5df860b2ac053c5a5e0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.337432   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.37f1b339 ...
	I0918 16:57:07.337456   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.37f1b339: {Name:mkf9155cc06cff6c926a6f1637026b23fbaea042 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.337590   60243 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.37f1b339 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 16:57:07.337708   60243 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.37f1b339 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 16:57:07.337789   60243 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 16:57:07.337811   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt with IP's: []
	I0918 16:57:07.508219   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt ...
	I0918 16:57:07.508250   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt: {Name:mk9be1072d013045d70f28d234a2966ed6a259eb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.508439   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key ...
	I0918 16:57:07.508459   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key: {Name:mk0fa849d3f79114700ec4346366d93036905ac9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:07.508586   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 16:57:07.508611   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 16:57:07.508632   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 16:57:07.508659   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 16:57:07.508679   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 16:57:07.508694   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 16:57:07.508710   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 16:57:07.508729   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 16:57:07.508805   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 16:57:07.508852   60243 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 16:57:07.508866   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 16:57:07.508898   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 16:57:07.508928   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 16:57:07.508964   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 16:57:07.509027   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:57:07.509070   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 16:57:07.509093   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:07.509106   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 16:57:07.509647   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 16:57:07.536147   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 16:57:07.563252   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 16:57:07.590602   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 16:57:07.616431   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)
	I0918 16:57:07.642036   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 16:57:07.668728   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 16:57:07.695297   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 16:57:07.720300   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 16:57:07.748223   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 16:57:07.774345   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 16:57:07.799523   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0918 16:57:07.818102   60243 ssh_runner.go:195] Run: openssl version
	I0918 16:57:07.823677   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 16:57:07.833790   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:07.837671   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:07.837733   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:07.844558   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 16:57:07.854483   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 16:57:07.864206   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 16:57:07.868068   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 16:57:07.868131   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 16:57:07.875355   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 16:57:07.885526   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 16:57:07.895494   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 16:57:07.899217   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 16:57:07.899266   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 16:57:07.906421   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 16:57:07.916547   60243 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 16:57:07.920046   60243 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0918 16:57:07.920125   60243 kubeadm.go:392] StartCluster: {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[
] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: Socket
VMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:57:07.920228   60243 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0918 16:57:07.920275   60243 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0918 16:57:07.956205   60243 cri.go:89] found id: ""
	I0918 16:57:07.956268   60243 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0918 16:57:07.965688   60243 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0918 16:57:07.975065   60243 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
	I0918 16:57:07.975155   60243 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0918 16:57:07.984553   60243 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0918 16:57:07.984571   60243 kubeadm.go:157] found existing configuration files:
	
	I0918 16:57:07.984632   60243 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0918 16:57:07.993826   60243 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0918 16:57:07.993878   60243 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0918 16:57:08.002980   60243 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0918 16:57:08.012468   60243 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0918 16:57:08.012566   60243 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0918 16:57:08.021925   60243 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0918 16:57:08.031367   60243 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0918 16:57:08.031459   60243 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0918 16:57:08.040660   60243 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0918 16:57:08.050415   60243 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0918 16:57:08.050490   60243 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0918 16:57:08.059624   60243 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0918 16:57:08.100277   60243 kubeadm.go:310] [init] Using Kubernetes version: v1.34.0
	I0918 16:57:08.100331   60243 kubeadm.go:310] [preflight] Running pre-flight checks
	I0918 16:57:08.116038   60243 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
	I0918 16:57:08.116128   60243 kubeadm.go:310] KERNEL_VERSION: 6.8.0-1037-gcp
	I0918 16:57:08.116186   60243 kubeadm.go:310] OS: Linux
	I0918 16:57:08.116266   60243 kubeadm.go:310] CGROUPS_CPU: enabled
	I0918 16:57:08.116315   60243 kubeadm.go:310] CGROUPS_CPUSET: enabled
	I0918 16:57:08.116373   60243 kubeadm.go:310] CGROUPS_DEVICES: enabled
	I0918 16:57:08.116443   60243 kubeadm.go:310] CGROUPS_FREEZER: enabled
	I0918 16:57:08.116522   60243 kubeadm.go:310] CGROUPS_MEMORY: enabled
	I0918 16:57:08.116571   60243 kubeadm.go:310] CGROUPS_PIDS: enabled
	I0918 16:57:08.116615   60243 kubeadm.go:310] CGROUPS_HUGETLB: enabled
	I0918 16:57:08.116655   60243 kubeadm.go:310] CGROUPS_IO: enabled
	I0918 16:57:08.171905   60243 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0918 16:57:08.172043   60243 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0918 16:57:08.172141   60243 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
	I0918 16:57:08.179444   60243 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0918 16:57:08.181874   60243 out.go:252]   - Generating certificates and keys ...
	I0918 16:57:08.181988   60243 kubeadm.go:310] [certs] Using existing ca certificate authority
	I0918 16:57:08.182109   60243 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
	I0918 16:57:08.384218   60243 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0918 16:57:08.699741   60243 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
	I0918 16:57:08.825486   60243 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
	I0918 16:57:09.371495   60243 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
	I0918 16:57:09.773350   60243 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
	I0918 16:57:09.773540   60243 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [ha-078118 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0918 16:57:09.808553   60243 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
	I0918 16:57:09.808791   60243 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [ha-078118 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0918 16:57:10.030134   60243 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0918 16:57:10.543694   60243 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
	I0918 16:57:10.609235   60243 kubeadm.go:310] [certs] Generating "sa" key and public key
	I0918 16:57:10.609444   60243 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0918 16:57:10.844107   60243 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0918 16:57:10.880658   60243 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
	I0918 16:57:11.137641   60243 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0918 16:57:11.532580   60243 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0918 16:57:12.251321   60243 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0918 16:57:12.251715   60243 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0918 16:57:12.253897   60243 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0918 16:57:12.256755   60243 out.go:252]   - Booting up control plane ...
	I0918 16:57:12.256866   60243 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0918 16:57:12.256981   60243 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0918 16:57:12.257446   60243 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0918 16:57:12.266598   60243 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0918 16:57:12.266737   60243 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
	I0918 16:57:12.272623   60243 kubeadm.go:310] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
	I0918 16:57:12.272803   60243 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0918 16:57:12.272863   60243 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0918 16:57:12.350329   60243 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
	I0918 16:57:12.350484   60243 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
	I0918 16:57:12.852220   60243 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 502.00859ms
	I0918 16:57:12.854990   60243 kubeadm.go:310] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
	I0918 16:57:12.855092   60243 kubeadm.go:310] [control-plane-check] Checking kube-apiserver at https://192.168.49.2:8443/livez
	I0918 16:57:12.855203   60243 kubeadm.go:310] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
	I0918 16:57:12.855323   60243 kubeadm.go:310] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
	I0918 16:57:14.965273   60243 kubeadm.go:310] [control-plane-check] kube-scheduler is healthy after 2.110264832s
	I0918 16:57:14.984462   60243 kubeadm.go:310] [control-plane-check] kube-controller-manager is healthy after 2.1294049s
	I0918 16:57:19.024541   60243 kubeadm.go:310] [control-plane-check] kube-apiserver is healthy after 6.169430817s
	I0918 16:57:19.036534   60243 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0918 16:57:19.048658   60243 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0918 16:57:19.058561   60243 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0918 16:57:19.058849   60243 kubeadm.go:310] [mark-control-plane] Marking the node ha-078118 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0918 16:57:19.067655   60243 kubeadm.go:310] [bootstrap-token] Using token: u1re3r.382xtbpelzb2vqn2
	I0918 16:57:19.069664   60243 out.go:252]   - Configuring RBAC rules ...
	I0918 16:57:19.069828   60243 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0918 16:57:19.073078   60243 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0918 16:57:19.080001   60243 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0918 16:57:19.082815   60243 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0918 16:57:19.085370   60243 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0918 16:57:19.088075   60243 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0918 16:57:19.430480   60243 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0918 16:57:19.851385   60243 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0918 16:57:20.430959   60243 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0918 16:57:20.432013   60243 kubeadm.go:310] 
	I0918 16:57:20.432090   60243 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0918 16:57:20.432099   60243 kubeadm.go:310] 
	I0918 16:57:20.432181   60243 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0918 16:57:20.432188   60243 kubeadm.go:310] 
	I0918 16:57:20.432210   60243 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0918 16:57:20.432276   60243 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0918 16:57:20.432337   60243 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0918 16:57:20.432348   60243 kubeadm.go:310] 
	I0918 16:57:20.432441   60243 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0918 16:57:20.432460   60243 kubeadm.go:310] 
	I0918 16:57:20.432557   60243 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0918 16:57:20.432567   60243 kubeadm.go:310] 
	I0918 16:57:20.432631   60243 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0918 16:57:20.432695   60243 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0918 16:57:20.432772   60243 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0918 16:57:20.432781   60243 kubeadm.go:310] 
	I0918 16:57:20.432883   60243 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0918 16:57:20.433004   60243 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0918 16:57:20.433043   60243 kubeadm.go:310] 
	I0918 16:57:20.433148   60243 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token u1re3r.382xtbpelzb2vqn2 \
	I0918 16:57:20.433277   60243 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 \
	I0918 16:57:20.433309   60243 kubeadm.go:310] 	--control-plane 
	I0918 16:57:20.433319   60243 kubeadm.go:310] 
	I0918 16:57:20.433422   60243 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0918 16:57:20.433430   60243 kubeadm.go:310] 
	I0918 16:57:20.433578   60243 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token u1re3r.382xtbpelzb2vqn2 \
	I0918 16:57:20.433727   60243 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 
	I0918 16:57:20.436674   60243 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1037-gcp\n", err: exit status 1
	I0918 16:57:20.436833   60243 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0918 16:57:20.436876   60243 cni.go:84] Creating CNI manager for ""
	I0918 16:57:20.436887   60243 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0918 16:57:20.439722   60243 out.go:179] * Configuring CNI (Container Networking Interface) ...
	I0918 16:57:20.441111   60243 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0918 16:57:20.445728   60243 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.0/kubectl ...
	I0918 16:57:20.445756   60243 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
	I0918 16:57:20.465315   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0918 16:57:20.690521   60243 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0918 16:57:20.690609   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:20.690640   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-078118 minikube.k8s.io/updated_at=2025_09_18T16_57_20_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596 minikube.k8s.io/name=ha-078118 minikube.k8s.io/primary=true
	I0918 16:57:20.700737   60243 ops.go:34] apiserver oom_adj: -16
	I0918 16:57:20.767604   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:21.268560   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:21.768089   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:22.268176   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:22.767676   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 16:57:22.839542   60243 kubeadm.go:1105] duration metric: took 2.149001453s to wait for elevateKubeSystemPrivileges
	I0918 16:57:22.839581   60243 kubeadm.go:394] duration metric: took 14.919472386s to StartCluster
	I0918 16:57:22.839607   60243 settings.go:142] acquiring lock: {Name:mk72fea03aefe901db9522a467405d86665fedd0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:22.839682   60243 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 16:57:22.840462   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:22.840735   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0918 16:57:22.840750   60243 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:57:22.840775   60243 start.go:241] waiting for startup goroutines ...
	I0918 16:57:22.840788   60243 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0918 16:57:22.840876   60243 addons.go:69] Setting storage-provisioner=true in profile "ha-078118"
	I0918 16:57:22.840891   60243 addons.go:69] Setting default-storageclass=true in profile "ha-078118"
	I0918 16:57:22.840905   60243 addons.go:238] Setting addon storage-provisioner=true in "ha-078118"
	I0918 16:57:22.840939   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:57:22.840991   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:22.840941   60243 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-078118"
	I0918 16:57:22.841392   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:22.841558   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:22.865202   60243 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0918 16:57:22.865763   60243 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
	I0918 16:57:22.865795   60243 cert_rotation.go:141] "Starting client certificate rotation controller" logger="tls-transport-cache"
	I0918 16:57:22.865809   60243 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I0918 16:57:22.865816   60243 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
	I0918 16:57:22.865822   60243 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I0918 16:57:22.865828   60243 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
	I0918 16:57:22.866253   60243 addons.go:238] Setting addon default-storageclass=true in "ha-078118"
	I0918 16:57:22.866295   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:57:22.866582   60243 out.go:179]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0918 16:57:22.866825   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:22.868241   60243 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 16:57:22.868262   60243 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0918 16:57:22.868342   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:22.887359   60243 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
	I0918 16:57:22.887382   60243 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0918 16:57:22.887455   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:22.887753   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:22.910642   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:22.923544   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0918 16:57:23.006833   60243 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 16:57:23.025178   60243 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0918 16:57:23.102314   60243 start.go:976] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0918 16:57:23.320187   60243 out.go:179] * Enabled addons: storage-provisioner, default-storageclass
	I0918 16:57:23.321629   60243 addons.go:514] duration metric: took 480.833788ms for enable addons: enabled=[storage-provisioner default-storageclass]
	I0918 16:57:23.321670   60243 start.go:246] waiting for cluster config update ...
	I0918 16:57:23.321686   60243 start.go:255] writing updated cluster config ...
	I0918 16:57:23.323424   60243 out.go:203] 
	I0918 16:57:23.325109   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:23.325199   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:57:23.327022   60243 out.go:179] * Starting "ha-078118-m02" control-plane node in "ha-078118" cluster
	I0918 16:57:23.328400   60243 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 16:57:23.329828   60243 out.go:179] * Pulling base image v0.0.48 ...
	I0918 16:57:23.331236   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:57:23.331263   60243 cache.go:58] Caching tarball of preloaded images
	I0918 16:57:23.331263   60243 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 16:57:23.331360   60243 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 16:57:23.331373   60243 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 16:57:23.331452   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:57:23.352040   60243 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 16:57:23.352060   60243 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 16:57:23.352072   60243 cache.go:232] Successfully downloaded all kic artifacts
	I0918 16:57:23.352116   60243 start.go:360] acquireMachinesLock for ha-078118-m02: {Name:mk65f6a883861f2032241e1132c63effea2ab61f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 16:57:23.352223   60243 start.go:364] duration metric: took 88.663µs to acquireMachinesLock for "ha-078118-m02"
	I0918 16:57:23.352254   60243 start.go:93] Provisioning new machine with config: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:57:23.352328   60243 start.go:125] createHost starting for "m02" (driver="docker")
	I0918 16:57:23.354398   60243 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
	I0918 16:57:23.354538   60243 start.go:159] libmachine.API.Create for "ha-078118" (driver="docker")
	I0918 16:57:23.354572   60243 client.go:168] LocalClient.Create starting
	I0918 16:57:23.354639   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 16:57:23.354680   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:57:23.354700   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:57:23.354772   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 16:57:23.354801   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:57:23.354818   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:57:23.355707   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:57:23.373229   60243 network_create.go:77] Found existing network {name:ha-078118 subnet:0xc002073950 gateway:[0 0 0 0 0 0 0 0 0 0 255 255 192 168 49 1] mtu:1500}
	I0918 16:57:23.373281   60243 kic.go:121] calculated static IP "192.168.49.3" for the "ha-078118-m02" container
	I0918 16:57:23.373335   60243 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 16:57:23.392406   60243 cli_runner.go:164] Run: docker volume create ha-078118-m02 --label name.minikube.sigs.k8s.io=ha-078118-m02 --label created_by.minikube.sigs.k8s.io=true
	I0918 16:57:23.414767   60243 oci.go:103] Successfully created a docker volume ha-078118-m02
	I0918 16:57:23.414860   60243 cli_runner.go:164] Run: docker run --rm --name ha-078118-m02-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m02 --entrypoint /usr/bin/test -v ha-078118-m02:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 16:57:23.852088   60243 oci.go:107] Successfully prepared a docker volume ha-078118-m02
	I0918 16:57:23.852142   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:57:23.852165   60243 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 16:57:23.852243   60243 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m02:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 16:57:28.049263   60243 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m02:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.19696985s)
	I0918 16:57:28.049296   60243 kic.go:203] duration metric: took 4.197127441s to extract preloaded images to volume ...
	W0918 16:57:28.049399   60243 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 16:57:28.049426   60243 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 16:57:28.049461   60243 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 16:57:28.104457   60243 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ha-078118-m02 --name ha-078118-m02 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m02 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ha-078118-m02 --network ha-078118 --ip 192.168.49.3 --volume ha-078118-m02:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 16:57:28.377133   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Running}}
	I0918 16:57:28.396963   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 16:57:28.416714   60243 cli_runner.go:164] Run: docker exec ha-078118-m02 stat /var/lib/dpkg/alternatives/iptables
	I0918 16:57:28.473951   60243 oci.go:144] the created container "ha-078118-m02" has a running status.
	I0918 16:57:28.473985   60243 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa...
	I0918 16:57:29.190216   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0918 16:57:29.190259   60243 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 16:57:29.215556   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 16:57:29.233891   60243 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0918 16:57:29.233912   60243 kic_runner.go:114] Args: [docker exec --privileged ha-078118-m02 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0918 16:57:29.288122   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 16:57:29.305873   60243 machine.go:93] provisionDockerMachine start ...
	I0918 16:57:29.305960   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:29.324234   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:29.324468   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32788 <nil> <nil>}
	I0918 16:57:29.324480   60243 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 16:57:29.460587   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 16:57:29.460616   60243 ubuntu.go:182] provisioning hostname "ha-078118-m02"
	I0918 16:57:29.460684   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:29.479097   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:29.479306   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32788 <nil> <nil>}
	I0918 16:57:29.479323   60243 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m02 && echo "ha-078118-m02" | sudo tee /etc/hostname
	I0918 16:57:29.628691   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 16:57:29.628814   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:29.647616   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:29.647872   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32788 <nil> <nil>}
	I0918 16:57:29.647893   60243 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m02' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m02/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m02' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 16:57:29.784402   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 16:57:29.784431   60243 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 16:57:29.784448   60243 ubuntu.go:190] setting up certificates
	I0918 16:57:29.784457   60243 provision.go:84] configureAuth start
	I0918 16:57:29.784531   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 16:57:29.803424   60243 provision.go:143] copyHostCerts
	I0918 16:57:29.803462   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:57:29.803520   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 16:57:29.803535   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:57:29.803621   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 16:57:29.803783   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:57:29.803815   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 16:57:29.803822   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:57:29.803868   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 16:57:29.803949   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:57:29.803975   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 16:57:29.803981   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:57:29.804020   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 16:57:29.804097   60243 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m02 san=[127.0.0.1 192.168.49.3 ha-078118-m02 localhost minikube]
	I0918 16:57:29.933774   60243 provision.go:177] copyRemoteCerts
	I0918 16:57:29.933834   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 16:57:29.933864   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:29.952199   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.053380   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 16:57:30.053448   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 16:57:30.079586   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 16:57:30.079652   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 16:57:30.106162   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 16:57:30.106215   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0918 16:57:30.131599   60243 provision.go:87] duration metric: took 347.131672ms to configureAuth
	I0918 16:57:30.131623   60243 ubuntu.go:206] setting minikube options for container-runtime
	I0918 16:57:30.131803   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:30.131903   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.151255   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:57:30.151466   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32788 <nil> <nil>}
	I0918 16:57:30.151481   60243 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 16:57:30.393377   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 16:57:30.393406   60243 machine.go:96] duration metric: took 1.08751272s to provisionDockerMachine
	I0918 16:57:30.393419   60243 client.go:171] duration metric: took 7.038837191s to LocalClient.Create
	I0918 16:57:30.393445   60243 start.go:167] duration metric: took 7.038908487s to libmachine.API.Create "ha-078118"
	I0918 16:57:30.393465   60243 start.go:293] postStartSetup for "ha-078118-m02" (driver="docker")
	I0918 16:57:30.393489   60243 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 16:57:30.393583   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 16:57:30.393629   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.412821   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.513018   60243 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 16:57:30.516819   60243 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 16:57:30.516868   60243 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 16:57:30.516888   60243 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 16:57:30.516896   60243 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 16:57:30.516914   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 16:57:30.516990   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 16:57:30.517127   60243 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 16:57:30.517140   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 16:57:30.517261   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 16:57:30.528368   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:57:30.556419   60243 start.go:296] duration metric: took 162.941822ms for postStartSetup
	I0918 16:57:30.556822   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 16:57:30.575320   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:57:30.575623   60243 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:57:30.575666   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.593574   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.686828   60243 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 16:57:30.691487   60243 start.go:128] duration metric: took 7.339144526s to createHost
	I0918 16:57:30.691534   60243 start.go:83] releasing machines lock for "ha-078118-m02", held for 7.33929551s
	I0918 16:57:30.691607   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 16:57:30.712513   60243 out.go:179] * Found network options:
	I0918 16:57:30.713751   60243 out.go:179]   - NO_PROXY=192.168.49.2
	W0918 16:57:30.714978   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 16:57:30.715016   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 16:57:30.715086   60243 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 16:57:30.715123   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.715166   60243 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 16:57:30.715216   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 16:57:30.734742   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.735055   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32788 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 16:57:30.962897   60243 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 16:57:30.967520   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:57:30.990153   60243 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 16:57:30.990237   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:57:31.019088   60243 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0918 16:57:31.019116   60243 start.go:495] detecting cgroup driver to use...
	I0918 16:57:31.019152   60243 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 16:57:31.019210   60243 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 16:57:31.034083   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 16:57:31.047475   60243 docker.go:218] disabling cri-docker service (if available) ...
	I0918 16:57:31.047603   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 16:57:31.061869   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 16:57:31.076170   60243 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 16:57:31.145517   60243 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 16:57:31.219386   60243 docker.go:234] disabling docker service ...
	I0918 16:57:31.219457   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 16:57:31.237791   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 16:57:31.250673   60243 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 16:57:31.317780   60243 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 16:57:31.430074   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 16:57:31.441929   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 16:57:31.459420   60243 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 16:57:31.459485   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.472552   60243 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 16:57:31.472626   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.483632   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.494315   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.505031   60243 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 16:57:31.515002   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.526242   60243 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.543262   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:57:31.554050   60243 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 16:57:31.563178   60243 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 16:57:31.572111   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:31.678605   60243 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 16:57:31.775150   60243 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 16:57:31.775210   60243 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 16:57:31.778938   60243 start.go:563] Will wait 60s for crictl version
	I0918 16:57:31.778989   60243 ssh_runner.go:195] Run: which crictl
	I0918 16:57:31.782593   60243 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 16:57:31.816289   60243 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 16:57:31.816365   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:57:31.851649   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:57:31.888680   60243 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 16:57:31.890365   60243 out.go:179]   - env NO_PROXY=192.168.49.2
	I0918 16:57:31.891835   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:57:31.909279   60243 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 16:57:31.913221   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:57:31.925293   60243 mustload.go:65] Loading cluster: ha-078118
	I0918 16:57:31.925540   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:31.925802   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:57:31.943863   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:57:31.944113   60243 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.3
	I0918 16:57:31.944124   60243 certs.go:194] generating shared ca certs ...
	I0918 16:57:31.944136   60243 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:31.944251   60243 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 16:57:31.944295   60243 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 16:57:31.944304   60243 certs.go:256] generating profile certs ...
	I0918 16:57:31.944380   60243 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 16:57:31.944412   60243 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd
	I0918 16:57:31.944425   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.77376cdd with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.3 192.168.49.254]
	I0918 16:57:32.168102   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.77376cdd ...
	I0918 16:57:32.168133   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.77376cdd: {Name:mk632021bef8af557693dc3ec289ba5200d429d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:32.168315   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd ...
	I0918 16:57:32.168329   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd: {Name:mk6495f27d17861f263fd496e8789375ecd02b96 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:57:32.168403   60243 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.77376cdd -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 16:57:32.168560   60243 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 16:57:32.168697   60243 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 16:57:32.168717   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 16:57:32.168729   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 16:57:32.168744   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 16:57:32.168757   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 16:57:32.168772   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 16:57:32.168785   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 16:57:32.168797   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 16:57:32.168806   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 16:57:32.168853   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 16:57:32.168877   60243 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 16:57:32.168887   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 16:57:32.168911   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 16:57:32.168937   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 16:57:32.168963   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 16:57:32.169007   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:57:32.169032   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 16:57:32.169052   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 16:57:32.169066   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:32.169122   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:32.187428   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:32.275908   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
	I0918 16:57:32.280174   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
	I0918 16:57:32.293804   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
	I0918 16:57:32.297921   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
	I0918 16:57:32.312674   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
	I0918 16:57:32.317137   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
	I0918 16:57:32.332012   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
	I0918 16:57:32.335910   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)
	I0918 16:57:32.349818   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
	I0918 16:57:32.353706   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
	I0918 16:57:32.367328   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
	I0918 16:57:32.371320   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
	I0918 16:57:32.384442   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 16:57:32.410849   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 16:57:32.436643   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 16:57:32.463000   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 16:57:32.489057   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)
	I0918 16:57:32.515291   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0918 16:57:32.541234   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 16:57:32.566259   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 16:57:32.591152   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 16:57:32.619176   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 16:57:32.645865   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 16:57:32.672086   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
	I0918 16:57:32.691464   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
	I0918 16:57:32.711184   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
	I0918 16:57:32.730444   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)
	I0918 16:57:32.749620   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
	I0918 16:57:32.768643   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
	I0918 16:57:32.788328   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
	I0918 16:57:32.807884   60243 ssh_runner.go:195] Run: openssl version
	I0918 16:57:32.813660   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 16:57:32.823960   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 16:57:32.828123   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 16:57:32.828191   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 16:57:32.835458   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 16:57:32.846026   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 16:57:32.856631   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 16:57:32.860308   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 16:57:32.860358   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 16:57:32.866856   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 16:57:32.876690   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 16:57:32.886762   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:32.890660   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:32.890731   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:57:32.897540   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 16:57:32.907932   60243 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 16:57:32.911973   60243 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0918 16:57:32.912038   60243 kubeadm.go:926] updating node {m02 192.168.49.3 8443 v1.34.0 crio true true} ...
	I0918 16:57:32.912131   60243 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.3
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 16:57:32.912158   60243 kube-vip.go:115] generating kube-vip config ...
	I0918 16:57:32.912205   60243 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 16:57:32.924930   60243 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 16:57:32.924991   60243 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 16:57:32.925053   60243 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 16:57:32.934340   60243 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 16:57:32.934404   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
	I0918 16:57:32.944100   60243 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0918 16:57:32.964172   60243 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 16:57:32.986017   60243 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 16:57:33.007415   60243 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 16:57:33.011436   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:57:33.023696   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:33.094414   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:57:33.122168   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:57:33.122460   60243 start.go:317] joinCluster: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]
DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mount
Type:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:57:33.122601   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm token create --print-join-command --ttl=0"
	I0918 16:57:33.122663   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:57:33.143661   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:57:33.287975   60243 start.go:343] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:57:33.288021   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token zhmybn.ylv6f2k1dop39m4s --discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-078118-m02 --control-plane --apiserver-advertise-address=192.168.49.3 --apiserver-bind-port=8443"
	I0918 16:57:50.957307   60243 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token zhmybn.ylv6f2k1dop39m4s --discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-078118-m02 --control-plane --apiserver-advertise-address=192.168.49.3 --apiserver-bind-port=8443": (17.669258722s)
	I0918 16:57:50.957347   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"
	I0918 16:57:51.183198   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-078118-m02 minikube.k8s.io/updated_at=2025_09_18T16_57_51_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596 minikube.k8s.io/name=ha-078118 minikube.k8s.io/primary=false
	I0918 16:57:51.257842   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-078118-m02 node-role.kubernetes.io/control-plane:NoSchedule-
	I0918 16:57:51.333794   60243 start.go:319] duration metric: took 18.211330608s to joinCluster
	I0918 16:57:51.333873   60243 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:57:51.334134   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:57:51.335826   60243 out.go:179] * Verifying Kubernetes components...
	I0918 16:57:51.337317   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:57:51.433888   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:57:51.448166   60243 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	W0918 16:57:51.448229   60243 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.49.254:8443 with https://192.168.49.2:8443
	I0918 16:57:51.448458   60243 node_ready.go:35] waiting up to 6m0s for node "ha-078118-m02" to be "Ready" ...
	W0918 16:57:53.452514   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:57:55.954646   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:57:58.452847   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:00.951914   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:02.952603   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:04.952691   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:06.953510   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:09.452614   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:11.951583   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:13.952555   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:16.452462   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:18.951818   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:20.952078   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:22.952626   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:25.452581   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:27.952333   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:30.452627   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 16:58:32.452894   60243 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	I0918 16:58:34.452216   60243 node_ready.go:49] node "ha-078118-m02" is "Ready"
	I0918 16:58:34.452242   60243 node_ready.go:38] duration metric: took 43.00375648s for node "ha-078118-m02" to be "Ready" ...
	I0918 16:58:34.452256   60243 api_server.go:52] waiting for apiserver process to appear ...
	I0918 16:58:34.452305   60243 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 16:58:34.464123   60243 api_server.go:72] duration metric: took 43.130215918s to wait for apiserver process to appear ...
	I0918 16:58:34.464146   60243 api_server.go:88] waiting for apiserver healthz status ...
	I0918 16:58:34.464162   60243 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0918 16:58:34.469944   60243 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0918 16:58:34.470928   60243 api_server.go:141] control plane version: v1.34.0
	I0918 16:58:34.470956   60243 api_server.go:131] duration metric: took 6.803903ms to wait for apiserver health ...
	I0918 16:58:34.470975   60243 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 16:58:34.475258   60243 system_pods.go:59] 17 kube-system pods found
	I0918 16:58:34.475292   60243 system_pods.go:61] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 16:58:34.475298   60243 system_pods.go:61] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 16:58:34.475301   60243 system_pods.go:61] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 16:58:34.475306   60243 system_pods.go:61] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 16:58:34.475310   60243 system_pods.go:61] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 16:58:34.475313   60243 system_pods.go:61] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 16:58:34.475318   60243 system_pods.go:61] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 16:58:34.475322   60243 system_pods.go:61] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 16:58:34.475325   60243 system_pods.go:61] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 16:58:34.475328   60243 system_pods.go:61] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 16:58:34.475332   60243 system_pods.go:61] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 16:58:34.475334   60243 system_pods.go:61] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 16:58:34.475337   60243 system_pods.go:61] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 16:58:34.475340   60243 system_pods.go:61] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 16:58:34.475343   60243 system_pods.go:61] "kube-vip-ha-078118" [9d6c9fdb-435c-43e0-b477-6ad4ac75fecf] Running
	I0918 16:58:34.475346   60243 system_pods.go:61] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 16:58:34.475349   60243 system_pods.go:61] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 16:58:34.475354   60243 system_pods.go:74] duration metric: took 4.373062ms to wait for pod list to return data ...
	I0918 16:58:34.475363   60243 default_sa.go:34] waiting for default service account to be created ...
	I0918 16:58:34.478310   60243 default_sa.go:45] found service account: "default"
	I0918 16:58:34.478331   60243 default_sa.go:55] duration metric: took 2.963019ms for default service account to be created ...
	I0918 16:58:34.478340   60243 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 16:58:34.481978   60243 system_pods.go:86] 17 kube-system pods found
	I0918 16:58:34.482005   60243 system_pods.go:89] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 16:58:34.482013   60243 system_pods.go:89] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 16:58:34.482019   60243 system_pods.go:89] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 16:58:34.482024   60243 system_pods.go:89] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 16:58:34.482029   60243 system_pods.go:89] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 16:58:34.482034   60243 system_pods.go:89] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 16:58:34.482041   60243 system_pods.go:89] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 16:58:34.482047   60243 system_pods.go:89] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 16:58:34.482055   60243 system_pods.go:89] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 16:58:34.482062   60243 system_pods.go:89] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 16:58:34.482071   60243 system_pods.go:89] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 16:58:34.482077   60243 system_pods.go:89] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 16:58:34.482086   60243 system_pods.go:89] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 16:58:34.482098   60243 system_pods.go:89] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 16:58:34.482106   60243 system_pods.go:89] "kube-vip-ha-078118" [9d6c9fdb-435c-43e0-b477-6ad4ac75fecf] Running
	I0918 16:58:34.482112   60243 system_pods.go:89] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 16:58:34.482120   60243 system_pods.go:89] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 16:58:34.482128   60243 system_pods.go:126] duration metric: took 3.781721ms to wait for k8s-apps to be running ...
	I0918 16:58:34.482140   60243 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 16:58:34.482192   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 16:58:34.503029   60243 system_svc.go:56] duration metric: took 20.8799ms WaitForService to wait for kubelet
	I0918 16:58:34.503062   60243 kubeadm.go:578] duration metric: took 43.169159629s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 16:58:34.503098   60243 node_conditions.go:102] verifying NodePressure condition ...
	I0918 16:58:34.506955   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:58:34.506981   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:58:34.506999   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:58:34.507002   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:58:34.507009   60243 node_conditions.go:105] duration metric: took 3.904235ms to run NodePressure ...
	I0918 16:58:34.507023   60243 start.go:241] waiting for startup goroutines ...
	I0918 16:58:34.507059   60243 start.go:255] writing updated cluster config ...
	I0918 16:58:34.509378   60243 out.go:203] 
	I0918 16:58:34.511211   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:58:34.511316   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:58:34.513091   60243 out.go:179] * Starting "ha-078118-m03" control-plane node in "ha-078118" cluster
	I0918 16:58:34.514457   60243 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 16:58:34.515762   60243 out.go:179] * Pulling base image v0.0.48 ...
	I0918 16:58:34.517107   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:58:34.517134   60243 cache.go:58] Caching tarball of preloaded images
	I0918 16:58:34.517177   60243 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 16:58:34.517230   60243 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 16:58:34.517241   60243 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 16:58:34.517325   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:58:34.538516   60243 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 16:58:34.538541   60243 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 16:58:34.538561   60243 cache.go:232] Successfully downloaded all kic artifacts
	I0918 16:58:34.538588   60243 start.go:360] acquireMachinesLock for ha-078118-m03: {Name:mk9d1c903c967299da898df87db82c277b1f732e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 16:58:34.538687   60243 start.go:364] duration metric: took 82.978µs to acquireMachinesLock for "ha-078118-m03"
	I0918 16:58:34.538711   60243 start.go:93] Provisioning new machine with config: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevi
rt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0
GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:58:34.538798   60243 start.go:125] createHost starting for "m03" (driver="docker")
	I0918 16:58:34.541070   60243 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
	I0918 16:58:34.541173   60243 start.go:159] libmachine.API.Create for "ha-078118" (driver="docker")
	I0918 16:58:34.541202   60243 client.go:168] LocalClient.Create starting
	I0918 16:58:34.541284   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 16:58:34.541320   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:58:34.541333   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:58:34.541387   60243 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 16:58:34.541406   60243 main.go:141] libmachine: Decoding PEM data...
	I0918 16:58:34.541417   60243 main.go:141] libmachine: Parsing certificate...
	I0918 16:58:34.541631   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:58:34.559076   60243 network_create.go:77] Found existing network {name:ha-078118 subnet:0xc00218f740 gateway:[0 0 0 0 0 0 0 0 0 0 255 255 192 168 49 1] mtu:1500}
	I0918 16:58:34.559115   60243 kic.go:121] calculated static IP "192.168.49.4" for the "ha-078118-m03" container
	I0918 16:58:34.559196   60243 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 16:58:34.577217   60243 cli_runner.go:164] Run: docker volume create ha-078118-m03 --label name.minikube.sigs.k8s.io=ha-078118-m03 --label created_by.minikube.sigs.k8s.io=true
	I0918 16:58:34.595827   60243 oci.go:103] Successfully created a docker volume ha-078118-m03
	I0918 16:58:34.595925   60243 cli_runner.go:164] Run: docker run --rm --name ha-078118-m03-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m03 --entrypoint /usr/bin/test -v ha-078118-m03:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 16:58:34.985370   60243 oci.go:107] Successfully prepared a docker volume ha-078118-m03
	I0918 16:58:34.985422   60243 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 16:58:34.985448   60243 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 16:58:34.985570   60243 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m03:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 16:58:39.161109   60243 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ha-078118-m03:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.175489065s)
	I0918 16:58:39.161137   60243 kic.go:203] duration metric: took 4.175687859s to extract preloaded images to volume ...
	W0918 16:58:39.161212   60243 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 16:58:39.161242   60243 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 16:58:39.161279   60243 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 16:58:39.216265   60243 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ha-078118-m03 --name ha-078118-m03 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ha-078118-m03 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ha-078118-m03 --network ha-078118 --ip 192.168.49.4 --volume ha-078118-m03:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 16:58:39.490676   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Running}}
	I0918 16:58:39.509154   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 16:58:39.528283   60243 cli_runner.go:164] Run: docker exec ha-078118-m03 stat /var/lib/dpkg/alternatives/iptables
	I0918 16:58:39.585189   60243 oci.go:144] the created container "ha-078118-m03" has a running status.
	I0918 16:58:39.585228   60243 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa...
	I0918 16:58:39.733661   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0918 16:58:39.733704   60243 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 16:58:39.767524   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 16:58:39.791739   60243 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0918 16:58:39.791763   60243 kic_runner.go:114] Args: [docker exec --privileged ha-078118-m03 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0918 16:58:39.846675   60243 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 16:58:39.867316   60243 machine.go:93] provisionDockerMachine start ...
	I0918 16:58:39.867429   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:39.888632   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:58:39.888885   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0918 16:58:39.888904   60243 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 16:58:40.029356   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m03
	
	I0918 16:58:40.029386   60243 ubuntu.go:182] provisioning hostname "ha-078118-m03"
	I0918 16:58:40.029443   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.049595   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:58:40.049807   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0918 16:58:40.049820   60243 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m03 && echo "ha-078118-m03" | sudo tee /etc/hostname
	I0918 16:58:40.200087   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m03
	
	I0918 16:58:40.200202   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.217994   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:58:40.218257   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0918 16:58:40.218286   60243 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m03' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m03/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m03' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 16:58:40.354076   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 16:58:40.354104   60243 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 16:58:40.354126   60243 ubuntu.go:190] setting up certificates
	I0918 16:58:40.354139   60243 provision.go:84] configureAuth start
	I0918 16:58:40.354197   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 16:58:40.373445   60243 provision.go:143] copyHostCerts
	I0918 16:58:40.373482   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:58:40.373528   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 16:58:40.373540   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 16:58:40.373612   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 16:58:40.373690   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:58:40.373708   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 16:58:40.373715   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 16:58:40.373745   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 16:58:40.373801   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:58:40.373825   60243 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 16:58:40.373835   60243 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 16:58:40.373871   60243 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 16:58:40.373939   60243 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m03 san=[127.0.0.1 192.168.49.4 ha-078118-m03 localhost minikube]
	I0918 16:58:40.469151   60243 provision.go:177] copyRemoteCerts
	I0918 16:58:40.469228   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 16:58:40.469260   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.487441   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:40.584958   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 16:58:40.585042   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 16:58:40.612338   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 16:58:40.612405   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 16:58:40.638478   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 16:58:40.638557   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 16:58:40.664375   60243 provision.go:87] duration metric: took 310.211334ms to configureAuth
	I0918 16:58:40.664412   60243 ubuntu.go:206] setting minikube options for container-runtime
	I0918 16:58:40.664640   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:58:40.664727   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.684197   60243 main.go:141] libmachine: Using SSH client type: native
	I0918 16:58:40.684440   60243 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32793 <nil> <nil>}
	I0918 16:58:40.684457   60243 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 16:58:40.917922   60243 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 16:58:40.917947   60243 machine.go:96] duration metric: took 1.050610089s to provisionDockerMachine
	I0918 16:58:40.917958   60243 client.go:171] duration metric: took 6.376747043s to LocalClient.Create
	I0918 16:58:40.917977   60243 start.go:167] duration metric: took 6.376804493s to libmachine.API.Create "ha-078118"
	I0918 16:58:40.917987   60243 start.go:293] postStartSetup for "ha-078118-m03" (driver="docker")
	I0918 16:58:40.918001   60243 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 16:58:40.918071   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 16:58:40.918125   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:40.936966   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:41.036914   60243 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 16:58:41.040743   60243 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 16:58:41.040792   60243 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 16:58:41.040806   60243 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 16:58:41.040817   60243 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 16:58:41.040830   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 16:58:41.040889   60243 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 16:58:41.040981   60243 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 16:58:41.040993   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 16:58:41.041109   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 16:58:41.050735   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:58:41.078178   60243 start.go:296] duration metric: took 160.175362ms for postStartSetup
	I0918 16:58:41.078562   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 16:58:41.096155   60243 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 16:58:41.096446   60243 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 16:58:41.096487   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:41.114313   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:41.207561   60243 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 16:58:41.211752   60243 start.go:128] duration metric: took 6.672942573s to createHost
	I0918 16:58:41.211772   60243 start.go:83] releasing machines lock for "ha-078118-m03", held for 6.673074744s
	I0918 16:58:41.211824   60243 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 16:58:41.231418   60243 out.go:179] * Found network options:
	I0918 16:58:41.233082   60243 out.go:179]   - NO_PROXY=192.168.49.2,192.168.49.3
	W0918 16:58:41.234375   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 16:58:41.234408   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 16:58:41.234439   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 16:58:41.234459   60243 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 16:58:41.234591   60243 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 16:58:41.234624   60243 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 16:58:41.234645   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:41.234674   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 16:58:41.253204   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:41.253574   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32793 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 16:58:41.487834   60243 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 16:58:41.492986   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:58:41.516316   60243 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 16:58:41.516406   60243 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 16:58:41.548254   60243 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0918 16:58:41.548282   60243 start.go:495] detecting cgroup driver to use...
	I0918 16:58:41.548320   60243 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 16:58:41.548374   60243 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 16:58:41.563666   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 16:58:41.575416   60243 docker.go:218] disabling cri-docker service (if available) ...
	I0918 16:58:41.575473   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 16:58:41.589676   60243 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 16:58:41.604330   60243 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 16:58:41.669451   60243 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 16:58:41.744471   60243 docker.go:234] disabling docker service ...
	I0918 16:58:41.744566   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 16:58:41.762473   60243 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 16:58:41.774931   60243 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 16:58:41.848307   60243 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 16:58:41.952604   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 16:58:41.964539   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 16:58:41.982943   60243 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 16:58:41.982998   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:41.997792   60243 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 16:58:41.997865   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.008724   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.019336   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.030192   60243 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 16:58:42.039767   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.050915   60243 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.067947   60243 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 16:58:42.078882   60243 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 16:58:42.088304   60243 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 16:58:42.097143   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:58:42.205602   60243 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 16:58:42.295918   60243 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 16:58:42.295989   60243 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 16:58:42.300000   60243 start.go:563] Will wait 60s for crictl version
	I0918 16:58:42.300068   60243 ssh_runner.go:195] Run: which crictl
	I0918 16:58:42.303803   60243 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 16:58:42.338282   60243 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 16:58:42.338376   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:58:42.373030   60243 ssh_runner.go:195] Run: crio --version
	I0918 16:58:42.410107   60243 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 16:58:42.411669   60243 out.go:179]   - env NO_PROXY=192.168.49.2
	I0918 16:58:42.413257   60243 out.go:179]   - env NO_PROXY=192.168.49.2,192.168.49.3
	I0918 16:58:42.415059   60243 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 16:58:42.433045   60243 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 16:58:42.437153   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:58:42.449343   60243 mustload.go:65] Loading cluster: ha-078118
	I0918 16:58:42.449621   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:58:42.449891   60243 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 16:58:42.468842   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:58:42.469136   60243 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.4
	I0918 16:58:42.469150   60243 certs.go:194] generating shared ca certs ...
	I0918 16:58:42.469170   60243 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:58:42.469308   60243 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 16:58:42.469358   60243 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 16:58:42.469373   60243 certs.go:256] generating profile certs ...
	I0918 16:58:42.469463   60243 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 16:58:42.469512   60243 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.4bf9a898
	I0918 16:58:42.469534   60243 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.4bf9a898 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.3 192.168.49.4 192.168.49.254]
	I0918 16:58:42.495627   60243 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.4bf9a898 ...
	I0918 16:58:42.495658   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.4bf9a898: {Name:mk68634cd7761667f3d175625830276296dacbf7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:58:42.495841   60243 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.4bf9a898 ...
	I0918 16:58:42.495855   60243 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.4bf9a898: {Name:mkaeb5ac6f7d0ea9f8347ea3ddec67699c073d9a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:58:42.495923   60243 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.4bf9a898 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 16:58:42.496068   60243 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.4bf9a898 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 16:58:42.496217   60243 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 16:58:42.496232   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 16:58:42.496244   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 16:58:42.496258   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 16:58:42.496271   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 16:58:42.496280   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 16:58:42.496293   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 16:58:42.496305   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 16:58:42.496317   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 16:58:42.496373   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 16:58:42.496401   60243 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 16:58:42.496411   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 16:58:42.496436   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 16:58:42.496457   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 16:58:42.496481   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 16:58:42.496534   60243 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 16:58:42.496569   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:58:42.496580   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 16:58:42.496590   60243 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 16:58:42.496636   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:58:42.515180   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:58:42.604836   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
	I0918 16:58:42.608908   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
	I0918 16:58:42.621875   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
	I0918 16:58:42.625619   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
	I0918 16:58:42.638496   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
	I0918 16:58:42.642068   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
	I0918 16:58:42.655358   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
	I0918 16:58:42.659079   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)
	I0918 16:58:42.671928   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
	I0918 16:58:42.675654   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
	I0918 16:58:42.689048   60243 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
	I0918 16:58:42.692776   60243 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
	I0918 16:58:42.705922   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 16:58:42.731686   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 16:58:42.757189   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 16:58:42.782344   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 16:58:42.808085   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)
	I0918 16:58:42.833677   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0918 16:58:42.860306   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 16:58:42.886762   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 16:58:42.911918   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 16:58:42.940030   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 16:58:42.965848   60243 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 16:58:42.992346   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
	I0918 16:58:43.010924   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
	I0918 16:58:43.029944   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
	I0918 16:58:43.050253   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)
	I0918 16:58:43.069277   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
	I0918 16:58:43.089240   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
	I0918 16:58:43.108796   60243 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
	I0918 16:58:43.127946   60243 ssh_runner.go:195] Run: openssl version
	I0918 16:58:43.134211   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 16:58:43.144901   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:58:43.148803   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:58:43.148864   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 16:58:43.155958   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 16:58:43.166216   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 16:58:43.176240   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 16:58:43.179779   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 16:58:43.179836   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 16:58:43.186793   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 16:58:43.196956   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 16:58:43.206631   60243 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 16:58:43.210807   60243 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 16:58:43.210895   60243 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 16:58:43.219238   60243 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 16:58:43.229939   60243 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 16:58:43.233807   60243 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0918 16:58:43.233861   60243 kubeadm.go:926] updating node {m03 192.168.49.4 8443 v1.34.0 crio true true} ...
	I0918 16:58:43.233942   60243 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.4
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 16:58:43.233965   60243 kube-vip.go:115] generating kube-vip config ...
	I0918 16:58:43.234001   60243 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 16:58:43.246584   60243 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 16:58:43.246654   60243 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 16:58:43.246708   60243 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 16:58:43.256222   60243 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 16:58:43.256294   60243 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
	I0918 16:58:43.265642   60243 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0918 16:58:43.286766   60243 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 16:58:43.308984   60243 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 16:58:43.330666   60243 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 16:58:43.334512   60243 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 16:58:43.346186   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:58:43.415160   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:58:43.438425   60243 host.go:66] Checking if "ha-078118" exists ...
	I0918 16:58:43.438701   60243 start.go:317] joinCluster: &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]
DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false log
viewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPa
useInterval:1m0s}
	I0918 16:58:43.438806   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm token create --print-join-command --ttl=0"
	I0918 16:58:43.438859   60243 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 16:58:43.458467   60243 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32783 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 16:58:43.605780   60243 start.go:343] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:58:43.605839   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token izhn3y.empz64p3o3t4ob63 --discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-078118-m03 --control-plane --apiserver-advertise-address=192.168.49.4 --apiserver-bind-port=8443"
	I0918 16:58:54.699353   60243 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token izhn3y.empz64p3o3t4ob63 --discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-078118-m03 --control-plane --apiserver-advertise-address=192.168.49.4 --apiserver-bind-port=8443": (11.093493296s)
	I0918 16:58:54.699381   60243 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"
	I0918 16:58:54.914238   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-078118-m03 minikube.k8s.io/updated_at=2025_09_18T16_58_54_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596 minikube.k8s.io/name=ha-078118 minikube.k8s.io/primary=false
	I0918 16:58:54.991429   60243 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-078118-m03 node-role.kubernetes.io/control-plane:NoSchedule-
	I0918 16:58:55.068483   60243 start.go:319] duration metric: took 11.629778037s to joinCluster
	I0918 16:58:55.068573   60243 start.go:235] Will wait 6m0s for node &{Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 16:58:55.068917   60243 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:58:55.070415   60243 out.go:179] * Verifying Kubernetes components...
	I0918 16:58:55.072098   60243 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 16:58:55.171709   60243 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 16:58:55.185623   60243 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	W0918 16:58:55.185688   60243 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.49.254:8443 with https://192.168.49.2:8443
	I0918 16:58:55.185879   60243 node_ready.go:35] waiting up to 6m0s for node "ha-078118-m03" to be "Ready" ...
	W0918 16:58:57.190925   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	W0918 16:58:59.689555   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	W0918 16:59:01.690108   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	W0918 16:59:04.189842   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	W0918 16:59:06.190032   60243 node_ready.go:57] node "ha-078118-m03" has "Ready":"False" status (will retry)
	I0918 16:59:06.690048   60243 node_ready.go:49] node "ha-078118-m03" is "Ready"
	I0918 16:59:06.690075   60243 node_ready.go:38] duration metric: took 11.50418456s for node "ha-078118-m03" to be "Ready" ...
	I0918 16:59:06.690089   60243 api_server.go:52] waiting for apiserver process to appear ...
	I0918 16:59:06.690136   60243 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 16:59:06.702758   60243 api_server.go:72] duration metric: took 11.634149066s to wait for apiserver process to appear ...
	I0918 16:59:06.702790   60243 api_server.go:88] waiting for apiserver healthz status ...
	I0918 16:59:06.702810   60243 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0918 16:59:06.707560   60243 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0918 16:59:06.708455   60243 api_server.go:141] control plane version: v1.34.0
	I0918 16:59:06.708480   60243 api_server.go:131] duration metric: took 5.681924ms to wait for apiserver health ...
	I0918 16:59:06.708491   60243 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 16:59:06.714696   60243 system_pods.go:59] 24 kube-system pods found
	I0918 16:59:06.714727   60243 system_pods.go:61] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 16:59:06.714733   60243 system_pods.go:61] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 16:59:06.714737   60243 system_pods.go:61] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 16:59:06.714740   60243 system_pods.go:61] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 16:59:06.714744   60243 system_pods.go:61] "etcd-ha-078118-m03" [ef27a91e-a220-4dcb-885c-2941742d985e] Running
	I0918 16:59:06.714747   60243 system_pods.go:61] "kindnet-f2b4b" [98c5afc6-e57e-488c-948a-e24ec24b97a7] Running
	I0918 16:59:06.714751   60243 system_pods.go:61] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 16:59:06.714756   60243 system_pods.go:61] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 16:59:06.714761   60243 system_pods.go:61] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 16:59:06.714765   60243 system_pods.go:61] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 16:59:06.714768   60243 system_pods.go:61] "kube-apiserver-ha-078118-m03" [1cc265d4-6f02-4291-b218-cfa76bcf557f] Running
	I0918 16:59:06.714772   60243 system_pods.go:61] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 16:59:06.714775   60243 system_pods.go:61] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 16:59:06.714778   60243 system_pods.go:61] "kube-controller-manager-ha-078118-m03" [43309df5-32b3-4ca8-a0a0-23bfcaac2138] Running
	I0918 16:59:06.714781   60243 system_pods.go:61] "kube-proxy-2pjrn" [490f3965-2c3c-42d8-89b3-d3d599ebf60e] Running
	I0918 16:59:06.714785   60243 system_pods.go:61] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 16:59:06.714787   60243 system_pods.go:61] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 16:59:06.714790   60243 system_pods.go:61] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 16:59:06.714794   60243 system_pods.go:61] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 16:59:06.714797   60243 system_pods.go:61] "kube-scheduler-ha-078118-m03" [93dfed73-cd97-4f3f-804e-ffdd528fd8ff] Running
	I0918 16:59:06.714802   60243 system_pods.go:61] "kube-vip-ha-078118" [9d6c9fdb-435c-43e0-b477-6ad4ac75fecf] Running
	I0918 16:59:06.714805   60243 system_pods.go:61] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 16:59:06.714809   60243 system_pods.go:61] "kube-vip-ha-078118-m03" [919fbb1f-4ca4-41e2-a8f7-6d2c73f81558] Running
	I0918 16:59:06.714813   60243 system_pods.go:61] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 16:59:06.714819   60243 system_pods.go:74] duration metric: took 6.323146ms to wait for pod list to return data ...
	I0918 16:59:06.714828   60243 default_sa.go:34] waiting for default service account to be created ...
	I0918 16:59:06.718387   60243 default_sa.go:45] found service account: "default"
	I0918 16:59:06.718417   60243 default_sa.go:55] duration metric: took 3.581681ms for default service account to be created ...
	I0918 16:59:06.718430   60243 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 16:59:06.724111   60243 system_pods.go:86] 24 kube-system pods found
	I0918 16:59:06.724142   60243 system_pods.go:89] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 16:59:06.724148   60243 system_pods.go:89] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 16:59:06.724152   60243 system_pods.go:89] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 16:59:06.724156   60243 system_pods.go:89] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 16:59:06.724159   60243 system_pods.go:89] "etcd-ha-078118-m03" [ef27a91e-a220-4dcb-885c-2941742d985e] Running
	I0918 16:59:06.724163   60243 system_pods.go:89] "kindnet-f2b4b" [98c5afc6-e57e-488c-948a-e24ec24b97a7] Running
	I0918 16:59:06.724167   60243 system_pods.go:89] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 16:59:06.724170   60243 system_pods.go:89] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 16:59:06.724175   60243 system_pods.go:89] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 16:59:06.724181   60243 system_pods.go:89] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 16:59:06.724186   60243 system_pods.go:89] "kube-apiserver-ha-078118-m03" [1cc265d4-6f02-4291-b218-cfa76bcf557f] Running
	I0918 16:59:06.724193   60243 system_pods.go:89] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 16:59:06.724199   60243 system_pods.go:89] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 16:59:06.724205   60243 system_pods.go:89] "kube-controller-manager-ha-078118-m03" [43309df5-32b3-4ca8-a0a0-23bfcaac2138] Running
	I0918 16:59:06.724211   60243 system_pods.go:89] "kube-proxy-2pjrn" [490f3965-2c3c-42d8-89b3-d3d599ebf60e] Running
	I0918 16:59:06.724220   60243 system_pods.go:89] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 16:59:06.724225   60243 system_pods.go:89] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 16:59:06.724239   60243 system_pods.go:89] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 16:59:06.724243   60243 system_pods.go:89] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 16:59:06.724246   60243 system_pods.go:89] "kube-scheduler-ha-078118-m03" [93dfed73-cd97-4f3f-804e-ffdd528fd8ff] Running
	I0918 16:59:06.724250   60243 system_pods.go:89] "kube-vip-ha-078118" [9d6c9fdb-435c-43e0-b477-6ad4ac75fecf] Running
	I0918 16:59:06.724254   60243 system_pods.go:89] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 16:59:06.724257   60243 system_pods.go:89] "kube-vip-ha-078118-m03" [919fbb1f-4ca4-41e2-a8f7-6d2c73f81558] Running
	I0918 16:59:06.724260   60243 system_pods.go:89] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 16:59:06.724267   60243 system_pods.go:126] duration metric: took 5.831309ms to wait for k8s-apps to be running ...
	I0918 16:59:06.724283   60243 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 16:59:06.724337   60243 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 16:59:06.737206   60243 system_svc.go:56] duration metric: took 12.914941ms WaitForService to wait for kubelet
	I0918 16:59:06.737236   60243 kubeadm.go:578] duration metric: took 11.668634825s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 16:59:06.737259   60243 node_conditions.go:102] verifying NodePressure condition ...
	I0918 16:59:06.740948   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:59:06.740970   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:59:06.740982   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:59:06.740985   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:59:06.740989   60243 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 16:59:06.740991   60243 node_conditions.go:123] node cpu capacity is 8
	I0918 16:59:06.740995   60243 node_conditions.go:105] duration metric: took 3.731587ms to run NodePressure ...
	I0918 16:59:06.741004   60243 start.go:241] waiting for startup goroutines ...
	I0918 16:59:06.741023   60243 start.go:255] writing updated cluster config ...
	I0918 16:59:06.741314   60243 ssh_runner.go:195] Run: rm -f paused
	I0918 16:59:06.745246   60243 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
	I0918 16:59:06.745875   60243 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0918 16:59:06.755285   60243 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-g9xk6" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.761037   60243 pod_ready.go:94] pod "coredns-66bc5c9577-g9xk6" is "Ready"
	I0918 16:59:06.761068   60243 pod_ready.go:86] duration metric: took 5.756901ms for pod "coredns-66bc5c9577-g9xk6" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.761077   60243 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-q42l7" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.767008   60243 pod_ready.go:94] pod "coredns-66bc5c9577-q42l7" is "Ready"
	I0918 16:59:06.767034   60243 pod_ready.go:86] duration metric: took 5.951535ms for pod "coredns-66bc5c9577-q42l7" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.770112   60243 pod_ready.go:83] waiting for pod "etcd-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.775267   60243 pod_ready.go:94] pod "etcd-ha-078118" is "Ready"
	I0918 16:59:06.775293   60243 pod_ready.go:86] duration metric: took 5.152116ms for pod "etcd-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.775303   60243 pod_ready.go:83] waiting for pod "etcd-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.780471   60243 pod_ready.go:94] pod "etcd-ha-078118-m02" is "Ready"
	I0918 16:59:06.780496   60243 pod_ready.go:86] duration metric: took 5.187344ms for pod "etcd-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.780520   60243 pod_ready.go:83] waiting for pod "etcd-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:06.946978   60243 request.go:683] "Waited before sending request" delay="166.314978ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/etcd-ha-078118-m03"
	I0918 16:59:07.146449   60243 request.go:683] "Waited before sending request" delay="196.292592ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:07.149449   60243 pod_ready.go:94] pod "etcd-ha-078118-m03" is "Ready"
	I0918 16:59:07.149474   60243 pod_ready.go:86] duration metric: took 368.947616ms for pod "etcd-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:07.346915   60243 request.go:683] "Waited before sending request" delay="197.328502ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Dkube-apiserver"
	I0918 16:59:07.350725   60243 pod_ready.go:83] waiting for pod "kube-apiserver-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:07.547175   60243 request.go:683] "Waited before sending request" delay="196.345419ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-078118"
	I0918 16:59:07.746829   60243 request.go:683] "Waited before sending request" delay="196.329751ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118"
	I0918 16:59:07.749941   60243 pod_ready.go:94] pod "kube-apiserver-ha-078118" is "Ready"
	I0918 16:59:07.749966   60243 pod_ready.go:86] duration metric: took 399.217151ms for pod "kube-apiserver-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:07.749974   60243 pod_ready.go:83] waiting for pod "kube-apiserver-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:07.947401   60243 request.go:683] "Waited before sending request" delay="197.34038ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-078118-m02"
	I0918 16:59:08.147239   60243 request.go:683] "Waited before sending request" delay="196.36185ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m02"
	I0918 16:59:08.150202   60243 pod_ready.go:94] pod "kube-apiserver-ha-078118-m02" is "Ready"
	I0918 16:59:08.150227   60243 pod_ready.go:86] duration metric: took 400.248007ms for pod "kube-apiserver-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:08.150235   60243 pod_ready.go:83] waiting for pod "kube-apiserver-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:08.346585   60243 request.go:683] "Waited before sending request" delay="196.280443ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-078118-m03"
	I0918 16:59:08.547289   60243 request.go:683] "Waited before sending request" delay="197.397248ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:08.550234   60243 pod_ready.go:94] pod "kube-apiserver-ha-078118-m03" is "Ready"
	I0918 16:59:08.550261   60243 pod_ready.go:86] duration metric: took 400.020405ms for pod "kube-apiserver-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:08.746686   60243 request.go:683] "Waited before sending request" delay="196.336839ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Dkube-controller-manager"
	I0918 16:59:08.750717   60243 pod_ready.go:83] waiting for pod "kube-controller-manager-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:08.947162   60243 request.go:683] "Waited before sending request" delay="196.333247ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-078118"
	I0918 16:59:09.146966   60243 request.go:683] "Waited before sending request" delay="196.326126ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118"
	I0918 16:59:09.150067   60243 pod_ready.go:94] pod "kube-controller-manager-ha-078118" is "Ready"
	I0918 16:59:09.150092   60243 pod_ready.go:86] duration metric: took 399.351356ms for pod "kube-controller-manager-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:09.150102   60243 pod_ready.go:83] waiting for pod "kube-controller-manager-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:09.346457   60243 request.go:683] "Waited before sending request" delay="196.279389ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-078118-m02"
	I0918 16:59:09.547040   60243 request.go:683] "Waited before sending request" delay="197.354653ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m02"
	I0918 16:59:09.550374   60243 pod_ready.go:94] pod "kube-controller-manager-ha-078118-m02" is "Ready"
	I0918 16:59:09.550404   60243 pod_ready.go:86] duration metric: took 400.295786ms for pod "kube-controller-manager-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:09.550413   60243 pod_ready.go:83] waiting for pod "kube-controller-manager-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:09.746708   60243 request.go:683] "Waited before sending request" delay="196.202501ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-078118-m03"
	I0918 16:59:09.946436   60243 request.go:683] "Waited before sending request" delay="196.280211ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:09.949494   60243 pod_ready.go:94] pod "kube-controller-manager-ha-078118-m03" is "Ready"
	I0918 16:59:09.949530   60243 pod_ready.go:86] duration metric: took 399.112324ms for pod "kube-controller-manager-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.146961   60243 request.go:683] "Waited before sending request" delay="197.325522ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods?labelSelector=k8s-app%3Dkube-proxy"
	I0918 16:59:10.150701   60243 pod_ready.go:83] waiting for pod "kube-proxy-2pjrn" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.347162   60243 request.go:683] "Waited before sending request" delay="196.352062ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-proxy-2pjrn"
	I0918 16:59:10.547072   60243 request.go:683] "Waited before sending request" delay="196.358455ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:10.550523   60243 pod_ready.go:94] pod "kube-proxy-2pjrn" is "Ready"
	I0918 16:59:10.550553   60243 pod_ready.go:86] duration metric: took 399.827869ms for pod "kube-proxy-2pjrn" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.550565   60243 pod_ready.go:83] waiting for pod "kube-proxy-b98xh" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.746898   60243 request.go:683] "Waited before sending request" delay="196.251425ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-proxy-b98xh"
	I0918 16:59:10.946676   60243 request.go:683] "Waited before sending request" delay="196.176643ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118"
	I0918 16:59:10.950120   60243 pod_ready.go:94] pod "kube-proxy-b98xh" is "Ready"
	I0918 16:59:10.950149   60243 pod_ready.go:86] duration metric: took 399.577448ms for pod "kube-proxy-b98xh" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:10.950157   60243 pod_ready.go:83] waiting for pod "kube-proxy-t5wdg" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:11.146526   60243 request.go:683] "Waited before sending request" delay="196.259149ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-proxy-t5wdg"
	I0918 16:59:11.347110   60243 request.go:683] "Waited before sending request" delay="197.374002ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m02"
	I0918 16:59:11.350466   60243 pod_ready.go:94] pod "kube-proxy-t5wdg" is "Ready"
	I0918 16:59:11.350490   60243 pod_ready.go:86] duration metric: took 400.328216ms for pod "kube-proxy-t5wdg" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:11.546945   60243 request.go:683] "Waited before sending request" delay="196.317609ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods?labelSelector=component%3Dkube-scheduler"
	I0918 16:59:11.550749   60243 pod_ready.go:83] waiting for pod "kube-scheduler-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:11.746977   60243 request.go:683] "Waited before sending request" delay="196.123839ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-078118"
	I0918 16:59:11.946489   60243 request.go:683] "Waited before sending request" delay="196.183652ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118"
	I0918 16:59:11.949628   60243 pod_ready.go:94] pod "kube-scheduler-ha-078118" is "Ready"
	I0918 16:59:11.949654   60243 pod_ready.go:86] duration metric: took 398.882401ms for pod "kube-scheduler-ha-078118" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:11.949664   60243 pod_ready.go:83] waiting for pod "kube-scheduler-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:12.147112   60243 request.go:683] "Waited before sending request" delay="197.344287ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-078118-m02"
	I0918 16:59:12.347169   60243 request.go:683] "Waited before sending request" delay="194.379019ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m02"
	I0918 16:59:12.350560   60243 pod_ready.go:94] pod "kube-scheduler-ha-078118-m02" is "Ready"
	I0918 16:59:12.350590   60243 pod_ready.go:86] duration metric: took 400.919858ms for pod "kube-scheduler-ha-078118-m02" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:12.350599   60243 pod_ready.go:83] waiting for pod "kube-scheduler-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:12.547018   60243 request.go:683] "Waited before sending request" delay="196.33287ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-078118-m03"
	I0918 16:59:12.746565   60243 request.go:683] "Waited before sending request" delay="196.309682ms" reason="client-side throttling, not priority and fairness" verb="GET" URL="https://192.168.49.254:8443/api/v1/nodes/ha-078118-m03"
	I0918 16:59:12.749906   60243 pod_ready.go:94] pod "kube-scheduler-ha-078118-m03" is "Ready"
	I0918 16:59:12.749934   60243 pod_ready.go:86] duration metric: took 399.329614ms for pod "kube-scheduler-ha-078118-m03" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 16:59:12.749945   60243 pod_ready.go:40] duration metric: took 6.004651446s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
	I0918 16:59:12.794689   60243 start.go:623] kubectl: 1.34.1, cluster: 1.34.0 (minor skew: 0)
	I0918 16:59:12.796689   60243 out.go:179] * Done! kubectl is now configured to use "ha-078118" cluster and "default" namespace by default
	
	
	==> CRI-O <==
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.765846307Z" level=info msg="Got pod network &{Name:coredns-66bc5c9577-q42l7 Namespace:kube-system ID:0f4c57d36fe625b73febbabe66c94a6fb7be96bd382b63dbe134a57a30fcc203 UID:c21094f1-585a-4109-b526-3a115d45f35f NetNS:/var/run/netns/ea110cd7-655f-4db5-9869-6caeb4e1e0b3 Networks:[] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.766003644Z" level=info msg="Checking pod kube-system_coredns-66bc5c9577-q42l7 for CNI network kindnet (type=ptp)"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.766404225Z" level=info msg="Checking image status: registry.k8s.io/coredns/coredns:v1.12.1" id=ef4ff467-d538-4946-933c-e5b5e907e1f3 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.766638638Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969,RepoTags:[registry.k8s.io/coredns/coredns:v1.12.1],RepoDigests:[registry.k8s.io/coredns/coredns@sha256:4f7a57135719628cf2070c5e3cbde64b013e90d4c560c5ecbf14004181f91998 registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c],Size_:76103547,Uid:nil,Username:nonroot,Spec:nil,},Info:map[string]string{},}" id=ef4ff467-d538-4946-933c-e5b5e907e1f3 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.767610373Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769256295Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/eec0c1a1e3f1faa7e681f72b6e678fe56d2fe548328908380b50105d4c4c5f9d/merged/etc/passwd: no such file or directory"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769296755Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/eec0c1a1e3f1faa7e681f72b6e678fe56d2fe548328908380b50105d4c4c5f9d/merged/etc/group: no such file or directory"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769333451Z" level=info msg="Creating container: kube-system/coredns-66bc5c9577-g9xk6/coredns" id=075f19de-1f75-4e06-b926-bfc1c8e7585c name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769428698Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.769443027Z" level=info msg="Ran pod sandbox 0f4c57d36fe625b73febbabe66c94a6fb7be96bd382b63dbe134a57a30fcc203 with infra container: kube-system/coredns-66bc5c9577-q42l7/POD" id=000880e9-0203-43be-9f90-44bb795de328 name=/runtime.v1.RuntimeService/RunPodSandbox
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.770428742Z" level=info msg="Checking image status: registry.k8s.io/coredns/coredns:v1.12.1" id=95b3db0e-d1ae-4a3e-a514-6be61c509f71 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.775530535Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969,RepoTags:[registry.k8s.io/coredns/coredns:v1.12.1],RepoDigests:[registry.k8s.io/coredns/coredns@sha256:4f7a57135719628cf2070c5e3cbde64b013e90d4c560c5ecbf14004181f91998 registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c],Size_:76103547,Uid:nil,Username:nonroot,Spec:nil,},Info:map[string]string{},}" id=95b3db0e-d1ae-4a3e-a514-6be61c509f71 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.776278769Z" level=info msg="Checking image status: registry.k8s.io/coredns/coredns:v1.12.1" id=0b0dcec1-95b6-495b-9197-5f67161037dc name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.776462315Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969,RepoTags:[registry.k8s.io/coredns/coredns:v1.12.1],RepoDigests:[registry.k8s.io/coredns/coredns@sha256:4f7a57135719628cf2070c5e3cbde64b013e90d4c560c5ecbf14004181f91998 registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c],Size_:76103547,Uid:nil,Username:nonroot,Spec:nil,},Info:map[string]string{},}" id=0b0dcec1-95b6-495b-9197-5f67161037dc name=/runtime.v1.ImageService/ImageStatus
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.779861607Z" level=info msg="Creating container: kube-system/coredns-66bc5c9577-q42l7/coredns" id=117c2489-b1bc-4e99-a3fa-ff10fa77c595 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.779940361Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.830159804Z" level=info msg="Created container 8adb6b34c613123531cf4233efc222dc4757692856895124a5e5db1a632a5b52: kube-system/storage-provisioner/storage-provisioner" id=5f7f2550-0b1b-47f1-b48c-5332a46450a7 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.830924779Z" level=info msg="Starting container: 8adb6b34c613123531cf4233efc222dc4757692856895124a5e5db1a632a5b52" id=52dc1dd3-f88a-484c-ab17-4d9f0b621779 name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.836679300Z" level=info msg="Created container 08391430590c253ff1b0064ee6c84e80981d5f041bc5ae9709bdf04d2b9aee8b: kube-system/coredns-66bc5c9577-g9xk6/coredns" id=075f19de-1f75-4e06-b926-bfc1c8e7585c name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.837315664Z" level=info msg="Starting container: 08391430590c253ff1b0064ee6c84e80981d5f041bc5ae9709bdf04d2b9aee8b" id=8bb023fd-89bf-411c-a6a6-6f2df8ddd77a name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.838803837Z" level=info msg="Started container" PID=2258 containerID=8adb6b34c613123531cf4233efc222dc4757692856895124a5e5db1a632a5b52 description=kube-system/storage-provisioner/storage-provisioner id=52dc1dd3-f88a-484c-ab17-4d9f0b621779 name=/runtime.v1.RuntimeService/StartContainer sandboxID=6928f50153d919aa3e3760ba1aa0739a387e79370881e9f1e54c731a0f3caea0
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.845287935Z" level=info msg="Started container" PID=2268 containerID=08391430590c253ff1b0064ee6c84e80981d5f041bc5ae9709bdf04d2b9aee8b description=kube-system/coredns-66bc5c9577-g9xk6/coredns id=8bb023fd-89bf-411c-a6a6-6f2df8ddd77a name=/runtime.v1.RuntimeService/StartContainer sandboxID=afde323910d94bea88be826de7977fce80c072eae58aba3bfd7c8d68a054031f
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.864792220Z" level=info msg="Created container aa37f0e0424d50f1f3f546dfdbacd705bc960545c699db9837bdf759142b77a6: kube-system/coredns-66bc5c9577-q42l7/coredns" id=117c2489-b1bc-4e99-a3fa-ff10fa77c595 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.865391067Z" level=info msg="Starting container: aa37f0e0424d50f1f3f546dfdbacd705bc960545c699db9837bdf759142b77a6" id=34f0c5a7-2503-4694-8c57-c675b57bdd4b name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 16:57:34 ha-078118 crio[932]: time="2025-09-18 16:57:34.872859452Z" level=info msg="Started container" PID=2308 containerID=aa37f0e0424d50f1f3f546dfdbacd705bc960545c699db9837bdf759142b77a6 description=kube-system/coredns-66bc5c9577-q42l7/coredns id=34f0c5a7-2503-4694-8c57-c675b57bdd4b name=/runtime.v1.RuntimeService/StartContainer sandboxID=0f4c57d36fe625b73febbabe66c94a6fb7be96bd382b63dbe134a57a30fcc203
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                               CREATED             STATE               NAME                      ATTEMPT             POD ID              POD
	aa37f0e0424d5       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                    3 minutes ago       Running             coredns                   0                   0f4c57d36fe62       coredns-66bc5c9577-q42l7
	08391430590c2       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                    3 minutes ago       Running             coredns                   0                   afde323910d94       coredns-66bc5c9577-g9xk6
	8adb6b34c6131       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                    3 minutes ago       Running             storage-provisioner       0                   6928f50153d91       storage-provisioner
	9d8271cae4bea       df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce                                    3 minutes ago       Running             kube-proxy                0                   391ffd3ffc487       kube-proxy-b98xh
	ace9ff4888542       409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c                                    3 minutes ago       Running             kindnet-cni               0                   4f7dc3d8e273c       kindnet-vqp76
	b6c234acce33d       ghcr.io/kube-vip/kube-vip@sha256:4f256554a83a6d824ea9c5307450a2c3fd132e09c52b339326f94fefaf67155c   4 minutes ago       Running             kube-vip                  0                   23e85847e6956       kube-vip-ha-078118
	db2ea624fa9b6       46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc                                    4 minutes ago       Running             kube-scheduler            0                   b36f66256961f       kube-scheduler-ha-078118
	642183ab67e73       a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634                                    4 minutes ago       Running             kube-controller-manager   0                   36e9334424f59       kube-controller-manager-ha-078118
	585dfd4fc0ca4       90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90                                    4 minutes ago       Running             kube-apiserver            0                   237ac462ccd86       kube-apiserver-ha-078118
	e11573adbeb5b       5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115                                    4 minutes ago       Running             etcd                      0                   780b62a8fc57d       etcd-ha-078118
	
	
	==> coredns [08391430590c253ff1b0064ee6c84e80981d5f041bc5ae9709bdf04d2b9aee8b] <==
	[INFO] 10.244.2.2:48579 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000213733s
	[INFO] 10.244.2.2:38852 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000147704s
	[INFO] 10.244.2.2:49722 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000215281s
	[INFO] 10.244.2.2:50509 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000150614s
	[INFO] 10.244.2.2:36432 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000124749s
	[INFO] 10.244.1.3:48987 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 111 0.009640803s
	[INFO] 10.244.1.3:34978 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000185219s
	[INFO] 10.244.1.3:42844 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000118247s
	[INFO] 10.244.1.3:56800 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000144749s
	[INFO] 10.244.1.2:49805 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000131607s
	[INFO] 10.244.1.2:57672 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000175017s
	[INFO] 10.244.1.2:59217 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000076607s
	[INFO] 10.244.2.2:59905 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000198959s
	[INFO] 10.244.2.2:35101 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000161137s
	[INFO] 10.244.1.3:37941 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000169116s
	[INFO] 10.244.1.2:60488 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00024264s
	[INFO] 10.244.2.2:60234 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000151314s
	[INFO] 10.244.2.2:42839 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000121874s
	[INFO] 10.244.1.3:38379 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.00013483s
	[INFO] 10.244.1.3:58046 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000167227s
	[INFO] 10.244.1.3:44714 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000092544s
	[INFO] 10.244.1.3:35218 - 5 "PTR IN 1.49.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000113387s
	[INFO] 10.244.1.2:59456 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000135367s
	[INFO] 10.244.1.2:35335 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000085423s
	[INFO] 10.244.1.2:35400 - 5 "PTR IN 1.49.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000096216s
	
	
	==> coredns [aa37f0e0424d50f1f3f546dfdbacd705bc960545c699db9837bdf759142b77a6] <==
	[INFO] 10.244.1.3:44450 - 6 "PTR IN 90.167.197.15.in-addr.arpa. udp 44 false 512" NOERROR qr,rd,ra 126 0.000909376s
	[INFO] 10.244.1.2:44019 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 140 0.000135871s
	[INFO] 10.244.2.2:56869 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000130632s
	[INFO] 10.244.2.2:46287 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 111 0.012245391s
	[INFO] 10.244.2.2:35509 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 111 0.009452726s
	[INFO] 10.244.1.3:51577 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000132103s
	[INFO] 10.244.1.3:45622 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000167069s
	[INFO] 10.244.1.3:38225 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000085042s
	[INFO] 10.244.1.3:45379 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000129198s
	[INFO] 10.244.1.2:53174 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000146423s
	[INFO] 10.244.1.2:48602 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.00009464s
	[INFO] 10.244.1.2:58862 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000135263s
	[INFO] 10.244.1.2:44989 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,aa,rd,ra 111 0.000093968s
	[INFO] 10.244.1.2:38888 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000167556s
	[INFO] 10.244.2.2:53888 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000144401s
	[INFO] 10.244.2.2:56382 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000096741s
	[INFO] 10.244.1.3:34825 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000143164s
	[INFO] 10.244.1.3:37381 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000153037s
	[INFO] 10.244.1.3:57943 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000098689s
	[INFO] 10.244.1.2:51449 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000134731s
	[INFO] 10.244.1.2:40898 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000183095s
	[INFO] 10.244.1.2:36063 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00011511s
	[INFO] 10.244.2.2:55350 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000152924s
	[INFO] 10.244.2.2:53746 - 5 "PTR IN 1.49.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000142562s
	[INFO] 10.244.1.2:36341 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000127988s
	
	
	==> describe nodes <==
	Name:               ha-078118
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2025_09_18T16_57_20_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:57:14 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:01:14 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 16:57:34 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 16:57:34 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 16:57:34 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 16:57:34 +0000   Thu, 18 Sep 2025 16:57:34 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ha-078118
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 37066c4af2194678a9f70f4417168319
	  System UUID:                910bee46-adcd-4833-91ec-cea7d3c2588c
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (10 in total)
	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---
	  kube-system                 coredns-66bc5c9577-g9xk6             100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     3m52s
	  kube-system                 coredns-66bc5c9577-q42l7             100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     3m52s
	  kube-system                 etcd-ha-078118                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         3m56s
	  kube-system                 kindnet-vqp76                        100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      3m52s
	  kube-system                 kube-apiserver-ha-078118             250m (3%)     0 (0%)      0 (0%)           0 (0%)         3m56s
	  kube-system                 kube-controller-manager-ha-078118    200m (2%)     0 (0%)      0 (0%)           0 (0%)         3m56s
	  kube-system                 kube-proxy-b98xh                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m52s
	  kube-system                 kube-scheduler-ha-078118             100m (1%)     0 (0%)      0 (0%)           0 (0%)         3m56s
	  kube-system                 kube-vip-ha-078118                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m
	  kube-system                 storage-provisioner                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m52s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (11%)  100m (1%)
	  memory             290Mi (0%)  390Mi (1%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                  From             Message
	  ----    ------                   ----                 ----             -------
	  Normal  Starting                 3m51s                kube-proxy       
	  Normal  NodeHasSufficientMemory  4m3s (x8 over 4m3s)  kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     4m3s (x8 over 4m3s)  kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  NodeHasNoDiskPressure    4m3s (x8 over 4m3s)  kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 4m3s                 kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  3m56s                kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  Starting                 3m56s                kubelet          Starting kubelet.
	  Normal  NodeHasNoDiskPressure    3m56s                kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     3m56s                kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           3m54s                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  NodeReady                3m41s                kubelet          Node ha-078118 status is now: NodeReady
	  Normal  RegisteredNode           3m27s                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           2m23s                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           46s                  node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	
	
	Name:               ha-078118-m02
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118-m02
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=false
	                    minikube.k8s.io/updated_at=2025_09_18T16_57_51_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:57:50 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118-m02
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:01:07 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 17:00:26 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 17:00:26 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 17:00:26 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 17:00:26 +0000   Thu, 18 Sep 2025 16:58:34 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.3
	  Hostname:    ha-078118-m02
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 7e031e6d77434b0a9ec8647b79e3a5d3
	  System UUID:                0093212b-e7dd-4bdc-8376-480f39da7714
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.1.0/24
	PodCIDRs:                     10.244.1.0/24
	Non-terminated Pods:          (9 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     busybox-7b57f96db7-bzrv2                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m2s
	  default                     busybox-7b57f96db7-t7rzr                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m2s
	  kube-system                 etcd-ha-078118-m02                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         3m23s
	  kube-system                 kindnet-jnlbr                            100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      3m25s
	  kube-system                 kube-apiserver-ha-078118-m02             250m (3%)     0 (0%)      0 (0%)           0 (0%)         3m23s
	  kube-system                 kube-controller-manager-ha-078118-m02    200m (2%)     0 (0%)      0 (0%)           0 (0%)         3m23s
	  kube-system                 kube-proxy-t5wdg                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m25s
	  kube-system                 kube-scheduler-ha-078118-m02             100m (1%)     0 (0%)      0 (0%)           0 (0%)         3m23s
	  kube-system                 kube-vip-ha-078118-m02                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m23s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%)   100m (1%)
	  memory             150Mi (0%)  50Mi (0%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                From             Message
	  ----    ------                   ----               ----             -------
	  Normal  Starting                 3m21s              kube-proxy       
	  Normal  RegisteredNode           3m24s              node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode           3m22s              node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode           2m23s              node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  Starting                 51s                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  51s (x8 over 51s)  kubelet          Node ha-078118-m02 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    51s (x8 over 51s)  kubelet          Node ha-078118-m02 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     51s (x8 over 51s)  kubelet          Node ha-078118-m02 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           46s                node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	
	
	Name:               ha-078118-m03
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118-m03
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=false
	                    minikube.k8s.io/updated_at=2025_09_18T16_58_54_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:58:54 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118-m03
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:01:06 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 16:59:24 +0000   Thu, 18 Sep 2025 16:58:54 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 16:59:24 +0000   Thu, 18 Sep 2025 16:58:54 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 16:59:24 +0000   Thu, 18 Sep 2025 16:58:54 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 16:59:24 +0000   Thu, 18 Sep 2025 16:59:06 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.4
	  Hostname:    ha-078118-m03
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 1cf4ae8c7cb4403a9f1c3d032956eb17
	  System UUID:                aad5bb9a-fbfa-4299-aec8-4ade9724e58c
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.2.0/24
	PodCIDRs:                     10.244.2.0/24
	Non-terminated Pods:          (8 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     busybox-7b57f96db7-95578                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m2s
	  kube-system                 etcd-ha-078118-m03                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         2m20s
	  kube-system                 kindnet-f2b4b                            100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      2m21s
	  kube-system                 kube-apiserver-ha-078118-m03             250m (3%)     0 (0%)      0 (0%)           0 (0%)         2m20s
	  kube-system                 kube-controller-manager-ha-078118-m03    200m (2%)     0 (0%)      0 (0%)           0 (0%)         2m20s
	  kube-system                 kube-proxy-2pjrn                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m21s
	  kube-system                 kube-scheduler-ha-078118-m03             100m (1%)     0 (0%)      0 (0%)           0 (0%)         2m20s
	  kube-system                 kube-vip-ha-078118-m03                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         2m20s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%)   100m (1%)
	  memory             150Mi (0%)  50Mi (0%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason          Age    From             Message
	  ----    ------          ----   ----             -------
	  Normal  Starting        2m19s  kube-proxy       
	  Normal  RegisteredNode  2m18s  node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	  Normal  RegisteredNode  2m18s  node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	  Normal  RegisteredNode  2m17s  node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	  Normal  RegisteredNode  46s    node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	
	
	==> dmesg <==
	[  +0.089038] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
	[  +0.028015] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
	[  +7.570818] kauditd_printk_skb: 47 callbacks suppressed
	[Sep18 16:41] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.013586] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023854] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023944] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023869] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023927] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000033] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +2.047789] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +4.031621] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000030] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +8.127251] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[Sep18 16:42] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[ +32.253146] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	
	
	==> etcd [e11573adbeb5b82db9b0ef3e45c8776e5669152b9e1194fc07eb290c619b2bf5] <==
	{"level":"warn","ts":"2025-09-18T17:00:12.812751Z","caller":"rafthttp/stream.go:193","msg":"lost TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","local-member-id":"aec36adc501070cc","remote-peer-id":"14496796fca4c312"}
	{"level":"warn","ts":"2025-09-18T17:00:13.487209Z","caller":"etcdserver/cluster_util.go:259","msg":"failed to reach the peer URL","address":"https://192.168.49.3:2380/version","remote-member-id":"14496796fca4c312","error":"Get \"https://192.168.49.3:2380/version\": dial tcp 192.168.49.3:2380: connect: connection refused"}
	{"level":"warn","ts":"2025-09-18T17:00:13.487277Z","caller":"etcdserver/cluster_util.go:160","msg":"failed to get version","remote-member-id":"14496796fca4c312","error":"Get \"https://192.168.49.3:2380/version\": dial tcp 192.168.49.3:2380: connect: connection refused"}
	{"level":"warn","ts":"2025-09-18T17:00:17.488481Z","caller":"etcdserver/cluster_util.go:259","msg":"failed to reach the peer URL","address":"https://192.168.49.3:2380/version","remote-member-id":"14496796fca4c312","error":"Get \"https://192.168.49.3:2380/version\": dial tcp 192.168.49.3:2380: connect: connection refused"}
	{"level":"warn","ts":"2025-09-18T17:00:17.488564Z","caller":"etcdserver/cluster_util.go:160","msg":"failed to get version","remote-member-id":"14496796fca4c312","error":"Get \"https://192.168.49.3:2380/version\": dial tcp 192.168.49.3:2380: connect: connection refused"}
	{"level":"warn","ts":"2025-09-18T17:00:23.490253Z","caller":"etcdserver/cluster_util.go:259","msg":"failed to reach the peer URL","address":"https://192.168.49.3:2380/version","remote-member-id":"14496796fca4c312","error":"Get \"https://192.168.49.3:2380/version\": dial tcp 192.168.49.3:2380: i/o timeout"}
	{"level":"warn","ts":"2025-09-18T17:00:23.490305Z","caller":"etcdserver/cluster_util.go:160","msg":"failed to get version","remote-member-id":"14496796fca4c312","error":"Get \"https://192.168.49.3:2380/version\": dial tcp 192.168.49.3:2380: i/o timeout"}
	{"level":"warn","ts":"2025-09-18T17:00:23.513778Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"14496796fca4c312","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:00:23.516596Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"14496796fca4c312","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:00:23.613406Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"14496796fca4c312","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:00:23.713627Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"14496796fca4c312","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:00:23.799816Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"14496796fca4c312","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:00:23.813957Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"14496796fca4c312","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:00:23.913845Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"14496796fca4c312","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:00:24.013368Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"14496796fca4c312","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:00:24.113476Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"14496796fca4c312","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:00:24.158599Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"14496796fca4c312","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:00:24.213561Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"14496796fca4c312","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"info","ts":"2025-09-18T17:00:24.874846Z","caller":"rafthttp/stream.go:248","msg":"set message encoder","from":"aec36adc501070cc","to":"14496796fca4c312","stream-type":"stream Message"}
	{"level":"info","ts":"2025-09-18T17:00:24.874892Z","caller":"rafthttp/peer_status.go:53","msg":"peer became active","peer-id":"14496796fca4c312"}
	{"level":"info","ts":"2025-09-18T17:00:24.874927Z","caller":"rafthttp/stream.go:273","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream Message","local-member-id":"aec36adc501070cc","remote-peer-id":"14496796fca4c312"}
	{"level":"info","ts":"2025-09-18T17:00:24.880496Z","caller":"rafthttp/stream.go:248","msg":"set message encoder","from":"aec36adc501070cc","to":"14496796fca4c312","stream-type":"stream MsgApp v2"}
	{"level":"info","ts":"2025-09-18T17:00:24.880555Z","caller":"rafthttp/stream.go:273","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","local-member-id":"aec36adc501070cc","remote-peer-id":"14496796fca4c312"}
	{"level":"info","ts":"2025-09-18T17:00:24.891034Z","caller":"rafthttp/stream.go:411","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream Message","local-member-id":"aec36adc501070cc","remote-peer-id":"14496796fca4c312"}
	{"level":"info","ts":"2025-09-18T17:00:24.891317Z","caller":"rafthttp/stream.go:411","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"aec36adc501070cc","remote-peer-id":"14496796fca4c312"}
	
	
	==> kernel <==
	 17:01:15 up 43 min,  0 users,  load average: 1.25, 0.88, 0.54
	Linux ha-078118 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [ace9ff48885424be2f8facd8cbf5492de4495d890b080eb415e9e2c3e73bf84a] <==
	I0918 17:00:33.957423       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 17:00:43.952629       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:00:43.952670       1 main.go:301] handling current node
	I0918 17:00:43.952688       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:00:43.952694       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:00:43.952882       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 17:00:43.952895       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 17:00:53.960603       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 17:00:53.960648       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 17:00:53.960830       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:00:53.960842       1 main.go:301] handling current node
	I0918 17:00:53.960855       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:00:53.960859       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:01:03.952619       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:01:03.952657       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:01:03.952841       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 17:01:03.952852       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 17:01:03.952931       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:01:03.952940       1 main.go:301] handling current node
	I0918 17:01:13.952576       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:01:13.952613       1 main.go:301] handling current node
	I0918 17:01:13.952628       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:01:13.952633       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:01:13.952859       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 17:01:13.952869       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	
	
	==> kube-apiserver [585dfd4fc0ca43249f7d7bbc2f741d26128a1d13b2fc082db1eafbe1df6a50ad] <==
	I0918 16:57:22.858581       1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
	I0918 16:57:23.049475       1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
	I0918 16:57:23.049475       1 controller.go:667] quota admission added evaluator for: controllerrevisions.apps
	I0918 16:58:18.352060       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:58:35.569702       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	E0918 16:59:18.376823       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38134: use of closed network connection
	E0918 16:59:18.542476       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38154: use of closed network connection
	E0918 16:59:18.708555       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38184: use of closed network connection
	E0918 16:59:18.891237       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38202: use of closed network connection
	E0918 16:59:19.063367       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38222: use of closed network connection
	E0918 16:59:19.219859       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38248: use of closed network connection
	E0918 16:59:19.374345       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38266: use of closed network connection
	E0918 16:59:19.528245       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38290: use of closed network connection
	E0918 16:59:19.686890       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38294: use of closed network connection
	E0918 16:59:19.960717       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38322: use of closed network connection
	E0918 16:59:20.128027       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38350: use of closed network connection
	E0918 16:59:20.286654       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38362: use of closed network connection
	E0918 16:59:20.443716       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38382: use of closed network connection
	E0918 16:59:20.608349       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38406: use of closed network connection
	E0918 16:59:20.762819       1 conn.go:339] Error on socket receive: read tcp 192.168.49.254:8443->192.168.49.1:38416: use of closed network connection
	I0918 16:59:23.504820       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 16:59:44.133401       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	W0918 17:00:26.629452       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.49.2 192.168.49.4]
	I0918 17:00:34.703656       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:00:56.414475       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	
	
	==> kube-controller-manager [642183ab67e7396340c3ad521e32b9cc18b992cf199597510b44396413805c56] <==
	I0918 16:57:21.996127       1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
	I0918 16:57:21.996161       1 shared_informer.go:356] "Caches are synced" controller="VAC protection"
	I0918 16:57:21.996195       1 shared_informer.go:356] "Caches are synced" controller="attach detach"
	I0918 16:57:21.996207       1 shared_informer.go:356] "Caches are synced" controller="ReplicationController"
	I0918 16:57:21.996244       1 shared_informer.go:356] "Caches are synced" controller="taint-eviction-controller"
	I0918 16:57:21.996548       1 shared_informer.go:356] "Caches are synced" controller="ephemeral"
	I0918 16:57:21.998625       1 shared_informer.go:356] "Caches are synced" controller="TTL after finished"
	I0918 16:57:21.998653       1 shared_informer.go:356] "Caches are synced" controller="stateful set"
	I0918 16:57:21.999787       1 shared_informer.go:356] "Caches are synced" controller="node"
	I0918 16:57:21.999840       1 range_allocator.go:177] "Sending events to api server" logger="node-ipam-controller"
	I0918 16:57:21.999874       1 range_allocator.go:183] "Starting range CIDR allocator" logger="node-ipam-controller"
	I0918 16:57:21.999884       1 shared_informer.go:349] "Waiting for caches to sync" controller="cidrallocator"
	I0918 16:57:21.999891       1 shared_informer.go:356] "Caches are synced" controller="cidrallocator"
	I0918 16:57:22.003084       1 shared_informer.go:356] "Caches are synced" controller="resource quota"
	I0918 16:57:22.005449       1 shared_informer.go:356] "Caches are synced" controller="crt configmap"
	I0918 16:57:22.007795       1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="ha-078118" podCIDRs=["10.244.0.0/24"]
	I0918 16:57:22.014810       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	I0918 16:57:36.949312       1 node_lifecycle_controller.go:1044] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"
	I0918 16:57:50.908088       1 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-078118-m02\" does not exist"
	I0918 16:57:50.920374       1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="ha-078118-m02" podCIDRs=["10.244.1.0/24"]
	I0918 16:57:51.951916       1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-078118-m02"
	E0918 16:58:53.029464       1 certificate_controller.go:151] "Unhandled Error" err="Sync csr-ns7n2 failed with : error updating signature for csr: Operation cannot be fulfilled on certificatesigningrequests.certificates.k8s.io \"csr-ns7n2\": the object has been modified; please apply your changes to the latest version and try again" logger="UnhandledError"
	I0918 16:58:54.398116       1 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-078118-m03\" does not exist"
	I0918 16:58:54.408644       1 range_allocator.go:428] "Set node PodCIDR" logger="node-ipam-controller" node="ha-078118-m03" podCIDRs=["10.244.2.0/24"]
	I0918 16:58:57.035270       1 node_lifecycle_controller.go:873] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-078118-m03"
	
	
	==> kube-proxy [9d8271cae4bea6871005fa5672799aa187936aa79b11a2ceee4b632f181632d9] <==
	I0918 16:57:23.552129       1 server_linux.go:53] "Using iptables proxy"
	I0918 16:57:23.618582       1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
	I0918 16:57:23.719415       1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
	I0918 16:57:23.719477       1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.49.2"]
	E0918 16:57:23.719603       1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
	I0918 16:57:23.742365       1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0918 16:57:23.742445       1 server_linux.go:132] "Using iptables Proxier"
	I0918 16:57:23.749399       1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
	I0918 16:57:23.749845       1 server.go:527] "Version info" version="v1.34.0"
	I0918 16:57:23.749872       1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 16:57:23.751257       1 config.go:403] "Starting serviceCIDR config controller"
	I0918 16:57:23.751277       1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
	I0918 16:57:23.751307       1 config.go:200] "Starting service config controller"
	I0918 16:57:23.751312       1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
	I0918 16:57:23.751338       1 config.go:309] "Starting node config controller"
	I0918 16:57:23.751344       1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
	I0918 16:57:23.752416       1 config.go:106] "Starting endpoint slice config controller"
	I0918 16:57:23.752752       1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
	I0918 16:57:23.851721       1 shared_informer.go:356] "Caches are synced" controller="service config"
	I0918 16:57:23.851721       1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
	I0918 16:57:23.851724       1 shared_informer.go:356] "Caches are synced" controller="node config"
	I0918 16:57:23.852869       1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
	
	
	==> kube-scheduler [db2ea624fa9b69b8338be3fd1f439edd2f934d1bb03c166e93576e563be0e8fa] <==
	E0918 16:57:14.963359       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
	E0918 16:57:15.879600       1 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIStorageCapacity"
	E0918 16:57:15.986882       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceSlice: resourceslices.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceslices\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceSlice"
	E0918 16:57:15.993286       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Pod"
	E0918 16:57:15.994165       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ResourceClaim: resourceclaims.resource.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"resourceclaims\" in API group \"resource.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ResourceClaim"
	E0918 16:57:16.023788       1 reflector.go:205] "Failed to watch" err="failed to list *v1.VolumeAttachment: volumeattachments.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"volumeattachments\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.VolumeAttachment"
	E0918 16:57:16.047113       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StatefulSet"
	E0918 16:57:16.071789       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.ReplicationController"
	E0918 16:57:16.077882       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
	E0918 16:57:16.154294       1 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
	E0918 16:57:16.219883       1 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError" reflector="runtime/asm_amd64.s:1700" type="*v1.ConfigMap"
	E0918 16:57:16.270378       1 reflector.go:205] "Failed to watch" err="failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.PersistentVolume"
	E0918 16:57:16.276428       1 reflector.go:205] "Failed to watch" err="failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.StorageClass"
	I0918 16:57:18.258571       1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	E0918 16:57:50.963316       1 framework.go:1400] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-gbrxz\": pod kindnet-gbrxz is already assigned to node \"ha-078118-m02\"" plugin="DefaultBinder" pod="kube-system/kindnet-gbrxz" node="ha-078118-m02"
	E0918 16:57:50.963458       1 schedule_one.go:1079] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-gbrxz\": pod kindnet-gbrxz is already assigned to node \"ha-078118-m02\"" logger="UnhandledError" pod="kube-system/kindnet-gbrxz"
	E0918 16:58:54.440393       1 framework.go:1400] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-tghfn\": pod kindnet-tghfn is already assigned to node \"ha-078118-m03\"" plugin="DefaultBinder" pod="kube-system/kindnet-tghfn" node="ha-078118-m03"
	E0918 16:58:54.440466       1 schedule_one.go:379] "scheduler cache ForgetPod failed" err="pod 22e6ba4d-8bbb-45e6-8e87-9527b52452e1(kube-system/kindnet-tghfn) wasn't assumed so cannot be forgotten" logger="UnhandledError" pod="kube-system/kindnet-tghfn"
	E0918 16:58:54.440493       1 schedule_one.go:1079] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-tghfn\": pod kindnet-tghfn is already assigned to node \"ha-078118-m03\"" logger="UnhandledError" pod="kube-system/kindnet-tghfn"
	I0918 16:58:54.441957       1 schedule_one.go:1092] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-tghfn" node="ha-078118-m03"
	I0918 16:59:13.788974       1 cache.go:512] "Pod was added to a different node than it was assumed" podKey="38c4aa96-8e5c-4bc7-a350-64f32c7e0774" pod="default/busybox-7b57f96db7-bzrv2" assumedNode="ha-078118-m02" currentNode="ha-078118"
	E0918 16:59:13.789425       1 framework.go:1400] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-7b57f96db7-bzrv2\": pod busybox-7b57f96db7-bzrv2 is already assigned to node \"ha-078118-m02\"" plugin="DefaultBinder" pod="default/busybox-7b57f96db7-bzrv2" node="ha-078118"
	E0918 16:59:13.789639       1 schedule_one.go:379] "scheduler cache ForgetPod failed" err="pod 38c4aa96-8e5c-4bc7-a350-64f32c7e0774(default/busybox-7b57f96db7-bzrv2) was assumed on ha-078118 but assigned to ha-078118-m02" logger="UnhandledError" pod="default/busybox-7b57f96db7-bzrv2"
	E0918 16:59:13.789660       1 schedule_one.go:1079] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-7b57f96db7-bzrv2\": pod busybox-7b57f96db7-bzrv2 is already assigned to node \"ha-078118-m02\"" logger="UnhandledError" pod="default/busybox-7b57f96db7-bzrv2"
	I0918 16:59:13.790820       1 schedule_one.go:1092] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-7b57f96db7-bzrv2" node="ha-078118-m02"
	
	
	==> kubelet <==
	Sep 18 16:59:15 ha-078118 kubelet[1671]: I0918 16:59:15.660724    1671 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc6485bb-dcea-454a-81bb-b9d71c73f2f5" path="/var/lib/kubelet/pods/bc6485bb-dcea-454a-81bb-b9d71c73f2f5/volumes"
	Sep 18 16:59:19 ha-078118 kubelet[1671]: E0918 16:59:19.682422    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214759682138930  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:19 ha-078118 kubelet[1671]: E0918 16:59:19.682458    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214759682138930  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:29 ha-078118 kubelet[1671]: E0918 16:59:29.683746    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214769683420730  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:29 ha-078118 kubelet[1671]: E0918 16:59:29.683784    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214769683420730  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:39 ha-078118 kubelet[1671]: E0918 16:59:39.685040    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214779684726563  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:39 ha-078118 kubelet[1671]: E0918 16:59:39.685111    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214779684726563  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:49 ha-078118 kubelet[1671]: E0918 16:59:49.686597    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214789686357189  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:49 ha-078118 kubelet[1671]: E0918 16:59:49.686637    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214789686357189  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:59 ha-078118 kubelet[1671]: E0918 16:59:59.687988    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214799687737931  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 16:59:59 ha-078118 kubelet[1671]: E0918 16:59:59.688025    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214799687737931  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:00:09 ha-078118 kubelet[1671]: E0918 17:00:09.689196    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214809688933603  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:00:09 ha-078118 kubelet[1671]: E0918 17:00:09.689233    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214809688933603  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:00:19 ha-078118 kubelet[1671]: E0918 17:00:19.690293    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214819690057500  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:00:19 ha-078118 kubelet[1671]: E0918 17:00:19.690334    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214819690057500  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:00:29 ha-078118 kubelet[1671]: E0918 17:00:29.692047    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214829691682024  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:00:29 ha-078118 kubelet[1671]: E0918 17:00:29.692090    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214829691682024  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:00:39 ha-078118 kubelet[1671]: E0918 17:00:39.693824    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214839693592230  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:00:39 ha-078118 kubelet[1671]: E0918 17:00:39.693858    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214839693592230  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:00:49 ha-078118 kubelet[1671]: E0918 17:00:49.694907    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214849694707230  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:00:49 ha-078118 kubelet[1671]: E0918 17:00:49.694941    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214849694707230  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:00:59 ha-078118 kubelet[1671]: E0918 17:00:59.697180    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214859696573941  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:00:59 ha-078118 kubelet[1671]: E0918 17:00:59.697222    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214859696573941  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:01:09 ha-078118 kubelet[1671]: E0918 17:01:09.698298    1671 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214869698066233  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:01:09 ha-078118 kubelet[1671]: E0918 17:01:09.698329    1671 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214869698066233  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	

                                                
                                                
-- /stdout --
helpers_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-078118 -n ha-078118
helpers_test.go:269: (dbg) Run:  kubectl --context ha-078118 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestMultiControlPlane/serial/RestartSecondaryNode FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestMultiControlPlane/serial/RestartSecondaryNode (52.86s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartClusterKeepsNodes (101.68s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes
ha_test.go:458: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 node list --alsologtostderr -v 5
ha_test.go:464: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 stop --alsologtostderr -v 5
E0918 17:01:32.217679   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:01:32.224091   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:01:32.235567   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:01:32.256962   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:01:32.298428   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:01:32.380436   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:01:32.542663   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:01:32.864617   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:01:33.506737   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:01:34.788423   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:01:37.351358   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:01:42.473077   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
ha_test.go:464: (dbg) Done: out/minikube-linux-amd64 -p ha-078118 stop --alsologtostderr -v 5: (32.322897502s)
ha_test.go:469: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 start --wait true --alsologtostderr -v 5
E0918 17:01:52.714785   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:02:08.141672   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:02:13.196468   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:02:54.159651   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
ha_test.go:469: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 start --wait true --alsologtostderr -v 5: exit status 90 (1m7.263423463s)

                                                
                                                
-- stdout --
	* [ha-078118] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=20370
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	* Starting "ha-078118" primary control-plane node in "ha-078118" cluster
	* Pulling base image v0.0.48 ...
	* Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	* Enabled addons: 
	
	* Starting "ha-078118-m02" control-plane node in "ha-078118" cluster
	* Pulling base image v0.0.48 ...
	* Found network options:
	  - NO_PROXY=192.168.49.2
	* Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	  - env NO_PROXY=192.168.49.2
	* Verifying Kubernetes components...
	
	* Starting "ha-078118-m03" control-plane node in "ha-078118" cluster
	* Pulling base image v0.0.48 ...
	* Found network options:
	  - NO_PROXY=192.168.49.2,192.168.49.3
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:01:49.379653   88523 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:01:49.379772   88523 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:01:49.379784   88523 out.go:374] Setting ErrFile to fd 2...
	I0918 17:01:49.379790   88523 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:01:49.380019   88523 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:01:49.380533   88523 out.go:368] Setting JSON to false
	I0918 17:01:49.381592   88523 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":2660,"bootTime":1758212249,"procs":195,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 17:01:49.381686   88523 start.go:140] virtualization: kvm guest
	I0918 17:01:49.384268   88523 out.go:179] * [ha-078118] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 17:01:49.385803   88523 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 17:01:49.385796   88523 notify.go:220] Checking for updates...
	I0918 17:01:49.387397   88523 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 17:01:49.389003   88523 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:01:49.390427   88523 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 17:01:49.391837   88523 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 17:01:49.393281   88523 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 17:01:49.395372   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:49.395474   88523 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 17:01:49.420078   88523 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 17:01:49.420170   88523 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:01:49.475997   88523 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:0 ContainersPaused:0 ContainersStopped:4 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 17:01:49.466272836 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:01:49.476147   88523 docker.go:318] overlay module found
	I0918 17:01:49.478189   88523 out.go:179] * Using the docker driver based on existing profile
	I0918 17:01:49.479694   88523 start.go:304] selected driver: docker
	I0918 17:01:49.479717   88523 start.go:924] validating driver "docker" against &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNam
es:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false
inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:
false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:01:49.479869   88523 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 17:01:49.479962   88523 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:01:49.539423   88523 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:0 ContainersPaused:0 ContainersStopped:4 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 17:01:49.529122726 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:01:49.540463   88523 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:01:49.540514   88523 cni.go:84] Creating CNI manager for ""
	I0918 17:01:49.540617   88523 cni.go:136] multinode detected (4 nodes found), recommending kindnet
	I0918 17:01:49.540690   88523 start.go:348] cluster config:
	{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: N
etworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubef
low:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Static
IP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:01:49.542911   88523 out.go:179] * Starting "ha-078118" primary control-plane node in "ha-078118" cluster
	I0918 17:01:49.544389   88523 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:01:49.545792   88523 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:01:49.547204   88523 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:01:49.547272   88523 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
	I0918 17:01:49.547302   88523 cache.go:58] Caching tarball of preloaded images
	I0918 17:01:49.547351   88523 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:01:49.547411   88523 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:01:49.547426   88523 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:01:49.547600   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:49.567461   88523 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:01:49.567478   88523 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:01:49.567515   88523 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:01:49.567543   88523 start.go:360] acquireMachinesLock for ha-078118: {Name:mk24a1b2c9ed1c42e9ffd635727b36c75401a437 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:01:49.567596   88523 start.go:364] duration metric: took 39.11µs to acquireMachinesLock for "ha-078118"
	I0918 17:01:49.567613   88523 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:01:49.567618   88523 fix.go:54] fixHost starting: 
	I0918 17:01:49.567821   88523 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:01:49.585475   88523 fix.go:112] recreateIfNeeded on ha-078118: state=Stopped err=<nil>
	W0918 17:01:49.585550   88523 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:01:49.587651   88523 out.go:252] * Restarting existing docker container for "ha-078118" ...
	I0918 17:01:49.587728   88523 cli_runner.go:164] Run: docker start ha-078118
	I0918 17:01:49.825406   88523 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:01:49.844741   88523 kic.go:430] container "ha-078118" state is running.
	I0918 17:01:49.845091   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:01:49.864909   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:49.865148   88523 machine.go:93] provisionDockerMachine start ...
	I0918 17:01:49.865211   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:49.884562   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:49.884789   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32813 <nil> <nil>}
	I0918 17:01:49.884809   88523 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:01:49.885517   88523 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:54636->127.0.0.1:32813: read: connection reset by peer
	I0918 17:01:53.023917   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 17:01:53.023947   88523 ubuntu.go:182] provisioning hostname "ha-078118"
	I0918 17:01:53.024015   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:53.042995   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:53.043252   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32813 <nil> <nil>}
	I0918 17:01:53.043274   88523 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118 && echo "ha-078118" | sudo tee /etc/hostname
	I0918 17:01:53.192161   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 17:01:53.192246   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:53.210910   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:53.211146   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32813 <nil> <nil>}
	I0918 17:01:53.211164   88523 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:01:53.348813   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:01:53.348841   88523 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:01:53.348884   88523 ubuntu.go:190] setting up certificates
	I0918 17:01:53.348896   88523 provision.go:84] configureAuth start
	I0918 17:01:53.348954   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:01:53.367869   88523 provision.go:143] copyHostCerts
	I0918 17:01:53.367917   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:01:53.367947   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:01:53.367963   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:01:53.368042   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:01:53.368157   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:01:53.368180   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:01:53.368186   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:01:53.368215   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:01:53.368277   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:01:53.368294   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:01:53.368300   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:01:53.368323   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:01:53.368389   88523 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118 san=[127.0.0.1 192.168.49.2 ha-078118 localhost minikube]
	I0918 17:01:53.505620   88523 provision.go:177] copyRemoteCerts
	I0918 17:01:53.505678   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:01:53.505710   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:53.524161   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:53.622628   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 17:01:53.622691   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:01:53.648566   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 17:01:53.648617   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)
	I0918 17:01:53.673434   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 17:01:53.673543   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:01:53.697938   88523 provision.go:87] duration metric: took 349.03073ms to configureAuth
	I0918 17:01:53.697966   88523 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:01:53.698195   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:53.698301   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:53.716437   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:53.716667   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32813 <nil> <nil>}
	I0918 17:01:53.716687   88523 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:01:54.060620   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:01:54.060651   88523 machine.go:96] duration metric: took 4.195487726s to provisionDockerMachine
	I0918 17:01:54.060665   88523 start.go:293] postStartSetup for "ha-078118" (driver="docker")
	I0918 17:01:54.060679   88523 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:01:54.060754   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:01:54.060810   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:54.081141   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:54.178371   88523 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:01:54.182063   88523 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:01:54.182105   88523 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:01:54.182113   88523 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:01:54.182119   88523 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:01:54.182128   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:01:54.182193   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:01:54.182333   88523 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:01:54.182355   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 17:01:54.182483   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:01:54.191863   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:01:54.217237   88523 start.go:296] duration metric: took 156.554854ms for postStartSetup
	I0918 17:01:54.217324   88523 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:01:54.217390   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:54.236238   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:54.329749   88523 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:01:54.334136   88523 fix.go:56] duration metric: took 4.766511986s for fixHost
	I0918 17:01:54.334163   88523 start.go:83] releasing machines lock for "ha-078118", held for 4.766557228s
	I0918 17:01:54.334217   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:01:54.351968   88523 ssh_runner.go:195] Run: cat /version.json
	I0918 17:01:54.352015   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:54.352066   88523 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:01:54.352121   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:54.371203   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:54.371672   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:54.463754   88523 ssh_runner.go:195] Run: systemctl --version
	I0918 17:01:54.535544   88523 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:01:54.676680   88523 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:01:54.681529   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:01:54.690765   88523 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:01:54.690857   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:01:54.700127   88523 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:01:54.700153   88523 start.go:495] detecting cgroup driver to use...
	I0918 17:01:54.700180   88523 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:01:54.700215   88523 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:01:54.712746   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:01:54.724661   88523 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:01:54.724728   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:01:54.737819   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:01:54.750395   88523 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:01:54.815179   88523 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:01:54.880585   88523 docker.go:234] disabling docker service ...
	I0918 17:01:54.880655   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:01:54.893483   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:01:54.905105   88523 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:01:54.970982   88523 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:01:55.036251   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:01:55.047926   88523 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:01:55.064969   88523 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:01:55.065039   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.075907   88523 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:01:55.075961   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.086186   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.096182   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.106316   88523 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:01:55.116742   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.127414   88523 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.137571   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.147863   88523 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:01:55.156583   88523 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:01:55.165138   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:01:55.228262   88523 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:01:55.328023   88523 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:01:55.328125   88523 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:01:55.332040   88523 start.go:563] Will wait 60s for crictl version
	I0918 17:01:55.332103   88523 ssh_runner.go:195] Run: which crictl
	I0918 17:01:55.335544   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:01:55.370764   88523 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 17:01:55.370835   88523 ssh_runner.go:195] Run: crio --version
	I0918 17:01:55.407074   88523 ssh_runner.go:195] Run: crio --version
	I0918 17:01:55.445239   88523 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 17:01:55.446549   88523 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:01:55.463986   88523 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 17:01:55.467838   88523 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:01:55.479645   88523 kubeadm.go:875] updating cluster {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIP
s:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-ga
dget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQ
emuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0918 17:01:55.479776   88523 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:01:55.479825   88523 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:01:55.521370   88523 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:01:55.521391   88523 crio.go:433] Images already preloaded, skipping extraction
	I0918 17:01:55.521435   88523 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:01:55.554619   88523 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:01:55.554641   88523 cache_images.go:85] Images are preloaded, skipping loading
	I0918 17:01:55.554650   88523 kubeadm.go:926] updating node { 192.168.49.2 8443 v1.34.0 crio true true} ...
	I0918 17:01:55.554740   88523 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 17:01:55.554809   88523 ssh_runner.go:195] Run: crio config
	I0918 17:01:55.597150   88523 cni.go:84] Creating CNI manager for ""
	I0918 17:01:55.597170   88523 cni.go:136] multinode detected (4 nodes found), recommending kindnet
	I0918 17:01:55.597182   88523 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0918 17:01:55.597201   88523 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.34.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-078118 NodeName:ha-078118 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manif
ests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0918 17:01:55.597323   88523 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "ha-078118"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.49.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	kubernetesVersion: v1.34.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: systemd
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0918 17:01:55.597340   88523 kube-vip.go:115] generating kube-vip config ...
	I0918 17:01:55.597387   88523 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 17:01:55.610040   88523 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:01:55.610150   88523 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 17:01:55.610202   88523 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 17:01:55.619652   88523 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 17:01:55.619730   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
	I0918 17:01:55.629065   88523 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (359 bytes)
	I0918 17:01:55.647817   88523 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 17:01:55.666322   88523 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2205 bytes)
	I0918 17:01:55.685799   88523 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 17:01:55.705367   88523 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 17:01:55.709566   88523 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:01:55.722362   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:01:55.784601   88523 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:01:55.808023   88523 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.2
	I0918 17:01:55.808042   88523 certs.go:194] generating shared ca certs ...
	I0918 17:01:55.808072   88523 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:55.808221   88523 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 17:01:55.808270   88523 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 17:01:55.808280   88523 certs.go:256] generating profile certs ...
	I0918 17:01:55.808359   88523 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 17:01:55.808395   88523 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.c944a3f3
	I0918 17:01:55.808410   88523 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.c944a3f3 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.3 192.168.49.4 192.168.49.254]
	I0918 17:01:56.210331   88523 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.c944a3f3 ...
	I0918 17:01:56.210365   88523 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.c944a3f3: {Name:mkb79a1de8248bd79832f6910fea7ba45af90c6a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.210571   88523 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.c944a3f3 ...
	I0918 17:01:56.210590   88523 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.c944a3f3: {Name:mkee19f1232c09da0d47765b6f3756d6bcdf1995 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.210674   88523 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.c944a3f3 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 17:01:56.210811   88523 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.c944a3f3 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 17:01:56.210938   88523 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 17:01:56.210952   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 17:01:56.210965   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 17:01:56.210976   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 17:01:56.210987   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 17:01:56.210997   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 17:01:56.211031   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 17:01:56.211043   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 17:01:56.211055   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 17:01:56.211116   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 17:01:56.211142   88523 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 17:01:56.211151   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 17:01:56.211172   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 17:01:56.211193   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 17:01:56.211213   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 17:01:56.211248   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:01:56.211275   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 17:01:56.211290   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 17:01:56.211302   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:01:56.211913   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 17:01:56.237934   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 17:01:56.263651   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 17:01:56.288002   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 17:01:56.314861   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
	I0918 17:01:56.340356   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 17:01:56.370284   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 17:01:56.398212   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 17:01:56.432277   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 17:01:56.471393   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 17:01:56.507057   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 17:01:56.541863   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0918 17:01:56.570235   88523 ssh_runner.go:195] Run: openssl version
	I0918 17:01:56.577129   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 17:01:56.588470   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 17:01:56.592889   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 17:01:56.592948   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 17:01:56.600490   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 17:01:56.610210   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 17:01:56.620549   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 17:01:56.624511   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 17:01:56.624575   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 17:01:56.632301   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 17:01:56.642250   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 17:01:56.652289   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:01:56.656446   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:01:56.656530   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:01:56.664059   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 17:01:56.673942   88523 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 17:01:56.678148   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0918 17:01:56.685430   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0918 17:01:56.692331   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0918 17:01:56.699250   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0918 17:01:56.706155   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0918 17:01:56.713040   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0918 17:01:56.719862   88523 kubeadm.go:392] StartCluster: {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[
] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadge
t:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemu
FirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:01:56.720000   88523 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0918 17:01:56.720046   88523 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0918 17:01:56.758372   88523 cri.go:89] found id: "1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5"
	I0918 17:01:56.758399   88523 cri.go:89] found id: "d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd"
	I0918 17:01:56.758404   88523 cri.go:89] found id: "47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67"
	I0918 17:01:56.758409   88523 cri.go:89] found id: "1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156"
	I0918 17:01:56.758413   88523 cri.go:89] found id: "f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a"
	I0918 17:01:56.758417   88523 cri.go:89] found id: ""
	I0918 17:01:56.758462   88523 ssh_runner.go:195] Run: sudo runc list -f json
	I0918 17:01:56.780084   88523 cri.go:116] JSON = [{"ociVersion":"1.0.2-dev","id":"1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5","pid":904,"status":"running","bundle":"/run/containers/storage/overlay-containers/1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5/userdata","rootfs":"/var/lib/containers/storage/overlay/9c71e033c7f3d6a01ab02e2f4462648d32830be6c4d23a4db21a231f88ff347b/merged","created":"2025-09-18T17:01:56.483000594Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"7eaa1830","io.kubernetes.container.name":"kube-controller-manager","io.kubernetes.container.ports":"[{\"name\":\"probe-port\",\"hostPort\":10257,\"containerPort\":10257,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"7eaa1830\",\"io.kubernetes.contai
ner.ports\":\"[{\\\"name\\\":\\\"probe-port\\\",\\\"hostPort\\\":10257,\\\"containerPort\\\":10257,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.414440268Z","io.kubernetes.cri-o.Image":"a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-controller-manager:v1.34.0","io.kubernetes.cri-o.ImageRef":"a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-controller-manager\",\"io.kubernetes.pod.name\":\"kube-controller-manager-ha-078118\",\"io.kube
rnetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"295d4b0a8fb5b6e3839f92f4ba9ebb80\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-controller-manager-ha-078118_295d4b0a8fb5b6e3839f92f4ba9ebb80/kube-controller-manager/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-controller-manager\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/9c71e033c7f3d6a01ab02e2f4462648d32830be6c4d23a4db21a231f88ff347b/merged","io.kubernetes.cri-o.Name":"k8s_kube-controller-manager_kube-controller-manager-ha-078118_kube-system_295d4b0a8fb5b6e3839f92f4ba9ebb80_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/bc00758e6c8406d5f266c3138b612bd3922701154711f59957fe39c69c66e540/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"bc00758e6c8406d5f266c3138b612bd3922701154711f59957fe39c69c66e540","io.kubernetes.cri-o.SandboxName":"k8s_kube-controller-manager-ha-078118_kube-system_295d4b0a8fb5b6e3839f92f4ba9ebb80_0","io.kubernetes
.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/ca-certificates\",\"host_path\":\"/etc/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/295d4b0a8fb5b6e3839f92f4ba9ebb80/containers/kube-controller-manager/72ee19b7\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/295d4b0a8fb5b6e3839f92f4ba9ebb80/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/ssl/certs\",\"host_path\":\"/etc/ssl/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/kubernetes/controller-manager.conf\",\"host_path\":\"/etc/kubernetes/controller-manager.conf\",\"readonly\":true,\"propagation\":0,\"se
linux_relabel\":false},{\"container_path\":\"/usr/share/ca-certificates\",\"host_path\":\"/usr/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/certs\",\"host_path\":\"/var/lib/minikube/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/local/share/ca-certificates\",\"host_path\":\"/usr/local/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/libexec/kubernetes/kubelet-plugins/volume/exec\",\"host_path\":\"/usr/libexec/kubernetes/kubelet-plugins/volume/exec\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-controller-manager-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"295d4b0a8fb5b6e3839f92f4ba9ebb80","kubernetes.io/config.hash":"295d4b0a8fb5b6e3839f92f4ba9ebb80","kubernetes.io/config.seen":"20
25-09-18T17:01:55.876115131Z","kubernetes.io/config.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependencies":"true","org.systemd.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156","pid":849,"status":"running","bundle":"/run/containers/storage/overlay-containers/1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156/userdata","rootfs":"/var/lib/containers/storage/overlay/9a05cb7fea32dc9ddf7a008a2caeccd14f1a898a68a3dd3ddbf49586836e44b4/merged","created":"2025-09-18T17:01:56.440722069Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"d64ad60b","io.kubernetes.container.name":"kube-vip","io.kubernetes.container.restartCount":"0","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kub
ernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"d64ad60b\",\"io.kubernetes.container.restartCount\":\"0\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.395408441Z","io.kubernetes.cri-o.Image":"765655ea6078171c416896d7cc155c1263a0411d30caaa03d7365aecb99fdf23","io.kubernetes.cri-o.ImageName":"ghcr.io/kube-vip/kube-vip:v1.0.0","io.kubernetes.cri-o.ImageRef":"765655ea6078171c416896d7cc155c1263a0411d30caaa03d7365aecb99fdf23","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-vip\",\"io.kubernetes.pod.name\":\"kube-vip-ha-078118\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"b5f2d8fa1610d58f11008a293d2cb33c\"}
","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-vip-ha-078118_b5f2d8fa1610d58f11008a293d2cb33c/kube-vip/0.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-vip\"}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/9a05cb7fea32dc9ddf7a008a2caeccd14f1a898a68a3dd3ddbf49586836e44b4/merged","io.kubernetes.cri-o.Name":"k8s_kube-vip_kube-vip-ha-078118_kube-system_b5f2d8fa1610d58f11008a293d2cb33c_0","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/30db82bb4c1ecf3da0c6fc497ad269f656085bac7f95a7fe045a62d4257a5f44/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"30db82bb4c1ecf3da0c6fc497ad269f656085bac7f95a7fe045a62d4257a5f44","io.kubernetes.cri-o.SandboxName":"k8s_kube-vip-ha-078118_kube-system_b5f2d8fa1610d58f11008a293d2cb33c_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/hosts\"
,\"host_path\":\"/var/lib/kubelet/pods/b5f2d8fa1610d58f11008a293d2cb33c/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/b5f2d8fa1610d58f11008a293d2cb33c/containers/kube-vip/ce75abae\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/kubernetes/admin.conf\",\"host_path\":\"/etc/kubernetes/admin.conf\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-vip-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"b5f2d8fa1610d58f11008a293d2cb33c","kubernetes.io/config.hash":"b5f2d8fa1610d58f11008a293d2cb33c","kubernetes.io/config.seen":"2025-09-18T17:01:55.876125807Z","kubernetes.io/config.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependenci
es":"true","org.systemd.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67","pid":885,"status":"running","bundle":"/run/containers/storage/overlay-containers/47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67/userdata","rootfs":"/var/lib/containers/storage/overlay/8e8b1e7cd8a289c8374f9b6257c15f074ae0f3c0cebbc0ba3761dd50fedae849/merged","created":"2025-09-18T17:01:56.465937045Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"85eae708","io.kubernetes.container.name":"kube-scheduler","io.kubernetes.container.ports":"[{\"name\":\"probe-port\",\"hostPort\":10259,\"containerPort\":10259,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"85eae708\",\"io.
kubernetes.container.ports\":\"[{\\\"name\\\":\\\"probe-port\\\",\\\"hostPort\\\":10259,\\\"containerPort\\\":10259,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.399734521Z","io.kubernetes.cri-o.Image":"46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-scheduler:v1.34.0","io.kubernetes.cri-o.ImageRef":"46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-scheduler\",\"io.kubernetes.pod.name\":\"kube-scheduler-ha-078118\",\"io.kubernetes.pod
.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"eef6954c295df14c6ded36d455ae3f64\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-scheduler-ha-078118_eef6954c295df14c6ded36d455ae3f64/kube-scheduler/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-scheduler\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/8e8b1e7cd8a289c8374f9b6257c15f074ae0f3c0cebbc0ba3761dd50fedae849/merged","io.kubernetes.cri-o.Name":"k8s_kube-scheduler_kube-scheduler-ha-078118_kube-system_eef6954c295df14c6ded36d455ae3f64_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/0b0c119de2a5e95db0b47c45e75dd2a09a0606aba44508db81678b39fd38137d/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"0b0c119de2a5e95db0b47c45e75dd2a09a0606aba44508db81678b39fd38137d","io.kubernetes.cri-o.SandboxName":"k8s_kube-scheduler-ha-078118_kube-system_eef6954c295df14c6ded36d455ae3f64_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false
","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/eef6954c295df14c6ded36d455ae3f64/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/eef6954c295df14c6ded36d455ae3f64/containers/kube-scheduler/3ee75ede\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/kubernetes/scheduler.conf\",\"host_path\":\"/etc/kubernetes/scheduler.conf\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-scheduler-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"eef6954c295df14c6ded36d455ae3f64","kubernetes.io/config.hash":"eef6954c295df14c6ded36d455ae3f64","kubernetes.io/config.seen":"2025-09-18T17:01:55.876124510Z","kubernetes.io/config
.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependencies":"true","org.systemd.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd","pid":895,"status":"running","bundle":"/run/containers/storage/overlay-containers/d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd/userdata","rootfs":"/var/lib/containers/storage/overlay/e609e9e46a7b4349013bb25dc88f625f340af02c9dc300f5dad6685070fd74b2/merged","created":"2025-09-18T17:01:56.468173373Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"d671eaa0","io.kubernetes.container.name":"kube-apiserver","io.kubernetes.container.ports":"[{\"name\":\"probe-port\",\"hostPort\":8443,\"containerPort\":8443,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/ter
mination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"d671eaa0\",\"io.kubernetes.container.ports\":\"[{\\\"name\\\":\\\"probe-port\\\",\\\"hostPort\\\":8443,\\\"containerPort\\\":8443,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.400849867Z","io.kubernetes.cri-o.Image":"90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-apiserver:v1.34.0","io.kubernetes.cri-o.ImageRef":"90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90","
io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-apiserver\",\"io.kubernetes.pod.name\":\"kube-apiserver-ha-078118\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"eab4cb22d09eb9c837e45b2e0c5fc664\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-apiserver-ha-078118_eab4cb22d09eb9c837e45b2e0c5fc664/kube-apiserver/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-apiserver\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/e609e9e46a7b4349013bb25dc88f625f340af02c9dc300f5dad6685070fd74b2/merged","io.kubernetes.cri-o.Name":"k8s_kube-apiserver_kube-apiserver-ha-078118_kube-system_eab4cb22d09eb9c837e45b2e0c5fc664_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/27ab8b84a9d30c714c81b49dbcbf9e1787031ad0f6c46d6f231d0b79f94b32f5/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"27ab8b84a9d30c714c81b49dbcbf9e1787031ad0f6c46d6f231d0b79f94b32f5","io.kubernetes.cri-o.SandboxName"
:"k8s_kube-apiserver-ha-078118_kube-system_eab4cb22d09eb9c837e45b2e0c5fc664_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/eab4cb22d09eb9c837e45b2e0c5fc664/containers/kube-apiserver/764ef81a\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/ca-certificates\",\"host_path\":\"/etc/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/eab4cb22d09eb9c837e45b2e0c5fc664/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/share/ca-certificates\",\"host_path\":\"/usr/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/ssl/certs\",\"host_path\":\
"/etc/ssl/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/certs\",\"host_path\":\"/var/lib/minikube/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/local/share/ca-certificates\",\"host_path\":\"/usr/local/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-apiserver-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"eab4cb22d09eb9c837e45b2e0c5fc664","kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.49.2:8443","kubernetes.io/config.hash":"eab4cb22d09eb9c837e45b2e0c5fc664","kubernetes.io/config.seen":"2025-09-18T17:01:55.876112955Z","kubernetes.io/config.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependencies":"true","org.system
d.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a","pid":832,"status":"running","bundle":"/run/containers/storage/overlay-containers/f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a/userdata","rootfs":"/var/lib/containers/storage/overlay/ef7555194ebc8c68b1cc9488dbf8f557c6e739f666631cf9b320b2dc5b85a30d/merged","created":"2025-09-18T17:01:56.443422336Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"e9e20c65","io.kubernetes.container.name":"etcd","io.kubernetes.container.ports":"[{\"name\":\"probe-port\",\"hostPort\":2381,\"containerPort\":2381,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"e9e20c65\",\"io.kubernetes.container.ports\":\"[{\
\\"name\\\":\\\"probe-port\\\",\\\"hostPort\\\":2381,\\\"containerPort\\\":2381,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.368917103Z","io.kubernetes.cri-o.Image":"5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115","io.kubernetes.cri-o.ImageName":"registry.k8s.io/etcd:3.6.4-0","io.kubernetes.cri-o.ImageRef":"5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"etcd\",\"io.kubernetes.pod.name\":\"etcd-ha-078118\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"c844ac4cd
3d56ebd5831bc0d85f91b01\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_etcd-ha-078118_c844ac4cd3d56ebd5831bc0d85f91b01/etcd/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"etcd\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/ef7555194ebc8c68b1cc9488dbf8f557c6e739f666631cf9b320b2dc5b85a30d/merged","io.kubernetes.cri-o.Name":"k8s_etcd_etcd-ha-078118_kube-system_c844ac4cd3d56ebd5831bc0d85f91b01_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/392032ae1b29544e24d0d98943a7310ad13f5d12f0c5be5a121d7418fe388e2c/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"392032ae1b29544e24d0d98943a7310ad13f5d12f0c5be5a121d7418fe388e2c","io.kubernetes.cri-o.SandboxName":"k8s_etcd-ha-078118_kube-system_c844ac4cd3d56ebd5831bc0d85f91b01_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\
":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/c844ac4cd3d56ebd5831bc0d85f91b01/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/c844ac4cd3d56ebd5831bc0d85f91b01/containers/etcd/129e1cf5\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/etcd\",\"host_path\":\"/var/lib/minikube/etcd\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/certs/etcd\",\"host_path\":\"/var/lib/minikube/certs/etcd\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"etcd-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"c844ac4cd3d56ebd5831bc0d85f91b01","kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.49.2:2379","kubernetes.io/config.hash":"c844ac4cd3d56ebd5831bc0d85f91b01",
"kubernetes.io/config.seen":"2025-09-18T17:01:55.876108105Z","kubernetes.io/config.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependencies":"true","org.systemd.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"}]
	I0918 17:01:56.780559   88523 cri.go:126] list returned 5 containers
	I0918 17:01:56.780578   88523 cri.go:129] container: {ID:1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5 Status:running}
	I0918 17:01:56.780593   88523 cri.go:135] skipping {1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5 running}: state = "running", want "paused"
	I0918 17:01:56.780608   88523 cri.go:129] container: {ID:1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156 Status:running}
	I0918 17:01:56.780614   88523 cri.go:135] skipping {1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156 running}: state = "running", want "paused"
	I0918 17:01:56.780622   88523 cri.go:129] container: {ID:47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67 Status:running}
	I0918 17:01:56.780627   88523 cri.go:135] skipping {47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67 running}: state = "running", want "paused"
	I0918 17:01:56.780635   88523 cri.go:129] container: {ID:d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd Status:running}
	I0918 17:01:56.780640   88523 cri.go:135] skipping {d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd running}: state = "running", want "paused"
	I0918 17:01:56.780648   88523 cri.go:129] container: {ID:f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a Status:running}
	I0918 17:01:56.780654   88523 cri.go:135] skipping {f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a running}: state = "running", want "paused"
	I0918 17:01:56.780711   88523 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0918 17:01:56.790261   88523 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0918 17:01:56.790289   88523 kubeadm.go:589] restartPrimaryControlPlane start ...
	I0918 17:01:56.790351   88523 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0918 17:01:56.799692   88523 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:01:56.800125   88523 kubeconfig.go:47] verify endpoint returned: get endpoint: "ha-078118" does not appear in /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:01:56.800245   88523 kubeconfig.go:62] /home/jenkins/minikube-integration/20370-7845/kubeconfig needs updating (will repair): [kubeconfig missing "ha-078118" cluster setting kubeconfig missing "ha-078118" context setting]
	I0918 17:01:56.800516   88523 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.800988   88523 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, Us
erAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0918 17:01:56.801446   88523 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
	I0918 17:01:56.801466   88523 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I0918 17:01:56.801472   88523 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
	I0918 17:01:56.801477   88523 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I0918 17:01:56.801483   88523 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
	I0918 17:01:56.801488   88523 cert_rotation.go:141] "Starting client certificate rotation controller" logger="tls-transport-cache"
	I0918 17:01:56.801819   88523 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0918 17:01:56.811376   88523 kubeadm.go:626] The running cluster does not require reconfiguration: 192.168.49.2
	I0918 17:01:56.811406   88523 kubeadm.go:593] duration metric: took 21.110094ms to restartPrimaryControlPlane
	I0918 17:01:56.811418   88523 kubeadm.go:394] duration metric: took 91.570194ms to StartCluster
	I0918 17:01:56.811440   88523 settings.go:142] acquiring lock: {Name:mk72fea03aefe901db9522a467405d86665fedd0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.811525   88523 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:01:56.812011   88523 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.812251   88523 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:01:56.812273   88523 start.go:241] waiting for startup goroutines ...
	I0918 17:01:56.812281   88523 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0918 17:01:56.812548   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:56.818560   88523 out.go:179] * Enabled addons: 
	I0918 17:01:56.819862   88523 addons.go:514] duration metric: took 7.577022ms for enable addons: enabled=[]
	I0918 17:01:56.819895   88523 start.go:246] waiting for cluster config update ...
	I0918 17:01:56.819902   88523 start.go:255] writing updated cluster config ...
	I0918 17:01:56.821358   88523 out.go:203] 
	I0918 17:01:56.822838   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:56.822935   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:56.824668   88523 out.go:179] * Starting "ha-078118-m02" control-plane node in "ha-078118" cluster
	I0918 17:01:56.826202   88523 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:01:56.827692   88523 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:01:56.829025   88523 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:01:56.829052   88523 cache.go:58] Caching tarball of preloaded images
	I0918 17:01:56.829116   88523 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:01:56.829157   88523 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:01:56.829174   88523 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:01:56.829286   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:56.852123   88523 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:01:56.852147   88523 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:01:56.852166   88523 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:01:56.852198   88523 start.go:360] acquireMachinesLock for ha-078118-m02: {Name:mk65f6a883861f2032241e1132c63effea2ab61f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:01:56.852266   88523 start.go:364] duration metric: took 48.677µs to acquireMachinesLock for "ha-078118-m02"
	I0918 17:01:56.852296   88523 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:01:56.852306   88523 fix.go:54] fixHost starting: m02
	I0918 17:01:56.852668   88523 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:01:56.872076   88523 fix.go:112] recreateIfNeeded on ha-078118-m02: state=Stopped err=<nil>
	W0918 17:01:56.872113   88523 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:01:56.874087   88523 out.go:252] * Restarting existing docker container for "ha-078118-m02" ...
	I0918 17:01:56.874180   88523 cli_runner.go:164] Run: docker start ha-078118-m02
	I0918 17:01:57.139627   88523 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:01:57.162974   88523 kic.go:430] container "ha-078118-m02" state is running.
	I0918 17:01:57.163617   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:01:57.187278   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:57.187580   88523 machine.go:93] provisionDockerMachine start ...
	I0918 17:01:57.187647   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:01:57.208558   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:57.208807   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32818 <nil> <nil>}
	I0918 17:01:57.208821   88523 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:01:57.209542   88523 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:35706->127.0.0.1:32818: read: connection reset by peer
	I0918 17:02:00.346412   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 17:02:00.346437   88523 ubuntu.go:182] provisioning hostname "ha-078118-m02"
	I0918 17:02:00.346489   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:00.364917   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:00.365177   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32818 <nil> <nil>}
	I0918 17:02:00.365191   88523 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m02 && echo "ha-078118-m02" | sudo tee /etc/hostname
	I0918 17:02:00.514327   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 17:02:00.514402   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:00.533549   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:00.533751   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32818 <nil> <nil>}
	I0918 17:02:00.533768   88523 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m02' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m02/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m02' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:02:00.670395   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:02:00.670429   88523 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:02:00.670444   88523 ubuntu.go:190] setting up certificates
	I0918 17:02:00.670453   88523 provision.go:84] configureAuth start
	I0918 17:02:00.670535   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:02:00.688318   88523 provision.go:143] copyHostCerts
	I0918 17:02:00.688353   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:02:00.688380   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:02:00.688388   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:02:00.688466   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:02:00.688593   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:02:00.688616   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:02:00.688621   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:02:00.688655   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:02:00.688706   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:02:00.688723   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:02:00.688727   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:02:00.688752   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:02:00.688815   88523 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m02 san=[127.0.0.1 192.168.49.3 ha-078118-m02 localhost minikube]
	I0918 17:02:01.100643   88523 provision.go:177] copyRemoteCerts
	I0918 17:02:01.100699   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:02:01.100739   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:01.128283   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:01.233731   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 17:02:01.233795   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:02:01.267239   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 17:02:01.267312   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 17:02:01.299631   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 17:02:01.299701   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:02:01.333166   88523 provision.go:87] duration metric: took 662.697168ms to configureAuth
	I0918 17:02:01.333201   88523 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:02:01.333436   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:01.333668   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:01.355891   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:01.356100   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32818 <nil> <nil>}
	I0918 17:02:01.356116   88523 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:02:01.803484   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:02:01.803598   88523 machine.go:96] duration metric: took 4.615990236s to provisionDockerMachine
	I0918 17:02:01.803617   88523 start.go:293] postStartSetup for "ha-078118-m02" (driver="docker")
	I0918 17:02:01.803631   88523 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:02:01.803737   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:02:01.803809   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:01.824810   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:01.943231   88523 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:02:01.949156   88523 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:02:01.949190   88523 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:02:01.949200   88523 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:02:01.949208   88523 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:02:01.949221   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:02:01.949294   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:02:01.949388   88523 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:02:01.949398   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 17:02:01.949539   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:02:01.964224   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:02:02.000604   88523 start.go:296] duration metric: took 196.969548ms for postStartSetup
	I0918 17:02:02.000678   88523 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:02:02.000709   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:02.024047   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:02.125240   88523 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:02:02.131938   88523 fix.go:56] duration metric: took 5.279624751s for fixHost
	I0918 17:02:02.131967   88523 start.go:83] releasing machines lock for "ha-078118-m02", held for 5.279686169s
	I0918 17:02:02.132049   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:02:02.156676   88523 out.go:179] * Found network options:
	I0918 17:02:02.157902   88523 out.go:179]   - NO_PROXY=192.168.49.2
	W0918 17:02:02.159818   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:02:02.159872   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 17:02:02.159952   88523 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:02:02.160020   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:02.160303   88523 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:02:02.160395   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:02.186312   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:02.187028   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:02.428885   88523 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:02:02.434009   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:02:02.444157   88523 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:02:02.444228   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:02:02.454051   88523 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:02:02.454077   88523 start.go:495] detecting cgroup driver to use...
	I0918 17:02:02.454114   88523 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:02:02.454162   88523 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:02:02.466948   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:02:02.478891   88523 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:02:02.478957   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:02:02.491961   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:02:02.504752   88523 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:02:02.594029   88523 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:02:02.701933   88523 docker.go:234] disabling docker service ...
	I0918 17:02:02.702003   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:02:02.717057   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:02:02.731660   88523 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:02:02.853518   88523 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:02:02.996040   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:02:03.016174   88523 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:02:03.045704   88523 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:02:03.045764   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.061608   88523 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:02:03.061695   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.083523   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.105214   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.120699   88523 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:02:03.138140   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.162450   88523 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.182797   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.204229   88523 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:02:03.218676   88523 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:02:03.234833   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:02:03.414424   88523 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:02:03.681075   88523 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:02:03.681172   88523 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:02:03.685900   88523 start.go:563] Will wait 60s for crictl version
	I0918 17:02:03.685976   88523 ssh_runner.go:195] Run: which crictl
	I0918 17:02:03.689938   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:03.732205   88523 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 17:02:03.732322   88523 ssh_runner.go:195] Run: crio --version
	I0918 17:02:03.780573   88523 ssh_runner.go:195] Run: crio --version
	I0918 17:02:03.836328   88523 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 17:02:03.837848   88523 out.go:179]   - env NO_PROXY=192.168.49.2
	I0918 17:02:03.839158   88523 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:02:03.863484   88523 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 17:02:03.869490   88523 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:02:03.885574   88523 mustload.go:65] Loading cluster: ha-078118
	I0918 17:02:03.885865   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:03.886138   88523 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:02:03.910178   88523 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:02:03.910520   88523 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.3
	I0918 17:02:03.910532   88523 certs.go:194] generating shared ca certs ...
	I0918 17:02:03.910550   88523 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:02:03.910702   88523 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 17:02:03.910746   88523 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 17:02:03.910754   88523 certs.go:256] generating profile certs ...
	I0918 17:02:03.910869   88523 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 17:02:03.910966   88523 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.e3295e3c
	I0918 17:02:03.911006   88523 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 17:02:03.911015   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 17:02:03.911031   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 17:02:03.911045   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 17:02:03.911062   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 17:02:03.911076   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 17:02:03.911090   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 17:02:03.911111   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 17:02:03.911124   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 17:02:03.911179   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 17:02:03.911212   88523 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 17:02:03.911222   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 17:02:03.911254   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 17:02:03.911281   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 17:02:03.911326   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 17:02:03.911397   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:02:03.911438   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 17:02:03.911459   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:02:03.911472   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 17:02:03.911547   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:02:03.946173   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:02:04.042870   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
	I0918 17:02:04.047477   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
	I0918 17:02:04.062496   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
	I0918 17:02:04.066022   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
	I0918 17:02:04.079216   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
	I0918 17:02:04.082987   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
	I0918 17:02:04.096266   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
	I0918 17:02:04.099842   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)
	I0918 17:02:04.114219   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
	I0918 17:02:04.117647   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
	I0918 17:02:04.130510   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
	I0918 17:02:04.134062   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
	I0918 17:02:04.148209   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 17:02:04.175449   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 17:02:04.202169   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 17:02:04.229482   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 17:02:04.256335   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
	I0918 17:02:04.282706   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 17:02:04.310591   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 17:02:04.337521   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 17:02:04.364519   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 17:02:04.390068   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 17:02:04.417491   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 17:02:04.443222   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
	I0918 17:02:04.463097   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
	I0918 17:02:04.483042   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
	I0918 17:02:04.502767   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)
	I0918 17:02:04.522870   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
	I0918 17:02:04.541750   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
	I0918 17:02:04.561986   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
	I0918 17:02:04.581734   88523 ssh_runner.go:195] Run: openssl version
	I0918 17:02:04.587350   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 17:02:04.597650   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 17:02:04.601731   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 17:02:04.601792   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 17:02:04.609763   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 17:02:04.619714   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 17:02:04.630360   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 17:02:04.634287   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 17:02:04.634340   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 17:02:04.641345   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 17:02:04.652864   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 17:02:04.664993   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:02:04.668853   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:02:04.668927   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:02:04.676354   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 17:02:04.686228   88523 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 17:02:04.690454   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0918 17:02:04.697758   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0918 17:02:04.705195   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0918 17:02:04.713070   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0918 17:02:04.720155   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0918 17:02:04.727534   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0918 17:02:04.734944   88523 kubeadm.go:926] updating node {m02 192.168.49.3 8443 v1.34.0 crio true true} ...
	I0918 17:02:04.735045   88523 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.3
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 17:02:04.735075   88523 kube-vip.go:115] generating kube-vip config ...
	I0918 17:02:04.735113   88523 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 17:02:04.751022   88523 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:02:04.751100   88523 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 17:02:04.751163   88523 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 17:02:04.762324   88523 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 17:02:04.762394   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
	I0918 17:02:04.772244   88523 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0918 17:02:04.792115   88523 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 17:02:04.812418   88523 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 17:02:04.831828   88523 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 17:02:04.835579   88523 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:02:04.848821   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:02:04.970270   88523 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:02:04.984165   88523 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:02:04.984487   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:04.987586   88523 out.go:179] * Verifying Kubernetes components...
	I0918 17:02:04.988873   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:02:05.103279   88523 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:02:05.116687   88523 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	W0918 17:02:05.116759   88523 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.49.254:8443 with https://192.168.49.2:8443
	I0918 17:02:05.117030   88523 node_ready.go:35] waiting up to 6m0s for node "ha-078118-m02" to be "Ready" ...
	I0918 17:02:05.126204   88523 node_ready.go:49] node "ha-078118-m02" is "Ready"
	I0918 17:02:05.126229   88523 node_ready.go:38] duration metric: took 9.18178ms for node "ha-078118-m02" to be "Ready" ...
	I0918 17:02:05.126242   88523 api_server.go:52] waiting for apiserver process to appear ...
	I0918 17:02:05.126286   88523 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:02:05.138174   88523 api_server.go:72] duration metric: took 153.959457ms to wait for apiserver process to appear ...
	I0918 17:02:05.138199   88523 api_server.go:88] waiting for apiserver healthz status ...
	I0918 17:02:05.138219   88523 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0918 17:02:05.143842   88523 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0918 17:02:05.144983   88523 api_server.go:141] control plane version: v1.34.0
	I0918 17:02:05.145013   88523 api_server.go:131] duration metric: took 6.806624ms to wait for apiserver health ...
	I0918 17:02:05.145024   88523 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 17:02:05.151629   88523 system_pods.go:59] 24 kube-system pods found
	I0918 17:02:05.151671   88523 system_pods.go:61] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:02:05.151682   88523 system_pods.go:61] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:02:05.151698   88523 system_pods.go:61] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:02:05.151709   88523 system_pods.go:61] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:02:05.151716   88523 system_pods.go:61] "etcd-ha-078118-m03" [ef27a91e-a220-4dcb-885c-2941742d985e] Running
	I0918 17:02:05.151723   88523 system_pods.go:61] "kindnet-f2b4b" [98c5afc6-e57e-488c-948a-e24ec24b97a7] Running
	I0918 17:02:05.151729   88523 system_pods.go:61] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 17:02:05.151736   88523 system_pods.go:61] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 17:02:05.151747   88523 system_pods.go:61] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:02:05.151761   88523 system_pods.go:61] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:02:05.151771   88523 system_pods.go:61] "kube-apiserver-ha-078118-m03" [1cc265d4-6f02-4291-b218-cfa76bcf557f] Running
	I0918 17:02:05.151784   88523 system_pods.go:61] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:02:05.151796   88523 system_pods.go:61] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:02:05.151805   88523 system_pods.go:61] "kube-controller-manager-ha-078118-m03" [43309df5-32b3-4ca8-a0a0-23bfcaac2138] Running
	I0918 17:02:05.151812   88523 system_pods.go:61] "kube-proxy-2pjrn" [490f3965-2c3c-42d8-89b3-d3d599ebf60e] Running
	I0918 17:02:05.151817   88523 system_pods.go:61] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 17:02:05.151823   88523 system_pods.go:61] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 17:02:05.151839   88523 system_pods.go:61] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:02:05.151856   88523 system_pods.go:61] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:02:05.151865   88523 system_pods.go:61] "kube-scheduler-ha-078118-m03" [93dfed73-cd97-4f3f-804e-ffdd528fd8ff] Running
	I0918 17:02:05.151872   88523 system_pods.go:61] "kube-vip-ha-078118" [d3c28c72-f791-4e3f-bd5f-91fc9bcb1fee] Running
	I0918 17:02:05.151880   88523 system_pods.go:61] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 17:02:05.151884   88523 system_pods.go:61] "kube-vip-ha-078118-m03" [919fbb1f-4ca4-41e2-a8f7-6d2c73f81558] Running
	I0918 17:02:05.151890   88523 system_pods.go:61] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 17:02:05.151899   88523 system_pods.go:74] duration metric: took 6.86776ms to wait for pod list to return data ...
	I0918 17:02:05.151913   88523 default_sa.go:34] waiting for default service account to be created ...
	I0918 17:02:05.155271   88523 default_sa.go:45] found service account: "default"
	I0918 17:02:05.155311   88523 default_sa.go:55] duration metric: took 3.373656ms for default service account to be created ...
	I0918 17:02:05.155323   88523 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 17:02:05.161172   88523 system_pods.go:86] 24 kube-system pods found
	I0918 17:02:05.161213   88523 system_pods.go:89] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:02:05.161226   88523 system_pods.go:89] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:02:05.161239   88523 system_pods.go:89] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:02:05.161252   88523 system_pods.go:89] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:02:05.161258   88523 system_pods.go:89] "etcd-ha-078118-m03" [ef27a91e-a220-4dcb-885c-2941742d985e] Running
	I0918 17:02:05.161268   88523 system_pods.go:89] "kindnet-f2b4b" [98c5afc6-e57e-488c-948a-e24ec24b97a7] Running
	I0918 17:02:05.161273   88523 system_pods.go:89] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 17:02:05.161281   88523 system_pods.go:89] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 17:02:05.161291   88523 system_pods.go:89] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:02:05.161310   88523 system_pods.go:89] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:02:05.161317   88523 system_pods.go:89] "kube-apiserver-ha-078118-m03" [1cc265d4-6f02-4291-b218-cfa76bcf557f] Running
	I0918 17:02:05.161326   88523 system_pods.go:89] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:02:05.161338   88523 system_pods.go:89] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:02:05.161347   88523 system_pods.go:89] "kube-controller-manager-ha-078118-m03" [43309df5-32b3-4ca8-a0a0-23bfcaac2138] Running
	I0918 17:02:05.161356   88523 system_pods.go:89] "kube-proxy-2pjrn" [490f3965-2c3c-42d8-89b3-d3d599ebf60e] Running
	I0918 17:02:05.161362   88523 system_pods.go:89] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 17:02:05.161368   88523 system_pods.go:89] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 17:02:05.161376   88523 system_pods.go:89] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:02:05.161388   88523 system_pods.go:89] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:02:05.161397   88523 system_pods.go:89] "kube-scheduler-ha-078118-m03" [93dfed73-cd97-4f3f-804e-ffdd528fd8ff] Running
	I0918 17:02:05.161403   88523 system_pods.go:89] "kube-vip-ha-078118" [d3c28c72-f791-4e3f-bd5f-91fc9bcb1fee] Running
	I0918 17:02:05.161408   88523 system_pods.go:89] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 17:02:05.161415   88523 system_pods.go:89] "kube-vip-ha-078118-m03" [919fbb1f-4ca4-41e2-a8f7-6d2c73f81558] Running
	I0918 17:02:05.161420   88523 system_pods.go:89] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 17:02:05.161430   88523 system_pods.go:126] duration metric: took 6.100358ms to wait for k8s-apps to be running ...
	I0918 17:02:05.161440   88523 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 17:02:05.161516   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:02:05.177297   88523 system_svc.go:56] duration metric: took 15.845414ms WaitForService to wait for kubelet
	I0918 17:02:05.177334   88523 kubeadm.go:578] duration metric: took 193.125652ms to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:02:05.177354   88523 node_conditions.go:102] verifying NodePressure condition ...
	I0918 17:02:05.185021   88523 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:02:05.185063   88523 node_conditions.go:123] node cpu capacity is 8
	I0918 17:02:05.185079   88523 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:02:05.185084   88523 node_conditions.go:123] node cpu capacity is 8
	I0918 17:02:05.185089   88523 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:02:05.185094   88523 node_conditions.go:123] node cpu capacity is 8
	I0918 17:02:05.185100   88523 node_conditions.go:105] duration metric: took 7.739153ms to run NodePressure ...
	I0918 17:02:05.185116   88523 start.go:241] waiting for startup goroutines ...
	I0918 17:02:05.185151   88523 start.go:255] writing updated cluster config ...
	I0918 17:02:05.188016   88523 out.go:203] 
	I0918 17:02:05.189941   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:05.190105   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:02:05.191907   88523 out.go:179] * Starting "ha-078118-m03" control-plane node in "ha-078118" cluster
	I0918 17:02:05.194060   88523 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:02:05.195551   88523 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:02:05.197069   88523 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:02:05.197116   88523 cache.go:58] Caching tarball of preloaded images
	I0918 17:02:05.197212   88523 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:02:05.197242   88523 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:02:05.197264   88523 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:02:05.197414   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:02:05.226983   88523 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:02:05.227006   88523 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:02:05.227018   88523 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:02:05.227040   88523 start.go:360] acquireMachinesLock for ha-078118-m03: {Name:mk9d1c903c967299da898df87db82c277b1f732e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:02:05.227086   88523 start.go:364] duration metric: took 34.168µs to acquireMachinesLock for "ha-078118-m03"
	I0918 17:02:05.227103   88523 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:02:05.227108   88523 fix.go:54] fixHost starting: m03
	I0918 17:02:05.227303   88523 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:02:05.249149   88523 fix.go:112] recreateIfNeeded on ha-078118-m03: state=Stopped err=<nil>
	W0918 17:02:05.249177   88523 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:02:05.250693   88523 out.go:252] * Restarting existing docker container for "ha-078118-m03" ...
	I0918 17:02:05.250758   88523 cli_runner.go:164] Run: docker start ha-078118-m03
	I0918 17:02:05.515973   88523 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:02:05.536187   88523 kic.go:430] container "ha-078118-m03" state is running.
	I0918 17:02:05.536534   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:02:05.558300   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:02:05.558648   88523 machine.go:93] provisionDockerMachine start ...
	I0918 17:02:05.558720   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:05.579338   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:05.579663   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32823 <nil> <nil>}
	I0918 17:02:05.579678   88523 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:02:05.580353   88523 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:45160->127.0.0.1:32823: read: connection reset by peer
	I0918 17:02:08.725772   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m03
	
	I0918 17:02:08.725804   88523 ubuntu.go:182] provisioning hostname "ha-078118-m03"
	I0918 17:02:08.725891   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:08.756666   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:08.756974   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32823 <nil> <nil>}
	I0918 17:02:08.756986   88523 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m03 && echo "ha-078118-m03" | sudo tee /etc/hostname
	I0918 17:02:08.930439   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m03
	
	I0918 17:02:08.930535   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:08.952376   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:08.952708   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32823 <nil> <nil>}
	I0918 17:02:08.952734   88523 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m03' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m03/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m03' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:02:09.100605   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:02:09.100638   88523 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:02:09.100658   88523 ubuntu.go:190] setting up certificates
	I0918 17:02:09.100671   88523 provision.go:84] configureAuth start
	I0918 17:02:09.100729   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:02:09.118862   88523 provision.go:143] copyHostCerts
	I0918 17:02:09.118901   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:02:09.118950   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:02:09.118960   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:02:09.119047   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:02:09.119191   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:02:09.119226   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:02:09.119236   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:02:09.119282   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:02:09.119369   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:02:09.119400   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:02:09.119409   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:02:09.119444   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:02:09.119559   88523 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m03 san=[127.0.0.1 192.168.49.4 ha-078118-m03 localhost minikube]
	I0918 17:02:09.260974   88523 provision.go:177] copyRemoteCerts
	I0918 17:02:09.261051   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:02:09.261103   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:09.280371   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:09.387340   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 17:02:09.387407   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:02:09.416941   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 17:02:09.417026   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 17:02:09.446183   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 17:02:09.446252   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:02:09.471835   88523 provision.go:87] duration metric: took 371.152567ms to configureAuth
	I0918 17:02:09.471860   88523 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:02:09.472058   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:09.472148   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:09.491093   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:09.491339   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32823 <nil> <nil>}
	I0918 17:02:09.491355   88523 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:02:09.891314   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:02:09.891343   88523 machine.go:96] duration metric: took 4.332677043s to provisionDockerMachine
	I0918 17:02:09.891358   88523 start.go:293] postStartSetup for "ha-078118-m03" (driver="docker")
	I0918 17:02:09.891371   88523 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:02:09.891442   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:02:09.891557   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:09.921555   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:10.028567   88523 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:02:10.033858   88523 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:02:10.033897   88523 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:02:10.033910   88523 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:02:10.033918   88523 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:02:10.033932   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:02:10.034000   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:02:10.034430   88523 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:02:10.034444   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 17:02:10.034568   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:02:10.048975   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:02:10.083492   88523 start.go:296] duration metric: took 192.119586ms for postStartSetup
	I0918 17:02:10.083604   88523 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:02:10.083656   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:10.106324   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:10.203785   88523 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:02:10.208849   88523 fix.go:56] duration metric: took 4.981736294s for fixHost
	I0918 17:02:10.208880   88523 start.go:83] releasing machines lock for "ha-078118-m03", held for 4.981783384s
	I0918 17:02:10.209046   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:02:10.233270   88523 out.go:179] * Found network options:
	I0918 17:02:10.234714   88523 out.go:179]   - NO_PROXY=192.168.49.2,192.168.49.3
	W0918 17:02:10.235974   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:02:10.236005   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:02:10.236041   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:02:10.236061   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 17:02:10.236138   88523 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:02:10.236187   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:10.236220   88523 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:02:10.236289   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:10.256738   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:10.257073   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:10.488616   88523 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:02:10.493307   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:02:10.503073   88523 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:02:10.503146   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:02:10.512908   88523 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:02:10.512936   88523 start.go:495] detecting cgroup driver to use...
	I0918 17:02:10.512971   88523 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:02:10.513021   88523 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:02:10.526086   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:02:10.538395   88523 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:02:10.538454   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:02:10.552019   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:02:10.564326   88523 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:02:10.675410   88523 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:02:10.794108   88523 docker.go:234] disabling docker service ...
	I0918 17:02:10.794170   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:02:10.807169   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:02:10.819727   88523 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:02:10.950399   88523 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:02:11.066947   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:02:11.080007   88523 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:02:11.097805   88523 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:02:11.097858   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.108323   88523 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:02:11.108404   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.118846   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.129919   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.140838   88523 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:02:11.150706   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.161419   88523 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.171572   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.182665   88523 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:02:11.192098   88523 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:02:11.201265   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:02:11.313472   88523 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:02:11.558568   88523 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:02:11.558638   88523 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:02:11.562585   88523 start.go:563] Will wait 60s for crictl version
	I0918 17:02:11.562642   88523 ssh_runner.go:195] Run: which crictl
	I0918 17:02:11.566682   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:11.598728   88523 retry.go:31] will retry after 7.956255474s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:11Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	I0918 17:02:19.555680   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:19.587687   88523 retry.go:31] will retry after 9.296604833s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:19Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	I0918 17:02:28.886490   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:28.918087   88523 retry.go:31] will retry after 27.630342902s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:28Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	I0918 17:02:56.549631   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:56.586522   88523 out.go:203] 
	W0918 17:02:56.587940   88523 out.go:285] X Exiting due to RUNTIME_ENABLE: Failed to start container runtime: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:56Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	
	X Exiting due to RUNTIME_ENABLE: Failed to start container runtime: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:56Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	
	W0918 17:02:56.587957   88523 out.go:285] * 
	* 
	W0918 17:02:56.589763   88523 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0918 17:02:56.591335   88523 out.go:203] 

                                                
                                                
** /stderr **
ha_test.go:471: failed to run minikube start. args "out/minikube-linux-amd64 -p ha-078118 node list --alsologtostderr -v 5" : exit status 90
ha_test.go:474: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 node list --alsologtostderr -v 5
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======>  post-mortem[TestMultiControlPlane/serial/RestartClusterKeepsNodes]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======>  post-mortem[TestMultiControlPlane/serial/RestartClusterKeepsNodes]: docker inspect <======
helpers_test.go:239: (dbg) Run:  docker inspect ha-078118
helpers_test.go:243: (dbg) docker inspect ha-078118:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7",
	        "Created": "2025-09-18T16:57:02.681891976Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 88722,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2025-09-18T17:01:49.614080081Z",
	            "FinishedAt": "2025-09-18T17:01:48.970614154Z"
	        },
	        "Image": "sha256:c6b5532e987b5b4f5fc9cb0336e378ed49c0542bad8cbfc564b71e977a6269de",
	        "ResolvConfPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/hostname",
	        "HostsPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/hosts",
	        "LogPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7-json.log",
	        "Name": "/ha-078118",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ha-078118:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "ha-078118",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "private",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 3221225472,
	            "NanoCpus": 0,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 6442450944,
	            "MemorySwappiness": null,
	            "OomKillDisable": null,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "ID": "0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7",
	                "LowerDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91-init/diff:/var/lib/docker/overlay2/1fd2bbb67ab9e5bb8d4549665a1a228eadda56df39fee53908cd735ea16a4e10/diff",
	                "MergedDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/merged",
	                "UpperDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/diff",
	                "WorkDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "ha-078118",
	                "Source": "/var/lib/docker/volumes/ha-078118/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "ha-078118",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ha-078118",
	                "name.minikube.sigs.k8s.io": "ha-078118",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "d7a7374ea2b8ba6f874686045bec8d8d2f4be5c3bb156f797cfc8fe734164d41",
	            "SandboxKey": "/var/run/docker/netns/d7a7374ea2b8",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32813"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32814"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32817"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32815"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32816"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ha-078118": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "3e:c5:df:f8:cd:13",
	                    "DriverOpts": null,
	                    "GwPriority": 0,
	                    "NetworkID": "0aa191750de6e44eaf49073a9e05a52994c63ccafcb0870d32aaf105d93cb724",
	                    "EndpointID": "ea5d387e75ac6e3dadc6865bf01be750dd4561640b93fb195ebd116b4ff71c26",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "ha-078118",
	                        "0cb187fb2895"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-078118 -n ha-078118
helpers_test.go:252: <<< TestMultiControlPlane/serial/RestartClusterKeepsNodes FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======>  post-mortem[TestMultiControlPlane/serial/RestartClusterKeepsNodes]: minikube logs <======
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p ha-078118 logs -n 25: (1.173213818s)
helpers_test.go:260: TestMultiControlPlane/serial/RestartClusterKeepsNodes logs: 
-- stdout --
	
	==> Audit <==
	┌─────────┬──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬───────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
	│ COMMAND │                                                                 ARGS                                                                 │  PROFILE  │  USER   │ VERSION │     START TIME      │      END TIME       │
	├─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼───────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
	│ cp      │ ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118-m02:/home/docker/cp-test_ha-078118-m03_ha-078118-m02.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m02 sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m02.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ cp      │ ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118-m04:/home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp testdata/cp-test.txt ha-078118-m04:/home/docker/cp-test.txt                                                             │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1931775572/001/cp-test_ha-078118-m04.txt │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118:/home/docker/cp-test_ha-078118-m04_ha-078118.txt                       │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118.txt                                                 │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m02:/home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m02 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m03:/home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ node    │ ha-078118 node stop m02 --alsologtostderr -v 5                                                                                       │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ node    │ ha-078118 node start m02 --alsologtostderr -v 5                                                                                      │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ node    │ ha-078118 node list --alsologtostderr -v 5                                                                                           │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:01 UTC │                     │
	│ stop    │ ha-078118 stop --alsologtostderr -v 5                                                                                                │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:01 UTC │ 18 Sep 25 17:01 UTC │
	│ start   │ ha-078118 start --wait true --alsologtostderr -v 5                                                                                   │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:01 UTC │                     │
	│ node    │ ha-078118 node list --alsologtostderr -v 5                                                                                           │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:02 UTC │                     │
	└─────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴───────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
	
	
	==> Last Start <==
	Log file created at: 2025/09/18 17:01:49
	Running on machine: ubuntu-20-agent-4
	Binary: Built with gc go1.24.6 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0918 17:01:49.379653   88523 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:01:49.379772   88523 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:01:49.379784   88523 out.go:374] Setting ErrFile to fd 2...
	I0918 17:01:49.379790   88523 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:01:49.380019   88523 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:01:49.380533   88523 out.go:368] Setting JSON to false
	I0918 17:01:49.381592   88523 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":2660,"bootTime":1758212249,"procs":195,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 17:01:49.381686   88523 start.go:140] virtualization: kvm guest
	I0918 17:01:49.384268   88523 out.go:179] * [ha-078118] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 17:01:49.385803   88523 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 17:01:49.385796   88523 notify.go:220] Checking for updates...
	I0918 17:01:49.387397   88523 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 17:01:49.389003   88523 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:01:49.390427   88523 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 17:01:49.391837   88523 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 17:01:49.393281   88523 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 17:01:49.395372   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:49.395474   88523 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 17:01:49.420078   88523 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 17:01:49.420170   88523 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:01:49.475997   88523 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:0 ContainersPaused:0 ContainersStopped:4 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 17:01:49.466272836 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:01:49.476147   88523 docker.go:318] overlay module found
	I0918 17:01:49.478189   88523 out.go:179] * Using the docker driver based on existing profile
	I0918 17:01:49.479694   88523 start.go:304] selected driver: docker
	I0918 17:01:49.479717   88523 start.go:924] validating driver "docker" against &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNam
es:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false
inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:
false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:01:49.479869   88523 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 17:01:49.479962   88523 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:01:49.539423   88523 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:0 ContainersPaused:0 ContainersStopped:4 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 17:01:49.529122726 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:01:49.540463   88523 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:01:49.540514   88523 cni.go:84] Creating CNI manager for ""
	I0918 17:01:49.540617   88523 cni.go:136] multinode detected (4 nodes found), recommending kindnet
	I0918 17:01:49.540690   88523 start.go:348] cluster config:
	{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: N
etworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubef
low:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Static
IP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:01:49.542911   88523 out.go:179] * Starting "ha-078118" primary control-plane node in "ha-078118" cluster
	I0918 17:01:49.544389   88523 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:01:49.545792   88523 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:01:49.547204   88523 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:01:49.547272   88523 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
	I0918 17:01:49.547302   88523 cache.go:58] Caching tarball of preloaded images
	I0918 17:01:49.547351   88523 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:01:49.547411   88523 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:01:49.547426   88523 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:01:49.547600   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:49.567461   88523 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:01:49.567478   88523 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:01:49.567515   88523 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:01:49.567543   88523 start.go:360] acquireMachinesLock for ha-078118: {Name:mk24a1b2c9ed1c42e9ffd635727b36c75401a437 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:01:49.567596   88523 start.go:364] duration metric: took 39.11µs to acquireMachinesLock for "ha-078118"
	I0918 17:01:49.567613   88523 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:01:49.567618   88523 fix.go:54] fixHost starting: 
	I0918 17:01:49.567821   88523 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:01:49.585475   88523 fix.go:112] recreateIfNeeded on ha-078118: state=Stopped err=<nil>
	W0918 17:01:49.585550   88523 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:01:49.587651   88523 out.go:252] * Restarting existing docker container for "ha-078118" ...
	I0918 17:01:49.587728   88523 cli_runner.go:164] Run: docker start ha-078118
	I0918 17:01:49.825406   88523 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:01:49.844741   88523 kic.go:430] container "ha-078118" state is running.
	I0918 17:01:49.845091   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:01:49.864909   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:49.865148   88523 machine.go:93] provisionDockerMachine start ...
	I0918 17:01:49.865211   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:49.884562   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:49.884789   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32813 <nil> <nil>}
	I0918 17:01:49.884809   88523 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:01:49.885517   88523 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:54636->127.0.0.1:32813: read: connection reset by peer
	I0918 17:01:53.023917   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 17:01:53.023947   88523 ubuntu.go:182] provisioning hostname "ha-078118"
	I0918 17:01:53.024015   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:53.042995   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:53.043252   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32813 <nil> <nil>}
	I0918 17:01:53.043274   88523 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118 && echo "ha-078118" | sudo tee /etc/hostname
	I0918 17:01:53.192161   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 17:01:53.192246   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:53.210910   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:53.211146   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32813 <nil> <nil>}
	I0918 17:01:53.211164   88523 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:01:53.348813   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:01:53.348841   88523 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:01:53.348884   88523 ubuntu.go:190] setting up certificates
	I0918 17:01:53.348896   88523 provision.go:84] configureAuth start
	I0918 17:01:53.348954   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:01:53.367869   88523 provision.go:143] copyHostCerts
	I0918 17:01:53.367917   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:01:53.367947   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:01:53.367963   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:01:53.368042   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:01:53.368157   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:01:53.368180   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:01:53.368186   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:01:53.368215   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:01:53.368277   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:01:53.368294   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:01:53.368300   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:01:53.368323   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:01:53.368389   88523 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118 san=[127.0.0.1 192.168.49.2 ha-078118 localhost minikube]
	I0918 17:01:53.505620   88523 provision.go:177] copyRemoteCerts
	I0918 17:01:53.505678   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:01:53.505710   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:53.524161   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:53.622628   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 17:01:53.622691   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:01:53.648566   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 17:01:53.648617   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)
	I0918 17:01:53.673434   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 17:01:53.673543   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:01:53.697938   88523 provision.go:87] duration metric: took 349.03073ms to configureAuth
	I0918 17:01:53.697966   88523 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:01:53.698195   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:53.698301   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:53.716437   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:53.716667   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32813 <nil> <nil>}
	I0918 17:01:53.716687   88523 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:01:54.060620   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:01:54.060651   88523 machine.go:96] duration metric: took 4.195487726s to provisionDockerMachine
	I0918 17:01:54.060665   88523 start.go:293] postStartSetup for "ha-078118" (driver="docker")
	I0918 17:01:54.060679   88523 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:01:54.060754   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:01:54.060810   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:54.081141   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:54.178371   88523 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:01:54.182063   88523 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:01:54.182105   88523 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:01:54.182113   88523 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:01:54.182119   88523 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:01:54.182128   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:01:54.182193   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:01:54.182333   88523 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:01:54.182355   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 17:01:54.182483   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:01:54.191863   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:01:54.217237   88523 start.go:296] duration metric: took 156.554854ms for postStartSetup
	I0918 17:01:54.217324   88523 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:01:54.217390   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:54.236238   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:54.329749   88523 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:01:54.334136   88523 fix.go:56] duration metric: took 4.766511986s for fixHost
	I0918 17:01:54.334163   88523 start.go:83] releasing machines lock for "ha-078118", held for 4.766557228s
	I0918 17:01:54.334217   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:01:54.351968   88523 ssh_runner.go:195] Run: cat /version.json
	I0918 17:01:54.352015   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:54.352066   88523 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:01:54.352121   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:54.371203   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:54.371672   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:54.463754   88523 ssh_runner.go:195] Run: systemctl --version
	I0918 17:01:54.535544   88523 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:01:54.676680   88523 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:01:54.681529   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:01:54.690765   88523 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:01:54.690857   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:01:54.700127   88523 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:01:54.700153   88523 start.go:495] detecting cgroup driver to use...
	I0918 17:01:54.700180   88523 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:01:54.700215   88523 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:01:54.712746   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:01:54.724661   88523 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:01:54.724728   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:01:54.737819   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:01:54.750395   88523 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:01:54.815179   88523 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:01:54.880585   88523 docker.go:234] disabling docker service ...
	I0918 17:01:54.880655   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:01:54.893483   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:01:54.905105   88523 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:01:54.970982   88523 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:01:55.036251   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:01:55.047926   88523 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:01:55.064969   88523 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:01:55.065039   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.075907   88523 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:01:55.075961   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.086186   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.096182   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.106316   88523 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:01:55.116742   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.127414   88523 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.137571   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.147863   88523 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:01:55.156583   88523 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:01:55.165138   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:01:55.228262   88523 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:01:55.328023   88523 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:01:55.328125   88523 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:01:55.332040   88523 start.go:563] Will wait 60s for crictl version
	I0918 17:01:55.332103   88523 ssh_runner.go:195] Run: which crictl
	I0918 17:01:55.335544   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:01:55.370764   88523 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 17:01:55.370835   88523 ssh_runner.go:195] Run: crio --version
	I0918 17:01:55.407074   88523 ssh_runner.go:195] Run: crio --version
	I0918 17:01:55.445239   88523 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 17:01:55.446549   88523 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:01:55.463986   88523 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 17:01:55.467838   88523 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:01:55.479645   88523 kubeadm.go:875] updating cluster {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIP
s:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-ga
dget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQ
emuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0918 17:01:55.479776   88523 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:01:55.479825   88523 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:01:55.521370   88523 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:01:55.521391   88523 crio.go:433] Images already preloaded, skipping extraction
	I0918 17:01:55.521435   88523 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:01:55.554619   88523 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:01:55.554641   88523 cache_images.go:85] Images are preloaded, skipping loading
	I0918 17:01:55.554650   88523 kubeadm.go:926] updating node { 192.168.49.2 8443 v1.34.0 crio true true} ...
	I0918 17:01:55.554740   88523 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 17:01:55.554809   88523 ssh_runner.go:195] Run: crio config
	I0918 17:01:55.597150   88523 cni.go:84] Creating CNI manager for ""
	I0918 17:01:55.597170   88523 cni.go:136] multinode detected (4 nodes found), recommending kindnet
	I0918 17:01:55.597182   88523 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0918 17:01:55.597201   88523 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.34.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-078118 NodeName:ha-078118 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manif
ests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0918 17:01:55.597323   88523 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "ha-078118"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.49.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	kubernetesVersion: v1.34.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: systemd
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0918 17:01:55.597340   88523 kube-vip.go:115] generating kube-vip config ...
	I0918 17:01:55.597387   88523 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 17:01:55.610040   88523 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:01:55.610150   88523 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 17:01:55.610202   88523 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 17:01:55.619652   88523 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 17:01:55.619730   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
	I0918 17:01:55.629065   88523 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (359 bytes)
	I0918 17:01:55.647817   88523 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 17:01:55.666322   88523 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2205 bytes)
	I0918 17:01:55.685799   88523 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 17:01:55.705367   88523 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 17:01:55.709566   88523 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:01:55.722362   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:01:55.784601   88523 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:01:55.808023   88523 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.2
	I0918 17:01:55.808042   88523 certs.go:194] generating shared ca certs ...
	I0918 17:01:55.808072   88523 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:55.808221   88523 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 17:01:55.808270   88523 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 17:01:55.808280   88523 certs.go:256] generating profile certs ...
	I0918 17:01:55.808359   88523 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 17:01:55.808395   88523 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.c944a3f3
	I0918 17:01:55.808410   88523 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.c944a3f3 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.3 192.168.49.4 192.168.49.254]
	I0918 17:01:56.210331   88523 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.c944a3f3 ...
	I0918 17:01:56.210365   88523 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.c944a3f3: {Name:mkb79a1de8248bd79832f6910fea7ba45af90c6a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.210571   88523 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.c944a3f3 ...
	I0918 17:01:56.210590   88523 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.c944a3f3: {Name:mkee19f1232c09da0d47765b6f3756d6bcdf1995 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.210674   88523 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.c944a3f3 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 17:01:56.210811   88523 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.c944a3f3 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 17:01:56.210938   88523 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 17:01:56.210952   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 17:01:56.210965   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 17:01:56.210976   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 17:01:56.210987   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 17:01:56.210997   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 17:01:56.211031   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 17:01:56.211043   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 17:01:56.211055   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 17:01:56.211116   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 17:01:56.211142   88523 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 17:01:56.211151   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 17:01:56.211172   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 17:01:56.211193   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 17:01:56.211213   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 17:01:56.211248   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:01:56.211275   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 17:01:56.211290   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 17:01:56.211302   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:01:56.211913   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 17:01:56.237934   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 17:01:56.263651   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 17:01:56.288002   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 17:01:56.314861   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
	I0918 17:01:56.340356   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 17:01:56.370284   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 17:01:56.398212   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 17:01:56.432277   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 17:01:56.471393   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 17:01:56.507057   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 17:01:56.541863   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0918 17:01:56.570235   88523 ssh_runner.go:195] Run: openssl version
	I0918 17:01:56.577129   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 17:01:56.588470   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 17:01:56.592889   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 17:01:56.592948   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 17:01:56.600490   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 17:01:56.610210   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 17:01:56.620549   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 17:01:56.624511   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 17:01:56.624575   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 17:01:56.632301   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 17:01:56.642250   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 17:01:56.652289   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:01:56.656446   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:01:56.656530   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:01:56.664059   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 17:01:56.673942   88523 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 17:01:56.678148   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0918 17:01:56.685430   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0918 17:01:56.692331   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0918 17:01:56.699250   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0918 17:01:56.706155   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0918 17:01:56.713040   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0918 17:01:56.719862   88523 kubeadm.go:392] StartCluster: {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[
] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadge
t:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemu
FirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:01:56.720000   88523 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0918 17:01:56.720046   88523 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0918 17:01:56.758372   88523 cri.go:89] found id: "1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5"
	I0918 17:01:56.758399   88523 cri.go:89] found id: "d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd"
	I0918 17:01:56.758404   88523 cri.go:89] found id: "47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67"
	I0918 17:01:56.758409   88523 cri.go:89] found id: "1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156"
	I0918 17:01:56.758413   88523 cri.go:89] found id: "f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a"
	I0918 17:01:56.758417   88523 cri.go:89] found id: ""
	I0918 17:01:56.758462   88523 ssh_runner.go:195] Run: sudo runc list -f json
	I0918 17:01:56.780084   88523 cri.go:116] JSON = [{"ociVersion":"1.0.2-dev","id":"1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5","pid":904,"status":"running","bundle":"/run/containers/storage/overlay-containers/1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5/userdata","rootfs":"/var/lib/containers/storage/overlay/9c71e033c7f3d6a01ab02e2f4462648d32830be6c4d23a4db21a231f88ff347b/merged","created":"2025-09-18T17:01:56.483000594Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"7eaa1830","io.kubernetes.container.name":"kube-controller-manager","io.kubernetes.container.ports":"[{\"name\":\"probe-port\",\"hostPort\":10257,\"containerPort\":10257,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"7eaa1830\",\"io.kubernetes.contai
ner.ports\":\"[{\\\"name\\\":\\\"probe-port\\\",\\\"hostPort\\\":10257,\\\"containerPort\\\":10257,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.414440268Z","io.kubernetes.cri-o.Image":"a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-controller-manager:v1.34.0","io.kubernetes.cri-o.ImageRef":"a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-controller-manager\",\"io.kubernetes.pod.name\":\"kube-controller-manager-ha-078118\",\"io.kube
rnetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"295d4b0a8fb5b6e3839f92f4ba9ebb80\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-controller-manager-ha-078118_295d4b0a8fb5b6e3839f92f4ba9ebb80/kube-controller-manager/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-controller-manager\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/9c71e033c7f3d6a01ab02e2f4462648d32830be6c4d23a4db21a231f88ff347b/merged","io.kubernetes.cri-o.Name":"k8s_kube-controller-manager_kube-controller-manager-ha-078118_kube-system_295d4b0a8fb5b6e3839f92f4ba9ebb80_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/bc00758e6c8406d5f266c3138b612bd3922701154711f59957fe39c69c66e540/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"bc00758e6c8406d5f266c3138b612bd3922701154711f59957fe39c69c66e540","io.kubernetes.cri-o.SandboxName":"k8s_kube-controller-manager-ha-078118_kube-system_295d4b0a8fb5b6e3839f92f4ba9ebb80_0","io.kubernetes
.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/ca-certificates\",\"host_path\":\"/etc/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/295d4b0a8fb5b6e3839f92f4ba9ebb80/containers/kube-controller-manager/72ee19b7\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/295d4b0a8fb5b6e3839f92f4ba9ebb80/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/ssl/certs\",\"host_path\":\"/etc/ssl/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/kubernetes/controller-manager.conf\",\"host_path\":\"/etc/kubernetes/controller-manager.conf\",\"readonly\":true,\"propagation\":0,\"se
linux_relabel\":false},{\"container_path\":\"/usr/share/ca-certificates\",\"host_path\":\"/usr/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/certs\",\"host_path\":\"/var/lib/minikube/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/local/share/ca-certificates\",\"host_path\":\"/usr/local/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/libexec/kubernetes/kubelet-plugins/volume/exec\",\"host_path\":\"/usr/libexec/kubernetes/kubelet-plugins/volume/exec\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-controller-manager-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"295d4b0a8fb5b6e3839f92f4ba9ebb80","kubernetes.io/config.hash":"295d4b0a8fb5b6e3839f92f4ba9ebb80","kubernetes.io/config.seen":"20
25-09-18T17:01:55.876115131Z","kubernetes.io/config.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependencies":"true","org.systemd.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156","pid":849,"status":"running","bundle":"/run/containers/storage/overlay-containers/1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156/userdata","rootfs":"/var/lib/containers/storage/overlay/9a05cb7fea32dc9ddf7a008a2caeccd14f1a898a68a3dd3ddbf49586836e44b4/merged","created":"2025-09-18T17:01:56.440722069Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"d64ad60b","io.kubernetes.container.name":"kube-vip","io.kubernetes.container.restartCount":"0","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kub
ernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"d64ad60b\",\"io.kubernetes.container.restartCount\":\"0\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.395408441Z","io.kubernetes.cri-o.Image":"765655ea6078171c416896d7cc155c1263a0411d30caaa03d7365aecb99fdf23","io.kubernetes.cri-o.ImageName":"ghcr.io/kube-vip/kube-vip:v1.0.0","io.kubernetes.cri-o.ImageRef":"765655ea6078171c416896d7cc155c1263a0411d30caaa03d7365aecb99fdf23","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-vip\",\"io.kubernetes.pod.name\":\"kube-vip-ha-078118\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"b5f2d8fa1610d58f11008a293d2cb33c\"}
","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-vip-ha-078118_b5f2d8fa1610d58f11008a293d2cb33c/kube-vip/0.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-vip\"}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/9a05cb7fea32dc9ddf7a008a2caeccd14f1a898a68a3dd3ddbf49586836e44b4/merged","io.kubernetes.cri-o.Name":"k8s_kube-vip_kube-vip-ha-078118_kube-system_b5f2d8fa1610d58f11008a293d2cb33c_0","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/30db82bb4c1ecf3da0c6fc497ad269f656085bac7f95a7fe045a62d4257a5f44/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"30db82bb4c1ecf3da0c6fc497ad269f656085bac7f95a7fe045a62d4257a5f44","io.kubernetes.cri-o.SandboxName":"k8s_kube-vip-ha-078118_kube-system_b5f2d8fa1610d58f11008a293d2cb33c_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/hosts\"
,\"host_path\":\"/var/lib/kubelet/pods/b5f2d8fa1610d58f11008a293d2cb33c/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/b5f2d8fa1610d58f11008a293d2cb33c/containers/kube-vip/ce75abae\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/kubernetes/admin.conf\",\"host_path\":\"/etc/kubernetes/admin.conf\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-vip-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"b5f2d8fa1610d58f11008a293d2cb33c","kubernetes.io/config.hash":"b5f2d8fa1610d58f11008a293d2cb33c","kubernetes.io/config.seen":"2025-09-18T17:01:55.876125807Z","kubernetes.io/config.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependenci
es":"true","org.systemd.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67","pid":885,"status":"running","bundle":"/run/containers/storage/overlay-containers/47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67/userdata","rootfs":"/var/lib/containers/storage/overlay/8e8b1e7cd8a289c8374f9b6257c15f074ae0f3c0cebbc0ba3761dd50fedae849/merged","created":"2025-09-18T17:01:56.465937045Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"85eae708","io.kubernetes.container.name":"kube-scheduler","io.kubernetes.container.ports":"[{\"name\":\"probe-port\",\"hostPort\":10259,\"containerPort\":10259,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"85eae708\",\"io.
kubernetes.container.ports\":\"[{\\\"name\\\":\\\"probe-port\\\",\\\"hostPort\\\":10259,\\\"containerPort\\\":10259,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.399734521Z","io.kubernetes.cri-o.Image":"46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-scheduler:v1.34.0","io.kubernetes.cri-o.ImageRef":"46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-scheduler\",\"io.kubernetes.pod.name\":\"kube-scheduler-ha-078118\",\"io.kubernetes.pod
.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"eef6954c295df14c6ded36d455ae3f64\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-scheduler-ha-078118_eef6954c295df14c6ded36d455ae3f64/kube-scheduler/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-scheduler\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/8e8b1e7cd8a289c8374f9b6257c15f074ae0f3c0cebbc0ba3761dd50fedae849/merged","io.kubernetes.cri-o.Name":"k8s_kube-scheduler_kube-scheduler-ha-078118_kube-system_eef6954c295df14c6ded36d455ae3f64_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/0b0c119de2a5e95db0b47c45e75dd2a09a0606aba44508db81678b39fd38137d/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"0b0c119de2a5e95db0b47c45e75dd2a09a0606aba44508db81678b39fd38137d","io.kubernetes.cri-o.SandboxName":"k8s_kube-scheduler-ha-078118_kube-system_eef6954c295df14c6ded36d455ae3f64_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false
","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/eef6954c295df14c6ded36d455ae3f64/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/eef6954c295df14c6ded36d455ae3f64/containers/kube-scheduler/3ee75ede\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/kubernetes/scheduler.conf\",\"host_path\":\"/etc/kubernetes/scheduler.conf\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-scheduler-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"eef6954c295df14c6ded36d455ae3f64","kubernetes.io/config.hash":"eef6954c295df14c6ded36d455ae3f64","kubernetes.io/config.seen":"2025-09-18T17:01:55.876124510Z","kubernetes.io/config
.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependencies":"true","org.systemd.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd","pid":895,"status":"running","bundle":"/run/containers/storage/overlay-containers/d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd/userdata","rootfs":"/var/lib/containers/storage/overlay/e609e9e46a7b4349013bb25dc88f625f340af02c9dc300f5dad6685070fd74b2/merged","created":"2025-09-18T17:01:56.468173373Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"d671eaa0","io.kubernetes.container.name":"kube-apiserver","io.kubernetes.container.ports":"[{\"name\":\"probe-port\",\"hostPort\":8443,\"containerPort\":8443,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/ter
mination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"d671eaa0\",\"io.kubernetes.container.ports\":\"[{\\\"name\\\":\\\"probe-port\\\",\\\"hostPort\\\":8443,\\\"containerPort\\\":8443,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.400849867Z","io.kubernetes.cri-o.Image":"90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-apiserver:v1.34.0","io.kubernetes.cri-o.ImageRef":"90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90","
io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-apiserver\",\"io.kubernetes.pod.name\":\"kube-apiserver-ha-078118\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"eab4cb22d09eb9c837e45b2e0c5fc664\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-apiserver-ha-078118_eab4cb22d09eb9c837e45b2e0c5fc664/kube-apiserver/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-apiserver\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/e609e9e46a7b4349013bb25dc88f625f340af02c9dc300f5dad6685070fd74b2/merged","io.kubernetes.cri-o.Name":"k8s_kube-apiserver_kube-apiserver-ha-078118_kube-system_eab4cb22d09eb9c837e45b2e0c5fc664_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/27ab8b84a9d30c714c81b49dbcbf9e1787031ad0f6c46d6f231d0b79f94b32f5/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"27ab8b84a9d30c714c81b49dbcbf9e1787031ad0f6c46d6f231d0b79f94b32f5","io.kubernetes.cri-o.SandboxName"
:"k8s_kube-apiserver-ha-078118_kube-system_eab4cb22d09eb9c837e45b2e0c5fc664_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/eab4cb22d09eb9c837e45b2e0c5fc664/containers/kube-apiserver/764ef81a\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/ca-certificates\",\"host_path\":\"/etc/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/eab4cb22d09eb9c837e45b2e0c5fc664/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/share/ca-certificates\",\"host_path\":\"/usr/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/ssl/certs\",\"host_path\":\
"/etc/ssl/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/certs\",\"host_path\":\"/var/lib/minikube/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/local/share/ca-certificates\",\"host_path\":\"/usr/local/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-apiserver-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"eab4cb22d09eb9c837e45b2e0c5fc664","kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.49.2:8443","kubernetes.io/config.hash":"eab4cb22d09eb9c837e45b2e0c5fc664","kubernetes.io/config.seen":"2025-09-18T17:01:55.876112955Z","kubernetes.io/config.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependencies":"true","org.system
d.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a","pid":832,"status":"running","bundle":"/run/containers/storage/overlay-containers/f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a/userdata","rootfs":"/var/lib/containers/storage/overlay/ef7555194ebc8c68b1cc9488dbf8f557c6e739f666631cf9b320b2dc5b85a30d/merged","created":"2025-09-18T17:01:56.443422336Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"e9e20c65","io.kubernetes.container.name":"etcd","io.kubernetes.container.ports":"[{\"name\":\"probe-port\",\"hostPort\":2381,\"containerPort\":2381,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"e9e20c65\",\"io.kubernetes.container.ports\":\"[{\
\\"name\\\":\\\"probe-port\\\",\\\"hostPort\\\":2381,\\\"containerPort\\\":2381,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.368917103Z","io.kubernetes.cri-o.Image":"5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115","io.kubernetes.cri-o.ImageName":"registry.k8s.io/etcd:3.6.4-0","io.kubernetes.cri-o.ImageRef":"5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"etcd\",\"io.kubernetes.pod.name\":\"etcd-ha-078118\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"c844ac4cd
3d56ebd5831bc0d85f91b01\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_etcd-ha-078118_c844ac4cd3d56ebd5831bc0d85f91b01/etcd/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"etcd\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/ef7555194ebc8c68b1cc9488dbf8f557c6e739f666631cf9b320b2dc5b85a30d/merged","io.kubernetes.cri-o.Name":"k8s_etcd_etcd-ha-078118_kube-system_c844ac4cd3d56ebd5831bc0d85f91b01_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/392032ae1b29544e24d0d98943a7310ad13f5d12f0c5be5a121d7418fe388e2c/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"392032ae1b29544e24d0d98943a7310ad13f5d12f0c5be5a121d7418fe388e2c","io.kubernetes.cri-o.SandboxName":"k8s_etcd-ha-078118_kube-system_c844ac4cd3d56ebd5831bc0d85f91b01_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\
":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/c844ac4cd3d56ebd5831bc0d85f91b01/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/c844ac4cd3d56ebd5831bc0d85f91b01/containers/etcd/129e1cf5\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/etcd\",\"host_path\":\"/var/lib/minikube/etcd\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/certs/etcd\",\"host_path\":\"/var/lib/minikube/certs/etcd\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"etcd-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"c844ac4cd3d56ebd5831bc0d85f91b01","kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.49.2:2379","kubernetes.io/config.hash":"c844ac4cd3d56ebd5831bc0d85f91b01",
"kubernetes.io/config.seen":"2025-09-18T17:01:55.876108105Z","kubernetes.io/config.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependencies":"true","org.systemd.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"}]
	I0918 17:01:56.780559   88523 cri.go:126] list returned 5 containers
	I0918 17:01:56.780578   88523 cri.go:129] container: {ID:1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5 Status:running}
	I0918 17:01:56.780593   88523 cri.go:135] skipping {1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5 running}: state = "running", want "paused"
	I0918 17:01:56.780608   88523 cri.go:129] container: {ID:1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156 Status:running}
	I0918 17:01:56.780614   88523 cri.go:135] skipping {1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156 running}: state = "running", want "paused"
	I0918 17:01:56.780622   88523 cri.go:129] container: {ID:47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67 Status:running}
	I0918 17:01:56.780627   88523 cri.go:135] skipping {47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67 running}: state = "running", want "paused"
	I0918 17:01:56.780635   88523 cri.go:129] container: {ID:d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd Status:running}
	I0918 17:01:56.780640   88523 cri.go:135] skipping {d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd running}: state = "running", want "paused"
	I0918 17:01:56.780648   88523 cri.go:129] container: {ID:f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a Status:running}
	I0918 17:01:56.780654   88523 cri.go:135] skipping {f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a running}: state = "running", want "paused"
	I0918 17:01:56.780711   88523 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0918 17:01:56.790261   88523 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0918 17:01:56.790289   88523 kubeadm.go:589] restartPrimaryControlPlane start ...
	I0918 17:01:56.790351   88523 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0918 17:01:56.799692   88523 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:01:56.800125   88523 kubeconfig.go:47] verify endpoint returned: get endpoint: "ha-078118" does not appear in /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:01:56.800245   88523 kubeconfig.go:62] /home/jenkins/minikube-integration/20370-7845/kubeconfig needs updating (will repair): [kubeconfig missing "ha-078118" cluster setting kubeconfig missing "ha-078118" context setting]
	I0918 17:01:56.800516   88523 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.800988   88523 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, Us
erAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0918 17:01:56.801446   88523 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
	I0918 17:01:56.801466   88523 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I0918 17:01:56.801472   88523 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
	I0918 17:01:56.801477   88523 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I0918 17:01:56.801483   88523 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
	I0918 17:01:56.801488   88523 cert_rotation.go:141] "Starting client certificate rotation controller" logger="tls-transport-cache"
	I0918 17:01:56.801819   88523 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0918 17:01:56.811376   88523 kubeadm.go:626] The running cluster does not require reconfiguration: 192.168.49.2
	I0918 17:01:56.811406   88523 kubeadm.go:593] duration metric: took 21.110094ms to restartPrimaryControlPlane
	I0918 17:01:56.811418   88523 kubeadm.go:394] duration metric: took 91.570194ms to StartCluster
	I0918 17:01:56.811440   88523 settings.go:142] acquiring lock: {Name:mk72fea03aefe901db9522a467405d86665fedd0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.811525   88523 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:01:56.812011   88523 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.812251   88523 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:01:56.812273   88523 start.go:241] waiting for startup goroutines ...
	I0918 17:01:56.812281   88523 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0918 17:01:56.812548   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:56.818560   88523 out.go:179] * Enabled addons: 
	I0918 17:01:56.819862   88523 addons.go:514] duration metric: took 7.577022ms for enable addons: enabled=[]
	I0918 17:01:56.819895   88523 start.go:246] waiting for cluster config update ...
	I0918 17:01:56.819902   88523 start.go:255] writing updated cluster config ...
	I0918 17:01:56.821358   88523 out.go:203] 
	I0918 17:01:56.822838   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:56.822935   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:56.824668   88523 out.go:179] * Starting "ha-078118-m02" control-plane node in "ha-078118" cluster
	I0918 17:01:56.826202   88523 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:01:56.827692   88523 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:01:56.829025   88523 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:01:56.829052   88523 cache.go:58] Caching tarball of preloaded images
	I0918 17:01:56.829116   88523 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:01:56.829157   88523 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:01:56.829174   88523 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:01:56.829286   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:56.852123   88523 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:01:56.852147   88523 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:01:56.852166   88523 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:01:56.852198   88523 start.go:360] acquireMachinesLock for ha-078118-m02: {Name:mk65f6a883861f2032241e1132c63effea2ab61f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:01:56.852266   88523 start.go:364] duration metric: took 48.677µs to acquireMachinesLock for "ha-078118-m02"
	I0918 17:01:56.852296   88523 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:01:56.852306   88523 fix.go:54] fixHost starting: m02
	I0918 17:01:56.852668   88523 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:01:56.872076   88523 fix.go:112] recreateIfNeeded on ha-078118-m02: state=Stopped err=<nil>
	W0918 17:01:56.872113   88523 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:01:56.874087   88523 out.go:252] * Restarting existing docker container for "ha-078118-m02" ...
	I0918 17:01:56.874180   88523 cli_runner.go:164] Run: docker start ha-078118-m02
	I0918 17:01:57.139627   88523 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:01:57.162974   88523 kic.go:430] container "ha-078118-m02" state is running.
	I0918 17:01:57.163617   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:01:57.187278   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:57.187580   88523 machine.go:93] provisionDockerMachine start ...
	I0918 17:01:57.187647   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:01:57.208558   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:57.208807   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32818 <nil> <nil>}
	I0918 17:01:57.208821   88523 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:01:57.209542   88523 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:35706->127.0.0.1:32818: read: connection reset by peer
	I0918 17:02:00.346412   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 17:02:00.346437   88523 ubuntu.go:182] provisioning hostname "ha-078118-m02"
	I0918 17:02:00.346489   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:00.364917   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:00.365177   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32818 <nil> <nil>}
	I0918 17:02:00.365191   88523 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m02 && echo "ha-078118-m02" | sudo tee /etc/hostname
	I0918 17:02:00.514327   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 17:02:00.514402   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:00.533549   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:00.533751   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32818 <nil> <nil>}
	I0918 17:02:00.533768   88523 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m02' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m02/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m02' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:02:00.670395   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:02:00.670429   88523 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:02:00.670444   88523 ubuntu.go:190] setting up certificates
	I0918 17:02:00.670453   88523 provision.go:84] configureAuth start
	I0918 17:02:00.670535   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:02:00.688318   88523 provision.go:143] copyHostCerts
	I0918 17:02:00.688353   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:02:00.688380   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:02:00.688388   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:02:00.688466   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:02:00.688593   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:02:00.688616   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:02:00.688621   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:02:00.688655   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:02:00.688706   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:02:00.688723   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:02:00.688727   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:02:00.688752   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:02:00.688815   88523 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m02 san=[127.0.0.1 192.168.49.3 ha-078118-m02 localhost minikube]
	I0918 17:02:01.100643   88523 provision.go:177] copyRemoteCerts
	I0918 17:02:01.100699   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:02:01.100739   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:01.128283   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:01.233731   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 17:02:01.233795   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:02:01.267239   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 17:02:01.267312   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 17:02:01.299631   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 17:02:01.299701   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:02:01.333166   88523 provision.go:87] duration metric: took 662.697168ms to configureAuth
	I0918 17:02:01.333201   88523 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:02:01.333436   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:01.333668   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:01.355891   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:01.356100   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32818 <nil> <nil>}
	I0918 17:02:01.356116   88523 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:02:01.803484   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:02:01.803598   88523 machine.go:96] duration metric: took 4.615990236s to provisionDockerMachine
	I0918 17:02:01.803617   88523 start.go:293] postStartSetup for "ha-078118-m02" (driver="docker")
	I0918 17:02:01.803631   88523 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:02:01.803737   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:02:01.803809   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:01.824810   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:01.943231   88523 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:02:01.949156   88523 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:02:01.949190   88523 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:02:01.949200   88523 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:02:01.949208   88523 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:02:01.949221   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:02:01.949294   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:02:01.949388   88523 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:02:01.949398   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 17:02:01.949539   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:02:01.964224   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:02:02.000604   88523 start.go:296] duration metric: took 196.969548ms for postStartSetup
	I0918 17:02:02.000678   88523 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:02:02.000709   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:02.024047   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:02.125240   88523 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:02:02.131938   88523 fix.go:56] duration metric: took 5.279624751s for fixHost
	I0918 17:02:02.131967   88523 start.go:83] releasing machines lock for "ha-078118-m02", held for 5.279686169s
	I0918 17:02:02.132049   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:02:02.156676   88523 out.go:179] * Found network options:
	I0918 17:02:02.157902   88523 out.go:179]   - NO_PROXY=192.168.49.2
	W0918 17:02:02.159818   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:02:02.159872   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 17:02:02.159952   88523 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:02:02.160020   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:02.160303   88523 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:02:02.160395   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:02.186312   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:02.187028   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:02.428885   88523 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:02:02.434009   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:02:02.444157   88523 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:02:02.444228   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:02:02.454051   88523 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:02:02.454077   88523 start.go:495] detecting cgroup driver to use...
	I0918 17:02:02.454114   88523 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:02:02.454162   88523 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:02:02.466948   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:02:02.478891   88523 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:02:02.478957   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:02:02.491961   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:02:02.504752   88523 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:02:02.594029   88523 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:02:02.701933   88523 docker.go:234] disabling docker service ...
	I0918 17:02:02.702003   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:02:02.717057   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:02:02.731660   88523 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:02:02.853518   88523 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:02:02.996040   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:02:03.016174   88523 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:02:03.045704   88523 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:02:03.045764   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.061608   88523 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:02:03.061695   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.083523   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.105214   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.120699   88523 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:02:03.138140   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.162450   88523 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.182797   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.204229   88523 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:02:03.218676   88523 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:02:03.234833   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:02:03.414424   88523 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:02:03.681075   88523 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:02:03.681172   88523 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:02:03.685900   88523 start.go:563] Will wait 60s for crictl version
	I0918 17:02:03.685976   88523 ssh_runner.go:195] Run: which crictl
	I0918 17:02:03.689938   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:03.732205   88523 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 17:02:03.732322   88523 ssh_runner.go:195] Run: crio --version
	I0918 17:02:03.780573   88523 ssh_runner.go:195] Run: crio --version
	I0918 17:02:03.836328   88523 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 17:02:03.837848   88523 out.go:179]   - env NO_PROXY=192.168.49.2
	I0918 17:02:03.839158   88523 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:02:03.863484   88523 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 17:02:03.869490   88523 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:02:03.885574   88523 mustload.go:65] Loading cluster: ha-078118
	I0918 17:02:03.885865   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:03.886138   88523 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:02:03.910178   88523 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:02:03.910520   88523 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.3
	I0918 17:02:03.910532   88523 certs.go:194] generating shared ca certs ...
	I0918 17:02:03.910550   88523 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:02:03.910702   88523 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 17:02:03.910746   88523 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 17:02:03.910754   88523 certs.go:256] generating profile certs ...
	I0918 17:02:03.910869   88523 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 17:02:03.910966   88523 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.e3295e3c
	I0918 17:02:03.911006   88523 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 17:02:03.911015   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 17:02:03.911031   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 17:02:03.911045   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 17:02:03.911062   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 17:02:03.911076   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 17:02:03.911090   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 17:02:03.911111   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 17:02:03.911124   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 17:02:03.911179   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 17:02:03.911212   88523 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 17:02:03.911222   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 17:02:03.911254   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 17:02:03.911281   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 17:02:03.911326   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 17:02:03.911397   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:02:03.911438   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 17:02:03.911459   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:02:03.911472   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 17:02:03.911547   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:02:03.946173   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:02:04.042870   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
	I0918 17:02:04.047477   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
	I0918 17:02:04.062496   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
	I0918 17:02:04.066022   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
	I0918 17:02:04.079216   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
	I0918 17:02:04.082987   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
	I0918 17:02:04.096266   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
	I0918 17:02:04.099842   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)
	I0918 17:02:04.114219   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
	I0918 17:02:04.117647   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
	I0918 17:02:04.130510   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
	I0918 17:02:04.134062   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
	I0918 17:02:04.148209   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 17:02:04.175449   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 17:02:04.202169   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 17:02:04.229482   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 17:02:04.256335   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
	I0918 17:02:04.282706   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 17:02:04.310591   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 17:02:04.337521   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 17:02:04.364519   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 17:02:04.390068   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 17:02:04.417491   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 17:02:04.443222   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
	I0918 17:02:04.463097   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
	I0918 17:02:04.483042   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
	I0918 17:02:04.502767   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)
	I0918 17:02:04.522870   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
	I0918 17:02:04.541750   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
	I0918 17:02:04.561986   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
	I0918 17:02:04.581734   88523 ssh_runner.go:195] Run: openssl version
	I0918 17:02:04.587350   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 17:02:04.597650   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 17:02:04.601731   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 17:02:04.601792   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 17:02:04.609763   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 17:02:04.619714   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 17:02:04.630360   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 17:02:04.634287   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 17:02:04.634340   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 17:02:04.641345   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 17:02:04.652864   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 17:02:04.664993   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:02:04.668853   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:02:04.668927   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:02:04.676354   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 17:02:04.686228   88523 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 17:02:04.690454   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0918 17:02:04.697758   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0918 17:02:04.705195   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0918 17:02:04.713070   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0918 17:02:04.720155   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0918 17:02:04.727534   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0918 17:02:04.734944   88523 kubeadm.go:926] updating node {m02 192.168.49.3 8443 v1.34.0 crio true true} ...
	I0918 17:02:04.735045   88523 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.3
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 17:02:04.735075   88523 kube-vip.go:115] generating kube-vip config ...
	I0918 17:02:04.735113   88523 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 17:02:04.751022   88523 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:02:04.751100   88523 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 17:02:04.751163   88523 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 17:02:04.762324   88523 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 17:02:04.762394   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
	I0918 17:02:04.772244   88523 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0918 17:02:04.792115   88523 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 17:02:04.812418   88523 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 17:02:04.831828   88523 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 17:02:04.835579   88523 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:02:04.848821   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:02:04.970270   88523 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:02:04.984165   88523 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:02:04.984487   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:04.987586   88523 out.go:179] * Verifying Kubernetes components...
	I0918 17:02:04.988873   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:02:05.103279   88523 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:02:05.116687   88523 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	W0918 17:02:05.116759   88523 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.49.254:8443 with https://192.168.49.2:8443
	I0918 17:02:05.117030   88523 node_ready.go:35] waiting up to 6m0s for node "ha-078118-m02" to be "Ready" ...
	I0918 17:02:05.126204   88523 node_ready.go:49] node "ha-078118-m02" is "Ready"
	I0918 17:02:05.126229   88523 node_ready.go:38] duration metric: took 9.18178ms for node "ha-078118-m02" to be "Ready" ...
	I0918 17:02:05.126242   88523 api_server.go:52] waiting for apiserver process to appear ...
	I0918 17:02:05.126286   88523 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:02:05.138174   88523 api_server.go:72] duration metric: took 153.959457ms to wait for apiserver process to appear ...
	I0918 17:02:05.138199   88523 api_server.go:88] waiting for apiserver healthz status ...
	I0918 17:02:05.138219   88523 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0918 17:02:05.143842   88523 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0918 17:02:05.144983   88523 api_server.go:141] control plane version: v1.34.0
	I0918 17:02:05.145013   88523 api_server.go:131] duration metric: took 6.806624ms to wait for apiserver health ...
	I0918 17:02:05.145024   88523 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 17:02:05.151629   88523 system_pods.go:59] 24 kube-system pods found
	I0918 17:02:05.151671   88523 system_pods.go:61] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:02:05.151682   88523 system_pods.go:61] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:02:05.151698   88523 system_pods.go:61] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:02:05.151709   88523 system_pods.go:61] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:02:05.151716   88523 system_pods.go:61] "etcd-ha-078118-m03" [ef27a91e-a220-4dcb-885c-2941742d985e] Running
	I0918 17:02:05.151723   88523 system_pods.go:61] "kindnet-f2b4b" [98c5afc6-e57e-488c-948a-e24ec24b97a7] Running
	I0918 17:02:05.151729   88523 system_pods.go:61] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 17:02:05.151736   88523 system_pods.go:61] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 17:02:05.151747   88523 system_pods.go:61] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:02:05.151761   88523 system_pods.go:61] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:02:05.151771   88523 system_pods.go:61] "kube-apiserver-ha-078118-m03" [1cc265d4-6f02-4291-b218-cfa76bcf557f] Running
	I0918 17:02:05.151784   88523 system_pods.go:61] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:02:05.151796   88523 system_pods.go:61] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:02:05.151805   88523 system_pods.go:61] "kube-controller-manager-ha-078118-m03" [43309df5-32b3-4ca8-a0a0-23bfcaac2138] Running
	I0918 17:02:05.151812   88523 system_pods.go:61] "kube-proxy-2pjrn" [490f3965-2c3c-42d8-89b3-d3d599ebf60e] Running
	I0918 17:02:05.151817   88523 system_pods.go:61] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 17:02:05.151823   88523 system_pods.go:61] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 17:02:05.151839   88523 system_pods.go:61] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:02:05.151856   88523 system_pods.go:61] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:02:05.151865   88523 system_pods.go:61] "kube-scheduler-ha-078118-m03" [93dfed73-cd97-4f3f-804e-ffdd528fd8ff] Running
	I0918 17:02:05.151872   88523 system_pods.go:61] "kube-vip-ha-078118" [d3c28c72-f791-4e3f-bd5f-91fc9bcb1fee] Running
	I0918 17:02:05.151880   88523 system_pods.go:61] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 17:02:05.151884   88523 system_pods.go:61] "kube-vip-ha-078118-m03" [919fbb1f-4ca4-41e2-a8f7-6d2c73f81558] Running
	I0918 17:02:05.151890   88523 system_pods.go:61] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 17:02:05.151899   88523 system_pods.go:74] duration metric: took 6.86776ms to wait for pod list to return data ...
	I0918 17:02:05.151913   88523 default_sa.go:34] waiting for default service account to be created ...
	I0918 17:02:05.155271   88523 default_sa.go:45] found service account: "default"
	I0918 17:02:05.155311   88523 default_sa.go:55] duration metric: took 3.373656ms for default service account to be created ...
	I0918 17:02:05.155323   88523 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 17:02:05.161172   88523 system_pods.go:86] 24 kube-system pods found
	I0918 17:02:05.161213   88523 system_pods.go:89] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:02:05.161226   88523 system_pods.go:89] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:02:05.161239   88523 system_pods.go:89] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:02:05.161252   88523 system_pods.go:89] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:02:05.161258   88523 system_pods.go:89] "etcd-ha-078118-m03" [ef27a91e-a220-4dcb-885c-2941742d985e] Running
	I0918 17:02:05.161268   88523 system_pods.go:89] "kindnet-f2b4b" [98c5afc6-e57e-488c-948a-e24ec24b97a7] Running
	I0918 17:02:05.161273   88523 system_pods.go:89] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 17:02:05.161281   88523 system_pods.go:89] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 17:02:05.161291   88523 system_pods.go:89] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:02:05.161310   88523 system_pods.go:89] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:02:05.161317   88523 system_pods.go:89] "kube-apiserver-ha-078118-m03" [1cc265d4-6f02-4291-b218-cfa76bcf557f] Running
	I0918 17:02:05.161326   88523 system_pods.go:89] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:02:05.161338   88523 system_pods.go:89] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:02:05.161347   88523 system_pods.go:89] "kube-controller-manager-ha-078118-m03" [43309df5-32b3-4ca8-a0a0-23bfcaac2138] Running
	I0918 17:02:05.161356   88523 system_pods.go:89] "kube-proxy-2pjrn" [490f3965-2c3c-42d8-89b3-d3d599ebf60e] Running
	I0918 17:02:05.161362   88523 system_pods.go:89] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 17:02:05.161368   88523 system_pods.go:89] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 17:02:05.161376   88523 system_pods.go:89] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:02:05.161388   88523 system_pods.go:89] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:02:05.161397   88523 system_pods.go:89] "kube-scheduler-ha-078118-m03" [93dfed73-cd97-4f3f-804e-ffdd528fd8ff] Running
	I0918 17:02:05.161403   88523 system_pods.go:89] "kube-vip-ha-078118" [d3c28c72-f791-4e3f-bd5f-91fc9bcb1fee] Running
	I0918 17:02:05.161408   88523 system_pods.go:89] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 17:02:05.161415   88523 system_pods.go:89] "kube-vip-ha-078118-m03" [919fbb1f-4ca4-41e2-a8f7-6d2c73f81558] Running
	I0918 17:02:05.161420   88523 system_pods.go:89] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 17:02:05.161430   88523 system_pods.go:126] duration metric: took 6.100358ms to wait for k8s-apps to be running ...
	I0918 17:02:05.161440   88523 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 17:02:05.161516   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:02:05.177297   88523 system_svc.go:56] duration metric: took 15.845414ms WaitForService to wait for kubelet
	I0918 17:02:05.177334   88523 kubeadm.go:578] duration metric: took 193.125652ms to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:02:05.177354   88523 node_conditions.go:102] verifying NodePressure condition ...
	I0918 17:02:05.185021   88523 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:02:05.185063   88523 node_conditions.go:123] node cpu capacity is 8
	I0918 17:02:05.185079   88523 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:02:05.185084   88523 node_conditions.go:123] node cpu capacity is 8
	I0918 17:02:05.185089   88523 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:02:05.185094   88523 node_conditions.go:123] node cpu capacity is 8
	I0918 17:02:05.185100   88523 node_conditions.go:105] duration metric: took 7.739153ms to run NodePressure ...
	I0918 17:02:05.185116   88523 start.go:241] waiting for startup goroutines ...
	I0918 17:02:05.185151   88523 start.go:255] writing updated cluster config ...
	I0918 17:02:05.188016   88523 out.go:203] 
	I0918 17:02:05.189941   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:05.190105   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:02:05.191907   88523 out.go:179] * Starting "ha-078118-m03" control-plane node in "ha-078118" cluster
	I0918 17:02:05.194060   88523 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:02:05.195551   88523 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:02:05.197069   88523 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:02:05.197116   88523 cache.go:58] Caching tarball of preloaded images
	I0918 17:02:05.197212   88523 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:02:05.197242   88523 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:02:05.197264   88523 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:02:05.197414   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:02:05.226983   88523 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:02:05.227006   88523 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:02:05.227018   88523 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:02:05.227040   88523 start.go:360] acquireMachinesLock for ha-078118-m03: {Name:mk9d1c903c967299da898df87db82c277b1f732e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:02:05.227086   88523 start.go:364] duration metric: took 34.168µs to acquireMachinesLock for "ha-078118-m03"
	I0918 17:02:05.227103   88523 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:02:05.227108   88523 fix.go:54] fixHost starting: m03
	I0918 17:02:05.227303   88523 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:02:05.249149   88523 fix.go:112] recreateIfNeeded on ha-078118-m03: state=Stopped err=<nil>
	W0918 17:02:05.249177   88523 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:02:05.250693   88523 out.go:252] * Restarting existing docker container for "ha-078118-m03" ...
	I0918 17:02:05.250758   88523 cli_runner.go:164] Run: docker start ha-078118-m03
	I0918 17:02:05.515973   88523 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:02:05.536187   88523 kic.go:430] container "ha-078118-m03" state is running.
	I0918 17:02:05.536534   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:02:05.558300   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:02:05.558648   88523 machine.go:93] provisionDockerMachine start ...
	I0918 17:02:05.558720   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:05.579338   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:05.579663   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32823 <nil> <nil>}
	I0918 17:02:05.579678   88523 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:02:05.580353   88523 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:45160->127.0.0.1:32823: read: connection reset by peer
	I0918 17:02:08.725772   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m03
	
	I0918 17:02:08.725804   88523 ubuntu.go:182] provisioning hostname "ha-078118-m03"
	I0918 17:02:08.725891   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:08.756666   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:08.756974   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32823 <nil> <nil>}
	I0918 17:02:08.756986   88523 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m03 && echo "ha-078118-m03" | sudo tee /etc/hostname
	I0918 17:02:08.930439   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m03
	
	I0918 17:02:08.930535   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:08.952376   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:08.952708   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32823 <nil> <nil>}
	I0918 17:02:08.952734   88523 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m03' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m03/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m03' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:02:09.100605   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:02:09.100638   88523 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:02:09.100658   88523 ubuntu.go:190] setting up certificates
	I0918 17:02:09.100671   88523 provision.go:84] configureAuth start
	I0918 17:02:09.100729   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:02:09.118862   88523 provision.go:143] copyHostCerts
	I0918 17:02:09.118901   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:02:09.118950   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:02:09.118960   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:02:09.119047   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:02:09.119191   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:02:09.119226   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:02:09.119236   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:02:09.119282   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:02:09.119369   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:02:09.119400   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:02:09.119409   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:02:09.119444   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:02:09.119559   88523 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m03 san=[127.0.0.1 192.168.49.4 ha-078118-m03 localhost minikube]
	I0918 17:02:09.260974   88523 provision.go:177] copyRemoteCerts
	I0918 17:02:09.261051   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:02:09.261103   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:09.280371   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:09.387340   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 17:02:09.387407   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:02:09.416941   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 17:02:09.417026   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 17:02:09.446183   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 17:02:09.446252   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:02:09.471835   88523 provision.go:87] duration metric: took 371.152567ms to configureAuth
	I0918 17:02:09.471860   88523 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:02:09.472058   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:09.472148   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:09.491093   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:09.491339   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32823 <nil> <nil>}
	I0918 17:02:09.491355   88523 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:02:09.891314   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:02:09.891343   88523 machine.go:96] duration metric: took 4.332677043s to provisionDockerMachine
	I0918 17:02:09.891358   88523 start.go:293] postStartSetup for "ha-078118-m03" (driver="docker")
	I0918 17:02:09.891371   88523 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:02:09.891442   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:02:09.891557   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:09.921555   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:10.028567   88523 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:02:10.033858   88523 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:02:10.033897   88523 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:02:10.033910   88523 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:02:10.033918   88523 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:02:10.033932   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:02:10.034000   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:02:10.034430   88523 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:02:10.034444   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 17:02:10.034568   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:02:10.048975   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:02:10.083492   88523 start.go:296] duration metric: took 192.119586ms for postStartSetup
	I0918 17:02:10.083604   88523 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:02:10.083656   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:10.106324   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:10.203785   88523 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:02:10.208849   88523 fix.go:56] duration metric: took 4.981736294s for fixHost
	I0918 17:02:10.208880   88523 start.go:83] releasing machines lock for "ha-078118-m03", held for 4.981783384s
	I0918 17:02:10.209046   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:02:10.233270   88523 out.go:179] * Found network options:
	I0918 17:02:10.234714   88523 out.go:179]   - NO_PROXY=192.168.49.2,192.168.49.3
	W0918 17:02:10.235974   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:02:10.236005   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:02:10.236041   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:02:10.236061   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 17:02:10.236138   88523 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:02:10.236187   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:10.236220   88523 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:02:10.236289   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:10.256738   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:10.257073   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:10.488616   88523 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:02:10.493307   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:02:10.503073   88523 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:02:10.503146   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:02:10.512908   88523 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:02:10.512936   88523 start.go:495] detecting cgroup driver to use...
	I0918 17:02:10.512971   88523 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:02:10.513021   88523 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:02:10.526086   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:02:10.538395   88523 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:02:10.538454   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:02:10.552019   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:02:10.564326   88523 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:02:10.675410   88523 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:02:10.794108   88523 docker.go:234] disabling docker service ...
	I0918 17:02:10.794170   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:02:10.807169   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:02:10.819727   88523 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:02:10.950399   88523 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:02:11.066947   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:02:11.080007   88523 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:02:11.097805   88523 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:02:11.097858   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.108323   88523 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:02:11.108404   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.118846   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.129919   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.140838   88523 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:02:11.150706   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.161419   88523 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.171572   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.182665   88523 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:02:11.192098   88523 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:02:11.201265   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:02:11.313472   88523 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:02:11.558568   88523 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:02:11.558638   88523 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:02:11.562585   88523 start.go:563] Will wait 60s for crictl version
	I0918 17:02:11.562642   88523 ssh_runner.go:195] Run: which crictl
	I0918 17:02:11.566682   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:11.598728   88523 retry.go:31] will retry after 7.956255474s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:11Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	I0918 17:02:19.555680   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:19.587687   88523 retry.go:31] will retry after 9.296604833s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:19Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	I0918 17:02:28.886490   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:28.918087   88523 retry.go:31] will retry after 27.630342902s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:28Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	I0918 17:02:56.549631   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:56.586522   88523 out.go:203] 
	W0918 17:02:56.587940   88523 out.go:285] X Exiting due to RUNTIME_ENABLE: Failed to start container runtime: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:56Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	
	W0918 17:02:56.587957   88523 out.go:285] * 
	W0918 17:02:56.589763   88523 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0918 17:02:56.591335   88523 out.go:203] 
	
	
	==> CRI-O <==
	Sep 18 17:02:03 ha-078118 crio[549]: time="2025-09-18 17:02:03.811347096Z" level=info msg="Starting container: d92258dd572ded142a5afbc78cddf28ea3a1121361d80dd2d867608475828e4a" id=8115de31-b905-4c44-be83-2e1dc5ae61e2 name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 17:02:03 ha-078118 crio[549]: time="2025-09-18 17:02:03.819400964Z" level=info msg="Started container" PID=1478 containerID=d92258dd572ded142a5afbc78cddf28ea3a1121361d80dd2d867608475828e4a description=kube-system/coredns-66bc5c9577-q42l7/coredns id=8115de31-b905-4c44-be83-2e1dc5ae61e2 name=/runtime.v1.RuntimeService/StartContainer sandboxID=e25b7987fbe82c34850efe4599b33978de254f3bebde7f1907d83368cf585ecd
	Sep 18 17:02:13 ha-078118 crio[549]: time="2025-09-18 17:02:13.708391367Z" level=info msg="CNI monitoring event \"/etc/cni/net.d/10-kindnet.conflist.temp\": CREATE"
	Sep 18 17:02:13 ha-078118 crio[549]: time="2025-09-18 17:02:13.713356288Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
	Sep 18 17:02:13 ha-078118 crio[549]: time="2025-09-18 17:02:13.713389341Z" level=info msg="Updated default CNI network name to kindnet"
	Sep 18 17:02:13 ha-078118 crio[549]: time="2025-09-18 17:02:13.713403800Z" level=info msg="CNI monitoring event \"/etc/cni/net.d/10-kindnet.conflist.temp\": WRITE"
	Sep 18 17:02:13 ha-078118 crio[549]: time="2025-09-18 17:02:13.717212844Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
	Sep 18 17:02:13 ha-078118 crio[549]: time="2025-09-18 17:02:13.717246992Z" level=info msg="Updated default CNI network name to kindnet"
	Sep 18 17:02:13 ha-078118 crio[549]: time="2025-09-18 17:02:13.717260409Z" level=info msg="CNI monitoring event \"/etc/cni/net.d/10-kindnet.conflist.temp\": RENAME"
	Sep 18 17:02:13 ha-078118 crio[549]: time="2025-09-18 17:02:13.721129228Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
	Sep 18 17:02:13 ha-078118 crio[549]: time="2025-09-18 17:02:13.721156306Z" level=info msg="Updated default CNI network name to kindnet"
	Sep 18 17:02:13 ha-078118 crio[549]: time="2025-09-18 17:02:13.721172168Z" level=info msg="CNI monitoring event \"/etc/cni/net.d/10-kindnet.conflist\": CREATE"
	Sep 18 17:02:13 ha-078118 crio[549]: time="2025-09-18 17:02:13.725052599Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
	Sep 18 17:02:13 ha-078118 crio[549]: time="2025-09-18 17:02:13.725088093Z" level=info msg="Updated default CNI network name to kindnet"
	Sep 18 17:02:33 ha-078118 crio[549]: time="2025-09-18 17:02:33.993559522Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=33bb583e-9655-4bda-9dc3-01376a95e571 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:02:33 ha-078118 crio[549]: time="2025-09-18 17:02:33.993801727Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,RepoTags:[gcr.io/k8s-minikube/storage-provisioner:v5],RepoDigests:[gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944 gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f],Size_:31470524,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=33bb583e-9655-4bda-9dc3-01376a95e571 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:02:33 ha-078118 crio[549]: time="2025-09-18 17:02:33.994562679Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=680ea2c4-9499-42b9-992e-42940cc0fde6 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:02:33 ha-078118 crio[549]: time="2025-09-18 17:02:33.994900404Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,RepoTags:[gcr.io/k8s-minikube/storage-provisioner:v5],RepoDigests:[gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944 gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f],Size_:31470524,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=680ea2c4-9499-42b9-992e-42940cc0fde6 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:02:33 ha-078118 crio[549]: time="2025-09-18 17:02:33.995766433Z" level=info msg="Creating container: kube-system/storage-provisioner/storage-provisioner" id=7cf4fcf0-05ec-4d9c-a8bd-1fd7e24bab81 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 17:02:33 ha-078118 crio[549]: time="2025-09-18 17:02:33.995866042Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 17:02:34 ha-078118 crio[549]: time="2025-09-18 17:02:34.008197976Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/6d0d4af0c593e32ab97ea672de993c225d4c778215833355b13ce047dc7729ae/merged/etc/passwd: no such file or directory"
	Sep 18 17:02:34 ha-078118 crio[549]: time="2025-09-18 17:02:34.008235580Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/6d0d4af0c593e32ab97ea672de993c225d4c778215833355b13ce047dc7729ae/merged/etc/group: no such file or directory"
	Sep 18 17:02:34 ha-078118 crio[549]: time="2025-09-18 17:02:34.059681894Z" level=info msg="Created container c5306bc68997539c87c2f87a4d32cb06fd7438b16669456d394f1cf8ae4fb842: kube-system/storage-provisioner/storage-provisioner" id=7cf4fcf0-05ec-4d9c-a8bd-1fd7e24bab81 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 17:02:34 ha-078118 crio[549]: time="2025-09-18 17:02:34.060268712Z" level=info msg="Starting container: c5306bc68997539c87c2f87a4d32cb06fd7438b16669456d394f1cf8ae4fb842" id=8840c728-c65d-4ad8-873e-04b29bd68fcb name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 17:02:34 ha-078118 crio[549]: time="2025-09-18 17:02:34.066403407Z" level=info msg="Started container" PID=1664 containerID=c5306bc68997539c87c2f87a4d32cb06fd7438b16669456d394f1cf8ae4fb842 description=kube-system/storage-provisioner/storage-provisioner id=8840c728-c65d-4ad8-873e-04b29bd68fcb name=/runtime.v1.RuntimeService/StartContainer sandboxID=b81ecaff085b3b8d21b63fb91c35feb7061e0f58a0af5d1c5dacb91a2588e358
	
	
	==> container status <==
	CONTAINER           IMAGE                                                              CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	c5306bc689975       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562   23 seconds ago       Running             storage-provisioner       2                   b81ecaff085b3       storage-provisioner
	d92258dd572de       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969   53 seconds ago       Running             coredns                   1                   e25b7987fbe82       coredns-66bc5c9577-q42l7
	21e20d4ddc753       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969   53 seconds ago       Running             coredns                   1                   a7949d1b05144       coredns-66bc5c9577-g9xk6
	ee4b7f442abce       409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c   54 seconds ago       Running             kindnet-cni               1                   b28207bd36b40       kindnet-vqp76
	21b6ad607723f       df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce   54 seconds ago       Running             kube-proxy                1                   a80daddb8a1b8       kube-proxy-b98xh
	e26adb5e15f89       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562   54 seconds ago       Exited              storage-provisioner       1                   b81ecaff085b3       storage-provisioner
	1116d08ec1d26       a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634   About a minute ago   Running             kube-controller-manager   1                   bc00758e6c840       kube-controller-manager-ha-078118
	d4f5428eab0f2       90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90   About a minute ago   Running             kube-apiserver            1                   27ab8b84a9d30       kube-apiserver-ha-078118
	47b875d1b553d       46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc   About a minute ago   Running             kube-scheduler            1                   0b0c119de2a5e       kube-scheduler-ha-078118
	1fb0f2e98fb3a       765655ea6078171c416896d7cc155c1263a0411d30caaa03d7365aecb99fdf23   About a minute ago   Running             kube-vip                  0                   30db82bb4c1ec       kube-vip-ha-078118
	f91dc53d280e7       5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115   About a minute ago   Running             etcd                      1                   392032ae1b295       etcd-ha-078118
	
	
	==> coredns [21e20d4ddc7530d0ecedda7040a90cb736185c9e2cfa6123c719be543b5f0b45] <==
	maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
	.:53
	[INFO] plugin/reload: Running configuration SHA512 = 9e2996f8cb67ac53e0259ab1f8d615d07d1beb0bd07e6a1e39769c3bf486a905bb991cc47f8d2f14d0d3a90a87dfc625a0b4c524fed169d8158c40657c0694b1
	CoreDNS-1.12.1
	linux/amd64, go1.24.1, 707c7c1
	[INFO] 127.0.0.1:50820 - 24265 "HINFO IN 812459865089642632.5213722986442749200. udp 56 false 512" NXDOMAIN qr,rd,ra 131 0.020389884s
	
	
	==> coredns [d92258dd572ded142a5afbc78cddf28ea3a1121361d80dd2d867608475828e4a] <==
	maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
	.:53
	[INFO] plugin/reload: Running configuration SHA512 = 9e2996f8cb67ac53e0259ab1f8d615d07d1beb0bd07e6a1e39769c3bf486a905bb991cc47f8d2f14d0d3a90a87dfc625a0b4c524fed169d8158c40657c0694b1
	CoreDNS-1.12.1
	linux/amd64, go1.24.1, 707c7c1
	[INFO] 127.0.0.1:32816 - 43183 "HINFO IN 6715587801686201477.3035471256272355978. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.032152072s
	
	
	==> describe nodes <==
	Name:               ha-078118
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2025_09_18T16_57_20_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:57:14 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:02:52 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 17:02:01 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 17:02:01 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 17:02:01 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 17:02:01 +0000   Thu, 18 Sep 2025 16:57:34 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ha-078118
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 458d106b7f2d49958eb79b0b2fc209fe
	  System UUID:                910bee46-adcd-4833-91ec-cea7d3c2588c
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (10 in total)
	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---
	  kube-system                 coredns-66bc5c9577-g9xk6             100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     5m34s
	  kube-system                 coredns-66bc5c9577-q42l7             100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     5m34s
	  kube-system                 etcd-ha-078118                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         5m38s
	  kube-system                 kindnet-vqp76                        100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      5m34s
	  kube-system                 kube-apiserver-ha-078118             250m (3%)     0 (0%)      0 (0%)           0 (0%)         5m38s
	  kube-system                 kube-controller-manager-ha-078118    200m (2%)     0 (0%)      0 (0%)           0 (0%)         5m38s
	  kube-system                 kube-proxy-b98xh                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m34s
	  kube-system                 kube-scheduler-ha-078118             100m (1%)     0 (0%)      0 (0%)           0 (0%)         5m38s
	  kube-system                 kube-vip-ha-078118                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         55s
	  kube-system                 storage-provisioner                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m34s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (11%)  100m (1%)
	  memory             290Mi (0%)  390Mi (1%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                    From             Message
	  ----    ------                   ----                   ----             -------
	  Normal  Starting                 5m34s                  kube-proxy       
	  Normal  Starting                 54s                    kube-proxy       
	  Normal  NodeHasSufficientPID     5m45s (x8 over 5m45s)  kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  Starting                 5m45s                  kubelet          Starting kubelet.
	  Normal  NodeHasNoDiskPressure    5m45s (x8 over 5m45s)  kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientMemory  5m45s (x8 over 5m45s)  kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  Starting                 5m38s                  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  5m38s                  kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     5m38s                  kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  NodeHasNoDiskPressure    5m38s                  kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  RegisteredNode           5m36s                  node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  NodeReady                5m23s                  kubelet          Node ha-078118 status is now: NodeReady
	  Normal  RegisteredNode           5m9s                   node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           4m5s                   node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           2m28s                  node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  Starting                 62s                    kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  62s (x8 over 62s)      kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    62s (x8 over 62s)      kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     62s (x8 over 62s)      kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           52s                    node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           52s                    node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           45s                    node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	
	
	Name:               ha-078118-m02
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118-m02
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=false
	                    minikube.k8s.io/updated_at=2025_09_18T16_57_51_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:57:50 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118-m02
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:02:53 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 17:02:02 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 17:02:02 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 17:02:02 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 17:02:02 +0000   Thu, 18 Sep 2025 16:58:34 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.3
	  Hostname:    ha-078118-m02
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 3f995e2e4a1c4f75914810fc1dbd193e
	  System UUID:                0093212b-e7dd-4bdc-8376-480f39da7714
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.1.0/24
	PodCIDRs:                     10.244.1.0/24
	Non-terminated Pods:          (9 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     busybox-7b57f96db7-bzrv2                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m44s
	  default                     busybox-7b57f96db7-t7rzr                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m44s
	  kube-system                 etcd-ha-078118-m02                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         5m5s
	  kube-system                 kindnet-jnlbr                            100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      5m7s
	  kube-system                 kube-apiserver-ha-078118-m02             250m (3%)     0 (0%)      0 (0%)           0 (0%)         5m5s
	  kube-system                 kube-controller-manager-ha-078118-m02    200m (2%)     0 (0%)      0 (0%)           0 (0%)         5m5s
	  kube-system                 kube-proxy-t5wdg                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m7s
	  kube-system                 kube-scheduler-ha-078118-m02             100m (1%)     0 (0%)      0 (0%)           0 (0%)         5m5s
	  kube-system                 kube-vip-ha-078118-m02                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m5s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%)   100m (1%)
	  memory             150Mi (0%)  50Mi (0%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                    From             Message
	  ----    ------                   ----                   ----             -------
	  Normal  Starting                 5m3s                   kube-proxy       
	  Normal  RegisteredNode           5m6s                   node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode           5m4s                   node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode           4m5s                   node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  NodeHasSufficientMemory  2m33s (x8 over 2m33s)  kubelet          Node ha-078118-m02 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     2m33s (x8 over 2m33s)  kubelet          Node ha-078118-m02 status is now: NodeHasSufficientPID
	  Normal  NodeHasNoDiskPressure    2m33s (x8 over 2m33s)  kubelet          Node ha-078118-m02 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 2m33s                  kubelet          Starting kubelet.
	  Normal  RegisteredNode           2m28s                  node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  Starting                 60s                    kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  60s (x8 over 60s)      kubelet          Node ha-078118-m02 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    60s (x8 over 60s)      kubelet          Node ha-078118-m02 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     60s (x8 over 60s)      kubelet          Node ha-078118-m02 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           52s                    node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode           52s                    node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode           45s                    node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	
	
	Name:               ha-078118-m03
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118-m03
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=false
	                    minikube.k8s.io/updated_at=2025_09_18T16_58_54_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:58:54 +0000
	Taints:             node.kubernetes.io/not-ready:NoExecute
	                    node.kubernetes.io/not-ready:NoSchedule
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118-m03
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:02:49 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 17:02:49 +0000   Thu, 18 Sep 2025 16:58:54 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 17:02:49 +0000   Thu, 18 Sep 2025 16:58:54 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 17:02:49 +0000   Thu, 18 Sep 2025 16:58:54 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            False   Thu, 18 Sep 2025 17:02:49 +0000   Thu, 18 Sep 2025 17:02:49 +0000   KubeletNotReady              container runtime is down
	Addresses:
	  InternalIP:  192.168.49.4
	  Hostname:    ha-078118-m03
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 71a5c19f35b04f27a99cc5d58abef418
	  System UUID:                aad5bb9a-fbfa-4299-aec8-4ade9724e58c
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://Unknown
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.2.0/24
	PodCIDRs:                     10.244.2.0/24
	Non-terminated Pods:          (8 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     busybox-7b57f96db7-95578                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m44s
	  kube-system                 etcd-ha-078118-m03                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         4m2s
	  kube-system                 kindnet-f2b4b                            100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      4m3s
	  kube-system                 kube-apiserver-ha-078118-m03             250m (3%)     0 (0%)      0 (0%)           0 (0%)         4m2s
	  kube-system                 kube-controller-manager-ha-078118-m03    200m (2%)     0 (0%)      0 (0%)           0 (0%)         4m2s
	  kube-system                 kube-proxy-2pjrn                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m3s
	  kube-system                 kube-scheduler-ha-078118-m03             100m (1%)     0 (0%)      0 (0%)           0 (0%)         4m2s
	  kube-system                 kube-vip-ha-078118-m03                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m2s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%)   100m (1%)
	  memory             150Mi (0%)  50Mi (0%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                From             Message
	  ----    ------                   ----               ----             -------
	  Normal  Starting                 4m1s               kube-proxy       
	  Normal  RegisteredNode           4m                 node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	  Normal  RegisteredNode           4m                 node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	  Normal  RegisteredNode           3m59s              node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	  Normal  RegisteredNode           2m28s              node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	  Normal  RegisteredNode           52s                node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	  Normal  RegisteredNode           52s                node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	  Normal  Starting                 52s                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  51s (x8 over 52s)  kubelet          Node ha-078118-m03 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    51s (x8 over 52s)  kubelet          Node ha-078118-m03 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     51s (x8 over 52s)  kubelet          Node ha-078118-m03 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           45s                node-controller  Node ha-078118-m03 event: Registered Node ha-078118-m03 in Controller
	
	
	==> dmesg <==
	[  +0.089038] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
	[  +0.028015] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
	[  +7.570818] kauditd_printk_skb: 47 callbacks suppressed
	[Sep18 16:41] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.013586] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023854] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023944] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023869] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023927] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000033] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +2.047789] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +4.031621] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000030] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +8.127251] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[Sep18 16:42] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[ +32.253146] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	
	
	==> etcd [f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a] <==
	{"level":"warn","ts":"2025-09-18T17:02:05.278053Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:02:05.278624Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:02:05.278942Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:02:05.292790Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:02:05.294289Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:02:05.297491Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:02:05.304786Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:02:05.307994Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:02:05.312229Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:02:05.313392Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:02:05.320407Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:02:05.342525Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:02:05.344957Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:02:05.356447Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:02:05.358691Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:02:05.369351Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:02:06.575527Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"4e0bda6b41205435","rtt":"0s","error":"dial tcp 192.168.49.4:2380: connect: connection refused"}
	{"level":"warn","ts":"2025-09-18T17:02:06.575554Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"4e0bda6b41205435","rtt":"0s","error":"dial tcp 192.168.49.4:2380: connect: connection refused"}
	{"level":"info","ts":"2025-09-18T17:02:06.683442Z","caller":"rafthttp/stream.go:248","msg":"set message encoder","from":"aec36adc501070cc","to":"4e0bda6b41205435","stream-type":"stream MsgApp v2"}
	{"level":"info","ts":"2025-09-18T17:02:06.683484Z","caller":"rafthttp/peer_status.go:53","msg":"peer became active","peer-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T17:02:06.683539Z","caller":"rafthttp/stream.go:273","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T17:02:06.687334Z","caller":"rafthttp/stream.go:248","msg":"set message encoder","from":"aec36adc501070cc","to":"4e0bda6b41205435","stream-type":"stream Message"}
	{"level":"info","ts":"2025-09-18T17:02:06.687384Z","caller":"rafthttp/stream.go:273","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream Message","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T17:02:06.708205Z","caller":"rafthttp/stream.go:411","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream Message","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	{"level":"info","ts":"2025-09-18T17:02:06.708299Z","caller":"rafthttp/stream.go:411","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	
	
	==> kernel <==
	 17:02:57 up 45 min,  0 users,  load average: 0.63, 0.80, 0.54
	Linux ha-078118 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [ee4b7f442abced82d1215a56d72dcb325957c75eca662f974092a942d3e19c88] <==
	I0918 17:02:13.711151       1 routes.go:62] Adding route {Ifindex: 0 Dst: 10.244.2.0/24 Src: <nil> Gw: 192.168.49.4 Flags: [] Table: 0 Realm: 0} 
	I0918 17:02:23.707720       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:02:23.707760       1 main.go:301] handling current node
	I0918 17:02:23.707773       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:02:23.707778       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:02:23.708023       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 17:02:23.708038       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 17:02:33.717214       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 17:02:33.717248       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 17:02:33.717460       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:02:33.717474       1 main.go:301] handling current node
	I0918 17:02:33.717488       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:02:33.717495       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:02:43.715630       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:02:43.715666       1 main.go:301] handling current node
	I0918 17:02:43.715680       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:02:43.715685       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:02:43.715844       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 17:02:43.715853       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 17:02:53.707928       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:02:53.707982       1 main.go:301] handling current node
	I0918 17:02:53.707996       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:02:53.708001       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:02:53.708180       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 17:02:53.708190       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	
	
	==> kube-apiserver [d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd] <==
	I0918 17:02:01.924107       1 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller"
	I0918 17:02:01.924154       1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
	I0918 17:02:01.924268       1 shared_informer.go:356] "Caches are synced" controller="crd-autoregister"
	I0918 17:02:01.924315       1 aggregator.go:171] initial CRD sync complete...
	I0918 17:02:01.924336       1 autoregister_controller.go:144] Starting autoregister controller
	I0918 17:02:01.924344       1 cache.go:32] Waiting for caches to sync for autoregister controller
	I0918 17:02:01.924356       1 cache.go:39] Caches are synced for autoregister controller
	I0918 17:02:01.924616       1 apf_controller.go:382] Running API Priority and Fairness config worker
	I0918 17:02:01.924627       1 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process
	I0918 17:02:01.925134       1 cache.go:39] Caches are synced for LocalAvailability controller
	I0918 17:02:01.925404       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0918 17:02:01.926298       1 cache.go:39] Caches are synced for RemoteAvailability controller
	I0918 17:02:01.933858       1 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller"
	I0918 17:02:01.935986       1 handler_discovery.go:451] Starting ResourceDiscoveryManager
	W0918 17:02:01.947413       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.49.3]
	I0918 17:02:01.949188       1 controller.go:667] quota admission added evaluator for: endpoints
	I0918 17:02:01.966691       1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
	E0918 17:02:01.974003       1 controller.go:95] Found stale data, removed previous endpoints on kubernetes service, apiserver didn't exit successfully previously
	I0918 17:02:01.981545       1 shared_informer.go:356] "Caches are synced" controller="node_authorizer"
	I0918 17:02:02.059433       1 controller.go:667] quota admission added evaluator for: serviceaccounts
	I0918 17:02:02.827879       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
	W0918 17:02:03.384540       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.49.2]
	I0918 17:02:05.265843       1 controller.go:667] quota admission added evaluator for: replicasets.apps
	I0918 17:02:07.416458       1 controller.go:667] quota admission added evaluator for: deployments.apps
	I0918 17:02:09.060071       1 controller.go:667] quota admission added evaluator for: daemonsets.apps
	
	
	==> kube-controller-manager [1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5] <==
	I0918 17:02:05.247881       1 shared_informer.go:356] "Caches are synced" controller="legacy-service-account-token-cleaner"
	I0918 17:02:05.259351       1 shared_informer.go:356] "Caches are synced" controller="attach detach"
	I0918 17:02:05.259374       1 shared_informer.go:356] "Caches are synced" controller="endpoint"
	I0918 17:02:05.259411       1 shared_informer.go:356] "Caches are synced" controller="taint-eviction-controller"
	I0918 17:02:05.259527       1 shared_informer.go:356] "Caches are synced" controller="disruption"
	I0918 17:02:05.259589       1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice"
	I0918 17:02:05.259678       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-serving"
	I0918 17:02:05.259774       1 shared_informer.go:356] "Caches are synced" controller="TTL after finished"
	I0918 17:02:05.259776       1 shared_informer.go:356] "Caches are synced" controller="ReplicationController"
	I0918 17:02:05.259905       1 shared_informer.go:356] "Caches are synced" controller="expand"
	I0918 17:02:05.260131       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-client"
	I0918 17:02:05.261025       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
	I0918 17:02:05.261053       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kube-apiserver-client"
	I0918 17:02:05.264410       1 shared_informer.go:356] "Caches are synced" controller="namespace"
	I0918 17:02:05.267245       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	I0918 17:02:05.267301       1 garbagecollector.go:154] "Garbage collector: all resource monitors have synced" logger="garbage-collector-controller"
	I0918 17:02:05.267312       1 garbagecollector.go:157] "Proceeding to collect garbage" logger="garbage-collector-controller"
	I0918 17:02:05.269527       1 shared_informer.go:356] "Caches are synced" controller="resource quota"
	I0918 17:02:05.274317       1 shared_informer.go:356] "Caches are synced" controller="validatingadmissionpolicy-status"
	I0918 17:02:05.277340       1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice_mirroring"
	I0918 17:02:05.292756       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	I0918 17:02:05.614934       1 endpointslice_controller.go:344] "Error syncing endpoint slices for service, retrying" logger="endpointslice-controller" key="kube-system/kube-dns" err="failed to update kube-dns-dsh2c EndpointSlice for Service kube-system/kube-dns: Operation cannot be fulfilled on endpointslices.discovery.k8s.io \"kube-dns-dsh2c\": the object has been modified; please apply your changes to the latest version and try again"
	I0918 17:02:05.615013       1 event.go:377] Event(v1.ObjectReference{Kind:"Service", Namespace:"kube-system", Name:"kube-dns", UID:"92afb4da-15d6-4c05-b549-cfdf91ba4ea0", APIVersion:"v1", ResourceVersion:"312", FieldPath:""}): type: 'Warning' reason: 'FailedToUpdateEndpointSlices' Error updating Endpoint Slices for Service kube-system/kube-dns: failed to update kube-dns-dsh2c EndpointSlice for Service kube-system/kube-dns: Operation cannot be fulfilled on endpointslices.discovery.k8s.io "kube-dns-dsh2c": the object has been modified; please apply your changes to the latest version and try again
	I0918 17:02:07.411918       1 endpointslice_controller.go:344] "Error syncing endpoint slices for service, retrying" logger="endpointslice-controller" key="kube-system/kube-dns" err="failed to update kube-dns-dsh2c EndpointSlice for Service kube-system/kube-dns: Operation cannot be fulfilled on endpointslices.discovery.k8s.io \"kube-dns-dsh2c\": the object has been modified; please apply your changes to the latest version and try again"
	I0918 17:02:07.411981       1 event.go:377] Event(v1.ObjectReference{Kind:"Service", Namespace:"kube-system", Name:"kube-dns", UID:"92afb4da-15d6-4c05-b549-cfdf91ba4ea0", APIVersion:"v1", ResourceVersion:"312", FieldPath:""}): type: 'Warning' reason: 'FailedToUpdateEndpointSlices' Error updating Endpoint Slices for Service kube-system/kube-dns: failed to update kube-dns-dsh2c EndpointSlice for Service kube-system/kube-dns: Operation cannot be fulfilled on endpointslices.discovery.k8s.io "kube-dns-dsh2c": the object has been modified; please apply your changes to the latest version and try again
	
	
	==> kube-proxy [21b6ad607723fc0096bcbd14ccd85f029136b58ac2b0ddb5ddcd5bed51ad655b] <==
	I0918 17:02:03.339116       1 server_linux.go:53] "Using iptables proxy"
	I0918 17:02:03.389961       1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
	I0918 17:02:03.490912       1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
	I0918 17:02:03.490950       1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.49.2"]
	E0918 17:02:03.491054       1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
	I0918 17:02:03.512844       1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0918 17:02:03.512918       1 server_linux.go:132] "Using iptables Proxier"
	I0918 17:02:03.518771       1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
	I0918 17:02:03.519678       1 server.go:527] "Version info" version="v1.34.0"
	I0918 17:02:03.519790       1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 17:02:03.522083       1 config.go:200] "Starting service config controller"
	I0918 17:02:03.522097       1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
	I0918 17:02:03.522139       1 config.go:309] "Starting node config controller"
	I0918 17:02:03.522142       1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
	I0918 17:02:03.522146       1 shared_informer.go:356] "Caches are synced" controller="node config"
	I0918 17:02:03.522322       1 config.go:106] "Starting endpoint slice config controller"
	I0918 17:02:03.522340       1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
	I0918 17:02:03.522359       1 config.go:403] "Starting serviceCIDR config controller"
	I0918 17:02:03.522367       1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
	I0918 17:02:03.622286       1 shared_informer.go:356] "Caches are synced" controller="service config"
	I0918 17:02:03.622411       1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
	I0918 17:02:03.622414       1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
	
	
	==> kube-scheduler [47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67] <==
	I0918 17:01:56.949468       1 serving.go:386] Generated self-signed cert in-memory
	W0918 17:02:01.848942       1 requestheader_controller.go:204] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W0918 17:02:01.848981       1 authentication.go:397] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W0918 17:02:01.848992       1 authentication.go:398] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0918 17:02:01.849002       1 authentication.go:399] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0918 17:02:01.914311       1 server.go:175] "Starting Kubernetes Scheduler" version="v1.34.0"
	I0918 17:02:01.914353       1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 17:02:01.923771       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0918 17:02:01.923812       1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0918 17:02:01.925571       1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
	I0918 17:02:01.925987       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
	I0918 17:02:02.024271       1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	
	
	==> kubelet <==
	Sep 18 17:02:02 ha-078118 kubelet[703]: I0918 17:02:02.056441     703 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/ccbd1a85-07b6-4166-8822-2b3617723baf-xtables-lock\") pod \"kindnet-vqp76\" (UID: \"ccbd1a85-07b6-4166-8822-2b3617723baf\") " pod="kube-system/kindnet-vqp76"
	Sep 18 17:02:02 ha-078118 kubelet[703]: I0918 17:02:02.115656     703 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-vip-ha-078118" podStartSLOduration=0.115630936 podStartE2EDuration="115.630936ms" podCreationTimestamp="2025-09-18 17:02:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-09-18 17:02:02.09970939 +0000 UTC m=+6.289408969" watchObservedRunningTime="2025-09-18 17:02:02.115630936 +0000 UTC m=+6.305330499"
	Sep 18 17:02:03 ha-078118 kubelet[703]: E0918 17:02:03.057869     703 configmap.go:193] Couldn't get configMap kube-system/coredns: failed to sync configmap cache: timed out waiting for the condition
	Sep 18 17:02:03 ha-078118 kubelet[703]: E0918 17:02:03.057974     703 configmap.go:193] Couldn't get configMap kube-system/coredns: failed to sync configmap cache: timed out waiting for the condition
	Sep 18 17:02:03 ha-078118 kubelet[703]: E0918 17:02:03.058095     703 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/74f8e6bc-8929-43a4-94fa-29301c1d703a-config-volume podName:74f8e6bc-8929-43a4-94fa-29301c1d703a nodeName:}" failed. No retries permitted until 2025-09-18 17:02:03.558053973 +0000 UTC m=+7.747753526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-volume" (UniqueName: "kubernetes.io/configmap/74f8e6bc-8929-43a4-94fa-29301c1d703a-config-volume") pod "coredns-66bc5c9577-g9xk6" (UID: "74f8e6bc-8929-43a4-94fa-29301c1d703a") : failed to sync configmap cache: timed out waiting for the condition
	Sep 18 17:02:03 ha-078118 kubelet[703]: E0918 17:02:03.058122     703 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c21094f1-585a-4109-b526-3a115d45f35f-config-volume podName:c21094f1-585a-4109-b526-3a115d45f35f nodeName:}" failed. No retries permitted until 2025-09-18 17:02:03.558111559 +0000 UTC m=+7.747811104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-volume" (UniqueName: "kubernetes.io/configmap/c21094f1-585a-4109-b526-3a115d45f35f-config-volume") pod "coredns-66bc5c9577-q42l7" (UID: "c21094f1-585a-4109-b526-3a115d45f35f") : failed to sync configmap cache: timed out waiting for the condition
	Sep 18 17:02:05 ha-078118 kubelet[703]: E0918 17:02:05.888882     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214925888637070  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:05 ha-078118 kubelet[703]: E0918 17:02:05.888923     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214925888637070  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:07 ha-078118 kubelet[703]: I0918 17:02:07.380277     703 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
	Sep 18 17:02:07 ha-078118 kubelet[703]: I0918 17:02:07.446941     703 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
	Sep 18 17:02:15 ha-078118 kubelet[703]: E0918 17:02:15.890834     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214935890411828  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:15 ha-078118 kubelet[703]: E0918 17:02:15.890877     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214935890411828  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:25 ha-078118 kubelet[703]: E0918 17:02:25.892044     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214945891835358  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:25 ha-078118 kubelet[703]: E0918 17:02:25.892079     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214945891835358  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:33 ha-078118 kubelet[703]: I0918 17:02:33.993183     703 scope.go:117] "RemoveContainer" containerID="e26adb5e15f89b7d6b2ae07f5ecd54f18d53826b37e5e202c66478a2da986742"
	Sep 18 17:02:35 ha-078118 kubelet[703]: E0918 17:02:35.893103     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214955892872566  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:35 ha-078118 kubelet[703]: E0918 17:02:35.893144     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214955892872566  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:45 ha-078118 kubelet[703]: E0918 17:02:45.894324     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214965894027593  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:45 ha-078118 kubelet[703]: E0918 17:02:45.894364     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214965894027593  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:55 ha-078118 kubelet[703]: E0918 17:02:55.880015     703 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5\": container with ID starting with 5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5 not found: ID does not exist" containerID="5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5"
	Sep 18 17:02:55 ha-078118 kubelet[703]: I0918 17:02:55.880056     703 kuberuntime_gc.go:364] "Error getting ContainerStatus for containerID" containerID="5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5" err="rpc error: code = NotFound desc = could not find container \"5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5\": container with ID starting with 5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5 not found: ID does not exist"
	Sep 18 17:02:55 ha-078118 kubelet[703]: E0918 17:02:55.880405     703 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9\": container with ID starting with b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9 not found: ID does not exist" containerID="b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9"
	Sep 18 17:02:55 ha-078118 kubelet[703]: I0918 17:02:55.880441     703 kuberuntime_gc.go:364] "Error getting ContainerStatus for containerID" containerID="b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9" err="rpc error: code = NotFound desc = could not find container \"b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9\": container with ID starting with b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9 not found: ID does not exist"
	Sep 18 17:02:55 ha-078118 kubelet[703]: E0918 17:02:55.895432     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214975895244633  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:55 ha-078118 kubelet[703]: E0918 17:02:55.895471     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214975895244633  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	

                                                
                                                
-- /stdout --
helpers_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-078118 -n ha-078118
helpers_test.go:269: (dbg) Run:  kubectl --context ha-078118 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestMultiControlPlane/serial/RestartClusterKeepsNodes FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestMultiControlPlane/serial/RestartClusterKeepsNodes (101.68s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeleteSecondaryNode (20.94s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeleteSecondaryNode
ha_test.go:489: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 node delete m03 --alsologtostderr -v 5
ha_test.go:489: (dbg) Done: out/minikube-linux-amd64 -p ha-078118 node delete m03 --alsologtostderr -v 5: (18.522219859s)
ha_test.go:495: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5
ha_test.go:495: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5: exit status 7 (516.462643ms)

                                                
                                                
-- stdout --
	ha-078118
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m02
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	ha-078118-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:03:17.208735   95891 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:03:17.208837   95891 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:03:17.208841   95891 out.go:374] Setting ErrFile to fd 2...
	I0918 17:03:17.208845   95891 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:03:17.209059   95891 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:03:17.209239   95891 out.go:368] Setting JSON to false
	I0918 17:03:17.209271   95891 mustload.go:65] Loading cluster: ha-078118
	I0918 17:03:17.209334   95891 notify.go:220] Checking for updates...
	I0918 17:03:17.209710   95891 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:03:17.209730   95891 status.go:174] checking status of ha-078118 ...
	I0918 17:03:17.210156   95891 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:03:17.229029   95891 status.go:371] ha-078118 host status = "Running" (err=<nil>)
	I0918 17:03:17.229062   95891 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:03:17.229321   95891 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:03:17.246594   95891 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:03:17.246816   95891 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:03:17.246860   95891 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:03:17.265391   95891 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:03:17.360862   95891 ssh_runner.go:195] Run: systemctl --version
	I0918 17:03:17.365286   95891 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:03:17.377192   95891 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:03:17.434179   95891 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:50 OomKillDisable:false NGoroutines:65 SystemTime:2025-09-18 17:03:17.425134587 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:03:17.434697   95891 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:03:17.434729   95891 api_server.go:166] Checking apiserver status ...
	I0918 17:03:17.434771   95891 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:03:17.446780   95891 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/895/cgroup
	W0918 17:03:17.457373   95891 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/895/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:03:17.457464   95891 ssh_runner.go:195] Run: ls
	I0918 17:03:17.461358   95891 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:03:17.465823   95891 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:03:17.465848   95891 status.go:463] ha-078118 apiserver status = Running (err=<nil>)
	I0918 17:03:17.465857   95891 status.go:176] ha-078118 status: &{Name:ha-078118 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:03:17.465878   95891 status.go:174] checking status of ha-078118-m02 ...
	I0918 17:03:17.466125   95891 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:03:17.483855   95891 status.go:371] ha-078118-m02 host status = "Running" (err=<nil>)
	I0918 17:03:17.483878   95891 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:03:17.484131   95891 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:03:17.501641   95891 host.go:66] Checking if "ha-078118-m02" exists ...
	I0918 17:03:17.501894   95891 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:03:17.501933   95891 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:03:17.519396   95891 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:03:17.612881   95891 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:03:17.625812   95891 kubeconfig.go:125] found "ha-078118" server: "https://192.168.49.254:8443"
	I0918 17:03:17.625844   95891 api_server.go:166] Checking apiserver status ...
	I0918 17:03:17.625893   95891 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:03:17.638178   95891 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/360/cgroup
	W0918 17:03:17.648552   95891 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/360/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:03:17.648609   95891 ssh_runner.go:195] Run: ls
	I0918 17:03:17.652437   95891 api_server.go:253] Checking apiserver healthz at https://192.168.49.254:8443/healthz ...
	I0918 17:03:17.657552   95891 api_server.go:279] https://192.168.49.254:8443/healthz returned 200:
	ok
	I0918 17:03:17.657578   95891 status.go:463] ha-078118-m02 apiserver status = Running (err=<nil>)
	I0918 17:03:17.657588   95891 status.go:176] ha-078118-m02 status: &{Name:ha-078118-m02 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:03:17.657617   95891 status.go:174] checking status of ha-078118-m04 ...
	I0918 17:03:17.657883   95891 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:03:17.676128   95891 status.go:371] ha-078118-m04 host status = "Stopped" (err=<nil>)
	I0918 17:03:17.676148   95891 status.go:384] host is not running, skipping remaining checks
	I0918 17:03:17.676158   95891 status.go:176] ha-078118-m04 status: &{Name:ha-078118-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:497: failed to run minikube status. args "out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======>  post-mortem[TestMultiControlPlane/serial/DeleteSecondaryNode]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======>  post-mortem[TestMultiControlPlane/serial/DeleteSecondaryNode]: docker inspect <======
helpers_test.go:239: (dbg) Run:  docker inspect ha-078118
helpers_test.go:243: (dbg) docker inspect ha-078118:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7",
	        "Created": "2025-09-18T16:57:02.681891976Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 88722,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2025-09-18T17:01:49.614080081Z",
	            "FinishedAt": "2025-09-18T17:01:48.970614154Z"
	        },
	        "Image": "sha256:c6b5532e987b5b4f5fc9cb0336e378ed49c0542bad8cbfc564b71e977a6269de",
	        "ResolvConfPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/hostname",
	        "HostsPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/hosts",
	        "LogPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7-json.log",
	        "Name": "/ha-078118",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ha-078118:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "ha-078118",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "private",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 3221225472,
	            "NanoCpus": 0,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 6442450944,
	            "MemorySwappiness": null,
	            "OomKillDisable": null,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "ID": "0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7",
	                "LowerDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91-init/diff:/var/lib/docker/overlay2/1fd2bbb67ab9e5bb8d4549665a1a228eadda56df39fee53908cd735ea16a4e10/diff",
	                "MergedDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/merged",
	                "UpperDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/diff",
	                "WorkDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "ha-078118",
	                "Source": "/var/lib/docker/volumes/ha-078118/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "ha-078118",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ha-078118",
	                "name.minikube.sigs.k8s.io": "ha-078118",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "d7a7374ea2b8ba6f874686045bec8d8d2f4be5c3bb156f797cfc8fe734164d41",
	            "SandboxKey": "/var/run/docker/netns/d7a7374ea2b8",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32813"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32814"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32817"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32815"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32816"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ha-078118": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "3e:c5:df:f8:cd:13",
	                    "DriverOpts": null,
	                    "GwPriority": 0,
	                    "NetworkID": "0aa191750de6e44eaf49073a9e05a52994c63ccafcb0870d32aaf105d93cb724",
	                    "EndpointID": "ea5d387e75ac6e3dadc6865bf01be750dd4561640b93fb195ebd116b4ff71c26",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "ha-078118",
	                        "0cb187fb2895"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-078118 -n ha-078118
helpers_test.go:252: <<< TestMultiControlPlane/serial/DeleteSecondaryNode FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======>  post-mortem[TestMultiControlPlane/serial/DeleteSecondaryNode]: minikube logs <======
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p ha-078118 logs -n 25: (1.137640805s)
helpers_test.go:260: TestMultiControlPlane/serial/DeleteSecondaryNode logs: 
-- stdout --
	
	==> Audit <==
	┌─────────┬──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬───────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
	│ COMMAND │                                                                 ARGS                                                                 │  PROFILE  │  USER   │ VERSION │     START TIME      │      END TIME       │
	├─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼───────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m02 sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m02.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ cp      │ ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118-m04:/home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp testdata/cp-test.txt ha-078118-m04:/home/docker/cp-test.txt                                                             │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1931775572/001/cp-test_ha-078118-m04.txt │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118:/home/docker/cp-test_ha-078118-m04_ha-078118.txt                       │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118.txt                                                 │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m02:/home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m02 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m03:/home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ node    │ ha-078118 node stop m02 --alsologtostderr -v 5                                                                                       │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ node    │ ha-078118 node start m02 --alsologtostderr -v 5                                                                                      │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ node    │ ha-078118 node list --alsologtostderr -v 5                                                                                           │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:01 UTC │                     │
	│ stop    │ ha-078118 stop --alsologtostderr -v 5                                                                                                │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:01 UTC │ 18 Sep 25 17:01 UTC │
	│ start   │ ha-078118 start --wait true --alsologtostderr -v 5                                                                                   │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:01 UTC │                     │
	│ node    │ ha-078118 node list --alsologtostderr -v 5                                                                                           │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:02 UTC │                     │
	│ node    │ ha-078118 node delete m03 --alsologtostderr -v 5                                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:02 UTC │ 18 Sep 25 17:03 UTC │
	└─────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴───────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
	
	
	==> Last Start <==
	Log file created at: 2025/09/18 17:01:49
	Running on machine: ubuntu-20-agent-4
	Binary: Built with gc go1.24.6 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0918 17:01:49.379653   88523 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:01:49.379772   88523 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:01:49.379784   88523 out.go:374] Setting ErrFile to fd 2...
	I0918 17:01:49.379790   88523 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:01:49.380019   88523 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:01:49.380533   88523 out.go:368] Setting JSON to false
	I0918 17:01:49.381592   88523 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":2660,"bootTime":1758212249,"procs":195,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 17:01:49.381686   88523 start.go:140] virtualization: kvm guest
	I0918 17:01:49.384268   88523 out.go:179] * [ha-078118] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 17:01:49.385803   88523 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 17:01:49.385796   88523 notify.go:220] Checking for updates...
	I0918 17:01:49.387397   88523 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 17:01:49.389003   88523 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:01:49.390427   88523 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 17:01:49.391837   88523 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 17:01:49.393281   88523 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 17:01:49.395372   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:49.395474   88523 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 17:01:49.420078   88523 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 17:01:49.420170   88523 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:01:49.475997   88523 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:0 ContainersPaused:0 ContainersStopped:4 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 17:01:49.466272836 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:01:49.476147   88523 docker.go:318] overlay module found
	I0918 17:01:49.478189   88523 out.go:179] * Using the docker driver based on existing profile
	I0918 17:01:49.479694   88523 start.go:304] selected driver: docker
	I0918 17:01:49.479717   88523 start.go:924] validating driver "docker" against &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNam
es:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false
inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:
false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:01:49.479869   88523 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 17:01:49.479962   88523 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:01:49.539423   88523 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:0 ContainersPaused:0 ContainersStopped:4 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 17:01:49.529122726 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:01:49.540463   88523 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:01:49.540514   88523 cni.go:84] Creating CNI manager for ""
	I0918 17:01:49.540617   88523 cni.go:136] multinode detected (4 nodes found), recommending kindnet
	I0918 17:01:49.540690   88523 start.go:348] cluster config:
	{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: N
etworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubef
low:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Static
IP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:01:49.542911   88523 out.go:179] * Starting "ha-078118" primary control-plane node in "ha-078118" cluster
	I0918 17:01:49.544389   88523 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:01:49.545792   88523 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:01:49.547204   88523 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:01:49.547272   88523 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
	I0918 17:01:49.547302   88523 cache.go:58] Caching tarball of preloaded images
	I0918 17:01:49.547351   88523 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:01:49.547411   88523 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:01:49.547426   88523 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:01:49.547600   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:49.567461   88523 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:01:49.567478   88523 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:01:49.567515   88523 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:01:49.567543   88523 start.go:360] acquireMachinesLock for ha-078118: {Name:mk24a1b2c9ed1c42e9ffd635727b36c75401a437 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:01:49.567596   88523 start.go:364] duration metric: took 39.11µs to acquireMachinesLock for "ha-078118"
	I0918 17:01:49.567613   88523 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:01:49.567618   88523 fix.go:54] fixHost starting: 
	I0918 17:01:49.567821   88523 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:01:49.585475   88523 fix.go:112] recreateIfNeeded on ha-078118: state=Stopped err=<nil>
	W0918 17:01:49.585550   88523 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:01:49.587651   88523 out.go:252] * Restarting existing docker container for "ha-078118" ...
	I0918 17:01:49.587728   88523 cli_runner.go:164] Run: docker start ha-078118
	I0918 17:01:49.825406   88523 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:01:49.844741   88523 kic.go:430] container "ha-078118" state is running.
	I0918 17:01:49.845091   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:01:49.864909   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:49.865148   88523 machine.go:93] provisionDockerMachine start ...
	I0918 17:01:49.865211   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:49.884562   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:49.884789   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32813 <nil> <nil>}
	I0918 17:01:49.884809   88523 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:01:49.885517   88523 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:54636->127.0.0.1:32813: read: connection reset by peer
	I0918 17:01:53.023917   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 17:01:53.023947   88523 ubuntu.go:182] provisioning hostname "ha-078118"
	I0918 17:01:53.024015   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:53.042995   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:53.043252   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32813 <nil> <nil>}
	I0918 17:01:53.043274   88523 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118 && echo "ha-078118" | sudo tee /etc/hostname
	I0918 17:01:53.192161   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 17:01:53.192246   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:53.210910   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:53.211146   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32813 <nil> <nil>}
	I0918 17:01:53.211164   88523 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:01:53.348813   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:01:53.348841   88523 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:01:53.348884   88523 ubuntu.go:190] setting up certificates
	I0918 17:01:53.348896   88523 provision.go:84] configureAuth start
	I0918 17:01:53.348954   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:01:53.367869   88523 provision.go:143] copyHostCerts
	I0918 17:01:53.367917   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:01:53.367947   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:01:53.367963   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:01:53.368042   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:01:53.368157   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:01:53.368180   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:01:53.368186   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:01:53.368215   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:01:53.368277   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:01:53.368294   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:01:53.368300   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:01:53.368323   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:01:53.368389   88523 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118 san=[127.0.0.1 192.168.49.2 ha-078118 localhost minikube]
	I0918 17:01:53.505620   88523 provision.go:177] copyRemoteCerts
	I0918 17:01:53.505678   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:01:53.505710   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:53.524161   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:53.622628   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 17:01:53.622691   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:01:53.648566   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 17:01:53.648617   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)
	I0918 17:01:53.673434   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 17:01:53.673543   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:01:53.697938   88523 provision.go:87] duration metric: took 349.03073ms to configureAuth
	I0918 17:01:53.697966   88523 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:01:53.698195   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:53.698301   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:53.716437   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:53.716667   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32813 <nil> <nil>}
	I0918 17:01:53.716687   88523 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:01:54.060620   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:01:54.060651   88523 machine.go:96] duration metric: took 4.195487726s to provisionDockerMachine
	I0918 17:01:54.060665   88523 start.go:293] postStartSetup for "ha-078118" (driver="docker")
	I0918 17:01:54.060679   88523 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:01:54.060754   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:01:54.060810   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:54.081141   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:54.178371   88523 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:01:54.182063   88523 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:01:54.182105   88523 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:01:54.182113   88523 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:01:54.182119   88523 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:01:54.182128   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:01:54.182193   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:01:54.182333   88523 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:01:54.182355   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 17:01:54.182483   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:01:54.191863   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:01:54.217237   88523 start.go:296] duration metric: took 156.554854ms for postStartSetup
	I0918 17:01:54.217324   88523 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:01:54.217390   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:54.236238   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:54.329749   88523 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:01:54.334136   88523 fix.go:56] duration metric: took 4.766511986s for fixHost
	I0918 17:01:54.334163   88523 start.go:83] releasing machines lock for "ha-078118", held for 4.766557228s
	I0918 17:01:54.334217   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:01:54.351968   88523 ssh_runner.go:195] Run: cat /version.json
	I0918 17:01:54.352015   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:54.352066   88523 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:01:54.352121   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:54.371203   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:54.371672   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:54.463754   88523 ssh_runner.go:195] Run: systemctl --version
	I0918 17:01:54.535544   88523 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:01:54.676680   88523 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:01:54.681529   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:01:54.690765   88523 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:01:54.690857   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:01:54.700127   88523 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:01:54.700153   88523 start.go:495] detecting cgroup driver to use...
	I0918 17:01:54.700180   88523 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:01:54.700215   88523 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:01:54.712746   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:01:54.724661   88523 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:01:54.724728   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:01:54.737819   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:01:54.750395   88523 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:01:54.815179   88523 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:01:54.880585   88523 docker.go:234] disabling docker service ...
	I0918 17:01:54.880655   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:01:54.893483   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:01:54.905105   88523 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:01:54.970982   88523 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:01:55.036251   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:01:55.047926   88523 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:01:55.064969   88523 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:01:55.065039   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.075907   88523 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:01:55.075961   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.086186   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.096182   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.106316   88523 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:01:55.116742   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.127414   88523 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.137571   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.147863   88523 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:01:55.156583   88523 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:01:55.165138   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:01:55.228262   88523 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:01:55.328023   88523 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:01:55.328125   88523 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:01:55.332040   88523 start.go:563] Will wait 60s for crictl version
	I0918 17:01:55.332103   88523 ssh_runner.go:195] Run: which crictl
	I0918 17:01:55.335544   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:01:55.370764   88523 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 17:01:55.370835   88523 ssh_runner.go:195] Run: crio --version
	I0918 17:01:55.407074   88523 ssh_runner.go:195] Run: crio --version
	I0918 17:01:55.445239   88523 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 17:01:55.446549   88523 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:01:55.463986   88523 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 17:01:55.467838   88523 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:01:55.479645   88523 kubeadm.go:875] updating cluster {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIP
s:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-ga
dget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQ
emuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0918 17:01:55.479776   88523 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:01:55.479825   88523 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:01:55.521370   88523 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:01:55.521391   88523 crio.go:433] Images already preloaded, skipping extraction
	I0918 17:01:55.521435   88523 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:01:55.554619   88523 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:01:55.554641   88523 cache_images.go:85] Images are preloaded, skipping loading
	I0918 17:01:55.554650   88523 kubeadm.go:926] updating node { 192.168.49.2 8443 v1.34.0 crio true true} ...
	I0918 17:01:55.554740   88523 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 17:01:55.554809   88523 ssh_runner.go:195] Run: crio config
	I0918 17:01:55.597150   88523 cni.go:84] Creating CNI manager for ""
	I0918 17:01:55.597170   88523 cni.go:136] multinode detected (4 nodes found), recommending kindnet
	I0918 17:01:55.597182   88523 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0918 17:01:55.597201   88523 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.34.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-078118 NodeName:ha-078118 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manif
ests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0918 17:01:55.597323   88523 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "ha-078118"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.49.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	kubernetesVersion: v1.34.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: systemd
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0918 17:01:55.597340   88523 kube-vip.go:115] generating kube-vip config ...
	I0918 17:01:55.597387   88523 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 17:01:55.610040   88523 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:01:55.610150   88523 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 17:01:55.610202   88523 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 17:01:55.619652   88523 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 17:01:55.619730   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
	I0918 17:01:55.629065   88523 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (359 bytes)
	I0918 17:01:55.647817   88523 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 17:01:55.666322   88523 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2205 bytes)
	I0918 17:01:55.685799   88523 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 17:01:55.705367   88523 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 17:01:55.709566   88523 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:01:55.722362   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:01:55.784601   88523 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:01:55.808023   88523 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.2
	I0918 17:01:55.808042   88523 certs.go:194] generating shared ca certs ...
	I0918 17:01:55.808072   88523 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:55.808221   88523 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 17:01:55.808270   88523 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 17:01:55.808280   88523 certs.go:256] generating profile certs ...
	I0918 17:01:55.808359   88523 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 17:01:55.808395   88523 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.c944a3f3
	I0918 17:01:55.808410   88523 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.c944a3f3 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.3 192.168.49.4 192.168.49.254]
	I0918 17:01:56.210331   88523 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.c944a3f3 ...
	I0918 17:01:56.210365   88523 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.c944a3f3: {Name:mkb79a1de8248bd79832f6910fea7ba45af90c6a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.210571   88523 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.c944a3f3 ...
	I0918 17:01:56.210590   88523 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.c944a3f3: {Name:mkee19f1232c09da0d47765b6f3756d6bcdf1995 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.210674   88523 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.c944a3f3 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 17:01:56.210811   88523 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.c944a3f3 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 17:01:56.210938   88523 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 17:01:56.210952   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 17:01:56.210965   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 17:01:56.210976   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 17:01:56.210987   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 17:01:56.210997   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 17:01:56.211031   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 17:01:56.211043   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 17:01:56.211055   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 17:01:56.211116   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 17:01:56.211142   88523 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 17:01:56.211151   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 17:01:56.211172   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 17:01:56.211193   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 17:01:56.211213   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 17:01:56.211248   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:01:56.211275   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 17:01:56.211290   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 17:01:56.211302   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:01:56.211913   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 17:01:56.237934   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 17:01:56.263651   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 17:01:56.288002   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 17:01:56.314861   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
	I0918 17:01:56.340356   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 17:01:56.370284   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 17:01:56.398212   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 17:01:56.432277   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 17:01:56.471393   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 17:01:56.507057   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 17:01:56.541863   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0918 17:01:56.570235   88523 ssh_runner.go:195] Run: openssl version
	I0918 17:01:56.577129   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 17:01:56.588470   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 17:01:56.592889   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 17:01:56.592948   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 17:01:56.600490   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 17:01:56.610210   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 17:01:56.620549   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 17:01:56.624511   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 17:01:56.624575   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 17:01:56.632301   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 17:01:56.642250   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 17:01:56.652289   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:01:56.656446   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:01:56.656530   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:01:56.664059   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 17:01:56.673942   88523 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 17:01:56.678148   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0918 17:01:56.685430   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0918 17:01:56.692331   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0918 17:01:56.699250   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0918 17:01:56.706155   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0918 17:01:56.713040   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0918 17:01:56.719862   88523 kubeadm.go:392] StartCluster: {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[
] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadge
t:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemu
FirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:01:56.720000   88523 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0918 17:01:56.720046   88523 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0918 17:01:56.758372   88523 cri.go:89] found id: "1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5"
	I0918 17:01:56.758399   88523 cri.go:89] found id: "d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd"
	I0918 17:01:56.758404   88523 cri.go:89] found id: "47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67"
	I0918 17:01:56.758409   88523 cri.go:89] found id: "1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156"
	I0918 17:01:56.758413   88523 cri.go:89] found id: "f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a"
	I0918 17:01:56.758417   88523 cri.go:89] found id: ""
	I0918 17:01:56.758462   88523 ssh_runner.go:195] Run: sudo runc list -f json
	I0918 17:01:56.780084   88523 cri.go:116] JSON = [{"ociVersion":"1.0.2-dev","id":"1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5","pid":904,"status":"running","bundle":"/run/containers/storage/overlay-containers/1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5/userdata","rootfs":"/var/lib/containers/storage/overlay/9c71e033c7f3d6a01ab02e2f4462648d32830be6c4d23a4db21a231f88ff347b/merged","created":"2025-09-18T17:01:56.483000594Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"7eaa1830","io.kubernetes.container.name":"kube-controller-manager","io.kubernetes.container.ports":"[{\"name\":\"probe-port\",\"hostPort\":10257,\"containerPort\":10257,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"7eaa1830\",\"io.kubernetes.contai
ner.ports\":\"[{\\\"name\\\":\\\"probe-port\\\",\\\"hostPort\\\":10257,\\\"containerPort\\\":10257,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.414440268Z","io.kubernetes.cri-o.Image":"a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-controller-manager:v1.34.0","io.kubernetes.cri-o.ImageRef":"a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-controller-manager\",\"io.kubernetes.pod.name\":\"kube-controller-manager-ha-078118\",\"io.kube
rnetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"295d4b0a8fb5b6e3839f92f4ba9ebb80\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-controller-manager-ha-078118_295d4b0a8fb5b6e3839f92f4ba9ebb80/kube-controller-manager/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-controller-manager\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/9c71e033c7f3d6a01ab02e2f4462648d32830be6c4d23a4db21a231f88ff347b/merged","io.kubernetes.cri-o.Name":"k8s_kube-controller-manager_kube-controller-manager-ha-078118_kube-system_295d4b0a8fb5b6e3839f92f4ba9ebb80_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/bc00758e6c8406d5f266c3138b612bd3922701154711f59957fe39c69c66e540/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"bc00758e6c8406d5f266c3138b612bd3922701154711f59957fe39c69c66e540","io.kubernetes.cri-o.SandboxName":"k8s_kube-controller-manager-ha-078118_kube-system_295d4b0a8fb5b6e3839f92f4ba9ebb80_0","io.kubernetes
.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/ca-certificates\",\"host_path\":\"/etc/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/295d4b0a8fb5b6e3839f92f4ba9ebb80/containers/kube-controller-manager/72ee19b7\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/295d4b0a8fb5b6e3839f92f4ba9ebb80/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/ssl/certs\",\"host_path\":\"/etc/ssl/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/kubernetes/controller-manager.conf\",\"host_path\":\"/etc/kubernetes/controller-manager.conf\",\"readonly\":true,\"propagation\":0,\"se
linux_relabel\":false},{\"container_path\":\"/usr/share/ca-certificates\",\"host_path\":\"/usr/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/certs\",\"host_path\":\"/var/lib/minikube/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/local/share/ca-certificates\",\"host_path\":\"/usr/local/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/libexec/kubernetes/kubelet-plugins/volume/exec\",\"host_path\":\"/usr/libexec/kubernetes/kubelet-plugins/volume/exec\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-controller-manager-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"295d4b0a8fb5b6e3839f92f4ba9ebb80","kubernetes.io/config.hash":"295d4b0a8fb5b6e3839f92f4ba9ebb80","kubernetes.io/config.seen":"20
25-09-18T17:01:55.876115131Z","kubernetes.io/config.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependencies":"true","org.systemd.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156","pid":849,"status":"running","bundle":"/run/containers/storage/overlay-containers/1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156/userdata","rootfs":"/var/lib/containers/storage/overlay/9a05cb7fea32dc9ddf7a008a2caeccd14f1a898a68a3dd3ddbf49586836e44b4/merged","created":"2025-09-18T17:01:56.440722069Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"d64ad60b","io.kubernetes.container.name":"kube-vip","io.kubernetes.container.restartCount":"0","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kub
ernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"d64ad60b\",\"io.kubernetes.container.restartCount\":\"0\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.395408441Z","io.kubernetes.cri-o.Image":"765655ea6078171c416896d7cc155c1263a0411d30caaa03d7365aecb99fdf23","io.kubernetes.cri-o.ImageName":"ghcr.io/kube-vip/kube-vip:v1.0.0","io.kubernetes.cri-o.ImageRef":"765655ea6078171c416896d7cc155c1263a0411d30caaa03d7365aecb99fdf23","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-vip\",\"io.kubernetes.pod.name\":\"kube-vip-ha-078118\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"b5f2d8fa1610d58f11008a293d2cb33c\"}
","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-vip-ha-078118_b5f2d8fa1610d58f11008a293d2cb33c/kube-vip/0.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-vip\"}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/9a05cb7fea32dc9ddf7a008a2caeccd14f1a898a68a3dd3ddbf49586836e44b4/merged","io.kubernetes.cri-o.Name":"k8s_kube-vip_kube-vip-ha-078118_kube-system_b5f2d8fa1610d58f11008a293d2cb33c_0","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/30db82bb4c1ecf3da0c6fc497ad269f656085bac7f95a7fe045a62d4257a5f44/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"30db82bb4c1ecf3da0c6fc497ad269f656085bac7f95a7fe045a62d4257a5f44","io.kubernetes.cri-o.SandboxName":"k8s_kube-vip-ha-078118_kube-system_b5f2d8fa1610d58f11008a293d2cb33c_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/hosts\"
,\"host_path\":\"/var/lib/kubelet/pods/b5f2d8fa1610d58f11008a293d2cb33c/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/b5f2d8fa1610d58f11008a293d2cb33c/containers/kube-vip/ce75abae\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/kubernetes/admin.conf\",\"host_path\":\"/etc/kubernetes/admin.conf\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-vip-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"b5f2d8fa1610d58f11008a293d2cb33c","kubernetes.io/config.hash":"b5f2d8fa1610d58f11008a293d2cb33c","kubernetes.io/config.seen":"2025-09-18T17:01:55.876125807Z","kubernetes.io/config.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependenci
es":"true","org.systemd.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67","pid":885,"status":"running","bundle":"/run/containers/storage/overlay-containers/47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67/userdata","rootfs":"/var/lib/containers/storage/overlay/8e8b1e7cd8a289c8374f9b6257c15f074ae0f3c0cebbc0ba3761dd50fedae849/merged","created":"2025-09-18T17:01:56.465937045Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"85eae708","io.kubernetes.container.name":"kube-scheduler","io.kubernetes.container.ports":"[{\"name\":\"probe-port\",\"hostPort\":10259,\"containerPort\":10259,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"85eae708\",\"io.
kubernetes.container.ports\":\"[{\\\"name\\\":\\\"probe-port\\\",\\\"hostPort\\\":10259,\\\"containerPort\\\":10259,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.399734521Z","io.kubernetes.cri-o.Image":"46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-scheduler:v1.34.0","io.kubernetes.cri-o.ImageRef":"46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-scheduler\",\"io.kubernetes.pod.name\":\"kube-scheduler-ha-078118\",\"io.kubernetes.pod
.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"eef6954c295df14c6ded36d455ae3f64\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-scheduler-ha-078118_eef6954c295df14c6ded36d455ae3f64/kube-scheduler/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-scheduler\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/8e8b1e7cd8a289c8374f9b6257c15f074ae0f3c0cebbc0ba3761dd50fedae849/merged","io.kubernetes.cri-o.Name":"k8s_kube-scheduler_kube-scheduler-ha-078118_kube-system_eef6954c295df14c6ded36d455ae3f64_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/0b0c119de2a5e95db0b47c45e75dd2a09a0606aba44508db81678b39fd38137d/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"0b0c119de2a5e95db0b47c45e75dd2a09a0606aba44508db81678b39fd38137d","io.kubernetes.cri-o.SandboxName":"k8s_kube-scheduler-ha-078118_kube-system_eef6954c295df14c6ded36d455ae3f64_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false
","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/eef6954c295df14c6ded36d455ae3f64/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/eef6954c295df14c6ded36d455ae3f64/containers/kube-scheduler/3ee75ede\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/kubernetes/scheduler.conf\",\"host_path\":\"/etc/kubernetes/scheduler.conf\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-scheduler-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"eef6954c295df14c6ded36d455ae3f64","kubernetes.io/config.hash":"eef6954c295df14c6ded36d455ae3f64","kubernetes.io/config.seen":"2025-09-18T17:01:55.876124510Z","kubernetes.io/config
.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependencies":"true","org.systemd.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd","pid":895,"status":"running","bundle":"/run/containers/storage/overlay-containers/d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd/userdata","rootfs":"/var/lib/containers/storage/overlay/e609e9e46a7b4349013bb25dc88f625f340af02c9dc300f5dad6685070fd74b2/merged","created":"2025-09-18T17:01:56.468173373Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"d671eaa0","io.kubernetes.container.name":"kube-apiserver","io.kubernetes.container.ports":"[{\"name\":\"probe-port\",\"hostPort\":8443,\"containerPort\":8443,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/ter
mination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"d671eaa0\",\"io.kubernetes.container.ports\":\"[{\\\"name\\\":\\\"probe-port\\\",\\\"hostPort\\\":8443,\\\"containerPort\\\":8443,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.400849867Z","io.kubernetes.cri-o.Image":"90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-apiserver:v1.34.0","io.kubernetes.cri-o.ImageRef":"90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90","
io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-apiserver\",\"io.kubernetes.pod.name\":\"kube-apiserver-ha-078118\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"eab4cb22d09eb9c837e45b2e0c5fc664\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-apiserver-ha-078118_eab4cb22d09eb9c837e45b2e0c5fc664/kube-apiserver/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-apiserver\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/e609e9e46a7b4349013bb25dc88f625f340af02c9dc300f5dad6685070fd74b2/merged","io.kubernetes.cri-o.Name":"k8s_kube-apiserver_kube-apiserver-ha-078118_kube-system_eab4cb22d09eb9c837e45b2e0c5fc664_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/27ab8b84a9d30c714c81b49dbcbf9e1787031ad0f6c46d6f231d0b79f94b32f5/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"27ab8b84a9d30c714c81b49dbcbf9e1787031ad0f6c46d6f231d0b79f94b32f5","io.kubernetes.cri-o.SandboxName"
:"k8s_kube-apiserver-ha-078118_kube-system_eab4cb22d09eb9c837e45b2e0c5fc664_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/eab4cb22d09eb9c837e45b2e0c5fc664/containers/kube-apiserver/764ef81a\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/ca-certificates\",\"host_path\":\"/etc/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/eab4cb22d09eb9c837e45b2e0c5fc664/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/share/ca-certificates\",\"host_path\":\"/usr/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/ssl/certs\",\"host_path\":\
"/etc/ssl/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/certs\",\"host_path\":\"/var/lib/minikube/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/local/share/ca-certificates\",\"host_path\":\"/usr/local/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-apiserver-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"eab4cb22d09eb9c837e45b2e0c5fc664","kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.49.2:8443","kubernetes.io/config.hash":"eab4cb22d09eb9c837e45b2e0c5fc664","kubernetes.io/config.seen":"2025-09-18T17:01:55.876112955Z","kubernetes.io/config.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependencies":"true","org.system
d.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a","pid":832,"status":"running","bundle":"/run/containers/storage/overlay-containers/f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a/userdata","rootfs":"/var/lib/containers/storage/overlay/ef7555194ebc8c68b1cc9488dbf8f557c6e739f666631cf9b320b2dc5b85a30d/merged","created":"2025-09-18T17:01:56.443422336Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"e9e20c65","io.kubernetes.container.name":"etcd","io.kubernetes.container.ports":"[{\"name\":\"probe-port\",\"hostPort\":2381,\"containerPort\":2381,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"e9e20c65\",\"io.kubernetes.container.ports\":\"[{\
\\"name\\\":\\\"probe-port\\\",\\\"hostPort\\\":2381,\\\"containerPort\\\":2381,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.368917103Z","io.kubernetes.cri-o.Image":"5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115","io.kubernetes.cri-o.ImageName":"registry.k8s.io/etcd:3.6.4-0","io.kubernetes.cri-o.ImageRef":"5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"etcd\",\"io.kubernetes.pod.name\":\"etcd-ha-078118\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"c844ac4cd
3d56ebd5831bc0d85f91b01\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_etcd-ha-078118_c844ac4cd3d56ebd5831bc0d85f91b01/etcd/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"etcd\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/ef7555194ebc8c68b1cc9488dbf8f557c6e739f666631cf9b320b2dc5b85a30d/merged","io.kubernetes.cri-o.Name":"k8s_etcd_etcd-ha-078118_kube-system_c844ac4cd3d56ebd5831bc0d85f91b01_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/392032ae1b29544e24d0d98943a7310ad13f5d12f0c5be5a121d7418fe388e2c/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"392032ae1b29544e24d0d98943a7310ad13f5d12f0c5be5a121d7418fe388e2c","io.kubernetes.cri-o.SandboxName":"k8s_etcd-ha-078118_kube-system_c844ac4cd3d56ebd5831bc0d85f91b01_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\
":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/c844ac4cd3d56ebd5831bc0d85f91b01/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/c844ac4cd3d56ebd5831bc0d85f91b01/containers/etcd/129e1cf5\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/etcd\",\"host_path\":\"/var/lib/minikube/etcd\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/certs/etcd\",\"host_path\":\"/var/lib/minikube/certs/etcd\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"etcd-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"c844ac4cd3d56ebd5831bc0d85f91b01","kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.49.2:2379","kubernetes.io/config.hash":"c844ac4cd3d56ebd5831bc0d85f91b01",
"kubernetes.io/config.seen":"2025-09-18T17:01:55.876108105Z","kubernetes.io/config.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependencies":"true","org.systemd.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"}]
	I0918 17:01:56.780559   88523 cri.go:126] list returned 5 containers
	I0918 17:01:56.780578   88523 cri.go:129] container: {ID:1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5 Status:running}
	I0918 17:01:56.780593   88523 cri.go:135] skipping {1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5 running}: state = "running", want "paused"
	I0918 17:01:56.780608   88523 cri.go:129] container: {ID:1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156 Status:running}
	I0918 17:01:56.780614   88523 cri.go:135] skipping {1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156 running}: state = "running", want "paused"
	I0918 17:01:56.780622   88523 cri.go:129] container: {ID:47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67 Status:running}
	I0918 17:01:56.780627   88523 cri.go:135] skipping {47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67 running}: state = "running", want "paused"
	I0918 17:01:56.780635   88523 cri.go:129] container: {ID:d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd Status:running}
	I0918 17:01:56.780640   88523 cri.go:135] skipping {d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd running}: state = "running", want "paused"
	I0918 17:01:56.780648   88523 cri.go:129] container: {ID:f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a Status:running}
	I0918 17:01:56.780654   88523 cri.go:135] skipping {f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a running}: state = "running", want "paused"
	I0918 17:01:56.780711   88523 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0918 17:01:56.790261   88523 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0918 17:01:56.790289   88523 kubeadm.go:589] restartPrimaryControlPlane start ...
	I0918 17:01:56.790351   88523 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0918 17:01:56.799692   88523 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:01:56.800125   88523 kubeconfig.go:47] verify endpoint returned: get endpoint: "ha-078118" does not appear in /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:01:56.800245   88523 kubeconfig.go:62] /home/jenkins/minikube-integration/20370-7845/kubeconfig needs updating (will repair): [kubeconfig missing "ha-078118" cluster setting kubeconfig missing "ha-078118" context setting]
	I0918 17:01:56.800516   88523 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.800988   88523 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, Us
erAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0918 17:01:56.801446   88523 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
	I0918 17:01:56.801466   88523 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I0918 17:01:56.801472   88523 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
	I0918 17:01:56.801477   88523 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I0918 17:01:56.801483   88523 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
	I0918 17:01:56.801488   88523 cert_rotation.go:141] "Starting client certificate rotation controller" logger="tls-transport-cache"
	I0918 17:01:56.801819   88523 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0918 17:01:56.811376   88523 kubeadm.go:626] The running cluster does not require reconfiguration: 192.168.49.2
	I0918 17:01:56.811406   88523 kubeadm.go:593] duration metric: took 21.110094ms to restartPrimaryControlPlane
	I0918 17:01:56.811418   88523 kubeadm.go:394] duration metric: took 91.570194ms to StartCluster
	I0918 17:01:56.811440   88523 settings.go:142] acquiring lock: {Name:mk72fea03aefe901db9522a467405d86665fedd0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.811525   88523 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:01:56.812011   88523 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.812251   88523 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:01:56.812273   88523 start.go:241] waiting for startup goroutines ...
	I0918 17:01:56.812281   88523 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0918 17:01:56.812548   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:56.818560   88523 out.go:179] * Enabled addons: 
	I0918 17:01:56.819862   88523 addons.go:514] duration metric: took 7.577022ms for enable addons: enabled=[]
	I0918 17:01:56.819895   88523 start.go:246] waiting for cluster config update ...
	I0918 17:01:56.819902   88523 start.go:255] writing updated cluster config ...
	I0918 17:01:56.821358   88523 out.go:203] 
	I0918 17:01:56.822838   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:56.822935   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:56.824668   88523 out.go:179] * Starting "ha-078118-m02" control-plane node in "ha-078118" cluster
	I0918 17:01:56.826202   88523 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:01:56.827692   88523 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:01:56.829025   88523 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:01:56.829052   88523 cache.go:58] Caching tarball of preloaded images
	I0918 17:01:56.829116   88523 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:01:56.829157   88523 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:01:56.829174   88523 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:01:56.829286   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:56.852123   88523 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:01:56.852147   88523 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:01:56.852166   88523 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:01:56.852198   88523 start.go:360] acquireMachinesLock for ha-078118-m02: {Name:mk65f6a883861f2032241e1132c63effea2ab61f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:01:56.852266   88523 start.go:364] duration metric: took 48.677µs to acquireMachinesLock for "ha-078118-m02"
	I0918 17:01:56.852296   88523 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:01:56.852306   88523 fix.go:54] fixHost starting: m02
	I0918 17:01:56.852668   88523 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:01:56.872076   88523 fix.go:112] recreateIfNeeded on ha-078118-m02: state=Stopped err=<nil>
	W0918 17:01:56.872113   88523 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:01:56.874087   88523 out.go:252] * Restarting existing docker container for "ha-078118-m02" ...
	I0918 17:01:56.874180   88523 cli_runner.go:164] Run: docker start ha-078118-m02
	I0918 17:01:57.139627   88523 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:01:57.162974   88523 kic.go:430] container "ha-078118-m02" state is running.
	I0918 17:01:57.163617   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:01:57.187278   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:57.187580   88523 machine.go:93] provisionDockerMachine start ...
	I0918 17:01:57.187647   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:01:57.208558   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:57.208807   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32818 <nil> <nil>}
	I0918 17:01:57.208821   88523 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:01:57.209542   88523 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:35706->127.0.0.1:32818: read: connection reset by peer
	I0918 17:02:00.346412   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 17:02:00.346437   88523 ubuntu.go:182] provisioning hostname "ha-078118-m02"
	I0918 17:02:00.346489   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:00.364917   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:00.365177   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32818 <nil> <nil>}
	I0918 17:02:00.365191   88523 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m02 && echo "ha-078118-m02" | sudo tee /etc/hostname
	I0918 17:02:00.514327   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 17:02:00.514402   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:00.533549   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:00.533751   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32818 <nil> <nil>}
	I0918 17:02:00.533768   88523 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m02' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m02/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m02' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:02:00.670395   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:02:00.670429   88523 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:02:00.670444   88523 ubuntu.go:190] setting up certificates
	I0918 17:02:00.670453   88523 provision.go:84] configureAuth start
	I0918 17:02:00.670535   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:02:00.688318   88523 provision.go:143] copyHostCerts
	I0918 17:02:00.688353   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:02:00.688380   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:02:00.688388   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:02:00.688466   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:02:00.688593   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:02:00.688616   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:02:00.688621   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:02:00.688655   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:02:00.688706   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:02:00.688723   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:02:00.688727   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:02:00.688752   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:02:00.688815   88523 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m02 san=[127.0.0.1 192.168.49.3 ha-078118-m02 localhost minikube]
	I0918 17:02:01.100643   88523 provision.go:177] copyRemoteCerts
	I0918 17:02:01.100699   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:02:01.100739   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:01.128283   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:01.233731   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 17:02:01.233795   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:02:01.267239   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 17:02:01.267312   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 17:02:01.299631   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 17:02:01.299701   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:02:01.333166   88523 provision.go:87] duration metric: took 662.697168ms to configureAuth
	I0918 17:02:01.333201   88523 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:02:01.333436   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:01.333668   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:01.355891   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:01.356100   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32818 <nil> <nil>}
	I0918 17:02:01.356116   88523 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:02:01.803484   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:02:01.803598   88523 machine.go:96] duration metric: took 4.615990236s to provisionDockerMachine
	I0918 17:02:01.803617   88523 start.go:293] postStartSetup for "ha-078118-m02" (driver="docker")
	I0918 17:02:01.803631   88523 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:02:01.803737   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:02:01.803809   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:01.824810   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:01.943231   88523 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:02:01.949156   88523 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:02:01.949190   88523 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:02:01.949200   88523 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:02:01.949208   88523 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:02:01.949221   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:02:01.949294   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:02:01.949388   88523 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:02:01.949398   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 17:02:01.949539   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:02:01.964224   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:02:02.000604   88523 start.go:296] duration metric: took 196.969548ms for postStartSetup
	I0918 17:02:02.000678   88523 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:02:02.000709   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:02.024047   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:02.125240   88523 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:02:02.131938   88523 fix.go:56] duration metric: took 5.279624751s for fixHost
	I0918 17:02:02.131967   88523 start.go:83] releasing machines lock for "ha-078118-m02", held for 5.279686169s
	I0918 17:02:02.132049   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:02:02.156676   88523 out.go:179] * Found network options:
	I0918 17:02:02.157902   88523 out.go:179]   - NO_PROXY=192.168.49.2
	W0918 17:02:02.159818   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:02:02.159872   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 17:02:02.159952   88523 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:02:02.160020   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:02.160303   88523 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:02:02.160395   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:02.186312   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:02.187028   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:02.428885   88523 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:02:02.434009   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:02:02.444157   88523 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:02:02.444228   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:02:02.454051   88523 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:02:02.454077   88523 start.go:495] detecting cgroup driver to use...
	I0918 17:02:02.454114   88523 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:02:02.454162   88523 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:02:02.466948   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:02:02.478891   88523 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:02:02.478957   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:02:02.491961   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:02:02.504752   88523 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:02:02.594029   88523 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:02:02.701933   88523 docker.go:234] disabling docker service ...
	I0918 17:02:02.702003   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:02:02.717057   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:02:02.731660   88523 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:02:02.853518   88523 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:02:02.996040   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:02:03.016174   88523 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:02:03.045704   88523 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:02:03.045764   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.061608   88523 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:02:03.061695   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.083523   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.105214   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.120699   88523 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:02:03.138140   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.162450   88523 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.182797   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.204229   88523 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:02:03.218676   88523 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:02:03.234833   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:02:03.414424   88523 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:02:03.681075   88523 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:02:03.681172   88523 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:02:03.685900   88523 start.go:563] Will wait 60s for crictl version
	I0918 17:02:03.685976   88523 ssh_runner.go:195] Run: which crictl
	I0918 17:02:03.689938   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:03.732205   88523 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 17:02:03.732322   88523 ssh_runner.go:195] Run: crio --version
	I0918 17:02:03.780573   88523 ssh_runner.go:195] Run: crio --version
	I0918 17:02:03.836328   88523 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 17:02:03.837848   88523 out.go:179]   - env NO_PROXY=192.168.49.2
	I0918 17:02:03.839158   88523 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:02:03.863484   88523 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 17:02:03.869490   88523 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:02:03.885574   88523 mustload.go:65] Loading cluster: ha-078118
	I0918 17:02:03.885865   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:03.886138   88523 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:02:03.910178   88523 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:02:03.910520   88523 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.3
	I0918 17:02:03.910532   88523 certs.go:194] generating shared ca certs ...
	I0918 17:02:03.910550   88523 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:02:03.910702   88523 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 17:02:03.910746   88523 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 17:02:03.910754   88523 certs.go:256] generating profile certs ...
	I0918 17:02:03.910869   88523 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 17:02:03.910966   88523 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.e3295e3c
	I0918 17:02:03.911006   88523 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 17:02:03.911015   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 17:02:03.911031   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 17:02:03.911045   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 17:02:03.911062   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 17:02:03.911076   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 17:02:03.911090   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 17:02:03.911111   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 17:02:03.911124   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 17:02:03.911179   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 17:02:03.911212   88523 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 17:02:03.911222   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 17:02:03.911254   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 17:02:03.911281   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 17:02:03.911326   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 17:02:03.911397   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:02:03.911438   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 17:02:03.911459   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:02:03.911472   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 17:02:03.911547   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:02:03.946173   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:02:04.042870   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
	I0918 17:02:04.047477   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
	I0918 17:02:04.062496   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
	I0918 17:02:04.066022   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
	I0918 17:02:04.079216   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
	I0918 17:02:04.082987   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
	I0918 17:02:04.096266   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
	I0918 17:02:04.099842   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)
	I0918 17:02:04.114219   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
	I0918 17:02:04.117647   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
	I0918 17:02:04.130510   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
	I0918 17:02:04.134062   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
	I0918 17:02:04.148209   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 17:02:04.175449   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 17:02:04.202169   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 17:02:04.229482   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 17:02:04.256335   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
	I0918 17:02:04.282706   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 17:02:04.310591   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 17:02:04.337521   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 17:02:04.364519   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 17:02:04.390068   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 17:02:04.417491   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 17:02:04.443222   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
	I0918 17:02:04.463097   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
	I0918 17:02:04.483042   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
	I0918 17:02:04.502767   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)
	I0918 17:02:04.522870   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
	I0918 17:02:04.541750   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
	I0918 17:02:04.561986   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
	I0918 17:02:04.581734   88523 ssh_runner.go:195] Run: openssl version
	I0918 17:02:04.587350   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 17:02:04.597650   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 17:02:04.601731   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 17:02:04.601792   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 17:02:04.609763   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 17:02:04.619714   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 17:02:04.630360   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 17:02:04.634287   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 17:02:04.634340   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 17:02:04.641345   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 17:02:04.652864   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 17:02:04.664993   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:02:04.668853   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:02:04.668927   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:02:04.676354   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 17:02:04.686228   88523 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 17:02:04.690454   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0918 17:02:04.697758   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0918 17:02:04.705195   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0918 17:02:04.713070   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0918 17:02:04.720155   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0918 17:02:04.727534   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0918 17:02:04.734944   88523 kubeadm.go:926] updating node {m02 192.168.49.3 8443 v1.34.0 crio true true} ...
	I0918 17:02:04.735045   88523 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.3
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 17:02:04.735075   88523 kube-vip.go:115] generating kube-vip config ...
	I0918 17:02:04.735113   88523 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 17:02:04.751022   88523 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:02:04.751100   88523 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 17:02:04.751163   88523 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 17:02:04.762324   88523 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 17:02:04.762394   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
	I0918 17:02:04.772244   88523 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0918 17:02:04.792115   88523 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 17:02:04.812418   88523 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 17:02:04.831828   88523 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 17:02:04.835579   88523 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:02:04.848821   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:02:04.970270   88523 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:02:04.984165   88523 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:02:04.984487   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:04.987586   88523 out.go:179] * Verifying Kubernetes components...
	I0918 17:02:04.988873   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:02:05.103279   88523 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:02:05.116687   88523 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	W0918 17:02:05.116759   88523 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.49.254:8443 with https://192.168.49.2:8443
	I0918 17:02:05.117030   88523 node_ready.go:35] waiting up to 6m0s for node "ha-078118-m02" to be "Ready" ...
	I0918 17:02:05.126204   88523 node_ready.go:49] node "ha-078118-m02" is "Ready"
	I0918 17:02:05.126229   88523 node_ready.go:38] duration metric: took 9.18178ms for node "ha-078118-m02" to be "Ready" ...
	I0918 17:02:05.126242   88523 api_server.go:52] waiting for apiserver process to appear ...
	I0918 17:02:05.126286   88523 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:02:05.138174   88523 api_server.go:72] duration metric: took 153.959457ms to wait for apiserver process to appear ...
	I0918 17:02:05.138199   88523 api_server.go:88] waiting for apiserver healthz status ...
	I0918 17:02:05.138219   88523 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0918 17:02:05.143842   88523 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0918 17:02:05.144983   88523 api_server.go:141] control plane version: v1.34.0
	I0918 17:02:05.145013   88523 api_server.go:131] duration metric: took 6.806624ms to wait for apiserver health ...
	I0918 17:02:05.145024   88523 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 17:02:05.151629   88523 system_pods.go:59] 24 kube-system pods found
	I0918 17:02:05.151671   88523 system_pods.go:61] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:02:05.151682   88523 system_pods.go:61] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:02:05.151698   88523 system_pods.go:61] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:02:05.151709   88523 system_pods.go:61] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:02:05.151716   88523 system_pods.go:61] "etcd-ha-078118-m03" [ef27a91e-a220-4dcb-885c-2941742d985e] Running
	I0918 17:02:05.151723   88523 system_pods.go:61] "kindnet-f2b4b" [98c5afc6-e57e-488c-948a-e24ec24b97a7] Running
	I0918 17:02:05.151729   88523 system_pods.go:61] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 17:02:05.151736   88523 system_pods.go:61] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 17:02:05.151747   88523 system_pods.go:61] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:02:05.151761   88523 system_pods.go:61] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:02:05.151771   88523 system_pods.go:61] "kube-apiserver-ha-078118-m03" [1cc265d4-6f02-4291-b218-cfa76bcf557f] Running
	I0918 17:02:05.151784   88523 system_pods.go:61] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:02:05.151796   88523 system_pods.go:61] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:02:05.151805   88523 system_pods.go:61] "kube-controller-manager-ha-078118-m03" [43309df5-32b3-4ca8-a0a0-23bfcaac2138] Running
	I0918 17:02:05.151812   88523 system_pods.go:61] "kube-proxy-2pjrn" [490f3965-2c3c-42d8-89b3-d3d599ebf60e] Running
	I0918 17:02:05.151817   88523 system_pods.go:61] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 17:02:05.151823   88523 system_pods.go:61] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 17:02:05.151839   88523 system_pods.go:61] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:02:05.151856   88523 system_pods.go:61] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:02:05.151865   88523 system_pods.go:61] "kube-scheduler-ha-078118-m03" [93dfed73-cd97-4f3f-804e-ffdd528fd8ff] Running
	I0918 17:02:05.151872   88523 system_pods.go:61] "kube-vip-ha-078118" [d3c28c72-f791-4e3f-bd5f-91fc9bcb1fee] Running
	I0918 17:02:05.151880   88523 system_pods.go:61] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 17:02:05.151884   88523 system_pods.go:61] "kube-vip-ha-078118-m03" [919fbb1f-4ca4-41e2-a8f7-6d2c73f81558] Running
	I0918 17:02:05.151890   88523 system_pods.go:61] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 17:02:05.151899   88523 system_pods.go:74] duration metric: took 6.86776ms to wait for pod list to return data ...
	I0918 17:02:05.151913   88523 default_sa.go:34] waiting for default service account to be created ...
	I0918 17:02:05.155271   88523 default_sa.go:45] found service account: "default"
	I0918 17:02:05.155311   88523 default_sa.go:55] duration metric: took 3.373656ms for default service account to be created ...
	I0918 17:02:05.155323   88523 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 17:02:05.161172   88523 system_pods.go:86] 24 kube-system pods found
	I0918 17:02:05.161213   88523 system_pods.go:89] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:02:05.161226   88523 system_pods.go:89] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:02:05.161239   88523 system_pods.go:89] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:02:05.161252   88523 system_pods.go:89] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:02:05.161258   88523 system_pods.go:89] "etcd-ha-078118-m03" [ef27a91e-a220-4dcb-885c-2941742d985e] Running
	I0918 17:02:05.161268   88523 system_pods.go:89] "kindnet-f2b4b" [98c5afc6-e57e-488c-948a-e24ec24b97a7] Running
	I0918 17:02:05.161273   88523 system_pods.go:89] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 17:02:05.161281   88523 system_pods.go:89] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 17:02:05.161291   88523 system_pods.go:89] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:02:05.161310   88523 system_pods.go:89] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:02:05.161317   88523 system_pods.go:89] "kube-apiserver-ha-078118-m03" [1cc265d4-6f02-4291-b218-cfa76bcf557f] Running
	I0918 17:02:05.161326   88523 system_pods.go:89] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:02:05.161338   88523 system_pods.go:89] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:02:05.161347   88523 system_pods.go:89] "kube-controller-manager-ha-078118-m03" [43309df5-32b3-4ca8-a0a0-23bfcaac2138] Running
	I0918 17:02:05.161356   88523 system_pods.go:89] "kube-proxy-2pjrn" [490f3965-2c3c-42d8-89b3-d3d599ebf60e] Running
	I0918 17:02:05.161362   88523 system_pods.go:89] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 17:02:05.161368   88523 system_pods.go:89] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 17:02:05.161376   88523 system_pods.go:89] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:02:05.161388   88523 system_pods.go:89] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:02:05.161397   88523 system_pods.go:89] "kube-scheduler-ha-078118-m03" [93dfed73-cd97-4f3f-804e-ffdd528fd8ff] Running
	I0918 17:02:05.161403   88523 system_pods.go:89] "kube-vip-ha-078118" [d3c28c72-f791-4e3f-bd5f-91fc9bcb1fee] Running
	I0918 17:02:05.161408   88523 system_pods.go:89] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 17:02:05.161415   88523 system_pods.go:89] "kube-vip-ha-078118-m03" [919fbb1f-4ca4-41e2-a8f7-6d2c73f81558] Running
	I0918 17:02:05.161420   88523 system_pods.go:89] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 17:02:05.161430   88523 system_pods.go:126] duration metric: took 6.100358ms to wait for k8s-apps to be running ...
	I0918 17:02:05.161440   88523 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 17:02:05.161516   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:02:05.177297   88523 system_svc.go:56] duration metric: took 15.845414ms WaitForService to wait for kubelet
	I0918 17:02:05.177334   88523 kubeadm.go:578] duration metric: took 193.125652ms to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:02:05.177354   88523 node_conditions.go:102] verifying NodePressure condition ...
	I0918 17:02:05.185021   88523 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:02:05.185063   88523 node_conditions.go:123] node cpu capacity is 8
	I0918 17:02:05.185079   88523 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:02:05.185084   88523 node_conditions.go:123] node cpu capacity is 8
	I0918 17:02:05.185089   88523 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:02:05.185094   88523 node_conditions.go:123] node cpu capacity is 8
	I0918 17:02:05.185100   88523 node_conditions.go:105] duration metric: took 7.739153ms to run NodePressure ...
	I0918 17:02:05.185116   88523 start.go:241] waiting for startup goroutines ...
	I0918 17:02:05.185151   88523 start.go:255] writing updated cluster config ...
	I0918 17:02:05.188016   88523 out.go:203] 
	I0918 17:02:05.189941   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:05.190105   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:02:05.191907   88523 out.go:179] * Starting "ha-078118-m03" control-plane node in "ha-078118" cluster
	I0918 17:02:05.194060   88523 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:02:05.195551   88523 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:02:05.197069   88523 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:02:05.197116   88523 cache.go:58] Caching tarball of preloaded images
	I0918 17:02:05.197212   88523 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:02:05.197242   88523 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:02:05.197264   88523 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:02:05.197414   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:02:05.226983   88523 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:02:05.227006   88523 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:02:05.227018   88523 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:02:05.227040   88523 start.go:360] acquireMachinesLock for ha-078118-m03: {Name:mk9d1c903c967299da898df87db82c277b1f732e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:02:05.227086   88523 start.go:364] duration metric: took 34.168µs to acquireMachinesLock for "ha-078118-m03"
	I0918 17:02:05.227103   88523 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:02:05.227108   88523 fix.go:54] fixHost starting: m03
	I0918 17:02:05.227303   88523 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:02:05.249149   88523 fix.go:112] recreateIfNeeded on ha-078118-m03: state=Stopped err=<nil>
	W0918 17:02:05.249177   88523 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:02:05.250693   88523 out.go:252] * Restarting existing docker container for "ha-078118-m03" ...
	I0918 17:02:05.250758   88523 cli_runner.go:164] Run: docker start ha-078118-m03
	I0918 17:02:05.515973   88523 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:02:05.536187   88523 kic.go:430] container "ha-078118-m03" state is running.
	I0918 17:02:05.536534   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:02:05.558300   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:02:05.558648   88523 machine.go:93] provisionDockerMachine start ...
	I0918 17:02:05.558720   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:05.579338   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:05.579663   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32823 <nil> <nil>}
	I0918 17:02:05.579678   88523 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:02:05.580353   88523 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:45160->127.0.0.1:32823: read: connection reset by peer
	I0918 17:02:08.725772   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m03
	
	I0918 17:02:08.725804   88523 ubuntu.go:182] provisioning hostname "ha-078118-m03"
	I0918 17:02:08.725891   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:08.756666   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:08.756974   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32823 <nil> <nil>}
	I0918 17:02:08.756986   88523 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m03 && echo "ha-078118-m03" | sudo tee /etc/hostname
	I0918 17:02:08.930439   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m03
	
	I0918 17:02:08.930535   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:08.952376   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:08.952708   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32823 <nil> <nil>}
	I0918 17:02:08.952734   88523 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m03' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m03/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m03' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:02:09.100605   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:02:09.100638   88523 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:02:09.100658   88523 ubuntu.go:190] setting up certificates
	I0918 17:02:09.100671   88523 provision.go:84] configureAuth start
	I0918 17:02:09.100729   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:02:09.118862   88523 provision.go:143] copyHostCerts
	I0918 17:02:09.118901   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:02:09.118950   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:02:09.118960   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:02:09.119047   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:02:09.119191   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:02:09.119226   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:02:09.119236   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:02:09.119282   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:02:09.119369   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:02:09.119400   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:02:09.119409   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:02:09.119444   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:02:09.119559   88523 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m03 san=[127.0.0.1 192.168.49.4 ha-078118-m03 localhost minikube]
	I0918 17:02:09.260974   88523 provision.go:177] copyRemoteCerts
	I0918 17:02:09.261051   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:02:09.261103   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:09.280371   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:09.387340   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 17:02:09.387407   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:02:09.416941   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 17:02:09.417026   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 17:02:09.446183   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 17:02:09.446252   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:02:09.471835   88523 provision.go:87] duration metric: took 371.152567ms to configureAuth
	I0918 17:02:09.471860   88523 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:02:09.472058   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:09.472148   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:09.491093   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:09.491339   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32823 <nil> <nil>}
	I0918 17:02:09.491355   88523 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:02:09.891314   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:02:09.891343   88523 machine.go:96] duration metric: took 4.332677043s to provisionDockerMachine
	I0918 17:02:09.891358   88523 start.go:293] postStartSetup for "ha-078118-m03" (driver="docker")
	I0918 17:02:09.891371   88523 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:02:09.891442   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:02:09.891557   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:09.921555   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:10.028567   88523 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:02:10.033858   88523 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:02:10.033897   88523 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:02:10.033910   88523 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:02:10.033918   88523 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:02:10.033932   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:02:10.034000   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:02:10.034430   88523 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:02:10.034444   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 17:02:10.034568   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:02:10.048975   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:02:10.083492   88523 start.go:296] duration metric: took 192.119586ms for postStartSetup
	I0918 17:02:10.083604   88523 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:02:10.083656   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:10.106324   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:10.203785   88523 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:02:10.208849   88523 fix.go:56] duration metric: took 4.981736294s for fixHost
	I0918 17:02:10.208880   88523 start.go:83] releasing machines lock for "ha-078118-m03", held for 4.981783384s
	I0918 17:02:10.209046   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:02:10.233270   88523 out.go:179] * Found network options:
	I0918 17:02:10.234714   88523 out.go:179]   - NO_PROXY=192.168.49.2,192.168.49.3
	W0918 17:02:10.235974   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:02:10.236005   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:02:10.236041   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:02:10.236061   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 17:02:10.236138   88523 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:02:10.236187   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:10.236220   88523 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:02:10.236289   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:10.256738   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:10.257073   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:10.488616   88523 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:02:10.493307   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:02:10.503073   88523 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:02:10.503146   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:02:10.512908   88523 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:02:10.512936   88523 start.go:495] detecting cgroup driver to use...
	I0918 17:02:10.512971   88523 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:02:10.513021   88523 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:02:10.526086   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:02:10.538395   88523 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:02:10.538454   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:02:10.552019   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:02:10.564326   88523 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:02:10.675410   88523 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:02:10.794108   88523 docker.go:234] disabling docker service ...
	I0918 17:02:10.794170   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:02:10.807169   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:02:10.819727   88523 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:02:10.950399   88523 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:02:11.066947   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:02:11.080007   88523 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:02:11.097805   88523 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:02:11.097858   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.108323   88523 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:02:11.108404   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.118846   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.129919   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.140838   88523 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:02:11.150706   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.161419   88523 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.171572   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.182665   88523 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:02:11.192098   88523 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:02:11.201265   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:02:11.313472   88523 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:02:11.558568   88523 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:02:11.558638   88523 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:02:11.562585   88523 start.go:563] Will wait 60s for crictl version
	I0918 17:02:11.562642   88523 ssh_runner.go:195] Run: which crictl
	I0918 17:02:11.566682   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:11.598728   88523 retry.go:31] will retry after 7.956255474s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:11Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	I0918 17:02:19.555680   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:19.587687   88523 retry.go:31] will retry after 9.296604833s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:19Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	I0918 17:02:28.886490   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:28.918087   88523 retry.go:31] will retry after 27.630342902s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:28Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	I0918 17:02:56.549631   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:56.586522   88523 out.go:203] 
	W0918 17:02:56.587940   88523 out.go:285] X Exiting due to RUNTIME_ENABLE: Failed to start container runtime: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:56Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	
	W0918 17:02:56.587957   88523 out.go:285] * 
	W0918 17:02:56.589763   88523 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0918 17:02:56.591335   88523 out.go:203] 
	
	
	==> CRI-O <==
	Sep 18 17:02:34 ha-078118 crio[549]: time="2025-09-18 17:02:34.060268712Z" level=info msg="Starting container: c5306bc68997539c87c2f87a4d32cb06fd7438b16669456d394f1cf8ae4fb842" id=8840c728-c65d-4ad8-873e-04b29bd68fcb name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 17:02:34 ha-078118 crio[549]: time="2025-09-18 17:02:34.066403407Z" level=info msg="Started container" PID=1664 containerID=c5306bc68997539c87c2f87a4d32cb06fd7438b16669456d394f1cf8ae4fb842 description=kube-system/storage-provisioner/storage-provisioner id=8840c728-c65d-4ad8-873e-04b29bd68fcb name=/runtime.v1.RuntimeService/StartContainer sandboxID=b81ecaff085b3b8d21b63fb91c35feb7061e0f58a0af5d1c5dacb91a2588e358
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.553598938Z" level=info msg="Running pod sandbox: default/busybox-7b57f96db7-8z4jq/POD" id=2153c012-19f9-4b62-a65f-1f86ab88833f name=/runtime.v1.RuntimeService/RunPodSandbox
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.553664224Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.567735894Z" level=info msg="Got pod network &{Name:busybox-7b57f96db7-8z4jq Namespace:default ID:4ed9df865d51951581fa18a38feb1e1f3cab5927fd87db98d679b83814bac0df UID:43e34594-9fbe-4c7f-b976-5df485b31ec1 NetNS:/var/run/netns/d54c6c86-4052-4027-9485-b7d139abfd45 Networks:[] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.567766994Z" level=info msg="Adding pod default_busybox-7b57f96db7-8z4jq to CNI network \"kindnet\" (type=ptp)"
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.577694368Z" level=info msg="Got pod network &{Name:busybox-7b57f96db7-8z4jq Namespace:default ID:4ed9df865d51951581fa18a38feb1e1f3cab5927fd87db98d679b83814bac0df UID:43e34594-9fbe-4c7f-b976-5df485b31ec1 NetNS:/var/run/netns/d54c6c86-4052-4027-9485-b7d139abfd45 Networks:[] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.577822099Z" level=info msg="Checking pod default_busybox-7b57f96db7-8z4jq for CNI network kindnet (type=ptp)"
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.578687556Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.579754844Z" level=info msg="Ran pod sandbox 4ed9df865d51951581fa18a38feb1e1f3cab5927fd87db98d679b83814bac0df with infra container: default/busybox-7b57f96db7-8z4jq/POD" id=2153c012-19f9-4b62-a65f-1f86ab88833f name=/runtime.v1.RuntimeService/RunPodSandbox
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.581000369Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28" id=4b3aaba2-af16-4909-aec4-0833192263a6 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.581251427Z" level=info msg="Image gcr.io/k8s-minikube/busybox:1.28 not found" id=4b3aaba2-af16-4909-aec4-0833192263a6 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.582052575Z" level=info msg="Pulling image: gcr.io/k8s-minikube/busybox:1.28" id=0005ca07-7e47-4ed3-8b4a-428a58471a33 name=/runtime.v1.ImageService/PullImage
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.587016416Z" level=info msg="Trying to access \"gcr.io/k8s-minikube/busybox:1.28\""
	Sep 18 17:03:00 ha-078118 crio[549]: time="2025-09-18 17:03:00.415839008Z" level=info msg="Trying to access \"gcr.io/k8s-minikube/busybox:1.28\""
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.619428740Z" level=info msg="Pulled image: gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335" id=0005ca07-7e47-4ed3-8b4a-428a58471a33 name=/runtime.v1.ImageService/PullImage
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.620142037Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28" id=0fc8fe55-a57a-4dfe-9b33-a9cd7b30b579 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.620710816Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,RepoTags:[gcr.io/k8s-minikube/busybox:1.28],RepoDigests:[gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335 gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12],Size_:1363676,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=0fc8fe55-a57a-4dfe-9b33-a9cd7b30b579 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.621392916Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28" id=d20453f4-7a64-430d-be1f-53a42e414e4c name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.622061348Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,RepoTags:[gcr.io/k8s-minikube/busybox:1.28],RepoDigests:[gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335 gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12],Size_:1363676,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=d20453f4-7a64-430d-be1f-53a42e414e4c name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.625531802Z" level=info msg="Creating container: default/busybox-7b57f96db7-8z4jq/busybox" id=0e84c568-4c82-4d47-a594-6e125813d616 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.625655265Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.697400770Z" level=info msg="Created container a6abf33433693d8ceabcc0df33e79fd6700f8c0f0416d08d6beda409021fd28e: default/busybox-7b57f96db7-8z4jq/busybox" id=0e84c568-4c82-4d47-a594-6e125813d616 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.698073432Z" level=info msg="Starting container: a6abf33433693d8ceabcc0df33e79fd6700f8c0f0416d08d6beda409021fd28e" id=af3aa0c9-e5da-4670-8bd4-33f66d6955eb name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.704786907Z" level=info msg="Started container" PID=2027 containerID=a6abf33433693d8ceabcc0df33e79fd6700f8c0f0416d08d6beda409021fd28e description=default/busybox-7b57f96db7-8z4jq/busybox id=af3aa0c9-e5da-4670-8bd4-33f66d6955eb name=/runtime.v1.RuntimeService/StartContainer sandboxID=4ed9df865d51951581fa18a38feb1e1f3cab5927fd87db98d679b83814bac0df
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                                 CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	a6abf33433693       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   16 seconds ago       Running             busybox                   0                   4ed9df865d519       busybox-7b57f96db7-8z4jq
	c5306bc689975       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      44 seconds ago       Running             storage-provisioner       2                   b81ecaff085b3       storage-provisioner
	d92258dd572de       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                      About a minute ago   Running             coredns                   1                   e25b7987fbe82       coredns-66bc5c9577-q42l7
	21e20d4ddc753       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                      About a minute ago   Running             coredns                   1                   a7949d1b05144       coredns-66bc5c9577-g9xk6
	ee4b7f442abce       409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c                                      About a minute ago   Running             kindnet-cni               1                   b28207bd36b40       kindnet-vqp76
	21b6ad607723f       df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce                                      About a minute ago   Running             kube-proxy                1                   a80daddb8a1b8       kube-proxy-b98xh
	e26adb5e15f89       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      About a minute ago   Exited              storage-provisioner       1                   b81ecaff085b3       storage-provisioner
	1116d08ec1d26       a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634                                      About a minute ago   Running             kube-controller-manager   1                   bc00758e6c840       kube-controller-manager-ha-078118
	d4f5428eab0f2       90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90                                      About a minute ago   Running             kube-apiserver            1                   27ab8b84a9d30       kube-apiserver-ha-078118
	47b875d1b553d       46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc                                      About a minute ago   Running             kube-scheduler            1                   0b0c119de2a5e       kube-scheduler-ha-078118
	1fb0f2e98fb3a       765655ea6078171c416896d7cc155c1263a0411d30caaa03d7365aecb99fdf23                                      About a minute ago   Running             kube-vip                  0                   30db82bb4c1ec       kube-vip-ha-078118
	f91dc53d280e7       5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115                                      About a minute ago   Running             etcd                      1                   392032ae1b295       etcd-ha-078118
	
	
	==> coredns [21e20d4ddc7530d0ecedda7040a90cb736185c9e2cfa6123c719be543b5f0b45] <==
	maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
	.:53
	[INFO] plugin/reload: Running configuration SHA512 = 9e2996f8cb67ac53e0259ab1f8d615d07d1beb0bd07e6a1e39769c3bf486a905bb991cc47f8d2f14d0d3a90a87dfc625a0b4c524fed169d8158c40657c0694b1
	CoreDNS-1.12.1
	linux/amd64, go1.24.1, 707c7c1
	[INFO] 127.0.0.1:50820 - 24265 "HINFO IN 812459865089642632.5213722986442749200. udp 56 false 512" NXDOMAIN qr,rd,ra 131 0.020389884s
	
	
	==> coredns [d92258dd572ded142a5afbc78cddf28ea3a1121361d80dd2d867608475828e4a] <==
	maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
	.:53
	[INFO] plugin/reload: Running configuration SHA512 = 9e2996f8cb67ac53e0259ab1f8d615d07d1beb0bd07e6a1e39769c3bf486a905bb991cc47f8d2f14d0d3a90a87dfc625a0b4c524fed169d8158c40657c0694b1
	CoreDNS-1.12.1
	linux/amd64, go1.24.1, 707c7c1
	[INFO] 127.0.0.1:32816 - 43183 "HINFO IN 6715587801686201477.3035471256272355978. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.032152072s
	
	
	==> describe nodes <==
	Name:               ha-078118
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2025_09_18T16_57_20_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:57:14 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:03:13 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 17:02:01 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 17:02:01 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 17:02:01 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 17:02:01 +0000   Thu, 18 Sep 2025 16:57:34 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ha-078118
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 458d106b7f2d49958eb79b0b2fc209fe
	  System UUID:                910bee46-adcd-4833-91ec-cea7d3c2588c
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (11 in total)
	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---
	  default                     busybox-7b57f96db7-8z4jq             0 (0%)        0 (0%)      0 (0%)           0 (0%)         19s
	  kube-system                 coredns-66bc5c9577-g9xk6             100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     5m55s
	  kube-system                 coredns-66bc5c9577-q42l7             100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     5m55s
	  kube-system                 etcd-ha-078118                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         5m59s
	  kube-system                 kindnet-vqp76                        100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      5m55s
	  kube-system                 kube-apiserver-ha-078118             250m (3%)     0 (0%)      0 (0%)           0 (0%)         5m59s
	  kube-system                 kube-controller-manager-ha-078118    200m (2%)     0 (0%)      0 (0%)           0 (0%)         5m59s
	  kube-system                 kube-proxy-b98xh                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m55s
	  kube-system                 kube-scheduler-ha-078118             100m (1%)     0 (0%)      0 (0%)           0 (0%)         5m59s
	  kube-system                 kube-vip-ha-078118                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         76s
	  kube-system                 storage-provisioner                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m55s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (11%)  100m (1%)
	  memory             290Mi (0%)  390Mi (1%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                  From             Message
	  ----    ------                   ----                 ----             -------
	  Normal  Starting                 5m55s                kube-proxy       
	  Normal  Starting                 75s                  kube-proxy       
	  Normal  NodeHasSufficientPID     6m6s (x8 over 6m6s)  kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  Starting                 6m6s                 kubelet          Starting kubelet.
	  Normal  NodeHasNoDiskPressure    6m6s (x8 over 6m6s)  kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientMemory  6m6s (x8 over 6m6s)  kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  Starting                 5m59s                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  5m59s                kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     5m59s                kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  NodeHasNoDiskPressure    5m59s                kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  RegisteredNode           5m57s                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  NodeReady                5m44s                kubelet          Node ha-078118 status is now: NodeReady
	  Normal  RegisteredNode           5m30s                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           4m26s                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           2m49s                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  Starting                 83s                  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  83s (x8 over 83s)    kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    83s (x8 over 83s)    kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     83s (x8 over 83s)    kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           73s                  node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           73s                  node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           66s                  node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	
	
	Name:               ha-078118-m02
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118-m02
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=false
	                    minikube.k8s.io/updated_at=2025_09_18T16_57_51_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:57:50 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118-m02
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:03:13 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 17:02:02 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 17:02:02 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 17:02:02 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 17:02:02 +0000   Thu, 18 Sep 2025 16:58:34 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.3
	  Hostname:    ha-078118-m02
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 3f995e2e4a1c4f75914810fc1dbd193e
	  System UUID:                0093212b-e7dd-4bdc-8376-480f39da7714
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.1.0/24
	PodCIDRs:                     10.244.1.0/24
	Non-terminated Pods:          (9 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     busybox-7b57f96db7-bzrv2                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m5s
	  default                     busybox-7b57f96db7-t7rzr                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m5s
	  kube-system                 etcd-ha-078118-m02                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         5m26s
	  kube-system                 kindnet-jnlbr                            100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      5m28s
	  kube-system                 kube-apiserver-ha-078118-m02             250m (3%)     0 (0%)      0 (0%)           0 (0%)         5m26s
	  kube-system                 kube-controller-manager-ha-078118-m02    200m (2%)     0 (0%)      0 (0%)           0 (0%)         5m26s
	  kube-system                 kube-proxy-t5wdg                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m28s
	  kube-system                 kube-scheduler-ha-078118-m02             100m (1%)     0 (0%)      0 (0%)           0 (0%)         5m26s
	  kube-system                 kube-vip-ha-078118-m02                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m26s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%)   100m (1%)
	  memory             150Mi (0%)  50Mi (0%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                    From             Message
	  ----    ------                   ----                   ----             -------
	  Normal  Starting                 5m24s                  kube-proxy       
	  Normal  RegisteredNode           5m27s                  node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode           5m25s                  node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode           4m26s                  node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  NodeHasSufficientMemory  2m54s (x8 over 2m54s)  kubelet          Node ha-078118-m02 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     2m54s (x8 over 2m54s)  kubelet          Node ha-078118-m02 status is now: NodeHasSufficientPID
	  Normal  NodeHasNoDiskPressure    2m54s (x8 over 2m54s)  kubelet          Node ha-078118-m02 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 2m54s                  kubelet          Starting kubelet.
	  Normal  RegisteredNode           2m49s                  node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  Starting                 81s                    kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  81s (x8 over 81s)      kubelet          Node ha-078118-m02 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    81s (x8 over 81s)      kubelet          Node ha-078118-m02 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     81s (x8 over 81s)      kubelet          Node ha-078118-m02 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           73s                    node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode           73s                    node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode           66s                    node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	
	
	==> dmesg <==
	[  +0.089038] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
	[  +0.028015] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
	[  +7.570818] kauditd_printk_skb: 47 callbacks suppressed
	[Sep18 16:41] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.013586] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023854] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023944] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023869] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023927] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000033] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +2.047789] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +4.031621] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000030] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +8.127251] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[Sep18 16:42] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[ +32.253146] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	
	
	==> etcd [f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a] <==
	{"level":"warn","ts":"2025-09-18T17:03:11.574803Z","caller":"rafthttp/stream.go:193","msg":"lost TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","local-member-id":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435"}
	{"level":"warn","ts":"2025-09-18T17:03:11.576711Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"4e0bda6b41205435","rtt":"7.144343ms","error":"dial tcp 192.168.49.4:2380: connect: connection refused"}
	{"level":"warn","ts":"2025-09-18T17:03:11.576729Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"4e0bda6b41205435","rtt":"346.209µs","error":"dial tcp 192.168.49.4:2380: connect: connection refused"}
	{"level":"warn","ts":"2025-09-18T17:03:16.578532Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"4e0bda6b41205435","rtt":"346.209µs","error":"dial tcp 192.168.49.4:2380: connect: connection refused"}
	{"level":"warn","ts":"2025-09-18T17:03:16.578543Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"4e0bda6b41205435","rtt":"7.144343ms","error":"dial tcp 192.168.49.4:2380: connect: connection refused"}
	{"level":"warn","ts":"2025-09-18T17:03:16.766305Z","caller":"etcdserver/cluster_util.go:259","msg":"failed to reach the peer URL","address":"https://192.168.49.4:2380/version","remote-member-id":"4e0bda6b41205435","error":"Get \"https://192.168.49.4:2380/version\": dial tcp 192.168.49.4:2380: i/o timeout"}
	{"level":"warn","ts":"2025-09-18T17:03:16.766378Z","caller":"etcdserver/cluster_util.go:160","msg":"failed to get version","remote-member-id":"4e0bda6b41205435","error":"Get \"https://192.168.49.4:2380/version\": dial tcp 192.168.49.4:2380: i/o timeout"}
	{"level":"warn","ts":"2025-09-18T17:03:18.359685Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.458344Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.542230Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.557930Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.646392Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.657878Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.779048Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.781917Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.785717Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.792993Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.800822Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.804997Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.807961Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.811146Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.817424Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.824669Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.858100Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:18.870670Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	
	
	==> kernel <==
	 17:03:18 up 45 min,  0 users,  load average: 0.53, 0.77, 0.54
	Linux ha-078118 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [ee4b7f442abced82d1215a56d72dcb325957c75eca662f974092a942d3e19c88] <==
	I0918 17:02:33.717248       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 17:02:33.717460       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:02:33.717474       1 main.go:301] handling current node
	I0918 17:02:33.717488       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:02:33.717495       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:02:43.715630       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:02:43.715666       1 main.go:301] handling current node
	I0918 17:02:43.715680       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:02:43.715685       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:02:43.715844       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 17:02:43.715853       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 17:02:53.707928       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:02:53.707982       1 main.go:301] handling current node
	I0918 17:02:53.707996       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:02:53.708001       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:02:53.708180       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 17:02:53.708190       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 17:03:03.707482       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:03:03.707536       1 main.go:301] handling current node
	I0918 17:03:03.707549       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:03:03.707554       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:03:13.715574       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:03:13.715612       1 main.go:301] handling current node
	I0918 17:03:13.715629       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:03:13.715634       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	
	
	==> kube-apiserver [d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd] <==
	I0918 17:02:01.924154       1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
	I0918 17:02:01.924268       1 shared_informer.go:356] "Caches are synced" controller="crd-autoregister"
	I0918 17:02:01.924315       1 aggregator.go:171] initial CRD sync complete...
	I0918 17:02:01.924336       1 autoregister_controller.go:144] Starting autoregister controller
	I0918 17:02:01.924344       1 cache.go:32] Waiting for caches to sync for autoregister controller
	I0918 17:02:01.924356       1 cache.go:39] Caches are synced for autoregister controller
	I0918 17:02:01.924616       1 apf_controller.go:382] Running API Priority and Fairness config worker
	I0918 17:02:01.924627       1 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process
	I0918 17:02:01.925134       1 cache.go:39] Caches are synced for LocalAvailability controller
	I0918 17:02:01.925404       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0918 17:02:01.926298       1 cache.go:39] Caches are synced for RemoteAvailability controller
	I0918 17:02:01.933858       1 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller"
	I0918 17:02:01.935986       1 handler_discovery.go:451] Starting ResourceDiscoveryManager
	W0918 17:02:01.947413       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.49.3]
	I0918 17:02:01.949188       1 controller.go:667] quota admission added evaluator for: endpoints
	I0918 17:02:01.966691       1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
	E0918 17:02:01.974003       1 controller.go:95] Found stale data, removed previous endpoints on kubernetes service, apiserver didn't exit successfully previously
	I0918 17:02:01.981545       1 shared_informer.go:356] "Caches are synced" controller="node_authorizer"
	I0918 17:02:02.059433       1 controller.go:667] quota admission added evaluator for: serviceaccounts
	I0918 17:02:02.827879       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
	W0918 17:02:03.384540       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.49.2]
	I0918 17:02:05.265843       1 controller.go:667] quota admission added evaluator for: replicasets.apps
	I0918 17:02:07.416458       1 controller.go:667] quota admission added evaluator for: deployments.apps
	I0918 17:02:09.060071       1 controller.go:667] quota admission added evaluator for: daemonsets.apps
	I0918 17:03:08.781722       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	
	
	==> kube-controller-manager [1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5] <==
	I0918 17:02:05.259774       1 shared_informer.go:356] "Caches are synced" controller="TTL after finished"
	I0918 17:02:05.259776       1 shared_informer.go:356] "Caches are synced" controller="ReplicationController"
	I0918 17:02:05.259905       1 shared_informer.go:356] "Caches are synced" controller="expand"
	I0918 17:02:05.260131       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-client"
	I0918 17:02:05.261025       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
	I0918 17:02:05.261053       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kube-apiserver-client"
	I0918 17:02:05.264410       1 shared_informer.go:356] "Caches are synced" controller="namespace"
	I0918 17:02:05.267245       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	I0918 17:02:05.267301       1 garbagecollector.go:154] "Garbage collector: all resource monitors have synced" logger="garbage-collector-controller"
	I0918 17:02:05.267312       1 garbagecollector.go:157] "Proceeding to collect garbage" logger="garbage-collector-controller"
	I0918 17:02:05.269527       1 shared_informer.go:356] "Caches are synced" controller="resource quota"
	I0918 17:02:05.274317       1 shared_informer.go:356] "Caches are synced" controller="validatingadmissionpolicy-status"
	I0918 17:02:05.277340       1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice_mirroring"
	I0918 17:02:05.292756       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	I0918 17:02:05.614934       1 endpointslice_controller.go:344] "Error syncing endpoint slices for service, retrying" logger="endpointslice-controller" key="kube-system/kube-dns" err="failed to update kube-dns-dsh2c EndpointSlice for Service kube-system/kube-dns: Operation cannot be fulfilled on endpointslices.discovery.k8s.io \"kube-dns-dsh2c\": the object has been modified; please apply your changes to the latest version and try again"
	I0918 17:02:05.615013       1 event.go:377] Event(v1.ObjectReference{Kind:"Service", Namespace:"kube-system", Name:"kube-dns", UID:"92afb4da-15d6-4c05-b549-cfdf91ba4ea0", APIVersion:"v1", ResourceVersion:"312", FieldPath:""}): type: 'Warning' reason: 'FailedToUpdateEndpointSlices' Error updating Endpoint Slices for Service kube-system/kube-dns: failed to update kube-dns-dsh2c EndpointSlice for Service kube-system/kube-dns: Operation cannot be fulfilled on endpointslices.discovery.k8s.io "kube-dns-dsh2c": the object has been modified; please apply your changes to the latest version and try again
	I0918 17:02:07.411918       1 endpointslice_controller.go:344] "Error syncing endpoint slices for service, retrying" logger="endpointslice-controller" key="kube-system/kube-dns" err="failed to update kube-dns-dsh2c EndpointSlice for Service kube-system/kube-dns: Operation cannot be fulfilled on endpointslices.discovery.k8s.io \"kube-dns-dsh2c\": the object has been modified; please apply your changes to the latest version and try again"
	I0918 17:02:07.411981       1 event.go:377] Event(v1.ObjectReference{Kind:"Service", Namespace:"kube-system", Name:"kube-dns", UID:"92afb4da-15d6-4c05-b549-cfdf91ba4ea0", APIVersion:"v1", ResourceVersion:"312", FieldPath:""}): type: 'Warning' reason: 'FailedToUpdateEndpointSlices' Error updating Endpoint Slices for Service kube-system/kube-dns: failed to update kube-dns-dsh2c EndpointSlice for Service kube-system/kube-dns: Operation cannot be fulfilled on endpointslices.discovery.k8s.io "kube-dns-dsh2c": the object has been modified; please apply your changes to the latest version and try again
	E0918 17:02:59.323055       1 replica_set.go:587] "Unhandled Error" err="sync \"default/busybox-7b57f96db7\" failed with Operation cannot be fulfilled on replicasets.apps \"busybox-7b57f96db7\": the object has been modified; please apply your changes to the latest version and try again" logger="UnhandledError"
	E0918 17:03:05.219873       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:03:05.219908       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:03:05.219932       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:03:05.219946       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:03:05.219953       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:03:05.219960       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	
	
	==> kube-proxy [21b6ad607723fc0096bcbd14ccd85f029136b58ac2b0ddb5ddcd5bed51ad655b] <==
	I0918 17:02:03.339116       1 server_linux.go:53] "Using iptables proxy"
	I0918 17:02:03.389961       1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
	I0918 17:02:03.490912       1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
	I0918 17:02:03.490950       1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.49.2"]
	E0918 17:02:03.491054       1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
	I0918 17:02:03.512844       1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0918 17:02:03.512918       1 server_linux.go:132] "Using iptables Proxier"
	I0918 17:02:03.518771       1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
	I0918 17:02:03.519678       1 server.go:527] "Version info" version="v1.34.0"
	I0918 17:02:03.519790       1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 17:02:03.522083       1 config.go:200] "Starting service config controller"
	I0918 17:02:03.522097       1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
	I0918 17:02:03.522139       1 config.go:309] "Starting node config controller"
	I0918 17:02:03.522142       1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
	I0918 17:02:03.522146       1 shared_informer.go:356] "Caches are synced" controller="node config"
	I0918 17:02:03.522322       1 config.go:106] "Starting endpoint slice config controller"
	I0918 17:02:03.522340       1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
	I0918 17:02:03.522359       1 config.go:403] "Starting serviceCIDR config controller"
	I0918 17:02:03.522367       1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
	I0918 17:02:03.622286       1 shared_informer.go:356] "Caches are synced" controller="service config"
	I0918 17:02:03.622411       1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
	I0918 17:02:03.622414       1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
	
	
	==> kube-scheduler [47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67] <==
	I0918 17:01:56.949468       1 serving.go:386] Generated self-signed cert in-memory
	W0918 17:02:01.848942       1 requestheader_controller.go:204] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W0918 17:02:01.848981       1 authentication.go:397] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W0918 17:02:01.848992       1 authentication.go:398] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0918 17:02:01.849002       1 authentication.go:399] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0918 17:02:01.914311       1 server.go:175] "Starting Kubernetes Scheduler" version="v1.34.0"
	I0918 17:02:01.914353       1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 17:02:01.923771       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0918 17:02:01.923812       1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0918 17:02:01.925571       1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
	I0918 17:02:01.925987       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
	I0918 17:02:02.024271       1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	
	
	==> kubelet <==
	Sep 18 17:02:03 ha-078118 kubelet[703]: E0918 17:02:03.058122     703 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c21094f1-585a-4109-b526-3a115d45f35f-config-volume podName:c21094f1-585a-4109-b526-3a115d45f35f nodeName:}" failed. No retries permitted until 2025-09-18 17:02:03.558111559 +0000 UTC m=+7.747811104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-volume" (UniqueName: "kubernetes.io/configmap/c21094f1-585a-4109-b526-3a115d45f35f-config-volume") pod "coredns-66bc5c9577-q42l7" (UID: "c21094f1-585a-4109-b526-3a115d45f35f") : failed to sync configmap cache: timed out waiting for the condition
	Sep 18 17:02:05 ha-078118 kubelet[703]: E0918 17:02:05.888882     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214925888637070  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:05 ha-078118 kubelet[703]: E0918 17:02:05.888923     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214925888637070  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:07 ha-078118 kubelet[703]: I0918 17:02:07.380277     703 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
	Sep 18 17:02:07 ha-078118 kubelet[703]: I0918 17:02:07.446941     703 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
	Sep 18 17:02:15 ha-078118 kubelet[703]: E0918 17:02:15.890834     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214935890411828  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:15 ha-078118 kubelet[703]: E0918 17:02:15.890877     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214935890411828  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:25 ha-078118 kubelet[703]: E0918 17:02:25.892044     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214945891835358  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:25 ha-078118 kubelet[703]: E0918 17:02:25.892079     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214945891835358  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:33 ha-078118 kubelet[703]: I0918 17:02:33.993183     703 scope.go:117] "RemoveContainer" containerID="e26adb5e15f89b7d6b2ae07f5ecd54f18d53826b37e5e202c66478a2da986742"
	Sep 18 17:02:35 ha-078118 kubelet[703]: E0918 17:02:35.893103     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214955892872566  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:35 ha-078118 kubelet[703]: E0918 17:02:35.893144     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214955892872566  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:45 ha-078118 kubelet[703]: E0918 17:02:45.894324     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214965894027593  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:45 ha-078118 kubelet[703]: E0918 17:02:45.894364     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214965894027593  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:55 ha-078118 kubelet[703]: E0918 17:02:55.880015     703 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5\": container with ID starting with 5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5 not found: ID does not exist" containerID="5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5"
	Sep 18 17:02:55 ha-078118 kubelet[703]: I0918 17:02:55.880056     703 kuberuntime_gc.go:364] "Error getting ContainerStatus for containerID" containerID="5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5" err="rpc error: code = NotFound desc = could not find container \"5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5\": container with ID starting with 5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5 not found: ID does not exist"
	Sep 18 17:02:55 ha-078118 kubelet[703]: E0918 17:02:55.880405     703 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9\": container with ID starting with b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9 not found: ID does not exist" containerID="b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9"
	Sep 18 17:02:55 ha-078118 kubelet[703]: I0918 17:02:55.880441     703 kuberuntime_gc.go:364] "Error getting ContainerStatus for containerID" containerID="b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9" err="rpc error: code = NotFound desc = could not find container \"b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9\": container with ID starting with b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9 not found: ID does not exist"
	Sep 18 17:02:55 ha-078118 kubelet[703]: E0918 17:02:55.895432     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214975895244633  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:55 ha-078118 kubelet[703]: E0918 17:02:55.895471     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214975895244633  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:59 ha-078118 kubelet[703]: I0918 17:02:59.434365     703 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9zqx\" (UniqueName: \"kubernetes.io/projected/43e34594-9fbe-4c7f-b976-5df485b31ec1-kube-api-access-d9zqx\") pod \"busybox-7b57f96db7-8z4jq\" (UID: \"43e34594-9fbe-4c7f-b976-5df485b31ec1\") " pod="default/busybox-7b57f96db7-8z4jq"
	Sep 18 17:03:05 ha-078118 kubelet[703]: E0918 17:03:05.896675     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214985896463318  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:03:05 ha-078118 kubelet[703]: E0918 17:03:05.896716     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214985896463318  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:03:15 ha-078118 kubelet[703]: E0918 17:03:15.897671     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214995897455606  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:03:15 ha-078118 kubelet[703]: E0918 17:03:15.897710     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214995897455606  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	

                                                
                                                
-- /stdout --
helpers_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-078118 -n ha-078118
helpers_test.go:269: (dbg) Run:  kubectl --context ha-078118 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestMultiControlPlane/serial/DeleteSecondaryNode FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestMultiControlPlane/serial/DeleteSecondaryNode (20.94s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (2.4s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:392: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
ha_test.go:415: expected profile "ha-078118" in json of 'profile list' to have "Degraded" status but have "Starting" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-078118\",\"Status\":\"Starting\",\"Config\":{\"Name\":\"ha-078118\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1\",\"Memory\":3072,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"docker\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares
\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.34.0\",\"ClusterName\":\"ha-078118\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.49.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"crio\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.49.2\",\"Port\":8443,\"KubernetesVersion\":\"v1.34.0\",\"ContainerRuntime\":\"crio\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":
\"192.168.49.3\",\"Port\":8443,\"KubernetesVersion\":\"v1.34.0\",\"ContainerRuntime\":\"crio\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"\",\"Port\":0,\"KubernetesVersion\":\"v1.34.0\",\"ContainerRuntime\":\"crio\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"amd-gpu-device-plugin\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kubetail\":false,\"kubevirt\":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases
\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"MountString\":\"\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"DisableCoreDNSLog\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"
SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":true}]}"*. args: "out/minikube-linux-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======>  post-mortem[TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======>  post-mortem[TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete]: docker inspect <======
helpers_test.go:239: (dbg) Run:  docker inspect ha-078118
helpers_test.go:243: (dbg) docker inspect ha-078118:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7",
	        "Created": "2025-09-18T16:57:02.681891976Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 88722,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2025-09-18T17:01:49.614080081Z",
	            "FinishedAt": "2025-09-18T17:01:48.970614154Z"
	        },
	        "Image": "sha256:c6b5532e987b5b4f5fc9cb0336e378ed49c0542bad8cbfc564b71e977a6269de",
	        "ResolvConfPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/hostname",
	        "HostsPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/hosts",
	        "LogPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7-json.log",
	        "Name": "/ha-078118",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ha-078118:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "ha-078118",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "private",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 3221225472,
	            "NanoCpus": 0,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 6442450944,
	            "MemorySwappiness": null,
	            "OomKillDisable": null,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "ID": "0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7",
	                "LowerDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91-init/diff:/var/lib/docker/overlay2/1fd2bbb67ab9e5bb8d4549665a1a228eadda56df39fee53908cd735ea16a4e10/diff",
	                "MergedDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/merged",
	                "UpperDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/diff",
	                "WorkDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "ha-078118",
	                "Source": "/var/lib/docker/volumes/ha-078118/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "ha-078118",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ha-078118",
	                "name.minikube.sigs.k8s.io": "ha-078118",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "d7a7374ea2b8ba6f874686045bec8d8d2f4be5c3bb156f797cfc8fe734164d41",
	            "SandboxKey": "/var/run/docker/netns/d7a7374ea2b8",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32813"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32814"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32817"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32815"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32816"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ha-078118": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "3e:c5:df:f8:cd:13",
	                    "DriverOpts": null,
	                    "GwPriority": 0,
	                    "NetworkID": "0aa191750de6e44eaf49073a9e05a52994c63ccafcb0870d32aaf105d93cb724",
	                    "EndpointID": "ea5d387e75ac6e3dadc6865bf01be750dd4561640b93fb195ebd116b4ff71c26",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "ha-078118",
	                        "0cb187fb2895"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-078118 -n ha-078118
helpers_test.go:252: <<< TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======>  post-mortem[TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete]: minikube logs <======
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p ha-078118 logs -n 25: (1.115635271s)
helpers_test.go:260: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete logs: 
-- stdout --
	
	==> Audit <==
	┌─────────┬──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬───────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
	│ COMMAND │                                                                 ARGS                                                                 │  PROFILE  │  USER   │ VERSION │     START TIME      │      END TIME       │
	├─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼───────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m02 sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m02.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ cp      │ ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118-m04:/home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp testdata/cp-test.txt ha-078118-m04:/home/docker/cp-test.txt                                                             │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1931775572/001/cp-test_ha-078118-m04.txt │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118:/home/docker/cp-test_ha-078118-m04_ha-078118.txt                       │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118.txt                                                 │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m02:/home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m02 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m03:/home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ node    │ ha-078118 node stop m02 --alsologtostderr -v 5                                                                                       │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ node    │ ha-078118 node start m02 --alsologtostderr -v 5                                                                                      │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ node    │ ha-078118 node list --alsologtostderr -v 5                                                                                           │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:01 UTC │                     │
	│ stop    │ ha-078118 stop --alsologtostderr -v 5                                                                                                │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:01 UTC │ 18 Sep 25 17:01 UTC │
	│ start   │ ha-078118 start --wait true --alsologtostderr -v 5                                                                                   │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:01 UTC │                     │
	│ node    │ ha-078118 node list --alsologtostderr -v 5                                                                                           │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:02 UTC │                     │
	│ node    │ ha-078118 node delete m03 --alsologtostderr -v 5                                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:02 UTC │ 18 Sep 25 17:03 UTC │
	└─────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴───────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
	
	
	==> Last Start <==
	Log file created at: 2025/09/18 17:01:49
	Running on machine: ubuntu-20-agent-4
	Binary: Built with gc go1.24.6 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0918 17:01:49.379653   88523 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:01:49.379772   88523 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:01:49.379784   88523 out.go:374] Setting ErrFile to fd 2...
	I0918 17:01:49.379790   88523 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:01:49.380019   88523 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:01:49.380533   88523 out.go:368] Setting JSON to false
	I0918 17:01:49.381592   88523 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":2660,"bootTime":1758212249,"procs":195,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 17:01:49.381686   88523 start.go:140] virtualization: kvm guest
	I0918 17:01:49.384268   88523 out.go:179] * [ha-078118] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 17:01:49.385803   88523 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 17:01:49.385796   88523 notify.go:220] Checking for updates...
	I0918 17:01:49.387397   88523 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 17:01:49.389003   88523 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:01:49.390427   88523 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 17:01:49.391837   88523 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 17:01:49.393281   88523 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 17:01:49.395372   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:49.395474   88523 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 17:01:49.420078   88523 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 17:01:49.420170   88523 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:01:49.475997   88523 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:0 ContainersPaused:0 ContainersStopped:4 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 17:01:49.466272836 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:01:49.476147   88523 docker.go:318] overlay module found
	I0918 17:01:49.478189   88523 out.go:179] * Using the docker driver based on existing profile
	I0918 17:01:49.479694   88523 start.go:304] selected driver: docker
	I0918 17:01:49.479717   88523 start.go:924] validating driver "docker" against &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNam
es:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false
inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:
false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:01:49.479869   88523 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 17:01:49.479962   88523 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:01:49.539423   88523 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:0 ContainersPaused:0 ContainersStopped:4 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 17:01:49.529122726 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:01:49.540463   88523 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:01:49.540514   88523 cni.go:84] Creating CNI manager for ""
	I0918 17:01:49.540617   88523 cni.go:136] multinode detected (4 nodes found), recommending kindnet
	I0918 17:01:49.540690   88523 start.go:348] cluster config:
	{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: N
etworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubef
low:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: Static
IP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:01:49.542911   88523 out.go:179] * Starting "ha-078118" primary control-plane node in "ha-078118" cluster
	I0918 17:01:49.544389   88523 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:01:49.545792   88523 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:01:49.547204   88523 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:01:49.547272   88523 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
	I0918 17:01:49.547302   88523 cache.go:58] Caching tarball of preloaded images
	I0918 17:01:49.547351   88523 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:01:49.547411   88523 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:01:49.547426   88523 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:01:49.547600   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:49.567461   88523 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:01:49.567478   88523 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:01:49.567515   88523 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:01:49.567543   88523 start.go:360] acquireMachinesLock for ha-078118: {Name:mk24a1b2c9ed1c42e9ffd635727b36c75401a437 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:01:49.567596   88523 start.go:364] duration metric: took 39.11µs to acquireMachinesLock for "ha-078118"
	I0918 17:01:49.567613   88523 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:01:49.567618   88523 fix.go:54] fixHost starting: 
	I0918 17:01:49.567821   88523 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:01:49.585475   88523 fix.go:112] recreateIfNeeded on ha-078118: state=Stopped err=<nil>
	W0918 17:01:49.585550   88523 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:01:49.587651   88523 out.go:252] * Restarting existing docker container for "ha-078118" ...
	I0918 17:01:49.587728   88523 cli_runner.go:164] Run: docker start ha-078118
	I0918 17:01:49.825406   88523 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:01:49.844741   88523 kic.go:430] container "ha-078118" state is running.
	I0918 17:01:49.845091   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:01:49.864909   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:49.865148   88523 machine.go:93] provisionDockerMachine start ...
	I0918 17:01:49.865211   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:49.884562   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:49.884789   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32813 <nil> <nil>}
	I0918 17:01:49.884809   88523 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:01:49.885517   88523 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:54636->127.0.0.1:32813: read: connection reset by peer
	I0918 17:01:53.023917   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 17:01:53.023947   88523 ubuntu.go:182] provisioning hostname "ha-078118"
	I0918 17:01:53.024015   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:53.042995   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:53.043252   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32813 <nil> <nil>}
	I0918 17:01:53.043274   88523 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118 && echo "ha-078118" | sudo tee /etc/hostname
	I0918 17:01:53.192161   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 17:01:53.192246   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:53.210910   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:53.211146   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32813 <nil> <nil>}
	I0918 17:01:53.211164   88523 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:01:53.348813   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:01:53.348841   88523 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:01:53.348884   88523 ubuntu.go:190] setting up certificates
	I0918 17:01:53.348896   88523 provision.go:84] configureAuth start
	I0918 17:01:53.348954   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:01:53.367869   88523 provision.go:143] copyHostCerts
	I0918 17:01:53.367917   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:01:53.367947   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:01:53.367963   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:01:53.368042   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:01:53.368157   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:01:53.368180   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:01:53.368186   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:01:53.368215   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:01:53.368277   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:01:53.368294   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:01:53.368300   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:01:53.368323   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:01:53.368389   88523 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118 san=[127.0.0.1 192.168.49.2 ha-078118 localhost minikube]
	I0918 17:01:53.505620   88523 provision.go:177] copyRemoteCerts
	I0918 17:01:53.505678   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:01:53.505710   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:53.524161   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:53.622628   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 17:01:53.622691   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:01:53.648566   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 17:01:53.648617   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)
	I0918 17:01:53.673434   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 17:01:53.673543   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:01:53.697938   88523 provision.go:87] duration metric: took 349.03073ms to configureAuth
	I0918 17:01:53.697966   88523 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:01:53.698195   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:53.698301   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:53.716437   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:53.716667   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32813 <nil> <nil>}
	I0918 17:01:53.716687   88523 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:01:54.060620   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:01:54.060651   88523 machine.go:96] duration metric: took 4.195487726s to provisionDockerMachine
	I0918 17:01:54.060665   88523 start.go:293] postStartSetup for "ha-078118" (driver="docker")
	I0918 17:01:54.060679   88523 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:01:54.060754   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:01:54.060810   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:54.081141   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:54.178371   88523 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:01:54.182063   88523 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:01:54.182105   88523 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:01:54.182113   88523 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:01:54.182119   88523 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:01:54.182128   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:01:54.182193   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:01:54.182333   88523 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:01:54.182355   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 17:01:54.182483   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:01:54.191863   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:01:54.217237   88523 start.go:296] duration metric: took 156.554854ms for postStartSetup
	I0918 17:01:54.217324   88523 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:01:54.217390   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:54.236238   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:54.329749   88523 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:01:54.334136   88523 fix.go:56] duration metric: took 4.766511986s for fixHost
	I0918 17:01:54.334163   88523 start.go:83] releasing machines lock for "ha-078118", held for 4.766557228s
	I0918 17:01:54.334217   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:01:54.351968   88523 ssh_runner.go:195] Run: cat /version.json
	I0918 17:01:54.352015   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:54.352066   88523 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:01:54.352121   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:01:54.371203   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:54.371672   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:01:54.463754   88523 ssh_runner.go:195] Run: systemctl --version
	I0918 17:01:54.535544   88523 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:01:54.676680   88523 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:01:54.681529   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:01:54.690765   88523 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:01:54.690857   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:01:54.700127   88523 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:01:54.700153   88523 start.go:495] detecting cgroup driver to use...
	I0918 17:01:54.700180   88523 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:01:54.700215   88523 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:01:54.712746   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:01:54.724661   88523 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:01:54.724728   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:01:54.737819   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:01:54.750395   88523 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:01:54.815179   88523 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:01:54.880585   88523 docker.go:234] disabling docker service ...
	I0918 17:01:54.880655   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:01:54.893483   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:01:54.905105   88523 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:01:54.970982   88523 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:01:55.036251   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:01:55.047926   88523 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:01:55.064969   88523 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:01:55.065039   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.075907   88523 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:01:55.075961   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.086186   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.096182   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.106316   88523 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:01:55.116742   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.127414   88523 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.137571   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:01:55.147863   88523 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:01:55.156583   88523 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:01:55.165138   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:01:55.228262   88523 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:01:55.328023   88523 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:01:55.328125   88523 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:01:55.332040   88523 start.go:563] Will wait 60s for crictl version
	I0918 17:01:55.332103   88523 ssh_runner.go:195] Run: which crictl
	I0918 17:01:55.335544   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:01:55.370764   88523 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 17:01:55.370835   88523 ssh_runner.go:195] Run: crio --version
	I0918 17:01:55.407074   88523 ssh_runner.go:195] Run: crio --version
	I0918 17:01:55.445239   88523 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 17:01:55.446549   88523 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:01:55.463986   88523 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 17:01:55.467838   88523 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:01:55.479645   88523 kubeadm.go:875] updating cluster {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIP
s:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-ga
dget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQ
emuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0918 17:01:55.479776   88523 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:01:55.479825   88523 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:01:55.521370   88523 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:01:55.521391   88523 crio.go:433] Images already preloaded, skipping extraction
	I0918 17:01:55.521435   88523 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:01:55.554619   88523 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:01:55.554641   88523 cache_images.go:85] Images are preloaded, skipping loading
	I0918 17:01:55.554650   88523 kubeadm.go:926] updating node { 192.168.49.2 8443 v1.34.0 crio true true} ...
	I0918 17:01:55.554740   88523 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 17:01:55.554809   88523 ssh_runner.go:195] Run: crio config
	I0918 17:01:55.597150   88523 cni.go:84] Creating CNI manager for ""
	I0918 17:01:55.597170   88523 cni.go:136] multinode detected (4 nodes found), recommending kindnet
	I0918 17:01:55.597182   88523 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0918 17:01:55.597201   88523 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.34.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-078118 NodeName:ha-078118 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manif
ests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0918 17:01:55.597323   88523 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "ha-078118"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.49.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	kubernetesVersion: v1.34.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: systemd
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0918 17:01:55.597340   88523 kube-vip.go:115] generating kube-vip config ...
	I0918 17:01:55.597387   88523 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 17:01:55.610040   88523 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:01:55.610150   88523 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 17:01:55.610202   88523 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 17:01:55.619652   88523 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 17:01:55.619730   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
	I0918 17:01:55.629065   88523 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (359 bytes)
	I0918 17:01:55.647817   88523 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 17:01:55.666322   88523 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2205 bytes)
	I0918 17:01:55.685799   88523 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 17:01:55.705367   88523 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 17:01:55.709566   88523 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:01:55.722362   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:01:55.784601   88523 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:01:55.808023   88523 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.2
	I0918 17:01:55.808042   88523 certs.go:194] generating shared ca certs ...
	I0918 17:01:55.808072   88523 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:55.808221   88523 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 17:01:55.808270   88523 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 17:01:55.808280   88523 certs.go:256] generating profile certs ...
	I0918 17:01:55.808359   88523 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 17:01:55.808395   88523 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.c944a3f3
	I0918 17:01:55.808410   88523 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.c944a3f3 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.3 192.168.49.4 192.168.49.254]
	I0918 17:01:56.210331   88523 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.c944a3f3 ...
	I0918 17:01:56.210365   88523 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.c944a3f3: {Name:mkb79a1de8248bd79832f6910fea7ba45af90c6a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.210571   88523 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.c944a3f3 ...
	I0918 17:01:56.210590   88523 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.c944a3f3: {Name:mkee19f1232c09da0d47765b6f3756d6bcdf1995 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.210674   88523 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.c944a3f3 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 17:01:56.210811   88523 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.c944a3f3 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 17:01:56.210938   88523 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 17:01:56.210952   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 17:01:56.210965   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 17:01:56.210976   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 17:01:56.210987   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 17:01:56.210997   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 17:01:56.211031   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 17:01:56.211043   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 17:01:56.211055   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 17:01:56.211116   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 17:01:56.211142   88523 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 17:01:56.211151   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 17:01:56.211172   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 17:01:56.211193   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 17:01:56.211213   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 17:01:56.211248   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:01:56.211275   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 17:01:56.211290   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 17:01:56.211302   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:01:56.211913   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 17:01:56.237934   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 17:01:56.263651   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 17:01:56.288002   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 17:01:56.314861   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
	I0918 17:01:56.340356   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 17:01:56.370284   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 17:01:56.398212   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 17:01:56.432277   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 17:01:56.471393   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 17:01:56.507057   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 17:01:56.541863   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0918 17:01:56.570235   88523 ssh_runner.go:195] Run: openssl version
	I0918 17:01:56.577129   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 17:01:56.588470   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 17:01:56.592889   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 17:01:56.592948   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 17:01:56.600490   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 17:01:56.610210   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 17:01:56.620549   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 17:01:56.624511   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 17:01:56.624575   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 17:01:56.632301   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 17:01:56.642250   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 17:01:56.652289   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:01:56.656446   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:01:56.656530   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:01:56.664059   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 17:01:56.673942   88523 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 17:01:56.678148   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0918 17:01:56.685430   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0918 17:01:56.692331   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0918 17:01:56.699250   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0918 17:01:56.706155   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0918 17:01:56.713040   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0918 17:01:56.719862   88523 kubeadm.go:392] StartCluster: {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[
] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.49.4 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadge
t:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemu
FirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:01:56.720000   88523 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0918 17:01:56.720046   88523 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0918 17:01:56.758372   88523 cri.go:89] found id: "1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5"
	I0918 17:01:56.758399   88523 cri.go:89] found id: "d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd"
	I0918 17:01:56.758404   88523 cri.go:89] found id: "47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67"
	I0918 17:01:56.758409   88523 cri.go:89] found id: "1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156"
	I0918 17:01:56.758413   88523 cri.go:89] found id: "f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a"
	I0918 17:01:56.758417   88523 cri.go:89] found id: ""
	I0918 17:01:56.758462   88523 ssh_runner.go:195] Run: sudo runc list -f json
	I0918 17:01:56.780084   88523 cri.go:116] JSON = [{"ociVersion":"1.0.2-dev","id":"1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5","pid":904,"status":"running","bundle":"/run/containers/storage/overlay-containers/1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5/userdata","rootfs":"/var/lib/containers/storage/overlay/9c71e033c7f3d6a01ab02e2f4462648d32830be6c4d23a4db21a231f88ff347b/merged","created":"2025-09-18T17:01:56.483000594Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"7eaa1830","io.kubernetes.container.name":"kube-controller-manager","io.kubernetes.container.ports":"[{\"name\":\"probe-port\",\"hostPort\":10257,\"containerPort\":10257,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"7eaa1830\",\"io.kubernetes.contai
ner.ports\":\"[{\\\"name\\\":\\\"probe-port\\\",\\\"hostPort\\\":10257,\\\"containerPort\\\":10257,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.414440268Z","io.kubernetes.cri-o.Image":"a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-controller-manager:v1.34.0","io.kubernetes.cri-o.ImageRef":"a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-controller-manager\",\"io.kubernetes.pod.name\":\"kube-controller-manager-ha-078118\",\"io.kube
rnetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"295d4b0a8fb5b6e3839f92f4ba9ebb80\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-controller-manager-ha-078118_295d4b0a8fb5b6e3839f92f4ba9ebb80/kube-controller-manager/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-controller-manager\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/9c71e033c7f3d6a01ab02e2f4462648d32830be6c4d23a4db21a231f88ff347b/merged","io.kubernetes.cri-o.Name":"k8s_kube-controller-manager_kube-controller-manager-ha-078118_kube-system_295d4b0a8fb5b6e3839f92f4ba9ebb80_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/bc00758e6c8406d5f266c3138b612bd3922701154711f59957fe39c69c66e540/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"bc00758e6c8406d5f266c3138b612bd3922701154711f59957fe39c69c66e540","io.kubernetes.cri-o.SandboxName":"k8s_kube-controller-manager-ha-078118_kube-system_295d4b0a8fb5b6e3839f92f4ba9ebb80_0","io.kubernetes
.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/ca-certificates\",\"host_path\":\"/etc/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/295d4b0a8fb5b6e3839f92f4ba9ebb80/containers/kube-controller-manager/72ee19b7\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/295d4b0a8fb5b6e3839f92f4ba9ebb80/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/ssl/certs\",\"host_path\":\"/etc/ssl/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/kubernetes/controller-manager.conf\",\"host_path\":\"/etc/kubernetes/controller-manager.conf\",\"readonly\":true,\"propagation\":0,\"se
linux_relabel\":false},{\"container_path\":\"/usr/share/ca-certificates\",\"host_path\":\"/usr/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/certs\",\"host_path\":\"/var/lib/minikube/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/local/share/ca-certificates\",\"host_path\":\"/usr/local/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/libexec/kubernetes/kubelet-plugins/volume/exec\",\"host_path\":\"/usr/libexec/kubernetes/kubelet-plugins/volume/exec\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-controller-manager-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"295d4b0a8fb5b6e3839f92f4ba9ebb80","kubernetes.io/config.hash":"295d4b0a8fb5b6e3839f92f4ba9ebb80","kubernetes.io/config.seen":"20
25-09-18T17:01:55.876115131Z","kubernetes.io/config.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependencies":"true","org.systemd.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156","pid":849,"status":"running","bundle":"/run/containers/storage/overlay-containers/1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156/userdata","rootfs":"/var/lib/containers/storage/overlay/9a05cb7fea32dc9ddf7a008a2caeccd14f1a898a68a3dd3ddbf49586836e44b4/merged","created":"2025-09-18T17:01:56.440722069Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"d64ad60b","io.kubernetes.container.name":"kube-vip","io.kubernetes.container.restartCount":"0","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kub
ernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"d64ad60b\",\"io.kubernetes.container.restartCount\":\"0\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.395408441Z","io.kubernetes.cri-o.Image":"765655ea6078171c416896d7cc155c1263a0411d30caaa03d7365aecb99fdf23","io.kubernetes.cri-o.ImageName":"ghcr.io/kube-vip/kube-vip:v1.0.0","io.kubernetes.cri-o.ImageRef":"765655ea6078171c416896d7cc155c1263a0411d30caaa03d7365aecb99fdf23","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-vip\",\"io.kubernetes.pod.name\":\"kube-vip-ha-078118\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"b5f2d8fa1610d58f11008a293d2cb33c\"}
","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-vip-ha-078118_b5f2d8fa1610d58f11008a293d2cb33c/kube-vip/0.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-vip\"}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/9a05cb7fea32dc9ddf7a008a2caeccd14f1a898a68a3dd3ddbf49586836e44b4/merged","io.kubernetes.cri-o.Name":"k8s_kube-vip_kube-vip-ha-078118_kube-system_b5f2d8fa1610d58f11008a293d2cb33c_0","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/30db82bb4c1ecf3da0c6fc497ad269f656085bac7f95a7fe045a62d4257a5f44/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"30db82bb4c1ecf3da0c6fc497ad269f656085bac7f95a7fe045a62d4257a5f44","io.kubernetes.cri-o.SandboxName":"k8s_kube-vip-ha-078118_kube-system_b5f2d8fa1610d58f11008a293d2cb33c_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/hosts\"
,\"host_path\":\"/var/lib/kubelet/pods/b5f2d8fa1610d58f11008a293d2cb33c/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/b5f2d8fa1610d58f11008a293d2cb33c/containers/kube-vip/ce75abae\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/kubernetes/admin.conf\",\"host_path\":\"/etc/kubernetes/admin.conf\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-vip-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"b5f2d8fa1610d58f11008a293d2cb33c","kubernetes.io/config.hash":"b5f2d8fa1610d58f11008a293d2cb33c","kubernetes.io/config.seen":"2025-09-18T17:01:55.876125807Z","kubernetes.io/config.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependenci
es":"true","org.systemd.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67","pid":885,"status":"running","bundle":"/run/containers/storage/overlay-containers/47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67/userdata","rootfs":"/var/lib/containers/storage/overlay/8e8b1e7cd8a289c8374f9b6257c15f074ae0f3c0cebbc0ba3761dd50fedae849/merged","created":"2025-09-18T17:01:56.465937045Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"85eae708","io.kubernetes.container.name":"kube-scheduler","io.kubernetes.container.ports":"[{\"name\":\"probe-port\",\"hostPort\":10259,\"containerPort\":10259,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"85eae708\",\"io.
kubernetes.container.ports\":\"[{\\\"name\\\":\\\"probe-port\\\",\\\"hostPort\\\":10259,\\\"containerPort\\\":10259,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.399734521Z","io.kubernetes.cri-o.Image":"46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-scheduler:v1.34.0","io.kubernetes.cri-o.ImageRef":"46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-scheduler\",\"io.kubernetes.pod.name\":\"kube-scheduler-ha-078118\",\"io.kubernetes.pod
.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"eef6954c295df14c6ded36d455ae3f64\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-scheduler-ha-078118_eef6954c295df14c6ded36d455ae3f64/kube-scheduler/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-scheduler\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/8e8b1e7cd8a289c8374f9b6257c15f074ae0f3c0cebbc0ba3761dd50fedae849/merged","io.kubernetes.cri-o.Name":"k8s_kube-scheduler_kube-scheduler-ha-078118_kube-system_eef6954c295df14c6ded36d455ae3f64_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/0b0c119de2a5e95db0b47c45e75dd2a09a0606aba44508db81678b39fd38137d/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"0b0c119de2a5e95db0b47c45e75dd2a09a0606aba44508db81678b39fd38137d","io.kubernetes.cri-o.SandboxName":"k8s_kube-scheduler-ha-078118_kube-system_eef6954c295df14c6ded36d455ae3f64_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false
","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/eef6954c295df14c6ded36d455ae3f64/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/eef6954c295df14c6ded36d455ae3f64/containers/kube-scheduler/3ee75ede\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/kubernetes/scheduler.conf\",\"host_path\":\"/etc/kubernetes/scheduler.conf\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-scheduler-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"eef6954c295df14c6ded36d455ae3f64","kubernetes.io/config.hash":"eef6954c295df14c6ded36d455ae3f64","kubernetes.io/config.seen":"2025-09-18T17:01:55.876124510Z","kubernetes.io/config
.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependencies":"true","org.systemd.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd","pid":895,"status":"running","bundle":"/run/containers/storage/overlay-containers/d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd/userdata","rootfs":"/var/lib/containers/storage/overlay/e609e9e46a7b4349013bb25dc88f625f340af02c9dc300f5dad6685070fd74b2/merged","created":"2025-09-18T17:01:56.468173373Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"d671eaa0","io.kubernetes.container.name":"kube-apiserver","io.kubernetes.container.ports":"[{\"name\":\"probe-port\",\"hostPort\":8443,\"containerPort\":8443,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/ter
mination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"d671eaa0\",\"io.kubernetes.container.ports\":\"[{\\\"name\\\":\\\"probe-port\\\",\\\"hostPort\\\":8443,\\\"containerPort\\\":8443,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.400849867Z","io.kubernetes.cri-o.Image":"90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-apiserver:v1.34.0","io.kubernetes.cri-o.ImageRef":"90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90","
io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-apiserver\",\"io.kubernetes.pod.name\":\"kube-apiserver-ha-078118\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"eab4cb22d09eb9c837e45b2e0c5fc664\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-apiserver-ha-078118_eab4cb22d09eb9c837e45b2e0c5fc664/kube-apiserver/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-apiserver\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/e609e9e46a7b4349013bb25dc88f625f340af02c9dc300f5dad6685070fd74b2/merged","io.kubernetes.cri-o.Name":"k8s_kube-apiserver_kube-apiserver-ha-078118_kube-system_eab4cb22d09eb9c837e45b2e0c5fc664_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/27ab8b84a9d30c714c81b49dbcbf9e1787031ad0f6c46d6f231d0b79f94b32f5/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"27ab8b84a9d30c714c81b49dbcbf9e1787031ad0f6c46d6f231d0b79f94b32f5","io.kubernetes.cri-o.SandboxName"
:"k8s_kube-apiserver-ha-078118_kube-system_eab4cb22d09eb9c837e45b2e0c5fc664_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/eab4cb22d09eb9c837e45b2e0c5fc664/containers/kube-apiserver/764ef81a\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/ca-certificates\",\"host_path\":\"/etc/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/eab4cb22d09eb9c837e45b2e0c5fc664/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/share/ca-certificates\",\"host_path\":\"/usr/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/ssl/certs\",\"host_path\":\
"/etc/ssl/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/certs\",\"host_path\":\"/var/lib/minikube/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/local/share/ca-certificates\",\"host_path\":\"/usr/local/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-apiserver-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"eab4cb22d09eb9c837e45b2e0c5fc664","kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.49.2:8443","kubernetes.io/config.hash":"eab4cb22d09eb9c837e45b2e0c5fc664","kubernetes.io/config.seen":"2025-09-18T17:01:55.876112955Z","kubernetes.io/config.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependencies":"true","org.system
d.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a","pid":832,"status":"running","bundle":"/run/containers/storage/overlay-containers/f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a/userdata","rootfs":"/var/lib/containers/storage/overlay/ef7555194ebc8c68b1cc9488dbf8f557c6e739f666631cf9b320b2dc5b85a30d/merged","created":"2025-09-18T17:01:56.443422336Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"e9e20c65","io.kubernetes.container.name":"etcd","io.kubernetes.container.ports":"[{\"name\":\"probe-port\",\"hostPort\":2381,\"containerPort\":2381,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"e9e20c65\",\"io.kubernetes.container.ports\":\"[{\
\\"name\\\":\\\"probe-port\\\",\\\"hostPort\\\":2381,\\\"containerPort\\\":2381,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2025-09-18T17:01:56.368917103Z","io.kubernetes.cri-o.Image":"5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115","io.kubernetes.cri-o.ImageName":"registry.k8s.io/etcd:3.6.4-0","io.kubernetes.cri-o.ImageRef":"5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"etcd\",\"io.kubernetes.pod.name\":\"etcd-ha-078118\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"c844ac4cd
3d56ebd5831bc0d85f91b01\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_etcd-ha-078118_c844ac4cd3d56ebd5831bc0d85f91b01/etcd/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"etcd\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/ef7555194ebc8c68b1cc9488dbf8f557c6e739f666631cf9b320b2dc5b85a30d/merged","io.kubernetes.cri-o.Name":"k8s_etcd_etcd-ha-078118_kube-system_c844ac4cd3d56ebd5831bc0d85f91b01_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/392032ae1b29544e24d0d98943a7310ad13f5d12f0c5be5a121d7418fe388e2c/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"392032ae1b29544e24d0d98943a7310ad13f5d12f0c5be5a121d7418fe388e2c","io.kubernetes.cri-o.SandboxName":"k8s_etcd-ha-078118_kube-system_c844ac4cd3d56ebd5831bc0d85f91b01_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\
":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/c844ac4cd3d56ebd5831bc0d85f91b01/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/c844ac4cd3d56ebd5831bc0d85f91b01/containers/etcd/129e1cf5\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/etcd\",\"host_path\":\"/var/lib/minikube/etcd\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/certs/etcd\",\"host_path\":\"/var/lib/minikube/certs/etcd\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"etcd-ha-078118","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"c844ac4cd3d56ebd5831bc0d85f91b01","kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.49.2:2379","kubernetes.io/config.hash":"c844ac4cd3d56ebd5831bc0d85f91b01",
"kubernetes.io/config.seen":"2025-09-18T17:01:55.876108105Z","kubernetes.io/config.source":"file","org.systemd.property.After":"['crio.service']","org.systemd.property.CollectMode":"'inactive-or-failed'","org.systemd.property.DefaultDependencies":"true","org.systemd.property.TimeoutStopUSec":"uint64 30000000"},"owner":"root"}]
	I0918 17:01:56.780559   88523 cri.go:126] list returned 5 containers
	I0918 17:01:56.780578   88523 cri.go:129] container: {ID:1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5 Status:running}
	I0918 17:01:56.780593   88523 cri.go:135] skipping {1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5 running}: state = "running", want "paused"
	I0918 17:01:56.780608   88523 cri.go:129] container: {ID:1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156 Status:running}
	I0918 17:01:56.780614   88523 cri.go:135] skipping {1fb0f2e98fb3a1e0ad48b99e2840a07a6039cc432558235378bc111e77127156 running}: state = "running", want "paused"
	I0918 17:01:56.780622   88523 cri.go:129] container: {ID:47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67 Status:running}
	I0918 17:01:56.780627   88523 cri.go:135] skipping {47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67 running}: state = "running", want "paused"
	I0918 17:01:56.780635   88523 cri.go:129] container: {ID:d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd Status:running}
	I0918 17:01:56.780640   88523 cri.go:135] skipping {d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd running}: state = "running", want "paused"
	I0918 17:01:56.780648   88523 cri.go:129] container: {ID:f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a Status:running}
	I0918 17:01:56.780654   88523 cri.go:135] skipping {f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a running}: state = "running", want "paused"
	I0918 17:01:56.780711   88523 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0918 17:01:56.790261   88523 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0918 17:01:56.790289   88523 kubeadm.go:589] restartPrimaryControlPlane start ...
	I0918 17:01:56.790351   88523 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0918 17:01:56.799692   88523 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:01:56.800125   88523 kubeconfig.go:47] verify endpoint returned: get endpoint: "ha-078118" does not appear in /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:01:56.800245   88523 kubeconfig.go:62] /home/jenkins/minikube-integration/20370-7845/kubeconfig needs updating (will repair): [kubeconfig missing "ha-078118" cluster setting kubeconfig missing "ha-078118" context setting]
	I0918 17:01:56.800516   88523 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.800988   88523 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, Us
erAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0918 17:01:56.801446   88523 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
	I0918 17:01:56.801466   88523 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I0918 17:01:56.801472   88523 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
	I0918 17:01:56.801477   88523 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I0918 17:01:56.801483   88523 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
	I0918 17:01:56.801488   88523 cert_rotation.go:141] "Starting client certificate rotation controller" logger="tls-transport-cache"
	I0918 17:01:56.801819   88523 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0918 17:01:56.811376   88523 kubeadm.go:626] The running cluster does not require reconfiguration: 192.168.49.2
	I0918 17:01:56.811406   88523 kubeadm.go:593] duration metric: took 21.110094ms to restartPrimaryControlPlane
	I0918 17:01:56.811418   88523 kubeadm.go:394] duration metric: took 91.570194ms to StartCluster
	I0918 17:01:56.811440   88523 settings.go:142] acquiring lock: {Name:mk72fea03aefe901db9522a467405d86665fedd0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.811525   88523 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:01:56.812011   88523 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:01:56.812251   88523 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:01:56.812273   88523 start.go:241] waiting for startup goroutines ...
	I0918 17:01:56.812281   88523 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0918 17:01:56.812548   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:56.818560   88523 out.go:179] * Enabled addons: 
	I0918 17:01:56.819862   88523 addons.go:514] duration metric: took 7.577022ms for enable addons: enabled=[]
	I0918 17:01:56.819895   88523 start.go:246] waiting for cluster config update ...
	I0918 17:01:56.819902   88523 start.go:255] writing updated cluster config ...
	I0918 17:01:56.821358   88523 out.go:203] 
	I0918 17:01:56.822838   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:01:56.822935   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:56.824668   88523 out.go:179] * Starting "ha-078118-m02" control-plane node in "ha-078118" cluster
	I0918 17:01:56.826202   88523 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:01:56.827692   88523 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:01:56.829025   88523 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:01:56.829052   88523 cache.go:58] Caching tarball of preloaded images
	I0918 17:01:56.829116   88523 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:01:56.829157   88523 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:01:56.829174   88523 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:01:56.829286   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:56.852123   88523 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:01:56.852147   88523 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:01:56.852166   88523 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:01:56.852198   88523 start.go:360] acquireMachinesLock for ha-078118-m02: {Name:mk65f6a883861f2032241e1132c63effea2ab61f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:01:56.852266   88523 start.go:364] duration metric: took 48.677µs to acquireMachinesLock for "ha-078118-m02"
	I0918 17:01:56.852296   88523 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:01:56.852306   88523 fix.go:54] fixHost starting: m02
	I0918 17:01:56.852668   88523 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:01:56.872076   88523 fix.go:112] recreateIfNeeded on ha-078118-m02: state=Stopped err=<nil>
	W0918 17:01:56.872113   88523 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:01:56.874087   88523 out.go:252] * Restarting existing docker container for "ha-078118-m02" ...
	I0918 17:01:56.874180   88523 cli_runner.go:164] Run: docker start ha-078118-m02
	I0918 17:01:57.139627   88523 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:01:57.162974   88523 kic.go:430] container "ha-078118-m02" state is running.
	I0918 17:01:57.163617   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:01:57.187278   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:01:57.187580   88523 machine.go:93] provisionDockerMachine start ...
	I0918 17:01:57.187647   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:01:57.208558   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:01:57.208807   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32818 <nil> <nil>}
	I0918 17:01:57.208821   88523 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:01:57.209542   88523 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:35706->127.0.0.1:32818: read: connection reset by peer
	I0918 17:02:00.346412   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 17:02:00.346437   88523 ubuntu.go:182] provisioning hostname "ha-078118-m02"
	I0918 17:02:00.346489   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:00.364917   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:00.365177   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32818 <nil> <nil>}
	I0918 17:02:00.365191   88523 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m02 && echo "ha-078118-m02" | sudo tee /etc/hostname
	I0918 17:02:00.514327   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 17:02:00.514402   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:00.533549   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:00.533751   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32818 <nil> <nil>}
	I0918 17:02:00.533768   88523 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m02' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m02/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m02' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:02:00.670395   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:02:00.670429   88523 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:02:00.670444   88523 ubuntu.go:190] setting up certificates
	I0918 17:02:00.670453   88523 provision.go:84] configureAuth start
	I0918 17:02:00.670535   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:02:00.688318   88523 provision.go:143] copyHostCerts
	I0918 17:02:00.688353   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:02:00.688380   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:02:00.688388   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:02:00.688466   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:02:00.688593   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:02:00.688616   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:02:00.688621   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:02:00.688655   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:02:00.688706   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:02:00.688723   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:02:00.688727   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:02:00.688752   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:02:00.688815   88523 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m02 san=[127.0.0.1 192.168.49.3 ha-078118-m02 localhost minikube]
	I0918 17:02:01.100643   88523 provision.go:177] copyRemoteCerts
	I0918 17:02:01.100699   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:02:01.100739   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:01.128283   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:01.233731   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 17:02:01.233795   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:02:01.267239   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 17:02:01.267312   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 17:02:01.299631   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 17:02:01.299701   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:02:01.333166   88523 provision.go:87] duration metric: took 662.697168ms to configureAuth
	I0918 17:02:01.333201   88523 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:02:01.333436   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:01.333668   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:01.355891   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:01.356100   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32818 <nil> <nil>}
	I0918 17:02:01.356116   88523 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:02:01.803484   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:02:01.803598   88523 machine.go:96] duration metric: took 4.615990236s to provisionDockerMachine
	I0918 17:02:01.803617   88523 start.go:293] postStartSetup for "ha-078118-m02" (driver="docker")
	I0918 17:02:01.803631   88523 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:02:01.803737   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:02:01.803809   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:01.824810   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:01.943231   88523 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:02:01.949156   88523 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:02:01.949190   88523 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:02:01.949200   88523 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:02:01.949208   88523 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:02:01.949221   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:02:01.949294   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:02:01.949388   88523 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:02:01.949398   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 17:02:01.949539   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:02:01.964224   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:02:02.000604   88523 start.go:296] duration metric: took 196.969548ms for postStartSetup
	I0918 17:02:02.000678   88523 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:02:02.000709   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:02.024047   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:02.125240   88523 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:02:02.131938   88523 fix.go:56] duration metric: took 5.279624751s for fixHost
	I0918 17:02:02.131967   88523 start.go:83] releasing machines lock for "ha-078118-m02", held for 5.279686169s
	I0918 17:02:02.132049   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:02:02.156676   88523 out.go:179] * Found network options:
	I0918 17:02:02.157902   88523 out.go:179]   - NO_PROXY=192.168.49.2
	W0918 17:02:02.159818   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:02:02.159872   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 17:02:02.159952   88523 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:02:02.160020   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:02.160303   88523 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:02:02.160395   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:02:02.186312   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:02.187028   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32818 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:02:02.428885   88523 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:02:02.434009   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:02:02.444157   88523 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:02:02.444228   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:02:02.454051   88523 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:02:02.454077   88523 start.go:495] detecting cgroup driver to use...
	I0918 17:02:02.454114   88523 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:02:02.454162   88523 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:02:02.466948   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:02:02.478891   88523 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:02:02.478957   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:02:02.491961   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:02:02.504752   88523 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:02:02.594029   88523 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:02:02.701933   88523 docker.go:234] disabling docker service ...
	I0918 17:02:02.702003   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:02:02.717057   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:02:02.731660   88523 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:02:02.853518   88523 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:02:02.996040   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:02:03.016174   88523 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:02:03.045704   88523 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:02:03.045764   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.061608   88523 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:02:03.061695   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.083523   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.105214   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.120699   88523 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:02:03.138140   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.162450   88523 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.182797   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:03.204229   88523 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:02:03.218676   88523 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:02:03.234833   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:02:03.414424   88523 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:02:03.681075   88523 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:02:03.681172   88523 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:02:03.685900   88523 start.go:563] Will wait 60s for crictl version
	I0918 17:02:03.685976   88523 ssh_runner.go:195] Run: which crictl
	I0918 17:02:03.689938   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:03.732205   88523 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 17:02:03.732322   88523 ssh_runner.go:195] Run: crio --version
	I0918 17:02:03.780573   88523 ssh_runner.go:195] Run: crio --version
	I0918 17:02:03.836328   88523 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 17:02:03.837848   88523 out.go:179]   - env NO_PROXY=192.168.49.2
	I0918 17:02:03.839158   88523 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:02:03.863484   88523 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 17:02:03.869490   88523 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:02:03.885574   88523 mustload.go:65] Loading cluster: ha-078118
	I0918 17:02:03.885865   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:03.886138   88523 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:02:03.910178   88523 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:02:03.910520   88523 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.3
	I0918 17:02:03.910532   88523 certs.go:194] generating shared ca certs ...
	I0918 17:02:03.910550   88523 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:02:03.910702   88523 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 17:02:03.910746   88523 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 17:02:03.910754   88523 certs.go:256] generating profile certs ...
	I0918 17:02:03.910869   88523 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 17:02:03.910966   88523 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.e3295e3c
	I0918 17:02:03.911006   88523 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 17:02:03.911015   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 17:02:03.911031   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 17:02:03.911045   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 17:02:03.911062   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 17:02:03.911076   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 17:02:03.911090   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 17:02:03.911111   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 17:02:03.911124   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 17:02:03.911179   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 17:02:03.911212   88523 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 17:02:03.911222   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 17:02:03.911254   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 17:02:03.911281   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 17:02:03.911326   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 17:02:03.911397   88523 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:02:03.911438   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 17:02:03.911459   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:02:03.911472   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 17:02:03.911547   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:02:03.946173   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32813 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:02:04.042870   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
	I0918 17:02:04.047477   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
	I0918 17:02:04.062496   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
	I0918 17:02:04.066022   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
	I0918 17:02:04.079216   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
	I0918 17:02:04.082987   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
	I0918 17:02:04.096266   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
	I0918 17:02:04.099842   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)
	I0918 17:02:04.114219   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
	I0918 17:02:04.117647   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
	I0918 17:02:04.130510   88523 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
	I0918 17:02:04.134062   88523 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
	I0918 17:02:04.148209   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 17:02:04.175449   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 17:02:04.202169   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 17:02:04.229482   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 17:02:04.256335   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
	I0918 17:02:04.282706   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 17:02:04.310591   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 17:02:04.337521   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 17:02:04.364519   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 17:02:04.390068   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 17:02:04.417491   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 17:02:04.443222   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
	I0918 17:02:04.463097   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
	I0918 17:02:04.483042   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
	I0918 17:02:04.502767   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)
	I0918 17:02:04.522870   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
	I0918 17:02:04.541750   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
	I0918 17:02:04.561986   88523 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
	I0918 17:02:04.581734   88523 ssh_runner.go:195] Run: openssl version
	I0918 17:02:04.587350   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 17:02:04.597650   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 17:02:04.601731   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 17:02:04.601792   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 17:02:04.609763   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 17:02:04.619714   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 17:02:04.630360   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 17:02:04.634287   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 17:02:04.634340   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 17:02:04.641345   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 17:02:04.652864   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 17:02:04.664993   88523 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:02:04.668853   88523 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:02:04.668927   88523 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:02:04.676354   88523 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 17:02:04.686228   88523 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 17:02:04.690454   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0918 17:02:04.697758   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0918 17:02:04.705195   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0918 17:02:04.713070   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0918 17:02:04.720155   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0918 17:02:04.727534   88523 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0918 17:02:04.734944   88523 kubeadm.go:926] updating node {m02 192.168.49.3 8443 v1.34.0 crio true true} ...
	I0918 17:02:04.735045   88523 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.3
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 17:02:04.735075   88523 kube-vip.go:115] generating kube-vip config ...
	I0918 17:02:04.735113   88523 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 17:02:04.751022   88523 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:02:04.751100   88523 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 17:02:04.751163   88523 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 17:02:04.762324   88523 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 17:02:04.762394   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
	I0918 17:02:04.772244   88523 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0918 17:02:04.792115   88523 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 17:02:04.812418   88523 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 17:02:04.831828   88523 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 17:02:04.835579   88523 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:02:04.848821   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:02:04.970270   88523 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:02:04.984165   88523 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:02:04.984487   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:04.987586   88523 out.go:179] * Verifying Kubernetes components...
	I0918 17:02:04.988873   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:02:05.103279   88523 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:02:05.116687   88523 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	W0918 17:02:05.116759   88523 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.49.254:8443 with https://192.168.49.2:8443
	I0918 17:02:05.117030   88523 node_ready.go:35] waiting up to 6m0s for node "ha-078118-m02" to be "Ready" ...
	I0918 17:02:05.126204   88523 node_ready.go:49] node "ha-078118-m02" is "Ready"
	I0918 17:02:05.126229   88523 node_ready.go:38] duration metric: took 9.18178ms for node "ha-078118-m02" to be "Ready" ...
	I0918 17:02:05.126242   88523 api_server.go:52] waiting for apiserver process to appear ...
	I0918 17:02:05.126286   88523 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:02:05.138174   88523 api_server.go:72] duration metric: took 153.959457ms to wait for apiserver process to appear ...
	I0918 17:02:05.138199   88523 api_server.go:88] waiting for apiserver healthz status ...
	I0918 17:02:05.138219   88523 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0918 17:02:05.143842   88523 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0918 17:02:05.144983   88523 api_server.go:141] control plane version: v1.34.0
	I0918 17:02:05.145013   88523 api_server.go:131] duration metric: took 6.806624ms to wait for apiserver health ...
	I0918 17:02:05.145024   88523 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 17:02:05.151629   88523 system_pods.go:59] 24 kube-system pods found
	I0918 17:02:05.151671   88523 system_pods.go:61] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:02:05.151682   88523 system_pods.go:61] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:02:05.151698   88523 system_pods.go:61] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:02:05.151709   88523 system_pods.go:61] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:02:05.151716   88523 system_pods.go:61] "etcd-ha-078118-m03" [ef27a91e-a220-4dcb-885c-2941742d985e] Running
	I0918 17:02:05.151723   88523 system_pods.go:61] "kindnet-f2b4b" [98c5afc6-e57e-488c-948a-e24ec24b97a7] Running
	I0918 17:02:05.151729   88523 system_pods.go:61] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 17:02:05.151736   88523 system_pods.go:61] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 17:02:05.151747   88523 system_pods.go:61] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:02:05.151761   88523 system_pods.go:61] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:02:05.151771   88523 system_pods.go:61] "kube-apiserver-ha-078118-m03" [1cc265d4-6f02-4291-b218-cfa76bcf557f] Running
	I0918 17:02:05.151784   88523 system_pods.go:61] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:02:05.151796   88523 system_pods.go:61] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:02:05.151805   88523 system_pods.go:61] "kube-controller-manager-ha-078118-m03" [43309df5-32b3-4ca8-a0a0-23bfcaac2138] Running
	I0918 17:02:05.151812   88523 system_pods.go:61] "kube-proxy-2pjrn" [490f3965-2c3c-42d8-89b3-d3d599ebf60e] Running
	I0918 17:02:05.151817   88523 system_pods.go:61] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 17:02:05.151823   88523 system_pods.go:61] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 17:02:05.151839   88523 system_pods.go:61] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:02:05.151856   88523 system_pods.go:61] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:02:05.151865   88523 system_pods.go:61] "kube-scheduler-ha-078118-m03" [93dfed73-cd97-4f3f-804e-ffdd528fd8ff] Running
	I0918 17:02:05.151872   88523 system_pods.go:61] "kube-vip-ha-078118" [d3c28c72-f791-4e3f-bd5f-91fc9bcb1fee] Running
	I0918 17:02:05.151880   88523 system_pods.go:61] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 17:02:05.151884   88523 system_pods.go:61] "kube-vip-ha-078118-m03" [919fbb1f-4ca4-41e2-a8f7-6d2c73f81558] Running
	I0918 17:02:05.151890   88523 system_pods.go:61] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 17:02:05.151899   88523 system_pods.go:74] duration metric: took 6.86776ms to wait for pod list to return data ...
	I0918 17:02:05.151913   88523 default_sa.go:34] waiting for default service account to be created ...
	I0918 17:02:05.155271   88523 default_sa.go:45] found service account: "default"
	I0918 17:02:05.155311   88523 default_sa.go:55] duration metric: took 3.373656ms for default service account to be created ...
	I0918 17:02:05.155323   88523 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 17:02:05.161172   88523 system_pods.go:86] 24 kube-system pods found
	I0918 17:02:05.161213   88523 system_pods.go:89] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:02:05.161226   88523 system_pods.go:89] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:02:05.161239   88523 system_pods.go:89] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:02:05.161252   88523 system_pods.go:89] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:02:05.161258   88523 system_pods.go:89] "etcd-ha-078118-m03" [ef27a91e-a220-4dcb-885c-2941742d985e] Running
	I0918 17:02:05.161268   88523 system_pods.go:89] "kindnet-f2b4b" [98c5afc6-e57e-488c-948a-e24ec24b97a7] Running
	I0918 17:02:05.161273   88523 system_pods.go:89] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 17:02:05.161281   88523 system_pods.go:89] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 17:02:05.161291   88523 system_pods.go:89] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:02:05.161310   88523 system_pods.go:89] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:02:05.161317   88523 system_pods.go:89] "kube-apiserver-ha-078118-m03" [1cc265d4-6f02-4291-b218-cfa76bcf557f] Running
	I0918 17:02:05.161326   88523 system_pods.go:89] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:02:05.161338   88523 system_pods.go:89] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:02:05.161347   88523 system_pods.go:89] "kube-controller-manager-ha-078118-m03" [43309df5-32b3-4ca8-a0a0-23bfcaac2138] Running
	I0918 17:02:05.161356   88523 system_pods.go:89] "kube-proxy-2pjrn" [490f3965-2c3c-42d8-89b3-d3d599ebf60e] Running
	I0918 17:02:05.161362   88523 system_pods.go:89] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 17:02:05.161368   88523 system_pods.go:89] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 17:02:05.161376   88523 system_pods.go:89] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:02:05.161388   88523 system_pods.go:89] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:02:05.161397   88523 system_pods.go:89] "kube-scheduler-ha-078118-m03" [93dfed73-cd97-4f3f-804e-ffdd528fd8ff] Running
	I0918 17:02:05.161403   88523 system_pods.go:89] "kube-vip-ha-078118" [d3c28c72-f791-4e3f-bd5f-91fc9bcb1fee] Running
	I0918 17:02:05.161408   88523 system_pods.go:89] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 17:02:05.161415   88523 system_pods.go:89] "kube-vip-ha-078118-m03" [919fbb1f-4ca4-41e2-a8f7-6d2c73f81558] Running
	I0918 17:02:05.161420   88523 system_pods.go:89] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 17:02:05.161430   88523 system_pods.go:126] duration metric: took 6.100358ms to wait for k8s-apps to be running ...
	I0918 17:02:05.161440   88523 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 17:02:05.161516   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:02:05.177297   88523 system_svc.go:56] duration metric: took 15.845414ms WaitForService to wait for kubelet
	I0918 17:02:05.177334   88523 kubeadm.go:578] duration metric: took 193.125652ms to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:02:05.177354   88523 node_conditions.go:102] verifying NodePressure condition ...
	I0918 17:02:05.185021   88523 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:02:05.185063   88523 node_conditions.go:123] node cpu capacity is 8
	I0918 17:02:05.185079   88523 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:02:05.185084   88523 node_conditions.go:123] node cpu capacity is 8
	I0918 17:02:05.185089   88523 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:02:05.185094   88523 node_conditions.go:123] node cpu capacity is 8
	I0918 17:02:05.185100   88523 node_conditions.go:105] duration metric: took 7.739153ms to run NodePressure ...
	I0918 17:02:05.185116   88523 start.go:241] waiting for startup goroutines ...
	I0918 17:02:05.185151   88523 start.go:255] writing updated cluster config ...
	I0918 17:02:05.188016   88523 out.go:203] 
	I0918 17:02:05.189941   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:05.190105   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:02:05.191907   88523 out.go:179] * Starting "ha-078118-m03" control-plane node in "ha-078118" cluster
	I0918 17:02:05.194060   88523 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:02:05.195551   88523 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:02:05.197069   88523 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:02:05.197116   88523 cache.go:58] Caching tarball of preloaded images
	I0918 17:02:05.197212   88523 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:02:05.197242   88523 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:02:05.197264   88523 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:02:05.197414   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:02:05.226983   88523 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:02:05.227006   88523 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:02:05.227018   88523 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:02:05.227040   88523 start.go:360] acquireMachinesLock for ha-078118-m03: {Name:mk9d1c903c967299da898df87db82c277b1f732e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:02:05.227086   88523 start.go:364] duration metric: took 34.168µs to acquireMachinesLock for "ha-078118-m03"
	I0918 17:02:05.227103   88523 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:02:05.227108   88523 fix.go:54] fixHost starting: m03
	I0918 17:02:05.227303   88523 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:02:05.249149   88523 fix.go:112] recreateIfNeeded on ha-078118-m03: state=Stopped err=<nil>
	W0918 17:02:05.249177   88523 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:02:05.250693   88523 out.go:252] * Restarting existing docker container for "ha-078118-m03" ...
	I0918 17:02:05.250758   88523 cli_runner.go:164] Run: docker start ha-078118-m03
	I0918 17:02:05.515973   88523 cli_runner.go:164] Run: docker container inspect ha-078118-m03 --format={{.State.Status}}
	I0918 17:02:05.536187   88523 kic.go:430] container "ha-078118-m03" state is running.
	I0918 17:02:05.536534   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:02:05.558300   88523 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:02:05.558648   88523 machine.go:93] provisionDockerMachine start ...
	I0918 17:02:05.558720   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:05.579338   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:05.579663   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32823 <nil> <nil>}
	I0918 17:02:05.579678   88523 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:02:05.580353   88523 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:45160->127.0.0.1:32823: read: connection reset by peer
	I0918 17:02:08.725772   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m03
	
	I0918 17:02:08.725804   88523 ubuntu.go:182] provisioning hostname "ha-078118-m03"
	I0918 17:02:08.725891   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:08.756666   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:08.756974   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32823 <nil> <nil>}
	I0918 17:02:08.756986   88523 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m03 && echo "ha-078118-m03" | sudo tee /etc/hostname
	I0918 17:02:08.930439   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m03
	
	I0918 17:02:08.930535   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:08.952376   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:08.952708   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32823 <nil> <nil>}
	I0918 17:02:08.952734   88523 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m03' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m03/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m03' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:02:09.100605   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:02:09.100638   88523 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:02:09.100658   88523 ubuntu.go:190] setting up certificates
	I0918 17:02:09.100671   88523 provision.go:84] configureAuth start
	I0918 17:02:09.100729   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:02:09.118862   88523 provision.go:143] copyHostCerts
	I0918 17:02:09.118901   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:02:09.118950   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:02:09.118960   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:02:09.119047   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:02:09.119191   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:02:09.119226   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:02:09.119236   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:02:09.119282   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:02:09.119369   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:02:09.119400   88523 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:02:09.119409   88523 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:02:09.119444   88523 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:02:09.119559   88523 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m03 san=[127.0.0.1 192.168.49.4 ha-078118-m03 localhost minikube]
	I0918 17:02:09.260974   88523 provision.go:177] copyRemoteCerts
	I0918 17:02:09.261051   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:02:09.261103   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:09.280371   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:09.387340   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 17:02:09.387407   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:02:09.416941   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 17:02:09.417026   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 17:02:09.446183   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 17:02:09.446252   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:02:09.471835   88523 provision.go:87] duration metric: took 371.152567ms to configureAuth
	I0918 17:02:09.471860   88523 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:02:09.472058   88523 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:02:09.472148   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:09.491093   88523 main.go:141] libmachine: Using SSH client type: native
	I0918 17:02:09.491339   88523 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32823 <nil> <nil>}
	I0918 17:02:09.491355   88523 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:02:09.891314   88523 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:02:09.891343   88523 machine.go:96] duration metric: took 4.332677043s to provisionDockerMachine
	I0918 17:02:09.891358   88523 start.go:293] postStartSetup for "ha-078118-m03" (driver="docker")
	I0918 17:02:09.891371   88523 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:02:09.891442   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:02:09.891557   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:09.921555   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:10.028567   88523 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:02:10.033858   88523 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:02:10.033897   88523 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:02:10.033910   88523 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:02:10.033918   88523 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:02:10.033932   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:02:10.034000   88523 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:02:10.034430   88523 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:02:10.034444   88523 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 17:02:10.034568   88523 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:02:10.048975   88523 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:02:10.083492   88523 start.go:296] duration metric: took 192.119586ms for postStartSetup
	I0918 17:02:10.083604   88523 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:02:10.083656   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:10.106324   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:10.203785   88523 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:02:10.208849   88523 fix.go:56] duration metric: took 4.981736294s for fixHost
	I0918 17:02:10.208880   88523 start.go:83] releasing machines lock for "ha-078118-m03", held for 4.981783384s
	I0918 17:02:10.209046   88523 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m03
	I0918 17:02:10.233270   88523 out.go:179] * Found network options:
	I0918 17:02:10.234714   88523 out.go:179]   - NO_PROXY=192.168.49.2,192.168.49.3
	W0918 17:02:10.235974   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:02:10.236005   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:02:10.236041   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:02:10.236061   88523 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 17:02:10.236138   88523 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:02:10.236187   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:10.236220   88523 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:02:10.236289   88523 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m03
	I0918 17:02:10.256738   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:10.257073   88523 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32823 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m03/id_rsa Username:docker}
	I0918 17:02:10.488616   88523 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:02:10.493307   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:02:10.503073   88523 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:02:10.503146   88523 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:02:10.512908   88523 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:02:10.512936   88523 start.go:495] detecting cgroup driver to use...
	I0918 17:02:10.512971   88523 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:02:10.513021   88523 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:02:10.526086   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:02:10.538395   88523 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:02:10.538454   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:02:10.552019   88523 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:02:10.564326   88523 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:02:10.675410   88523 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:02:10.794108   88523 docker.go:234] disabling docker service ...
	I0918 17:02:10.794170   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:02:10.807169   88523 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:02:10.819727   88523 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:02:10.950399   88523 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:02:11.066947   88523 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:02:11.080007   88523 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:02:11.097805   88523 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:02:11.097858   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.108323   88523 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:02:11.108404   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.118846   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.129919   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.140838   88523 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:02:11.150706   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.161419   88523 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.171572   88523 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:02:11.182665   88523 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:02:11.192098   88523 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:02:11.201265   88523 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:02:11.313472   88523 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:02:11.558568   88523 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:02:11.558638   88523 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:02:11.562585   88523 start.go:563] Will wait 60s for crictl version
	I0918 17:02:11.562642   88523 ssh_runner.go:195] Run: which crictl
	I0918 17:02:11.566682   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:11.598728   88523 retry.go:31] will retry after 7.956255474s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:11Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	I0918 17:02:19.555680   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:19.587687   88523 retry.go:31] will retry after 9.296604833s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:19Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	I0918 17:02:28.886490   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:28.918087   88523 retry.go:31] will retry after 27.630342902s: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:28Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	I0918 17:02:56.549631   88523 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:02:56.586522   88523 out.go:203] 
	W0918 17:02:56.587940   88523 out.go:285] X Exiting due to RUNTIME_ENABLE: Failed to start container runtime: Temporary Error: sudo /usr/bin/crictl version: Process exited with status 1
	stdout:
	
	stderr:
	time="2025-09-18T17:02:56Z" level=fatal msg="unable to determine runtime API version: rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing dial unix /var/run/crio/crio.sock: connect: connection refused\""
	
	W0918 17:02:56.587957   88523 out.go:285] * 
	W0918 17:02:56.589763   88523 out.go:308] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0918 17:02:56.591335   88523 out.go:203] 
	
	
	==> CRI-O <==
	Sep 18 17:02:34 ha-078118 crio[549]: time="2025-09-18 17:02:34.060268712Z" level=info msg="Starting container: c5306bc68997539c87c2f87a4d32cb06fd7438b16669456d394f1cf8ae4fb842" id=8840c728-c65d-4ad8-873e-04b29bd68fcb name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 17:02:34 ha-078118 crio[549]: time="2025-09-18 17:02:34.066403407Z" level=info msg="Started container" PID=1664 containerID=c5306bc68997539c87c2f87a4d32cb06fd7438b16669456d394f1cf8ae4fb842 description=kube-system/storage-provisioner/storage-provisioner id=8840c728-c65d-4ad8-873e-04b29bd68fcb name=/runtime.v1.RuntimeService/StartContainer sandboxID=b81ecaff085b3b8d21b63fb91c35feb7061e0f58a0af5d1c5dacb91a2588e358
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.553598938Z" level=info msg="Running pod sandbox: default/busybox-7b57f96db7-8z4jq/POD" id=2153c012-19f9-4b62-a65f-1f86ab88833f name=/runtime.v1.RuntimeService/RunPodSandbox
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.553664224Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.567735894Z" level=info msg="Got pod network &{Name:busybox-7b57f96db7-8z4jq Namespace:default ID:4ed9df865d51951581fa18a38feb1e1f3cab5927fd87db98d679b83814bac0df UID:43e34594-9fbe-4c7f-b976-5df485b31ec1 NetNS:/var/run/netns/d54c6c86-4052-4027-9485-b7d139abfd45 Networks:[] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.567766994Z" level=info msg="Adding pod default_busybox-7b57f96db7-8z4jq to CNI network \"kindnet\" (type=ptp)"
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.577694368Z" level=info msg="Got pod network &{Name:busybox-7b57f96db7-8z4jq Namespace:default ID:4ed9df865d51951581fa18a38feb1e1f3cab5927fd87db98d679b83814bac0df UID:43e34594-9fbe-4c7f-b976-5df485b31ec1 NetNS:/var/run/netns/d54c6c86-4052-4027-9485-b7d139abfd45 Networks:[] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.577822099Z" level=info msg="Checking pod default_busybox-7b57f96db7-8z4jq for CNI network kindnet (type=ptp)"
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.578687556Z" level=info msg="Not creating sandbox cgroup: sbParent is empty"
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.579754844Z" level=info msg="Ran pod sandbox 4ed9df865d51951581fa18a38feb1e1f3cab5927fd87db98d679b83814bac0df with infra container: default/busybox-7b57f96db7-8z4jq/POD" id=2153c012-19f9-4b62-a65f-1f86ab88833f name=/runtime.v1.RuntimeService/RunPodSandbox
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.581000369Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28" id=4b3aaba2-af16-4909-aec4-0833192263a6 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.581251427Z" level=info msg="Image gcr.io/k8s-minikube/busybox:1.28 not found" id=4b3aaba2-af16-4909-aec4-0833192263a6 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.582052575Z" level=info msg="Pulling image: gcr.io/k8s-minikube/busybox:1.28" id=0005ca07-7e47-4ed3-8b4a-428a58471a33 name=/runtime.v1.ImageService/PullImage
	Sep 18 17:02:59 ha-078118 crio[549]: time="2025-09-18 17:02:59.587016416Z" level=info msg="Trying to access \"gcr.io/k8s-minikube/busybox:1.28\""
	Sep 18 17:03:00 ha-078118 crio[549]: time="2025-09-18 17:03:00.415839008Z" level=info msg="Trying to access \"gcr.io/k8s-minikube/busybox:1.28\""
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.619428740Z" level=info msg="Pulled image: gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335" id=0005ca07-7e47-4ed3-8b4a-428a58471a33 name=/runtime.v1.ImageService/PullImage
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.620142037Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28" id=0fc8fe55-a57a-4dfe-9b33-a9cd7b30b579 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.620710816Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,RepoTags:[gcr.io/k8s-minikube/busybox:1.28],RepoDigests:[gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335 gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12],Size_:1363676,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=0fc8fe55-a57a-4dfe-9b33-a9cd7b30b579 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.621392916Z" level=info msg="Checking image status: gcr.io/k8s-minikube/busybox:1.28" id=d20453f4-7a64-430d-be1f-53a42e414e4c name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.622061348Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,RepoTags:[gcr.io/k8s-minikube/busybox:1.28],RepoDigests:[gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335 gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12],Size_:1363676,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=d20453f4-7a64-430d-be1f-53a42e414e4c name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.625531802Z" level=info msg="Creating container: default/busybox-7b57f96db7-8z4jq/busybox" id=0e84c568-4c82-4d47-a594-6e125813d616 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.625655265Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.697400770Z" level=info msg="Created container a6abf33433693d8ceabcc0df33e79fd6700f8c0f0416d08d6beda409021fd28e: default/busybox-7b57f96db7-8z4jq/busybox" id=0e84c568-4c82-4d47-a594-6e125813d616 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.698073432Z" level=info msg="Starting container: a6abf33433693d8ceabcc0df33e79fd6700f8c0f0416d08d6beda409021fd28e" id=af3aa0c9-e5da-4670-8bd4-33f66d6955eb name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 17:03:01 ha-078118 crio[549]: time="2025-09-18 17:03:01.704786907Z" level=info msg="Started container" PID=2027 containerID=a6abf33433693d8ceabcc0df33e79fd6700f8c0f0416d08d6beda409021fd28e description=default/busybox-7b57f96db7-8z4jq/busybox id=af3aa0c9-e5da-4670-8bd4-33f66d6955eb name=/runtime.v1.RuntimeService/StartContainer sandboxID=4ed9df865d51951581fa18a38feb1e1f3cab5927fd87db98d679b83814bac0df
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                                 CREATED              STATE               NAME                      ATTEMPT             POD ID              POD
	a6abf33433693       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   19 seconds ago       Running             busybox                   0                   4ed9df865d519       busybox-7b57f96db7-8z4jq
	c5306bc689975       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      47 seconds ago       Running             storage-provisioner       2                   b81ecaff085b3       storage-provisioner
	d92258dd572de       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                      About a minute ago   Running             coredns                   1                   e25b7987fbe82       coredns-66bc5c9577-q42l7
	21e20d4ddc753       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                      About a minute ago   Running             coredns                   1                   a7949d1b05144       coredns-66bc5c9577-g9xk6
	ee4b7f442abce       409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c                                      About a minute ago   Running             kindnet-cni               1                   b28207bd36b40       kindnet-vqp76
	21b6ad607723f       df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce                                      About a minute ago   Running             kube-proxy                1                   a80daddb8a1b8       kube-proxy-b98xh
	e26adb5e15f89       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      About a minute ago   Exited              storage-provisioner       1                   b81ecaff085b3       storage-provisioner
	1116d08ec1d26       a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634                                      About a minute ago   Running             kube-controller-manager   1                   bc00758e6c840       kube-controller-manager-ha-078118
	d4f5428eab0f2       90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90                                      About a minute ago   Running             kube-apiserver            1                   27ab8b84a9d30       kube-apiserver-ha-078118
	47b875d1b553d       46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc                                      About a minute ago   Running             kube-scheduler            1                   0b0c119de2a5e       kube-scheduler-ha-078118
	1fb0f2e98fb3a       765655ea6078171c416896d7cc155c1263a0411d30caaa03d7365aecb99fdf23                                      About a minute ago   Running             kube-vip                  0                   30db82bb4c1ec       kube-vip-ha-078118
	f91dc53d280e7       5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115                                      About a minute ago   Running             etcd                      1                   392032ae1b295       etcd-ha-078118
	
	
	==> coredns [21e20d4ddc7530d0ecedda7040a90cb736185c9e2cfa6123c719be543b5f0b45] <==
	maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
	.:53
	[INFO] plugin/reload: Running configuration SHA512 = 9e2996f8cb67ac53e0259ab1f8d615d07d1beb0bd07e6a1e39769c3bf486a905bb991cc47f8d2f14d0d3a90a87dfc625a0b4c524fed169d8158c40657c0694b1
	CoreDNS-1.12.1
	linux/amd64, go1.24.1, 707c7c1
	[INFO] 127.0.0.1:50820 - 24265 "HINFO IN 812459865089642632.5213722986442749200. udp 56 false 512" NXDOMAIN qr,rd,ra 131 0.020389884s
	
	
	==> coredns [d92258dd572ded142a5afbc78cddf28ea3a1121361d80dd2d867608475828e4a] <==
	maxprocs: Leaving GOMAXPROCS=8: CPU quota undefined
	.:53
	[INFO] plugin/reload: Running configuration SHA512 = 9e2996f8cb67ac53e0259ab1f8d615d07d1beb0bd07e6a1e39769c3bf486a905bb991cc47f8d2f14d0d3a90a87dfc625a0b4c524fed169d8158c40657c0694b1
	CoreDNS-1.12.1
	linux/amd64, go1.24.1, 707c7c1
	[INFO] 127.0.0.1:32816 - 43183 "HINFO IN 6715587801686201477.3035471256272355978. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.032152072s
	
	
	==> describe nodes <==
	Name:               ha-078118
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2025_09_18T16_57_20_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:57:14 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:03:13 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 17:02:01 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 17:02:01 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 17:02:01 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 17:02:01 +0000   Thu, 18 Sep 2025 16:57:34 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ha-078118
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 458d106b7f2d49958eb79b0b2fc209fe
	  System UUID:                910bee46-adcd-4833-91ec-cea7d3c2588c
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (11 in total)
	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---
	  default                     busybox-7b57f96db7-8z4jq             0 (0%)        0 (0%)      0 (0%)           0 (0%)         22s
	  kube-system                 coredns-66bc5c9577-g9xk6             100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     5m58s
	  kube-system                 coredns-66bc5c9577-q42l7             100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     5m58s
	  kube-system                 etcd-ha-078118                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         6m2s
	  kube-system                 kindnet-vqp76                        100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      5m58s
	  kube-system                 kube-apiserver-ha-078118             250m (3%)     0 (0%)      0 (0%)           0 (0%)         6m2s
	  kube-system                 kube-controller-manager-ha-078118    200m (2%)     0 (0%)      0 (0%)           0 (0%)         6m2s
	  kube-system                 kube-proxy-b98xh                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m58s
	  kube-system                 kube-scheduler-ha-078118             100m (1%)     0 (0%)      0 (0%)           0 (0%)         6m2s
	  kube-system                 kube-vip-ha-078118                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         79s
	  kube-system                 storage-provisioner                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m58s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (11%)  100m (1%)
	  memory             290Mi (0%)  390Mi (1%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                  From             Message
	  ----    ------                   ----                 ----             -------
	  Normal  Starting                 5m57s                kube-proxy       
	  Normal  Starting                 77s                  kube-proxy       
	  Normal  NodeHasSufficientPID     6m9s (x8 over 6m9s)  kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  Starting                 6m9s                 kubelet          Starting kubelet.
	  Normal  NodeHasNoDiskPressure    6m9s (x8 over 6m9s)  kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientMemory  6m9s (x8 over 6m9s)  kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  Starting                 6m2s                 kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  6m2s                 kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     6m2s                 kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  NodeHasNoDiskPressure    6m2s                 kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  RegisteredNode           6m                   node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  NodeReady                5m47s                kubelet          Node ha-078118 status is now: NodeReady
	  Normal  RegisteredNode           5m33s                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           4m29s                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           2m52s                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  Starting                 86s                  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  86s (x8 over 86s)    kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    86s (x8 over 86s)    kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     86s (x8 over 86s)    kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           76s                  node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           76s                  node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           69s                  node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	
	
	Name:               ha-078118-m02
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118-m02
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=false
	                    minikube.k8s.io/updated_at=2025_09_18T16_57_51_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:57:50 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118-m02
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:03:13 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 17:02:02 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 17:02:02 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 17:02:02 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 17:02:02 +0000   Thu, 18 Sep 2025 16:58:34 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.3
	  Hostname:    ha-078118-m02
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 3f995e2e4a1c4f75914810fc1dbd193e
	  System UUID:                0093212b-e7dd-4bdc-8376-480f39da7714
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.1.0/24
	PodCIDRs:                     10.244.1.0/24
	Non-terminated Pods:          (9 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     busybox-7b57f96db7-bzrv2                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m8s
	  default                     busybox-7b57f96db7-t7rzr                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m8s
	  kube-system                 etcd-ha-078118-m02                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         5m29s
	  kube-system                 kindnet-jnlbr                            100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      5m31s
	  kube-system                 kube-apiserver-ha-078118-m02             250m (3%)     0 (0%)      0 (0%)           0 (0%)         5m29s
	  kube-system                 kube-controller-manager-ha-078118-m02    200m (2%)     0 (0%)      0 (0%)           0 (0%)         5m29s
	  kube-system                 kube-proxy-t5wdg                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m31s
	  kube-system                 kube-scheduler-ha-078118-m02             100m (1%)     0 (0%)      0 (0%)           0 (0%)         5m29s
	  kube-system                 kube-vip-ha-078118-m02                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m29s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%)   100m (1%)
	  memory             150Mi (0%)  50Mi (0%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                    From             Message
	  ----    ------                   ----                   ----             -------
	  Normal  Starting                 5m27s                  kube-proxy       
	  Normal  RegisteredNode           5m30s                  node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode           5m28s                  node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode           4m29s                  node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  NodeHasSufficientMemory  2m57s (x8 over 2m57s)  kubelet          Node ha-078118-m02 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     2m57s (x8 over 2m57s)  kubelet          Node ha-078118-m02 status is now: NodeHasSufficientPID
	  Normal  NodeHasNoDiskPressure    2m57s (x8 over 2m57s)  kubelet          Node ha-078118-m02 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 2m57s                  kubelet          Starting kubelet.
	  Normal  RegisteredNode           2m52s                  node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  Starting                 84s                    kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  84s (x8 over 84s)      kubelet          Node ha-078118-m02 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    84s (x8 over 84s)      kubelet          Node ha-078118-m02 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     84s (x8 over 84s)      kubelet          Node ha-078118-m02 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           76s                    node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode           76s                    node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal  RegisteredNode           69s                    node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	
	
	==> dmesg <==
	[  +0.089038] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
	[  +0.028015] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
	[  +7.570818] kauditd_printk_skb: 47 callbacks suppressed
	[Sep18 16:41] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.013586] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023854] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023944] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023869] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023927] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000033] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +2.047789] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +4.031621] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000030] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +8.127251] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[Sep18 16:42] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[ +32.253146] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	
	
	==> etcd [f91dc53d280e73296b67c5af262f92ccc765a2d06dabb01f644747155136c12a] <==
	{"level":"warn","ts":"2025-09-18T17:03:20.558395Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:20.628100Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:20.709707Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:20.910175Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:20.958215Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:20.985050Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:20.989780Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.058175Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.069383Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.073792Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.144146Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.158098Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.206298Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.211966Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.214605Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.218430Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.225723Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.232702Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.235474Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.237760Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.241544Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.247738Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.253618Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.258412Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:03:21.280820Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	
	
	==> kernel <==
	 17:03:21 up 45 min,  0 users,  load average: 0.81, 0.82, 0.56
	Linux ha-078118 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [ee4b7f442abced82d1215a56d72dcb325957c75eca662f974092a942d3e19c88] <==
	I0918 17:02:33.717248       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 17:02:33.717460       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:02:33.717474       1 main.go:301] handling current node
	I0918 17:02:33.717488       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:02:33.717495       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:02:43.715630       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:02:43.715666       1 main.go:301] handling current node
	I0918 17:02:43.715680       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:02:43.715685       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:02:43.715844       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 17:02:43.715853       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 17:02:53.707928       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:02:53.707982       1 main.go:301] handling current node
	I0918 17:02:53.707996       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:02:53.708001       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:02:53.708180       1 main.go:297] Handling node with IPs: map[192.168.49.4:{}]
	I0918 17:02:53.708190       1 main.go:324] Node ha-078118-m03 has CIDR [10.244.2.0/24] 
	I0918 17:03:03.707482       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:03:03.707536       1 main.go:301] handling current node
	I0918 17:03:03.707549       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:03:03.707554       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:03:13.715574       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:03:13.715612       1 main.go:301] handling current node
	I0918 17:03:13.715629       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:03:13.715634       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	
	
	==> kube-apiserver [d4f5428eab0f2a8a0ca07ae986a46d4e7c06ce0e5322afd878ab06cc67a7e5fd] <==
	I0918 17:02:01.924154       1 default_servicecidr_controller.go:137] Shutting down kubernetes-service-cidr-controller
	I0918 17:02:01.924268       1 shared_informer.go:356] "Caches are synced" controller="crd-autoregister"
	I0918 17:02:01.924315       1 aggregator.go:171] initial CRD sync complete...
	I0918 17:02:01.924336       1 autoregister_controller.go:144] Starting autoregister controller
	I0918 17:02:01.924344       1 cache.go:32] Waiting for caches to sync for autoregister controller
	I0918 17:02:01.924356       1 cache.go:39] Caches are synced for autoregister controller
	I0918 17:02:01.924616       1 apf_controller.go:382] Running API Priority and Fairness config worker
	I0918 17:02:01.924627       1 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process
	I0918 17:02:01.925134       1 cache.go:39] Caches are synced for LocalAvailability controller
	I0918 17:02:01.925404       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0918 17:02:01.926298       1 cache.go:39] Caches are synced for RemoteAvailability controller
	I0918 17:02:01.933858       1 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller"
	I0918 17:02:01.935986       1 handler_discovery.go:451] Starting ResourceDiscoveryManager
	W0918 17:02:01.947413       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.49.3]
	I0918 17:02:01.949188       1 controller.go:667] quota admission added evaluator for: endpoints
	I0918 17:02:01.966691       1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
	E0918 17:02:01.974003       1 controller.go:95] Found stale data, removed previous endpoints on kubernetes service, apiserver didn't exit successfully previously
	I0918 17:02:01.981545       1 shared_informer.go:356] "Caches are synced" controller="node_authorizer"
	I0918 17:02:02.059433       1 controller.go:667] quota admission added evaluator for: serviceaccounts
	I0918 17:02:02.827879       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
	W0918 17:02:03.384540       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.49.2]
	I0918 17:02:05.265843       1 controller.go:667] quota admission added evaluator for: replicasets.apps
	I0918 17:02:07.416458       1 controller.go:667] quota admission added evaluator for: deployments.apps
	I0918 17:02:09.060071       1 controller.go:667] quota admission added evaluator for: daemonsets.apps
	I0918 17:03:08.781722       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	
	
	==> kube-controller-manager [1116d08ec1d269195f2a2e8ae64741618a2b1e2c4e5826296f672f469a7322a5] <==
	I0918 17:02:05.259774       1 shared_informer.go:356] "Caches are synced" controller="TTL after finished"
	I0918 17:02:05.259776       1 shared_informer.go:356] "Caches are synced" controller="ReplicationController"
	I0918 17:02:05.259905       1 shared_informer.go:356] "Caches are synced" controller="expand"
	I0918 17:02:05.260131       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-client"
	I0918 17:02:05.261025       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
	I0918 17:02:05.261053       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kube-apiserver-client"
	I0918 17:02:05.264410       1 shared_informer.go:356] "Caches are synced" controller="namespace"
	I0918 17:02:05.267245       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	I0918 17:02:05.267301       1 garbagecollector.go:154] "Garbage collector: all resource monitors have synced" logger="garbage-collector-controller"
	I0918 17:02:05.267312       1 garbagecollector.go:157] "Proceeding to collect garbage" logger="garbage-collector-controller"
	I0918 17:02:05.269527       1 shared_informer.go:356] "Caches are synced" controller="resource quota"
	I0918 17:02:05.274317       1 shared_informer.go:356] "Caches are synced" controller="validatingadmissionpolicy-status"
	I0918 17:02:05.277340       1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice_mirroring"
	I0918 17:02:05.292756       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	I0918 17:02:05.614934       1 endpointslice_controller.go:344] "Error syncing endpoint slices for service, retrying" logger="endpointslice-controller" key="kube-system/kube-dns" err="failed to update kube-dns-dsh2c EndpointSlice for Service kube-system/kube-dns: Operation cannot be fulfilled on endpointslices.discovery.k8s.io \"kube-dns-dsh2c\": the object has been modified; please apply your changes to the latest version and try again"
	I0918 17:02:05.615013       1 event.go:377] Event(v1.ObjectReference{Kind:"Service", Namespace:"kube-system", Name:"kube-dns", UID:"92afb4da-15d6-4c05-b549-cfdf91ba4ea0", APIVersion:"v1", ResourceVersion:"312", FieldPath:""}): type: 'Warning' reason: 'FailedToUpdateEndpointSlices' Error updating Endpoint Slices for Service kube-system/kube-dns: failed to update kube-dns-dsh2c EndpointSlice for Service kube-system/kube-dns: Operation cannot be fulfilled on endpointslices.discovery.k8s.io "kube-dns-dsh2c": the object has been modified; please apply your changes to the latest version and try again
	I0918 17:02:07.411918       1 endpointslice_controller.go:344] "Error syncing endpoint slices for service, retrying" logger="endpointslice-controller" key="kube-system/kube-dns" err="failed to update kube-dns-dsh2c EndpointSlice for Service kube-system/kube-dns: Operation cannot be fulfilled on endpointslices.discovery.k8s.io \"kube-dns-dsh2c\": the object has been modified; please apply your changes to the latest version and try again"
	I0918 17:02:07.411981       1 event.go:377] Event(v1.ObjectReference{Kind:"Service", Namespace:"kube-system", Name:"kube-dns", UID:"92afb4da-15d6-4c05-b549-cfdf91ba4ea0", APIVersion:"v1", ResourceVersion:"312", FieldPath:""}): type: 'Warning' reason: 'FailedToUpdateEndpointSlices' Error updating Endpoint Slices for Service kube-system/kube-dns: failed to update kube-dns-dsh2c EndpointSlice for Service kube-system/kube-dns: Operation cannot be fulfilled on endpointslices.discovery.k8s.io "kube-dns-dsh2c": the object has been modified; please apply your changes to the latest version and try again
	E0918 17:02:59.323055       1 replica_set.go:587] "Unhandled Error" err="sync \"default/busybox-7b57f96db7\" failed with Operation cannot be fulfilled on replicasets.apps \"busybox-7b57f96db7\": the object has been modified; please apply your changes to the latest version and try again" logger="UnhandledError"
	E0918 17:03:05.219873       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:03:05.219908       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:03:05.219932       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:03:05.219946       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:03:05.219953       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:03:05.219960       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	
	
	==> kube-proxy [21b6ad607723fc0096bcbd14ccd85f029136b58ac2b0ddb5ddcd5bed51ad655b] <==
	I0918 17:02:03.339116       1 server_linux.go:53] "Using iptables proxy"
	I0918 17:02:03.389961       1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
	I0918 17:02:03.490912       1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
	I0918 17:02:03.490950       1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.49.2"]
	E0918 17:02:03.491054       1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
	I0918 17:02:03.512844       1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0918 17:02:03.512918       1 server_linux.go:132] "Using iptables Proxier"
	I0918 17:02:03.518771       1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
	I0918 17:02:03.519678       1 server.go:527] "Version info" version="v1.34.0"
	I0918 17:02:03.519790       1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 17:02:03.522083       1 config.go:200] "Starting service config controller"
	I0918 17:02:03.522097       1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
	I0918 17:02:03.522139       1 config.go:309] "Starting node config controller"
	I0918 17:02:03.522142       1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
	I0918 17:02:03.522146       1 shared_informer.go:356] "Caches are synced" controller="node config"
	I0918 17:02:03.522322       1 config.go:106] "Starting endpoint slice config controller"
	I0918 17:02:03.522340       1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
	I0918 17:02:03.522359       1 config.go:403] "Starting serviceCIDR config controller"
	I0918 17:02:03.522367       1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
	I0918 17:02:03.622286       1 shared_informer.go:356] "Caches are synced" controller="service config"
	I0918 17:02:03.622411       1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
	I0918 17:02:03.622414       1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
	
	
	==> kube-scheduler [47b875d1b553d7877d7d481e425ea07fc063800dddd54b871a6bd6ab139efe67] <==
	I0918 17:01:56.949468       1 serving.go:386] Generated self-signed cert in-memory
	W0918 17:02:01.848942       1 requestheader_controller.go:204] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W0918 17:02:01.848981       1 authentication.go:397] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W0918 17:02:01.848992       1 authentication.go:398] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0918 17:02:01.849002       1 authentication.go:399] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0918 17:02:01.914311       1 server.go:175] "Starting Kubernetes Scheduler" version="v1.34.0"
	I0918 17:02:01.914353       1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 17:02:01.923771       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0918 17:02:01.923812       1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0918 17:02:01.925571       1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
	I0918 17:02:01.925987       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
	I0918 17:02:02.024271       1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	
	
	==> kubelet <==
	Sep 18 17:02:03 ha-078118 kubelet[703]: E0918 17:02:03.058122     703 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c21094f1-585a-4109-b526-3a115d45f35f-config-volume podName:c21094f1-585a-4109-b526-3a115d45f35f nodeName:}" failed. No retries permitted until 2025-09-18 17:02:03.558111559 +0000 UTC m=+7.747811104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-volume" (UniqueName: "kubernetes.io/configmap/c21094f1-585a-4109-b526-3a115d45f35f-config-volume") pod "coredns-66bc5c9577-q42l7" (UID: "c21094f1-585a-4109-b526-3a115d45f35f") : failed to sync configmap cache: timed out waiting for the condition
	Sep 18 17:02:05 ha-078118 kubelet[703]: E0918 17:02:05.888882     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214925888637070  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:05 ha-078118 kubelet[703]: E0918 17:02:05.888923     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214925888637070  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:07 ha-078118 kubelet[703]: I0918 17:02:07.380277     703 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
	Sep 18 17:02:07 ha-078118 kubelet[703]: I0918 17:02:07.446941     703 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
	Sep 18 17:02:15 ha-078118 kubelet[703]: E0918 17:02:15.890834     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214935890411828  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:15 ha-078118 kubelet[703]: E0918 17:02:15.890877     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214935890411828  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:25 ha-078118 kubelet[703]: E0918 17:02:25.892044     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214945891835358  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:25 ha-078118 kubelet[703]: E0918 17:02:25.892079     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214945891835358  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:33 ha-078118 kubelet[703]: I0918 17:02:33.993183     703 scope.go:117] "RemoveContainer" containerID="e26adb5e15f89b7d6b2ae07f5ecd54f18d53826b37e5e202c66478a2da986742"
	Sep 18 17:02:35 ha-078118 kubelet[703]: E0918 17:02:35.893103     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214955892872566  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:35 ha-078118 kubelet[703]: E0918 17:02:35.893144     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214955892872566  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:45 ha-078118 kubelet[703]: E0918 17:02:45.894324     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214965894027593  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:45 ha-078118 kubelet[703]: E0918 17:02:45.894364     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214965894027593  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:55 ha-078118 kubelet[703]: E0918 17:02:55.880015     703 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5\": container with ID starting with 5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5 not found: ID does not exist" containerID="5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5"
	Sep 18 17:02:55 ha-078118 kubelet[703]: I0918 17:02:55.880056     703 kuberuntime_gc.go:364] "Error getting ContainerStatus for containerID" containerID="5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5" err="rpc error: code = NotFound desc = could not find container \"5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5\": container with ID starting with 5c0e7f567bba1b39a51fa48fd0efd369f1ce2dd4539771773b73b7265464fdf5 not found: ID does not exist"
	Sep 18 17:02:55 ha-078118 kubelet[703]: E0918 17:02:55.880405     703 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9\": container with ID starting with b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9 not found: ID does not exist" containerID="b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9"
	Sep 18 17:02:55 ha-078118 kubelet[703]: I0918 17:02:55.880441     703 kuberuntime_gc.go:364] "Error getting ContainerStatus for containerID" containerID="b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9" err="rpc error: code = NotFound desc = could not find container \"b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9\": container with ID starting with b6c234acce33d5650e31670cca994984b384853eeb7eee069f3e8dcfae352ae9 not found: ID does not exist"
	Sep 18 17:02:55 ha-078118 kubelet[703]: E0918 17:02:55.895432     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214975895244633  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:55 ha-078118 kubelet[703]: E0918 17:02:55.895471     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214975895244633  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:140135}  inodes_used:{value:63}}"
	Sep 18 17:02:59 ha-078118 kubelet[703]: I0918 17:02:59.434365     703 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9zqx\" (UniqueName: \"kubernetes.io/projected/43e34594-9fbe-4c7f-b976-5df485b31ec1-kube-api-access-d9zqx\") pod \"busybox-7b57f96db7-8z4jq\" (UID: \"43e34594-9fbe-4c7f-b976-5df485b31ec1\") " pod="default/busybox-7b57f96db7-8z4jq"
	Sep 18 17:03:05 ha-078118 kubelet[703]: E0918 17:03:05.896675     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214985896463318  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:03:05 ha-078118 kubelet[703]: E0918 17:03:05.896716     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214985896463318  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:03:15 ha-078118 kubelet[703]: E0918 17:03:15.897671     703 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758214995897455606  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:03:15 ha-078118 kubelet[703]: E0918 17:03:15.897710     703 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758214995897455606  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	

                                                
                                                
-- /stdout --
helpers_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-078118 -n ha-078118
helpers_test.go:269: (dbg) Run:  kubectl --context ha-078118 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (2.40s)

                                                
                                    
x
+
TestMultiControlPlane/serial/RestartCluster (1382.47s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/RestartCluster
ha_test.go:562: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 start --wait true --alsologtostderr -v 5 --driver=docker  --container-runtime=crio
E0918 17:04:16.081082   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:05:45.076324   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:06:32.217608   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:06:59.922777   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:10:45.076161   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:11:32.218529   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:15:45.076665   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:16:32.217621   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:17:55.285079   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:18:48.144067   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:20:45.078279   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:21:32.217738   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:25:45.077583   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:26:32.218057   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
ha_test.go:562: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 start --wait true --alsologtostderr -v 5 --driver=docker  --container-runtime=crio: signal: killed (22m59.990413491s)

                                                
                                                
-- stdout --
	* [ha-078118] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=20370
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	* Starting "ha-078118" primary control-plane node in "ha-078118" cluster
	* Pulling base image v0.0.48 ...
	* Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	* Enabled addons: 
	
	* Starting "ha-078118-m02" control-plane node in "ha-078118" cluster
	* Pulling base image v0.0.48 ...
	* Found network options:
	  - NO_PROXY=192.168.49.2
	* Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	  - env NO_PROXY=192.168.49.2
	* Verifying Kubernetes components...
	
	* Starting "ha-078118-m04" worker node in "ha-078118" cluster
	* Pulling base image v0.0.48 ...

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:03:57.594373   98925 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:03:57.594655   98925 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:03:57.594663   98925 out.go:374] Setting ErrFile to fd 2...
	I0918 17:03:57.594668   98925 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:03:57.594895   98925 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:03:57.595320   98925 out.go:368] Setting JSON to false
	I0918 17:03:57.596151   98925 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":2789,"bootTime":1758212249,"procs":193,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 17:03:57.596237   98925 start.go:140] virtualization: kvm guest
	I0918 17:03:57.598717   98925 out.go:179] * [ha-078118] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 17:03:57.600208   98925 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 17:03:57.600207   98925 notify.go:220] Checking for updates...
	I0918 17:03:57.602648   98925 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 17:03:57.604010   98925 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:03:57.608766   98925 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 17:03:57.610424   98925 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 17:03:57.611661   98925 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 17:03:57.613545   98925 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:03:57.614250   98925 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 17:03:57.638851   98925 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 17:03:57.638983   98925 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:03:57.695587   98925 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:0 ContainersPaused:0 ContainersStopped:3 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 17:03:57.684953795 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:03:57.695706   98925 docker.go:318] overlay module found
	I0918 17:03:57.698232   98925 out.go:179] * Using the docker driver based on existing profile
	I0918 17:03:57.699567   98925 start.go:304] selected driver: docker
	I0918 17:03:57.699584   98925 start.go:924] validating driver "docker" against &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNam
es:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:f
alse logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs
: AutoPauseInterval:1m0s}
	I0918 17:03:57.699699   98925 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 17:03:57.699788   98925 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:03:57.758843   98925 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:0 ContainersPaused:0 ContainersStopped:3 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 17:03:57.74842303 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[ma
p[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:03:57.759422   98925 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:03:57.759451   98925 cni.go:84] Creating CNI manager for ""
	I0918 17:03:57.759497   98925 cni.go:136] multinode detected (3 nodes found), recommending kindnet
	I0918 17:03:57.759585   98925 start.go:348] cluster config:
	{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: N
etworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:fal
se nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:03:57.761857   98925 out.go:179] * Starting "ha-078118" primary control-plane node in "ha-078118" cluster
	I0918 17:03:57.763122   98925 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:03:57.764409   98925 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:03:57.765526   98925 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:03:57.765563   98925 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:03:57.765569   98925 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
	I0918 17:03:57.765672   98925 cache.go:58] Caching tarball of preloaded images
	I0918 17:03:57.765752   98925 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:03:57.765763   98925 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:03:57.765873   98925 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:03:57.785986   98925 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:03:57.786007   98925 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:03:57.786022   98925 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:03:57.786044   98925 start.go:360] acquireMachinesLock for ha-078118: {Name:mk24a1b2c9ed1c42e9ffd635727b36c75401a437 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:03:57.786093   98925 start.go:364] duration metric: took 36.376µs to acquireMachinesLock for "ha-078118"
	I0918 17:03:57.786122   98925 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:03:57.786126   98925 fix.go:54] fixHost starting: 
	I0918 17:03:57.786320   98925 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:03:57.804531   98925 fix.go:112] recreateIfNeeded on ha-078118: state=Stopped err=<nil>
	W0918 17:03:57.804560   98925 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:03:57.806679   98925 out.go:252] * Restarting existing docker container for "ha-078118" ...
	I0918 17:03:57.806737   98925 cli_runner.go:164] Run: docker start ha-078118
	I0918 17:03:58.041262   98925 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:03:58.060595   98925 kic.go:430] container "ha-078118" state is running.
	I0918 17:03:58.061033   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:03:58.080513   98925 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:03:58.080761   98925 machine.go:93] provisionDockerMachine start ...
	I0918 17:03:58.080833   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:03:58.100738   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:03:58.101016   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32828 <nil> <nil>}
	I0918 17:03:58.101029   98925 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:03:58.101685   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52750->127.0.0.1:32828: read: connection reset by peer
	I0918 17:04:01.238733   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 17:04:01.238763   98925 ubuntu.go:182] provisioning hostname "ha-078118"
	I0918 17:04:01.238834   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:04:01.258055   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:04:01.258346   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32828 <nil> <nil>}
	I0918 17:04:01.258364   98925 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118 && echo "ha-078118" | sudo tee /etc/hostname
	I0918 17:04:01.407711   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 17:04:01.407786   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:04:01.427630   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:04:01.427847   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32828 <nil> <nil>}
	I0918 17:04:01.427868   98925 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:04:01.565143   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:04:01.565174   98925 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:04:01.565192   98925 ubuntu.go:190] setting up certificates
	I0918 17:04:01.565200   98925 provision.go:84] configureAuth start
	I0918 17:04:01.565260   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:04:01.583813   98925 provision.go:143] copyHostCerts
	I0918 17:04:01.583854   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:04:01.583890   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:04:01.583911   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:04:01.583997   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:04:01.584130   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:04:01.584160   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:04:01.584168   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:04:01.584215   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:04:01.584303   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:04:01.584329   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:04:01.584336   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:04:01.584378   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:04:01.584491   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118 san=[127.0.0.1 192.168.49.2 ha-078118 localhost minikube]
	I0918 17:04:01.819899   98925 provision.go:177] copyRemoteCerts
	I0918 17:04:01.819969   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:04:01.820019   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:04:01.838846   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:04:01.936269   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 17:04:01.936338   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:04:01.961659   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 17:04:01.961712   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)
	I0918 17:04:01.988103   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 17:04:01.988195   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:04:02.014756   98925 provision.go:87] duration metric: took 449.541141ms to configureAuth
	I0918 17:04:02.014782   98925 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:04:02.015062   98925 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:04:02.015169   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:04:02.035480   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:04:02.035772   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32828 <nil> <nil>}
	I0918 17:04:02.035798   98925 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:04:02.330029   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:04:02.330064   98925 machine.go:96] duration metric: took 4.249285196s to provisionDockerMachine
	I0918 17:04:02.330078   98925 start.go:293] postStartSetup for "ha-078118" (driver="docker")
	I0918 17:04:02.330091   98925 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:04:02.330158   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:04:02.330196   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:04:02.351033   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:04:02.448754   98925 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:04:02.452309   98925 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:04:02.452338   98925 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:04:02.452345   98925 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:04:02.452351   98925 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:04:02.452363   98925 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:04:02.452421   98925 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:04:02.452533   98925 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:04:02.452547   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 17:04:02.452651   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:04:02.462223   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:04:02.487591   98925 start.go:296] duration metric: took 157.495588ms for postStartSetup
	I0918 17:04:02.487676   98925 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:04:02.487707   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:04:02.506069   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:04:02.598804   98925 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:04:02.603432   98925 fix.go:56] duration metric: took 4.817299115s for fixHost
	I0918 17:04:02.603451   98925 start.go:83] releasing machines lock for "ha-078118", held for 4.817337719s
	I0918 17:04:02.603531   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:04:02.621923   98925 ssh_runner.go:195] Run: cat /version.json
	I0918 17:04:02.621979   98925 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:04:02.621981   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:04:02.622088   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:04:02.640799   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:04:02.641940   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:04:02.804562   98925 ssh_runner.go:195] Run: systemctl --version
	I0918 17:04:02.809239   98925 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:04:02.948676   98925 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:04:02.953707   98925 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:04:02.963082   98925 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:04:02.963152   98925 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:04:02.973150   98925 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:04:02.973175   98925 start.go:495] detecting cgroup driver to use...
	I0918 17:04:02.973210   98925 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:04:02.973252   98925 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:04:02.985878   98925 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:04:02.997962   98925 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:04:02.998022   98925 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:04:03.011574   98925 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:04:03.023470   98925 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:04:03.090015   98925 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:04:03.156516   98925 docker.go:234] disabling docker service ...
	I0918 17:04:03.156570   98925 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:04:03.169081   98925 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:04:03.180644   98925 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:04:03.244437   98925 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:04:03.308493   98925 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:04:03.320106   98925 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:04:03.338047   98925 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:04:03.338121   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:03.348200   98925 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:04:03.348264   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:03.358132   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:03.368068   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:03.378226   98925 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:04:03.387878   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:03.398333   98925 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:03.408651   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:03.419278   98925 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:04:03.428742   98925 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:04:03.438161   98925 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:04:03.503358   98925 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:04:03.600553   98925 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:04:03.600607   98925 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:04:03.604332   98925 start.go:563] Will wait 60s for crictl version
	I0918 17:04:03.604381   98925 ssh_runner.go:195] Run: which crictl
	I0918 17:04:03.607979   98925 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:04:03.642240   98925 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 17:04:03.642310   98925 ssh_runner.go:195] Run: crio --version
	I0918 17:04:03.677761   98925 ssh_runner.go:195] Run: crio --version
	I0918 17:04:03.715740   98925 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 17:04:03.716941   98925 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:04:03.733826   98925 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 17:04:03.737760   98925 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:04:03.750310   98925 kubeadm.go:875] updating cluster {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIP
s:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:fa
lse metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterv
al:1m0s} ...
	I0918 17:04:03.750492   98925 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:04:03.750579   98925 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:04:03.794898   98925 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:04:03.794921   98925 crio.go:433] Images already preloaded, skipping extraction
	I0918 17:04:03.794967   98925 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:04:03.829067   98925 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:04:03.829088   98925 cache_images.go:85] Images are preloaded, skipping loading
	I0918 17:04:03.829095   98925 kubeadm.go:926] updating node { 192.168.49.2 8443 v1.34.0 crio true true} ...
	I0918 17:04:03.829197   98925 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 17:04:03.829256   98925 ssh_runner.go:195] Run: crio config
	I0918 17:04:03.872946   98925 cni.go:84] Creating CNI manager for ""
	I0918 17:04:03.872968   98925 cni.go:136] multinode detected (3 nodes found), recommending kindnet
	I0918 17:04:03.872979   98925 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0918 17:04:03.873002   98925 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.34.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-078118 NodeName:ha-078118 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manif
ests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0918 17:04:03.873121   98925 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "ha-078118"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.49.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	kubernetesVersion: v1.34.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: systemd
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0918 17:04:03.873140   98925 kube-vip.go:115] generating kube-vip config ...
	I0918 17:04:03.873180   98925 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 17:04:03.885882   98925 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:04:03.885998   98925 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 17:04:03.886049   98925 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 17:04:03.895467   98925 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 17:04:03.895549   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
	I0918 17:04:03.904754   98925 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (359 bytes)
	I0918 17:04:03.922634   98925 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 17:04:03.940888   98925 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2205 bytes)
	I0918 17:04:03.959544   98925 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 17:04:03.977715   98925 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 17:04:03.981411   98925 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:04:03.993676   98925 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:04:04.061078   98925 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:04:04.085058   98925 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.2
	I0918 17:04:04.085078   98925 certs.go:194] generating shared ca certs ...
	I0918 17:04:04.085097   98925 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:04:04.085263   98925 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 17:04:04.085339   98925 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 17:04:04.085354   98925 certs.go:256] generating profile certs ...
	I0918 17:04:04.085451   98925 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 17:04:04.085480   98925 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.b995b0dc
	I0918 17:04:04.085496   98925 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.b995b0dc with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.3 192.168.49.254]
	I0918 17:04:04.160148   98925 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.b995b0dc ...
	I0918 17:04:04.160174   98925 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.b995b0dc: {Name:mkb34757c7a4eb6e083919115700eaf7e30d8097 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:04:04.160346   98925 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.b995b0dc ...
	I0918 17:04:04.160366   98925 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.b995b0dc: {Name:mk6902309b7ede2f8f875fb920044a4cd0c4dde0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:04:04.160464   98925 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.b995b0dc -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 17:04:04.160666   98925 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.b995b0dc -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 17:04:04.160877   98925 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 17:04:04.160894   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 17:04:04.160907   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 17:04:04.160922   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 17:04:04.160946   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 17:04:04.160964   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 17:04:04.160982   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 17:04:04.160996   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 17:04:04.161023   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 17:04:04.161098   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 17:04:04.161139   98925 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 17:04:04.161153   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 17:04:04.161189   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 17:04:04.161220   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 17:04:04.161249   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 17:04:04.161315   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:04:04.161363   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 17:04:04.161386   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:04:04.161400   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 17:04:04.161931   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 17:04:04.188732   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 17:04:04.214486   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 17:04:04.239835   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 17:04:04.265084   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I0918 17:04:04.291194   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 17:04:04.316780   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 17:04:04.341677   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 17:04:04.367789   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 17:04:04.393742   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 17:04:04.419125   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 17:04:04.445672   98925 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0918 17:04:04.465313   98925 ssh_runner.go:195] Run: openssl version
	I0918 17:04:04.471226   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 17:04:04.481994   98925 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 17:04:04.485914   98925 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 17:04:04.485972   98925 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 17:04:04.492901   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 17:04:04.502114   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 17:04:04.512379   98925 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 17:04:04.516044   98925 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 17:04:04.516109   98925 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 17:04:04.522965   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 17:04:04.532481   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 17:04:04.542631   98925 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:04:04.546239   98925 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:04:04.546309   98925 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:04:04.553421   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 17:04:04.562895   98925 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 17:04:04.566588   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0918 17:04:04.573365   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0918 17:04:04.580853   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0918 17:04:04.588465   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0918 17:04:04.595699   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0918 17:04:04.602651   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0918 17:04:04.609622   98925 kubeadm.go:392] StartCluster: {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[
] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false
metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:
1m0s}
	I0918 17:04:04.609792   98925 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0918 17:04:04.609870   98925 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0918 17:04:04.652226   98925 cri.go:89] found id: ""
	I0918 17:04:04.652287   98925 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0918 17:04:04.663357   98925 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0918 17:04:04.663379   98925 kubeadm.go:589] restartPrimaryControlPlane start ...
	I0918 17:04:04.663429   98925 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0918 17:04:04.675832   98925 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:04:04.676375   98925 kubeconfig.go:47] verify endpoint returned: get endpoint: "ha-078118" does not appear in /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:04:04.676567   98925 kubeconfig.go:62] /home/jenkins/minikube-integration/20370-7845/kubeconfig needs updating (will repair): [kubeconfig missing "ha-078118" cluster setting kubeconfig missing "ha-078118" context setting]
	I0918 17:04:04.677032   98925 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:04:04.678037   98925 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, Us
erAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0918 17:04:04.678561   98925 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I0918 17:04:04.678582   98925 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
	I0918 17:04:04.678590   98925 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I0918 17:04:04.678596   98925 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
	I0918 17:04:04.678602   98925 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
	I0918 17:04:04.678638   98925 cert_rotation.go:141] "Starting client certificate rotation controller" logger="tls-transport-cache"
	I0918 17:04:04.679022   98925 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0918 17:04:04.691527   98925 kubeadm.go:626] The running cluster does not require reconfiguration: 192.168.49.2
	I0918 17:04:04.691555   98925 kubeadm.go:593] duration metric: took 28.168236ms to restartPrimaryControlPlane
	I0918 17:04:04.691566   98925 kubeadm.go:394] duration metric: took 81.955818ms to StartCluster
	I0918 17:04:04.691588   98925 settings.go:142] acquiring lock: {Name:mk72fea03aefe901db9522a467405d86665fedd0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:04:04.691651   98925 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:04:04.692430   98925 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:04:04.692711   98925 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:04:04.692737   98925 start.go:241] waiting for startup goroutines ...
	I0918 17:04:04.692747   98925 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0918 17:04:04.693214   98925 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:04:04.695176   98925 out.go:179] * Enabled addons: 
	I0918 17:04:04.697268   98925 addons.go:514] duration metric: took 4.514845ms for enable addons: enabled=[]
	I0918 17:04:04.697308   98925 start.go:246] waiting for cluster config update ...
	I0918 17:04:04.697318   98925 start.go:255] writing updated cluster config ...
	I0918 17:04:04.699124   98925 out.go:203] 
	I0918 17:04:04.701411   98925 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:04:04.701544   98925 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:04:04.703314   98925 out.go:179] * Starting "ha-078118-m02" control-plane node in "ha-078118" cluster
	I0918 17:04:04.704895   98925 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:04:04.707334   98925 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:04:04.708690   98925 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:04:04.708718   98925 cache.go:58] Caching tarball of preloaded images
	I0918 17:04:04.708765   98925 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:04:04.708842   98925 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:04:04.708853   98925 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:04:04.708994   98925 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:04:04.737396   98925 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:04:04.737425   98925 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:04:04.737463   98925 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:04:04.737554   98925 start.go:360] acquireMachinesLock for ha-078118-m02: {Name:mk65f6a883861f2032241e1132c63effea2ab61f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:04:04.737627   98925 start.go:364] duration metric: took 48.809µs to acquireMachinesLock for "ha-078118-m02"
	I0918 17:04:04.737685   98925 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:04:04.737696   98925 fix.go:54] fixHost starting: m02
	I0918 17:04:04.738019   98925 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:04:04.761465   98925 fix.go:112] recreateIfNeeded on ha-078118-m02: state=Stopped err=<nil>
	W0918 17:04:04.761496   98925 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:04:04.763421   98925 out.go:252] * Restarting existing docker container for "ha-078118-m02" ...
	I0918 17:04:04.763513   98925 cli_runner.go:164] Run: docker start ha-078118-m02
	I0918 17:04:05.047202   98925 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:04:05.070655   98925 kic.go:430] container "ha-078118-m02" state is running.
	I0918 17:04:05.071012   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:04:05.091008   98925 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:04:05.091287   98925 machine.go:93] provisionDockerMachine start ...
	I0918 17:04:05.091350   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:05.111230   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:04:05.111458   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32833 <nil> <nil>}
	I0918 17:04:05.111470   98925 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:04:05.112079   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:51368->127.0.0.1:32833: read: connection reset by peer
	I0918 17:04:08.248492   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 17:04:08.248541   98925 ubuntu.go:182] provisioning hostname "ha-078118-m02"
	I0918 17:04:08.248592   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:08.269007   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:04:08.269256   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32833 <nil> <nil>}
	I0918 17:04:08.269275   98925 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m02 && echo "ha-078118-m02" | sudo tee /etc/hostname
	I0918 17:04:08.418819   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 17:04:08.418914   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:08.437638   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:04:08.437882   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32833 <nil> <nil>}
	I0918 17:04:08.437900   98925 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m02' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m02/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m02' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:04:08.588208   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:04:08.588238   98925 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:04:08.588258   98925 ubuntu.go:190] setting up certificates
	I0918 17:04:08.588270   98925 provision.go:84] configureAuth start
	I0918 17:04:08.588330   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:04:08.611747   98925 provision.go:143] copyHostCerts
	I0918 17:04:08.611788   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:04:08.611825   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:04:08.611837   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:04:08.611927   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:04:08.612029   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:04:08.612063   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:04:08.612073   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:04:08.612116   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:04:08.612243   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:04:08.612286   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:04:08.612295   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:04:08.612338   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:04:08.612417   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m02 san=[127.0.0.1 192.168.49.3 ha-078118-m02 localhost minikube]
	I0918 17:04:08.764892   98925 provision.go:177] copyRemoteCerts
	I0918 17:04:08.764963   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:04:08.765014   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:08.788345   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32833 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:04:08.898920   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 17:04:08.898989   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:04:08.932774   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 17:04:08.932832   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 17:04:08.970263   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 17:04:08.970327   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:04:09.006703   98925 provision.go:87] duration metric: took 418.417936ms to configureAuth
	I0918 17:04:09.006746   98925 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:04:09.007001   98925 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:04:09.007123   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:09.028985   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:04:09.029244   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32833 <nil> <nil>}
	I0918 17:04:09.029264   98925 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:04:09.459889   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:04:09.459917   98925 machine.go:96] duration metric: took 4.36861554s to provisionDockerMachine
	I0918 17:04:09.459931   98925 start.go:293] postStartSetup for "ha-078118-m02" (driver="docker")
	I0918 17:04:09.459944   98925 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:04:09.460020   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:04:09.460072   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:09.483808   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32833 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:04:09.604387   98925 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:04:09.609911   98925 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:04:09.609950   98925 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:04:09.609963   98925 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:04:09.609970   98925 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:04:09.609984   98925 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:04:09.610044   98925 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:04:09.610164   98925 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:04:09.610174   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 17:04:09.610292   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:04:09.625217   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:04:09.664622   98925 start.go:296] duration metric: took 204.673856ms for postStartSetup
	I0918 17:04:09.664715   98925 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:04:09.664769   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:09.685164   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32833 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:04:09.781054   98925 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:04:09.785698   98925 fix.go:56] duration metric: took 5.047998942s for fixHost
	I0918 17:04:09.785717   98925 start.go:83] releasing machines lock for "ha-078118-m02", held for 5.0480764s
	I0918 17:04:09.785790   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:04:09.805706   98925 out.go:179] * Found network options:
	I0918 17:04:09.807043   98925 out.go:179]   - NO_PROXY=192.168.49.2
	W0918 17:04:09.808236   98925 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:04:09.808284   98925 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 17:04:09.808345   98925 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:04:09.808378   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:09.808401   98925 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:04:09.808463   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:09.826545   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32833 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:04:09.826797   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32833 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:04:10.055703   98925 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:04:10.060676   98925 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:04:10.070388   98925 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:04:10.070470   98925 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:04:10.080620   98925 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:04:10.080643   98925 start.go:495] detecting cgroup driver to use...
	I0918 17:04:10.080672   98925 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:04:10.080709   98925 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:04:10.094054   98925 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:04:10.105732   98925 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:04:10.105786   98925 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:04:10.118591   98925 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:04:10.130249   98925 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:04:10.234830   98925 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:04:10.343115   98925 docker.go:234] disabling docker service ...
	I0918 17:04:10.343212   98925 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:04:10.356190   98925 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:04:10.367993   98925 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:04:10.463003   98925 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:04:10.582142   98925 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:04:10.599981   98925 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:04:10.630631   98925 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:04:10.630701   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:10.651513   98925 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:04:10.651657   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:10.673539   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:10.694103   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:10.713110   98925 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:04:10.729312   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:10.746714   98925 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:10.763191   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:10.784627   98925 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:04:10.799255   98925 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:04:10.810939   98925 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:04:10.954859   98925 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:05:41.347134   98925 ssh_runner.go:235] Completed: sudo systemctl restart crio: (1m30.392221643s)
	I0918 17:05:41.347190   98925 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:05:41.347242   98925 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:05:41.351691   98925 start.go:563] Will wait 60s for crictl version
	I0918 17:05:41.351748   98925 ssh_runner.go:195] Run: which crictl
	I0918 17:05:41.355515   98925 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:05:41.391779   98925 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 17:05:41.391858   98925 ssh_runner.go:195] Run: crio --version
	I0918 17:05:41.427005   98925 ssh_runner.go:195] Run: crio --version
	I0918 17:05:41.465310   98925 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 17:05:41.466762   98925 out.go:179]   - env NO_PROXY=192.168.49.2
	I0918 17:05:41.468185   98925 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:05:41.486222   98925 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 17:05:41.490481   98925 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:05:41.502788   98925 mustload.go:65] Loading cluster: ha-078118
	I0918 17:05:41.503008   98925 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:05:41.503241   98925 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:05:41.522395   98925 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:05:41.522734   98925 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.3
	I0918 17:05:41.522759   98925 certs.go:194] generating shared ca certs ...
	I0918 17:05:41.522779   98925 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:05:41.522926   98925 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 17:05:41.522982   98925 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 17:05:41.523001   98925 certs.go:256] generating profile certs ...
	I0918 17:05:41.523150   98925 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 17:05:41.523233   98925 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd
	I0918 17:05:41.523285   98925 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 17:05:41.523298   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 17:05:41.523312   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 17:05:41.523325   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 17:05:41.523338   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 17:05:41.523350   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 17:05:41.523368   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 17:05:41.523380   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 17:05:41.523398   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 17:05:41.523495   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 17:05:41.523556   98925 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 17:05:41.523567   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 17:05:41.523599   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 17:05:41.523624   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 17:05:41.523644   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 17:05:41.523681   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:05:41.523711   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:05:41.523722   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 17:05:41.523736   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 17:05:41.523780   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:05:41.542943   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:05:41.632805   98925 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
	I0918 17:05:41.637040   98925 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
	I0918 17:05:41.650599   98925 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
	I0918 17:05:41.654432   98925 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
	I0918 17:05:41.668031   98925 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
	I0918 17:05:41.671942   98925 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
	I0918 17:05:41.685644   98925 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
	I0918 17:05:41.689404   98925 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)
	I0918 17:05:41.703009   98925 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
	I0918 17:05:41.707200   98925 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
	I0918 17:05:41.720273   98925 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
	I0918 17:05:41.724095   98925 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
	I0918 17:05:41.737178   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 17:05:41.764232   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 17:05:41.790974   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 17:05:41.817439   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 17:05:41.843145   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I0918 17:05:41.870665   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 17:05:41.897068   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 17:05:41.922855   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 17:05:41.948562   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 17:05:41.976113   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 17:05:42.003777   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 17:05:42.031230   98925 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
	I0918 17:05:42.052629   98925 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
	I0918 17:05:42.071817   98925 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
	I0918 17:05:42.091629   98925 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)
	I0918 17:05:42.111814   98925 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
	I0918 17:05:42.131120   98925 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
	I0918 17:05:42.150925   98925 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
	I0918 17:05:42.170339   98925 ssh_runner.go:195] Run: openssl version
	I0918 17:05:42.177305   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 17:05:42.188103   98925 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 17:05:42.191993   98925 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 17:05:42.192052   98925 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 17:05:42.199271   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 17:05:42.208980   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 17:05:42.220181   98925 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:05:42.224204   98925 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:05:42.224259   98925 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:05:42.231241   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 17:05:42.241058   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 17:05:42.251492   98925 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 17:05:42.255774   98925 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 17:05:42.255831   98925 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 17:05:42.262833   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 17:05:42.272374   98925 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 17:05:42.276032   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0918 17:05:42.282782   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0918 17:05:42.289559   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0918 17:05:42.296669   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0918 17:05:42.303973   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0918 17:05:42.310810   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0918 17:05:42.317723   98925 kubeadm.go:926] updating node {m02 192.168.49.3 8443 v1.34.0 crio true true} ...
	I0918 17:05:42.317845   98925 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.3
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 17:05:42.317873   98925 kube-vip.go:115] generating kube-vip config ...
	I0918 17:05:42.317927   98925 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 17:05:42.330738   98925 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:05:42.330802   98925 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 17:05:42.330850   98925 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 17:05:42.340207   98925 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 17:05:42.340276   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
	I0918 17:05:42.350019   98925 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0918 17:05:42.368663   98925 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 17:05:42.387086   98925 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 17:05:42.406088   98925 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 17:05:42.409827   98925 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:05:42.421529   98925 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:05:42.531439   98925 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:05:42.544241   98925 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:05:42.544529   98925 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:05:42.546649   98925 out.go:179] * Verifying Kubernetes components...
	I0918 17:05:42.547817   98925 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:05:42.660699   98925 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:05:42.673813   98925 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	W0918 17:05:42.673894   98925 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.49.254:8443 with https://192.168.49.2:8443
	I0918 17:05:42.674300   98925 node_ready.go:35] waiting up to 6m0s for node "ha-078118-m02" to be "Ready" ...
	W0918 17:05:44.679163   98925 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 17:05:47.178363   98925 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 17:05:49.178592   98925 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 17:05:51.677997   98925 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	I0918 17:05:52.177644   98925 node_ready.go:49] node "ha-078118-m02" is "Ready"
	I0918 17:05:52.177667   98925 node_ready.go:38] duration metric: took 9.503338102s for node "ha-078118-m02" to be "Ready" ...
	I0918 17:05:52.177679   98925 api_server.go:52] waiting for apiserver process to appear ...
	I0918 17:05:52.177724   98925 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:05:52.189641   98925 api_server.go:72] duration metric: took 9.645348546s to wait for apiserver process to appear ...
	I0918 17:05:52.189671   98925 api_server.go:88] waiting for apiserver healthz status ...
	I0918 17:05:52.189692   98925 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0918 17:05:52.193626   98925 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0918 17:05:52.194554   98925 api_server.go:141] control plane version: v1.34.0
	I0918 17:05:52.194574   98925 api_server.go:131] duration metric: took 4.897305ms to wait for apiserver health ...
	I0918 17:05:52.194582   98925 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 17:05:52.199386   98925 system_pods.go:59] 17 kube-system pods found
	I0918 17:05:52.199420   98925 system_pods.go:61] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 17:05:52.199427   98925 system_pods.go:61] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 17:05:52.199433   98925 system_pods.go:61] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 17:05:52.199436   98925 system_pods.go:61] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 17:05:52.199440   98925 system_pods.go:61] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 17:05:52.199445   98925 system_pods.go:61] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 17:05:52.199450   98925 system_pods.go:61] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 17:05:52.199458   98925 system_pods.go:61] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 17:05:52.199463   98925 system_pods.go:61] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 17:05:52.199469   98925 system_pods.go:61] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 17:05:52.199477   98925 system_pods.go:61] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 17:05:52.199483   98925 system_pods.go:61] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 17:05:52.199489   98925 system_pods.go:61] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 17:05:52.199493   98925 system_pods.go:61] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 17:05:52.199513   98925 system_pods.go:61] "kube-vip-ha-078118" [d3c28c72-f791-4e3f-bd5f-91fc9bcb1fee] Running
	I0918 17:05:52.199518   98925 system_pods.go:61] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 17:05:52.199527   98925 system_pods.go:61] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 17:05:52.199535   98925 system_pods.go:74] duration metric: took 4.946851ms to wait for pod list to return data ...
	I0918 17:05:52.199544   98925 default_sa.go:34] waiting for default service account to be created ...
	I0918 17:05:52.202524   98925 default_sa.go:45] found service account: "default"
	I0918 17:05:52.202545   98925 default_sa.go:55] duration metric: took 2.993182ms for default service account to be created ...
	I0918 17:05:52.202554   98925 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 17:05:52.206107   98925 system_pods.go:86] 17 kube-system pods found
	I0918 17:05:52.206133   98925 system_pods.go:89] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 17:05:52.206139   98925 system_pods.go:89] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 17:05:52.206143   98925 system_pods.go:89] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 17:05:52.206146   98925 system_pods.go:89] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 17:05:52.206150   98925 system_pods.go:89] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 17:05:52.206153   98925 system_pods.go:89] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 17:05:52.206156   98925 system_pods.go:89] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 17:05:52.206160   98925 system_pods.go:89] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 17:05:52.206163   98925 system_pods.go:89] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 17:05:52.206169   98925 system_pods.go:89] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 17:05:52.206173   98925 system_pods.go:89] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 17:05:52.206176   98925 system_pods.go:89] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 17:05:52.206179   98925 system_pods.go:89] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 17:05:52.206182   98925 system_pods.go:89] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 17:05:52.206185   98925 system_pods.go:89] "kube-vip-ha-078118" [d3c28c72-f791-4e3f-bd5f-91fc9bcb1fee] Running
	I0918 17:05:52.206188   98925 system_pods.go:89] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 17:05:52.206191   98925 system_pods.go:89] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 17:05:52.206196   98925 system_pods.go:126] duration metric: took 3.63714ms to wait for k8s-apps to be running ...
	I0918 17:05:52.206205   98925 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 17:05:52.206246   98925 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:05:52.218830   98925 system_svc.go:56] duration metric: took 12.606279ms WaitForService to wait for kubelet
	I0918 17:05:52.218866   98925 kubeadm.go:578] duration metric: took 9.674575514s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:05:52.218886   98925 node_conditions.go:102] verifying NodePressure condition ...
	I0918 17:05:52.222581   98925 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:05:52.222611   98925 node_conditions.go:123] node cpu capacity is 8
	I0918 17:05:52.222629   98925 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:05:52.222634   98925 node_conditions.go:123] node cpu capacity is 8
	I0918 17:05:52.222641   98925 node_conditions.go:105] duration metric: took 3.748884ms to run NodePressure ...
	I0918 17:05:52.222656   98925 start.go:241] waiting for startup goroutines ...
	I0918 17:05:52.222683   98925 start.go:255] writing updated cluster config ...
	I0918 17:05:52.225578   98925 out.go:203] 
	I0918 17:05:52.227263   98925 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:05:52.227358   98925 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:05:52.229196   98925 out.go:179] * Starting "ha-078118-m04" worker node in "ha-078118" cluster
	I0918 17:05:52.231011   98925 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:05:52.232562   98925 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:05:52.233828   98925 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:05:52.233854   98925 cache.go:58] Caching tarball of preloaded images
	I0918 17:05:52.233932   98925 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:05:52.233956   98925 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:05:52.233964   98925 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:05:52.234054   98925 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:05:52.255101   98925 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:05:52.255122   98925 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:05:52.255141   98925 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:05:52.255171   98925 start.go:360] acquireMachinesLock for ha-078118-m04: {Name:mkdcee71069a15ce1d36f6cf5f43097fe7468c48 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:05:52.255239   98925 start.go:364] duration metric: took 48.479µs to acquireMachinesLock for "ha-078118-m04"
	I0918 17:05:52.255271   98925 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:05:52.255282   98925 fix.go:54] fixHost starting: m04
	I0918 17:05:52.255490   98925 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:05:52.274190   98925 fix.go:112] recreateIfNeeded on ha-078118-m04: state=Stopped err=<nil>
	W0918 17:05:52.274229   98925 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:05:52.276134   98925 out.go:252] * Restarting existing docker container for "ha-078118-m04" ...
	I0918 17:05:52.276219   98925 cli_runner.go:164] Run: docker start ha-078118-m04
	I0918 17:05:52.534028   98925 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:05:52.553831   98925 kic.go:430] container "ha-078118-m04" state is running.
	I0918 17:05:52.554236   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:05:52.575159   98925 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:05:52.575538   98925 machine.go:93] provisionDockerMachine start ...
	I0918 17:05:52.575622   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:05:52.597102   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:05:52.597346   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32838 <nil> <nil>}
	I0918 17:05:52.597358   98925 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:05:52.598003   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52942->127.0.0.1:32838: read: connection reset by peer
	I0918 17:05:55.634175   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:05:58.670550   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:01.708553   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:04.744918   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:07.780591   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:10.818323   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:13.855234   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:16.893073   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:19.929815   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:22.966522   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:26.002302   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:29.039127   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:32.076960   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:35.113986   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:38.149759   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:41.187141   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:44.222787   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:47.260408   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:50.297588   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:53.333910   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:56.370213   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:59.407000   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:02.444365   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:05.479905   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:08.515842   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:11.552931   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:14.589522   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:17.626638   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:20.663745   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:23.699895   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:26.736782   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:29.774311   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:32.809768   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:35.846456   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:38.884332   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:41.921241   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:44.957195   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:47.993908   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:51.032626   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:54.068384   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:57.105890   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:00.143675   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:03.180125   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:06.217085   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:09.253450   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:12.291017   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:15.326374   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:18.361896   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:21.399667   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:24.437162   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:27.475160   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:30.511774   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:33.548566   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:36.585383   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:39.621897   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:42.659283   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:45.694870   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:48.731564   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:51.768889   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:54.769855   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:08:54.769889   98925 ubuntu.go:182] provisioning hostname "ha-078118-m04"
	I0918 17:08:54.769959   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:08:54.788837   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:08:54.789114   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32838 <nil> <nil>}
	I0918 17:08:54.789148   98925 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m04 && echo "ha-078118-m04" | sudo tee /etc/hostname
	I0918 17:08:54.824590   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:57.861147   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:00.898100   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:03.934426   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:06.972764   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:10.011415   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:13.047413   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:16.084176   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:19.120974   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:22.158597   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:25.195764   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:28.231869   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:31.268697   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:34.304934   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:37.342400   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:40.379002   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:43.414801   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:46.450596   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:49.488045   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:52.524000   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:55.560573   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:58.597044   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:01.634548   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:04.672683   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:07.709978   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:10.747858   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:13.784978   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:16.822136   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:19.859647   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:22.896452   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:25.932115   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:28.968739   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:32.007168   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:35.043833   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:38.080543   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:41.117724   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:44.153958   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:47.192024   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:50.229203   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:53.264678   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:56.302007   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:59.338648   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:02.376277   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:05.411573   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:08.447479   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:11.485052   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:14.521797   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:17.559912   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:20.596792   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:23.634228   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:26.671462   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:29.709736   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:32.747315   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:35.784034   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:38.820804   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:41.857431   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:44.893862   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:47.929690   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:50.966600   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:54.003791   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:57.005612   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:11:57.005705   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:11:57.025591   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:11:57.025808   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32838 <nil> <nil>}
	I0918 17:11:57.025825   98925 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m04' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m04/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m04' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:11:57.061790   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:00.098689   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:03.134810   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:06.171350   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:09.208668   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:12.246362   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:15.282613   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:18.318965   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:21.357169   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:24.393483   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:27.429465   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:30.467239   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:33.503326   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:36.539551   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:39.577065   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:42.615043   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:45.651325   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:48.688024   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:51.724938   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:54.760195   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:57.797184   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:00.835178   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:03.871063   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:06.908796   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:09.946406   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:12.983597   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:16.020457   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:19.055927   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:22.092456   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:25.128953   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:28.165032   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:31.203910   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:34.240790   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:37.278940   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:40.316696   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:43.353386   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:46.388901   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:49.426100   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:52.463001   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:55.498818   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:58.536699   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:01.575055   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:04.611351   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:07.648283   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:10.685807   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:13.722198   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:16.760493   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:19.798480   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:22.834595   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:25.870876   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:28.906858   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:31.945170   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:34.981486   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:38.017085   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:41.054492   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:44.091544   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:47.128191   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:50.164676   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:53.200802   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:56.237111   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:59.238215   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:14:59.238287   98925 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:14:59.238320   98925 ubuntu.go:190] setting up certificates
	I0918 17:14:59.238335   98925 provision.go:84] configureAuth start
	I0918 17:14:59.238401   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:14:59.257482   98925 provision.go:143] copyHostCerts
	I0918 17:14:59.257535   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:14:59.257567   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:14:59.257573   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:14:59.257656   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:14:59.257756   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:14:59.257804   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:14:59.257815   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:14:59.257857   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:14:59.257984   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:14:59.258010   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:14:59.258016   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:14:59.258053   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:14:59.258128   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:14:59.380643   98925 provision.go:177] copyRemoteCerts
	I0918 17:14:59.380699   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:14:59.380741   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:14:59.398407   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:14:59.433425   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:59.433470   98925 retry.go:31] will retry after 268.35155ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:14:59.739537   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:59.739579   98925 retry.go:31] will retry after 461.787446ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:00.237031   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:00.237066   98925 retry.go:31] will retry after 393.307667ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:00.666200   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:00.666268   98925 retry.go:31] will retry after 170.568408ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:00.837750   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:00.855596   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:00.891558   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:00.891592   98925 retry.go:31] will retry after 314.580969ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:01.242485   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:01.242539   98925 retry.go:31] will retry after 523.845907ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:01.802191   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:01.802226   98925 retry.go:31] will retry after 838.778289ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:02.678361   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:02.678441   98925 provision.go:87] duration metric: took 3.440096954s to configureAuth
	W0918 17:15:02.678447   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:02.678459   98925 retry.go:31] will retry after 84.66µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:02.679728   98925 provision.go:84] configureAuth start
	I0918 17:15:02.679818   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:02.698388   98925 provision.go:143] copyHostCerts
	I0918 17:15:02.698428   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:02.698463   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:02.698473   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:02.698556   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:02.698643   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:02.698662   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:02.698669   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:02.698690   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:02.698735   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:02.698751   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:02.698757   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:02.698775   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:02.698826   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:02.871319   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:02.871385   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:02.871435   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:02.889297   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:02.925389   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:02.925415   98925 retry.go:31] will retry after 228.591069ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:03.190038   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:03.190081   98925 retry.go:31] will retry after 425.118971ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:03.651705   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:03.651748   98925 retry.go:31] will retry after 717.03324ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:04.404289   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:04.404360   98925 retry.go:31] will retry after 329.393621ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:04.734838   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:04.754276   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:04.790424   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:04.790451   98925 retry.go:31] will retry after 132.792964ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:04.959153   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:04.959181   98925 retry.go:31] will retry after 422.781555ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:05.418286   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:05.418319   98925 retry.go:31] will retry after 307.736158ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:05.762285   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:05.762313   98925 retry.go:31] will retry after 776.314053ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:06.574535   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:06.574631   98925 provision.go:87] duration metric: took 3.894880474s to configureAuth
	W0918 17:15:06.574643   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:06.574660   98925 retry.go:31] will retry after 218.855µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:06.575780   98925 provision.go:84] configureAuth start
	I0918 17:15:06.575854   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:06.593791   98925 provision.go:143] copyHostCerts
	I0918 17:15:06.593824   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:06.593853   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:06.593858   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:06.593916   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:06.594007   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:06.594026   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:06.594030   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:06.594052   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:06.594124   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:06.594143   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:06.594157   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:06.594182   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:06.594246   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:06.786722   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:06.786776   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:06.786807   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:06.804920   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:06.839913   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:06.839939   98925 retry.go:31] will retry after 325.634731ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:07.202127   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:07.202155   98925 retry.go:31] will retry after 320.243692ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:07.558281   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:07.558311   98925 retry.go:31] will retry after 342.723191ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:07.937590   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:07.937627   98925 retry.go:31] will retry after 799.497734ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:08.773155   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:08.773229   98925 provision.go:87] duration metric: took 2.197431877s to configureAuth
	W0918 17:15:08.773238   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:08.773247   98925 retry.go:31] will retry after 254.729µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:08.774382   98925 provision.go:84] configureAuth start
	I0918 17:15:08.774452   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:08.791922   98925 provision.go:143] copyHostCerts
	I0918 17:15:08.791957   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:08.791982   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:08.791988   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:08.792043   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:08.792134   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:08.792156   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:08.792162   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:08.792184   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:08.792240   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:08.792256   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:08.792262   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:08.792282   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:08.792360   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:09.031569   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:09.031624   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:09.031656   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:09.050288   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:09.085720   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:09.085746   98925 retry.go:31] will retry after 218.750642ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:09.340825   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:09.340853   98925 retry.go:31] will retry after 544.639731ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:09.921852   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:09.921877   98925 retry.go:31] will retry after 546.940836ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:10.504773   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:10.504840   98925 retry.go:31] will retry after 192.87596ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:10.698311   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:10.716918   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:10.752129   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:10.752164   98925 retry.go:31] will retry after 200.277929ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:10.988213   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:10.988243   98925 retry.go:31] will retry after 403.083564ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:11.426924   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:11.426951   98925 retry.go:31] will retry after 302.512661ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:11.766259   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:11.766357   98925 provision.go:87] duration metric: took 2.991954366s to configureAuth
	W0918 17:15:11.766372   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:11.766384   98925 retry.go:31] will retry after 279.806µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:11.767530   98925 provision.go:84] configureAuth start
	I0918 17:15:11.767612   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:11.785539   98925 provision.go:143] copyHostCerts
	I0918 17:15:11.785580   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:11.785610   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:11.785618   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:11.785674   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:11.785761   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:11.785781   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:11.785788   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:11.785809   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:11.785864   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:11.785881   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:11.785887   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:11.785913   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:11.785976   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:11.830245   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:11.830301   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:11.830339   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:11.848741   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:11.884243   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:11.884268   98925 retry.go:31] will retry after 257.771631ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:12.178319   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:12.178356   98925 retry.go:31] will retry after 431.897997ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:12.646744   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:12.646770   98925 retry.go:31] will retry after 725.600553ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:13.407750   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:13.407834   98925 retry.go:31] will retry after 344.872036ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:13.753455   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:13.772979   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:13.808333   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:13.808367   98925 retry.go:31] will retry after 175.449039ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:14.020293   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:14.020335   98925 retry.go:31] will retry after 349.43257ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:14.406574   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:14.406606   98925 retry.go:31] will retry after 657.102406ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:15.099800   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:15.099891   98925 provision.go:87] duration metric: took 3.332339605s to configureAuth
	W0918 17:15:15.099904   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:15.099917   98925 retry.go:31] will retry after 325.636µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:15.101042   98925 provision.go:84] configureAuth start
	I0918 17:15:15.101107   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:15.119793   98925 provision.go:143] copyHostCerts
	I0918 17:15:15.119828   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:15.119861   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:15.119869   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:15.119926   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:15.120015   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:15.120035   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:15.120041   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:15.120062   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:15.120123   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:15.120140   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:15.120146   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:15.120165   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:15.120232   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:15.239984   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:15.240043   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:15.240085   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:15.259177   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:15.294353   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:15.294383   98925 retry.go:31] will retry after 126.755455ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:15.457390   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:15.457421   98925 retry.go:31] will retry after 304.398533ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:15.798319   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:15.798350   98925 retry.go:31] will retry after 456.616907ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:16.291469   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:16.291543   98925 retry.go:31] will retry after 665.162816ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:16.993007   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:16.993114   98925 retry.go:31] will retry after 135.127627ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:17.128468   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:17.146857   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:17.182996   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:17.183036   98925 retry.go:31] will retry after 292.261015ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:17.510824   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:17.510859   98925 retry.go:31] will retry after 193.50588ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:17.741129   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:17.741158   98925 retry.go:31] will retry after 784.483212ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:18.561494   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:18.561553   98925 retry.go:31] will retry after 462.393645ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:19.059929   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:19.060034   98925 provision.go:87] duration metric: took 3.958975958s to configureAuth
	W0918 17:15:19.060048   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:19.060063   98925 retry.go:31] will retry after 519.65µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:19.061239   98925 provision.go:84] configureAuth start
	I0918 17:15:19.061314   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:19.078987   98925 provision.go:143] copyHostCerts
	I0918 17:15:19.079020   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:19.079048   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:19.079057   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:19.079115   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:19.079210   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:19.079229   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:19.079233   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:19.079254   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:19.079312   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:19.079328   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:19.079334   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:19.079358   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:19.079422   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:19.232890   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:19.232947   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:19.232979   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:19.251270   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:19.286860   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:19.286893   98925 retry.go:31] will retry after 236.829994ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:19.559820   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:19.559848   98925 retry.go:31] will retry after 477.627076ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:20.073928   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:20.073960   98925 retry.go:31] will retry after 775.525785ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:20.885980   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:20.886064   98925 retry.go:31] will retry after 225.727784ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:21.112577   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:21.131231   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:21.166801   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:21.166835   98925 retry.go:31] will retry after 197.802417ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:21.400942   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:21.400971   98925 retry.go:31] will retry after 358.391406ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:21.795806   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:21.795834   98925 retry.go:31] will retry after 608.7734ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:22.440866   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:22.440899   98925 retry.go:31] will retry after 587.669933ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:23.064909   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:23.065104   98925 provision.go:87] duration metric: took 4.003840029s to configureAuth
	W0918 17:15:23.065133   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:23.065150   98925 retry.go:31] will retry after 624.101µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:23.066281   98925 provision.go:84] configureAuth start
	I0918 17:15:23.066424   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:23.085440   98925 provision.go:143] copyHostCerts
	I0918 17:15:23.085490   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:23.085558   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:23.085568   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:23.085618   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:23.085704   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:23.085722   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:23.085728   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:23.085749   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:23.085806   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:23.085822   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:23.085828   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:23.085847   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:23.085910   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:23.171932   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:23.171994   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:23.172030   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:23.191005   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:23.226259   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:23.226294   98925 retry.go:31] will retry after 171.560384ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:23.433916   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:23.433947   98925 retry.go:31] will retry after 499.206949ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:23.968964   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:23.968998   98925 retry.go:31] will retry after 654.190756ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:24.659387   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:24.659460   98925 retry.go:31] will retry after 251.11801ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:24.910860   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:24.929478   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:24.965250   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:24.965277   98925 retry.go:31] will retry after 154.62241ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:25.155845   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:25.155873   98925 retry.go:31] will retry after 264.824164ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:25.456964   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:25.457009   98925 retry.go:31] will retry after 553.552537ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:26.045840   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:26.045939   98925 provision.go:87] duration metric: took 2.979640326s to configureAuth
	W0918 17:15:26.045951   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:26.045963   98925 retry.go:31] will retry after 2.04296ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:26.048123   98925 provision.go:84] configureAuth start
	I0918 17:15:26.048213   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:26.067174   98925 provision.go:143] copyHostCerts
	I0918 17:15:26.067222   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:26.067251   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:26.067260   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:26.067334   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:26.067446   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:26.067472   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:26.067483   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:26.067532   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:26.067619   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:26.067644   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:26.067654   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:26.067680   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:26.067767   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:26.182542   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:26.182603   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:26.182635   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:26.201459   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:26.237657   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:26.237689   98925 retry.go:31] will retry after 254.464025ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:26.528614   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:26.528644   98925 retry.go:31] will retry after 425.679195ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:26.990533   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:26.990564   98925 retry.go:31] will retry after 311.44155ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:27.338524   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:27.338610   98925 retry.go:31] will retry after 244.52069ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:27.583943   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:27.601649   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:27.639575   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:27.639609   98925 retry.go:31] will retry after 159.844577ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:27.835839   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:27.835871   98925 retry.go:31] will retry after 249.184829ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:28.121401   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:28.121434   98925 retry.go:31] will retry after 501.41332ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:28.658969   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:28.659000   98925 retry.go:31] will retry after 724.88604ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:29.420417   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:29.420495   98925 provision.go:87] duration metric: took 3.372355438s to configureAuth
	W0918 17:15:29.420530   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:29.420544   98925 retry.go:31] will retry after 3.580205ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:29.424752   98925 provision.go:84] configureAuth start
	I0918 17:15:29.424828   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:29.443097   98925 provision.go:143] copyHostCerts
	I0918 17:15:29.443130   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:29.443158   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:29.443166   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:29.443219   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:29.443308   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:29.443326   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:29.443330   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:29.443351   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:29.443408   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:29.443424   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:29.443431   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:29.443450   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:29.443536   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:29.518307   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:29.518364   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:29.518431   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:29.536979   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:29.573427   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:29.573463   98925 retry.go:31] will retry after 199.335368ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:29.811301   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:29.811334   98925 retry.go:31] will retry after 327.323314ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:30.174329   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:30.174356   98925 retry.go:31] will retry after 321.977277ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:30.532995   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:30.533026   98925 retry.go:31] will retry after 935.956822ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:31.504577   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:31.504666   98925 provision.go:87] duration metric: took 2.079891414s to configureAuth
	W0918 17:15:31.504676   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:31.504687   98925 retry.go:31] will retry after 4.655172ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:31.509896   98925 provision.go:84] configureAuth start
	I0918 17:15:31.510003   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:31.528992   98925 provision.go:143] copyHostCerts
	I0918 17:15:31.529059   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:31.529105   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:31.529116   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:31.529184   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:31.529301   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:31.529323   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:31.529332   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:31.529367   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:31.529447   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:31.529469   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:31.529479   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:31.529531   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:31.529622   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:31.768227   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:31.768284   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:31.768331   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:31.786738   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:31.824048   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:31.824088   98925 retry.go:31] will retry after 284.086569ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:32.143631   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:32.143664   98925 retry.go:31] will retry after 550.501991ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:32.730522   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:32.730554   98925 retry.go:31] will retry after 489.218319ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:33.255619   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:33.255685   98925 retry.go:31] will retry after 169.023343ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:33.425084   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:33.444455   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:33.480162   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:33.480190   98925 retry.go:31] will retry after 280.925286ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:33.798461   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:33.798491   98925 retry.go:31] will retry after 432.125725ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:34.266848   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:34.266884   98925 retry.go:31] will retry after 543.023851ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:34.847474   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:34.847585   98925 provision.go:87] duration metric: took 3.337666934s to configureAuth
	W0918 17:15:34.847599   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:34.847612   98925 retry.go:31] will retry after 6.022902ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:34.853863   98925 provision.go:84] configureAuth start
	I0918 17:15:34.853936   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:34.873183   98925 provision.go:143] copyHostCerts
	I0918 17:15:34.873219   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:34.873244   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:34.873253   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:34.873324   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:34.873443   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:34.873469   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:34.873479   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:34.873528   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:34.873612   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:34.873638   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:34.873647   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:34.873683   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:34.873781   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:34.967712   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:34.967767   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:34.967811   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:34.987519   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:35.023048   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:35.023087   98925 retry.go:31] will retry after 178.693072ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:35.238873   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:35.238901   98925 retry.go:31] will retry after 219.792409ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:35.495106   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:35.495142   98925 retry.go:31] will retry after 292.870647ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:35.824186   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:35.824267   98925 retry.go:31] will retry after 139.901523ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:35.964758   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:35.984327   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:36.019887   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:36.019925   98925 retry.go:31] will retry after 186.863506ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:36.243541   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:36.243568   98925 retry.go:31] will retry after 418.127314ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:36.697646   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:36.697683   98925 retry.go:31] will retry after 347.770879ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:37.083439   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:37.083559   98925 provision.go:87] duration metric: took 2.229676494s to configureAuth
	W0918 17:15:37.083572   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:37.083583   98925 retry.go:31] will retry after 4.936759ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:37.088827   98925 provision.go:84] configureAuth start
	I0918 17:15:37.088923   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:37.108259   98925 provision.go:143] copyHostCerts
	I0918 17:15:37.108320   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:37.108358   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:37.108369   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:37.108436   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:37.108551   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:37.108580   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:37.108589   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:37.108624   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:37.108692   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:37.108716   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:37.108723   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:37.108754   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:37.108824   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:37.526521   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:37.526582   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:37.526616   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:37.544994   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:37.581123   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:37.581158   98925 retry.go:31] will retry after 249.854321ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:37.867377   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:37.867407   98925 retry.go:31] will retry after 402.240557ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:38.306363   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:38.306401   98925 retry.go:31] will retry after 757.465073ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:39.099774   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:39.099853   98925 retry.go:31] will retry after 169.725244ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:39.270332   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:39.288455   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:39.323947   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:39.323973   98925 retry.go:31] will retry after 233.865825ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:39.594018   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:39.594044   98925 retry.go:31] will retry after 533.184665ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:40.162570   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:40.162595   98925 retry.go:31] will retry after 425.912722ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:40.624369   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:40.624460   98925 provision.go:87] duration metric: took 3.535608935s to configureAuth
	W0918 17:15:40.624472   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:40.624491   98925 retry.go:31] will retry after 14.814643ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:40.639771   98925 provision.go:84] configureAuth start
	I0918 17:15:40.639885   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:40.659842   98925 provision.go:143] copyHostCerts
	I0918 17:15:40.659885   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:40.659922   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:40.659935   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:40.660006   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:40.660107   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:40.660149   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:40.660160   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:40.660194   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:40.660263   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:40.660288   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:40.660301   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:40.660332   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:40.660404   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:41.222857   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:41.222913   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:41.222945   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:41.241222   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:41.277407   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:41.277444   98925 retry.go:31] will retry after 290.853287ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:41.604288   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:41.604320   98925 retry.go:31] will retry after 418.619425ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:42.058732   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:42.058759   98925 retry.go:31] will retry after 714.947499ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:42.809985   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:42.810069   98925 retry.go:31] will retry after 269.319715ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:43.079585   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:43.098748   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:43.135311   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:43.135349   98925 retry.go:31] will retry after 258.802621ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:43.431015   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:43.431085   98925 retry.go:31] will retry after 341.973185ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:43.808660   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:43.808687   98925 retry.go:31] will retry after 511.614169ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:44.356439   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:44.356563   98925 provision.go:87] duration metric: took 3.716764446s to configureAuth
	W0918 17:15:44.356578   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:44.356589   98925 retry.go:31] will retry after 23.365135ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:44.380836   98925 provision.go:84] configureAuth start
	I0918 17:15:44.380913   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:44.399522   98925 provision.go:143] copyHostCerts
	I0918 17:15:44.399560   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:44.399599   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:44.399611   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:44.399676   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:44.399770   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:44.399797   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:44.399804   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:44.399840   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:44.400030   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:44.400064   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:44.400072   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:44.400113   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:44.400198   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:44.839710   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:44.839768   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:44.839815   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:44.858242   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:44.895123   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:44.895163   98925 retry.go:31] will retry after 187.572464ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:45.118959   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:45.118994   98925 retry.go:31] will retry after 489.581843ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:45.645160   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:45.645195   98925 retry.go:31] will retry after 390.680376ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:46.072161   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:46.072239   98925 retry.go:31] will retry after 334.844677ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:46.407854   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:46.426682   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:46.462783   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:46.462815   98925 retry.go:31] will retry after 150.601455ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:46.649259   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:46.649291   98925 retry.go:31] will retry after 377.833407ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:47.063140   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:47.063173   98925 retry.go:31] will retry after 708.609343ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:47.806813   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:47.806900   98925 provision.go:87] duration metric: took 3.426042007s to configureAuth
	W0918 17:15:47.806910   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:47.806924   98925 retry.go:31] will retry after 22.606508ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:47.830187   98925 provision.go:84] configureAuth start
	I0918 17:15:47.830289   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:47.849178   98925 provision.go:143] copyHostCerts
	I0918 17:15:47.849222   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:47.849251   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:47.849260   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:47.849314   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:47.849401   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:47.849421   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:47.849428   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:47.849450   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:47.849518   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:47.849544   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:47.849552   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:47.849576   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:47.849639   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:48.098401   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:48.098454   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:48.098484   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:48.117097   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:48.152826   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:48.152857   98925 retry.go:31] will retry after 267.733312ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:48.456891   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:48.456938   98925 retry.go:31] will retry after 226.71043ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:48.719529   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:48.719561   98925 retry.go:31] will retry after 631.416726ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:49.386409   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:49.386489   98925 retry.go:31] will retry after 260.083381ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:49.646934   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:49.666615   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:49.701785   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:49.701815   98925 retry.go:31] will retry after 301.717887ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:50.039859   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:50.039899   98925 retry.go:31] will retry after 476.440642ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:50.551792   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:50.551826   98925 retry.go:31] will retry after 765.183642ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:51.352884   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:51.352963   98925 provision.go:87] duration metric: took 3.522733966s to configureAuth
	W0918 17:15:51.352975   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:51.353001   98925 retry.go:31] will retry after 55.843325ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:51.409251   98925 provision.go:84] configureAuth start
	I0918 17:15:51.409361   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:51.427770   98925 provision.go:143] copyHostCerts
	I0918 17:15:51.427806   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:51.427834   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:51.427843   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:51.427902   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:51.427978   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:51.427998   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:51.428005   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:51.428026   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:51.428069   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:51.428086   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:51.428094   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:51.428119   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:51.428197   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:51.525672   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:51.525730   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:51.525762   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:51.543950   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:51.580493   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:51.580537   98925 retry.go:31] will retry after 171.654123ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:51.788347   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:51.788373   98925 retry.go:31] will retry after 266.521376ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:52.091304   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:52.091331   98925 retry.go:31] will retry after 556.771368ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:52.686253   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:52.686285   98925 retry.go:31] will retry after 475.441177ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:53.197865   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:53.197948   98925 retry.go:31] will retry after 286.552371ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:53.485521   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:53.503951   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:53.540076   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:53.540110   98925 retry.go:31] will retry after 189.527948ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:53.766013   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:53.766051   98925 retry.go:31] will retry after 376.558212ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:54.179475   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:54.179527   98925 retry.go:31] will retry after 656.975157ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:54.873023   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:54.873053   98925 retry.go:31] will retry after 546.362301ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:55.454916   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:55.455012   98925 provision.go:87] duration metric: took 4.045717874s to configureAuth
	W0918 17:15:55.455027   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:55.455039   98925 retry.go:31] will retry after 77.366167ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:55.533363   98925 provision.go:84] configureAuth start
	I0918 17:15:55.533452   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:55.552156   98925 provision.go:143] copyHostCerts
	I0918 17:15:55.552193   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:55.552230   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:55.552238   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:55.552307   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:55.552427   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:55.552457   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:55.552468   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:55.552516   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:55.552587   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:55.552624   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:55.552631   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:55.552661   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:55.552737   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:55.718776   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:55.718830   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:55.718864   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:55.736737   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:55.772285   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:55.772310   98925 retry.go:31] will retry after 180.64953ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:55.989467   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:55.989513   98925 retry.go:31] will retry after 373.425539ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:56.397961   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:56.397998   98925 retry.go:31] will retry after 573.326801ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:57.006887   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:57.006966   98925 retry.go:31] will retry after 345.690185ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:57.353603   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:57.372225   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:57.407589   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:57.407622   98925 retry.go:31] will retry after 259.194461ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:57.703102   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:57.703140   98925 retry.go:31] will retry after 344.562115ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:58.083956   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:58.083992   98925 retry.go:31] will retry after 398.870491ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:58.519597   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:58.519705   98925 provision.go:87] duration metric: took 2.986316742s to configureAuth
	W0918 17:15:58.519719   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:58.519731   98925 retry.go:31] will retry after 64.0582ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:58.583892   98925 provision.go:84] configureAuth start
	I0918 17:15:58.583975   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:58.602215   98925 provision.go:143] copyHostCerts
	I0918 17:15:58.602252   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:58.602288   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:58.602299   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:58.602377   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:58.602480   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:58.602520   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:58.602531   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:58.602565   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:58.602672   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:58.602697   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:58.602708   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:58.602741   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:58.602814   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:59.095416   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:59.095478   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:59.095528   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:59.114401   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:59.150254   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:59.150284   98925 retry.go:31] will retry after 139.937696ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:59.325685   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:59.325723   98925 retry.go:31] will retry after 511.345828ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:59.873413   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:59.873448   98925 retry.go:31] will retry after 519.006591ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:00.428112   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:00.428140   98925 retry.go:31] will retry after 471.634435ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:00.936415   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:00.936534   98925 provision.go:87] duration metric: took 2.352617944s to configureAuth
	W0918 17:16:00.936550   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:00.936563   98925 retry.go:31] will retry after 145.832808ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:01.082892   98925 provision.go:84] configureAuth start
	I0918 17:16:01.082980   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:01.101958   98925 provision.go:143] copyHostCerts
	I0918 17:16:01.101995   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:01.102038   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:01.102050   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:01.102119   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:01.102378   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:01.102413   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:01.102418   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:01.102457   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:01.102551   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:01.102579   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:01.102584   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:01.102614   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:01.102700   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:01.360565   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:01.360618   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:01.360653   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:01.378917   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:01.414692   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:01.414718   98925 retry.go:31] will retry after 325.0379ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:01.776951   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:01.776981   98925 retry.go:31] will retry after 520.226286ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:02.333218   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:02.333250   98925 retry.go:31] will retry after 552.838137ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:02.922305   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:02.922401   98925 retry.go:31] will retry after 143.1223ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:03.065659   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:03.083948   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:03.118886   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:03.118918   98925 retry.go:31] will retry after 359.967624ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:03.516028   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:03.516084   98925 retry.go:31] will retry after 475.894999ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:04.028339   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:04.028373   98925 retry.go:31] will retry after 402.591536ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:04.467083   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:04.467200   98925 provision.go:87] duration metric: took 3.384280817s to configureAuth
	W0918 17:16:04.467213   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:04.467225   98925 retry.go:31] will retry after 136.744499ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:04.604553   98925 provision.go:84] configureAuth start
	I0918 17:16:04.604660   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:04.623100   98925 provision.go:143] copyHostCerts
	I0918 17:16:04.623135   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:04.623162   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:04.623168   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:04.623222   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:04.623321   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:04.623341   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:04.623349   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:04.623383   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:04.623469   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:04.623489   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:04.623509   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:04.623543   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:04.623628   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:04.870972   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:04.871045   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:04.871093   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:04.889706   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:04.924861   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:04.924889   98925 retry.go:31] will retry after 281.383585ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:05.243091   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:05.243116   98925 retry.go:31] will retry after 486.022533ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:05.766841   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:05.766886   98925 retry.go:31] will retry after 670.729101ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:06.473254   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:06.473331   98925 retry.go:31] will retry after 182.80492ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:06.656729   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:06.675456   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:06.711470   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:06.711533   98925 retry.go:31] will retry after 190.419537ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:06.938391   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:06.938425   98925 retry.go:31] will retry after 270.734207ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:07.244853   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:07.244882   98925 retry.go:31] will retry after 374.435362ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:07.654920   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:07.654946   98925 retry.go:31] will retry after 812.624255ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:08.504185   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:08.504278   98925 provision.go:87] duration metric: took 3.899683162s to configureAuth
	W0918 17:16:08.504292   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:08.504312   98925 retry.go:31] will retry after 212.529948ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:08.717550   98925 provision.go:84] configureAuth start
	I0918 17:16:08.717667   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:08.735045   98925 provision.go:143] copyHostCerts
	I0918 17:16:08.735086   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:08.735115   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:08.735124   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:08.735182   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:08.735276   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:08.735296   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:08.735303   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:08.735326   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:08.735405   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:08.735422   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:08.735426   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:08.735448   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:08.735522   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:08.809570   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:08.809630   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:08.809667   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:08.829013   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:08.864610   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:08.864643   98925 retry.go:31] will retry after 246.117797ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:09.146654   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:09.146684   98925 retry.go:31] will retry after 404.702948ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:09.588100   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:09.588131   98925 retry.go:31] will retry after 299.317341ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:09.922494   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:09.922541   98925 retry.go:31] will retry after 879.095975ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:10.837794   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:10.837871   98925 provision.go:87] duration metric: took 2.12029402s to configureAuth
	W0918 17:16:10.837879   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:10.837932   98925 retry.go:31] will retry after 429.583693ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:11.268563   98925 provision.go:84] configureAuth start
	I0918 17:16:11.268643   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:11.286963   98925 provision.go:143] copyHostCerts
	I0918 17:16:11.287013   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:11.287050   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:11.287060   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:11.287122   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:11.287226   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:11.287251   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:11.287263   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:11.287293   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:11.287345   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:11.287364   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:11.287368   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:11.287387   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:11.287438   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:11.434158   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:11.434215   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:11.434249   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:11.452720   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:11.487934   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:11.487962   98925 retry.go:31] will retry after 187.206322ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:11.710486   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:11.710529   98925 retry.go:31] will retry after 330.747383ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:12.077476   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:12.077522   98925 retry.go:31] will retry after 385.664414ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:12.499402   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:12.499438   98925 retry.go:31] will retry after 574.769966ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:13.110229   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:13.110327   98925 provision.go:87] duration metric: took 1.841736272s to configureAuth
	W0918 17:16:13.110341   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:13.110354   98925 retry.go:31] will retry after 1.099114165s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:14.210581   98925 provision.go:84] configureAuth start
	I0918 17:16:14.210679   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:14.229593   98925 provision.go:143] copyHostCerts
	I0918 17:16:14.229632   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:14.229661   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:14.229668   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:14.229724   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:14.229806   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:14.229825   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:14.229829   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:14.229851   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:14.229929   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:14.229945   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:14.229952   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:14.229970   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:14.230038   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:14.499019   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:14.499087   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:14.499135   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:14.518345   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:14.554081   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:14.554110   98925 retry.go:31] will retry after 283.483489ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:14.875212   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:14.875247   98925 retry.go:31] will retry after 346.448624ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:15.258728   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:15.258760   98925 retry.go:31] will retry after 409.684209ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:15.705283   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:15.705320   98925 retry.go:31] will retry after 590.755274ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:16.332597   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:16.332692   98925 provision.go:87] duration metric: took 2.122086065s to configureAuth
	W0918 17:16:16.332709   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:16.332723   98925 retry.go:31] will retry after 873.891735ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:17.206720   98925 provision.go:84] configureAuth start
	I0918 17:16:17.206816   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:17.225185   98925 provision.go:143] copyHostCerts
	I0918 17:16:17.225226   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:17.225262   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:17.225272   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:17.225344   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:17.225434   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:17.225459   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:17.225467   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:17.225520   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:17.225593   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:17.225616   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:17.225625   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:17.225652   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:17.225724   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:17.327478   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:17.327547   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:17.327580   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:17.346274   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:17.381452   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:17.381481   98925 retry.go:31] will retry after 269.470525ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:17.688836   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:17.688869   98925 retry.go:31] will retry after 522.334692ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:18.247457   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:18.247495   98925 retry.go:31] will retry after 481.819911ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:18.765396   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:18.765474   98925 retry.go:31] will retry after 241.089827ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:19.006909   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:19.024833   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:19.060381   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:19.060410   98925 retry.go:31] will retry after 165.090599ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:19.261437   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:19.261474   98925 retry.go:31] will retry after 506.35158ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:19.803260   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:19.803293   98925 retry.go:31] will retry after 555.106778ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:20.395232   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:20.395264   98925 retry.go:31] will retry after 557.511502ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:20.988756   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:20.988833   98925 provision.go:87] duration metric: took 3.78207371s to configureAuth
	W0918 17:16:20.988841   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:20.988851   98925 retry.go:31] will retry after 2.262260324s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:23.251559   98925 provision.go:84] configureAuth start
	I0918 17:16:23.251666   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:23.270802   98925 provision.go:143] copyHostCerts
	I0918 17:16:23.270837   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:23.270864   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:23.270870   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:23.270936   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:23.271027   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:23.271048   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:23.271053   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:23.271076   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:23.271163   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:23.271187   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:23.271197   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:23.271228   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:23.271304   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:23.388045   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:23.388118   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:23.388177   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:23.406369   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:23.442773   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:23.442810   98925 retry.go:31] will retry after 363.813606ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:23.842796   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:23.842825   98925 retry.go:31] will retry after 432.801316ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:24.311895   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:24.311923   98925 retry.go:31] will retry after 309.356734ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:24.658307   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:24.658396   98925 retry.go:31] will retry after 220.794692ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:24.879848   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:24.898118   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:24.934394   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:24.934432   98925 retry.go:31] will retry after 190.457795ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:25.161937   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:25.161986   98925 retry.go:31] will retry after 454.67117ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:25.653475   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:25.653517   98925 retry.go:31] will retry after 453.076295ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:26.142623   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:26.142720   98925 provision.go:87] duration metric: took 2.891137972s to configureAuth
	W0918 17:16:26.142732   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:26.142749   98925 retry.go:31] will retry after 2.489870814s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:28.632846   98925 provision.go:84] configureAuth start
	I0918 17:16:28.632959   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:28.652479   98925 provision.go:143] copyHostCerts
	I0918 17:16:28.652530   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:28.652566   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:28.652576   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:28.652643   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:28.652747   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:28.652774   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:28.652782   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:28.652815   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:28.652882   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:28.652910   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:28.652920   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:28.652954   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:28.653025   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:29.057226   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:29.057284   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:29.057315   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:29.076278   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:29.112540   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:29.112574   98925 retry.go:31] will retry after 177.20504ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:29.325554   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:29.325588   98925 retry.go:31] will retry after 245.321786ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:29.607132   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:29.607166   98925 retry.go:31] will retry after 693.764641ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:30.337495   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:30.337545   98925 retry.go:31] will retry after 618.896523ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:30.994058   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:30.994157   98925 provision.go:87] duration metric: took 2.361285265s to configureAuth
	W0918 17:16:30.994169   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:30.994179   98925 retry.go:31] will retry after 4.838105643s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:35.833220   98925 provision.go:84] configureAuth start
	I0918 17:16:35.833312   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:35.851706   98925 provision.go:143] copyHostCerts
	I0918 17:16:35.851738   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:35.851764   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:35.851770   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:35.851825   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:35.851898   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:35.851916   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:35.851920   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:35.851939   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:35.851983   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:35.851999   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:35.852005   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:35.852022   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:35.852074   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:36.226763   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:36.226824   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:36.226858   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:36.245557   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:36.281187   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:36.281213   98925 retry.go:31] will retry after 363.710903ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:36.681864   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:36.681893   98925 retry.go:31] will retry after 398.852782ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:37.117587   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:37.117631   98925 retry.go:31] will retry after 557.02421ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:37.711181   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:37.711274   98925 retry.go:31] will retry after 341.786055ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:38.053746   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:38.073341   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:38.110539   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:38.110568   98925 retry.go:31] will retry after 358.471077ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:38.506452   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:38.506489   98925 retry.go:31] will retry after 258.274031ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:38.801300   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:38.801330   98925 retry.go:31] will retry after 670.02118ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:39.507734   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:39.507820   98925 provision.go:87] duration metric: took 3.674573855s to configureAuth
	W0918 17:16:39.507831   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:39.507845   98925 retry.go:31] will retry after 3.072900033s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:42.582567   98925 provision.go:84] configureAuth start
	I0918 17:16:42.582744   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:42.601032   98925 provision.go:143] copyHostCerts
	I0918 17:16:42.601100   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:42.601138   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:42.601147   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:42.601201   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:42.601275   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:42.601293   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:42.601302   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:42.601330   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:42.601375   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:42.601391   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:42.601397   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:42.601415   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:42.601463   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:42.791723   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:42.791781   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:42.791813   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:42.810857   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:42.847226   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:42.847251   98925 retry.go:31] will retry after 179.066143ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:43.062310   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:43.062362   98925 retry.go:31] will retry after 444.747023ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:43.544966   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:43.545001   98925 retry.go:31] will retry after 438.412023ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:44.021096   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:44.021168   98925 retry.go:31] will retry after 280.423604ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:44.302767   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:44.321408   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:44.357152   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:44.357191   98925 retry.go:31] will retry after 129.513966ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:44.524126   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:44.524157   98925 retry.go:31] will retry after 302.389742ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:44.863722   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:44.863766   98925 retry.go:31] will retry after 322.992055ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:45.223006   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:45.223094   98925 retry.go:31] will retry after 621.633647ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:45.881579   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:45.881693   98925 provision.go:87] duration metric: took 3.299096949s to configureAuth
	W0918 17:16:45.881711   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:45.881724   98925 retry.go:31] will retry after 7.249483941s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:53.132300   98925 provision.go:84] configureAuth start
	I0918 17:16:53.132383   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:53.151279   98925 provision.go:143] copyHostCerts
	I0918 17:16:53.151312   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:53.151353   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:53.151362   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:53.151417   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:53.151491   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:53.151529   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:53.151540   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:53.151565   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:53.151615   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:53.151631   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:53.151638   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:53.151656   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:53.151708   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:53.749803   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:53.749858   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:53.749893   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:53.768982   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:53.806621   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:53.806667   98925 retry.go:31] will retry after 194.21686ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:54.036656   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:54.036683   98925 retry.go:31] will retry after 303.062777ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:54.375864   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:54.375896   98925 retry.go:31] will retry after 366.941892ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:54.779034   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:54.779063   98925 retry.go:31] will retry after 982.788008ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:55.799737   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:55.799861   98925 provision.go:87] duration metric: took 2.667534162s to configureAuth
	W0918 17:16:55.799876   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:55.799889   98925 ubuntu.go:202] Error configuring auth during provisioning Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:55.799900   98925 machine.go:96] duration metric: took 11m3.224345916s to provisionDockerMachine
	I0918 17:16:55.799963   98925 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:16:55.800001   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:55.818456   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:55.855555   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:55.855582   98925 retry.go:31] will retry after 282.574969ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:56.174599   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:56.174629   98925 retry.go:31] will retry after 290.455822ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:56.501451   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:56.501481   98925 retry.go:31] will retry after 692.583759ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:57.229789   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:57.229815   98925 retry.go:31] will retry after 496.643512ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:57.762665   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:57.762751   98925 start.go:268] error running df -h /var: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:57.762766   98925 start.go:235] error getting percentage of /var that is free: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:57.762823   98925 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:16:57.762867   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:57.782701   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:57.818850   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:57.818887   98925 retry.go:31] will retry after 154.422259ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:58.010350   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:58.010380   98925 retry.go:31] will retry after 264.826686ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:58.311633   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:58.311662   98925 retry.go:31] will retry after 711.001206ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:59.059712   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:59.059770   98925 retry.go:31] will retry after 373.295613ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:59.433340   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:59.452430   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:59.489457   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:59.489491   98925 retry.go:31] will retry after 293.106044ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:59.818396   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:59.818430   98925 retry.go:31] will retry after 249.595529ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:17:00.105085   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:00.105113   98925 retry.go:31] will retry after 691.50438ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:17:00.833188   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:00.833221   98925 retry.go:31] will retry after 541.186888ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:17:01.409667   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:17:01.409762   98925 start.go:283] error running df -BG /var: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:17:01.409780   98925 start.go:240] error getting GiB of /var that is available: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:01.409789   98925 fix.go:56] duration metric: took 11m9.154507562s for fixHost
	I0918 17:17:01.409798   98925 start.go:83] releasing machines lock for "ha-078118-m04", held for 11m9.154548806s
	W0918 17:17:01.409818   98925 start.go:714] error starting host: provision: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:17:01.409893   98925 out.go:285] ! StartHost failed, but will try again: provision: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	! StartHost failed, but will try again: provision: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:01.409906   98925 start.go:729] Will try again in 5 seconds ...
	I0918 17:17:06.410981   98925 start.go:360] acquireMachinesLock for ha-078118-m04: {Name:mkdcee71069a15ce1d36f6cf5f43097fe7468c48 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:17:06.411105   98925 start.go:364] duration metric: took 64.444µs to acquireMachinesLock for "ha-078118-m04"
	I0918 17:17:06.411128   98925 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:17:06.411135   98925 fix.go:54] fixHost starting: m04
	I0918 17:17:06.411360   98925 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:17:06.428896   98925 fix.go:112] recreateIfNeeded on ha-078118-m04: state=Running err=<nil>
	W0918 17:17:06.428923   98925 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:17:06.431127   98925 out.go:252] * Updating the running docker "ha-078118-m04" container ...
	I0918 17:17:06.431165   98925 machine.go:93] provisionDockerMachine start ...
	I0918 17:17:06.431232   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:17:06.450558   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:17:06.450819   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32838 <nil> <nil>}
	I0918 17:17:06.450834   98925 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:17:06.486356   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:09.524393   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:12.560266   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:15.595619   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:18.632933   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:21.670739   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:24.708244   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:27.744364   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:30.783558   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:33.820732   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:36.858571   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:39.897432   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:42.932887   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:45.969359   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:49.006437   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:52.043744   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:55.080445   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:58.117410   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:01.155542   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:04.192808   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:07.229077   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:10.266704   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:13.303381   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:16.339962   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:19.378803   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:22.416539   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:25.452951   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:28.489055   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:31.526402   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:34.563566   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:37.601328   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:40.639029   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:43.675764   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:46.713380   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:49.751357   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:52.788320   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:55.824026   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:58.860350   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:01.899060   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:04.935763   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:07.971578   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:11.009081   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:14.046009   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:17.084154   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:20.122129   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:23.158710   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:26.194313   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:29.230761   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:32.268243   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:35.305019   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:38.341354   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:41.377922   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:44.414442   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:47.451743   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:50.488237   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:53.523656   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:56.560150   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:59.597544   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:02.632922   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:05.670137   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:08.670820   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:20:08.670856   98925 ubuntu.go:182] provisioning hostname "ha-078118-m04"
	I0918 17:20:08.670917   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:20:08.692379   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:20:08.692614   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32838 <nil> <nil>}
	I0918 17:20:08.692633   98925 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m04 && echo "ha-078118-m04" | sudo tee /etc/hostname
	I0918 17:20:08.728465   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:11.767277   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:14.803437   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:17.839403   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:20.879040   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:23.916030   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:26.952310   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:29.989950   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:33.026080   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:36.063030   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:39.100517   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:42.137833   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:45.174081   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:48.209927   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:51.248045   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:54.284455   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:57.320935   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:00.357693   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:03.393125   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:06.429660   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:09.466577   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:12.505527   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:15.542731   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:18.579129   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:21.616853   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:24.654676   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:27.692616   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:30.728933   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:33.765612   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:36.801918   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:39.839996   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:42.876340   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:45.913153   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:48.949539   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:51.985287   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:55.021376   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:58.057576   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:01.094248   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:04.130462   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:07.167270   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:10.203615   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:13.239443   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:16.277036   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:19.313390   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:22.351797   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:25.388038   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:28.423882   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:31.459541   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:34.496661   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:37.534279   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:40.572774   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:43.608018   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:46.643986   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:49.683229   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:52.718572   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:55.755393   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:58.791782   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:01.829640   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:04.865931   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:07.902419   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:10.903573   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:23:10.903659   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:23:10.922956   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:23:10.923203   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32838 <nil> <nil>}
	I0918 17:23:10.923221   98925 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m04' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m04/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m04' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:23:10.959134   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:13.995727   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:17.032966   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:20.072186   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:23.108861   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:26.146050   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:29.182864   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:32.220202   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:35.255834   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:38.295690   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:41.334186   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:44.370204   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:47.406730   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:50.444224   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:53.480237   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:56.517649   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:59.553997   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:02.591468   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:05.627866   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:08.664222   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:11.701228   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:14.738462   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:17.775043   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:20.811758   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:23.848370   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:26.886058   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:29.923106   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:32.959379   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:35.996139   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:39.032804   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:42.070839   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:45.106685   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:48.142745   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:51.179556   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:54.215894   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:57.252851   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:00.290960   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:03.326589   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:06.363965   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:09.399628   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:12.437724   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:15.473635   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:18.509068   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:21.547568   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:24.585365   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:27.622772   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:30.661349   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:33.696861   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:36.734799   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:39.772535   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:42.808983   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:45.845805   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:48.882433   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:51.920379   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:54.956695   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:57.993410   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:01.031174   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:04.067317   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:07.106070   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:10.142813   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:13.143677   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:26:13.143706   98925 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:26:13.143729   98925 ubuntu.go:190] setting up certificates
	I0918 17:26:13.143740   98925 provision.go:84] configureAuth start
	I0918 17:26:13.143796   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:13.162899   98925 provision.go:143] copyHostCerts
	I0918 17:26:13.162939   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:13.162975   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:13.162987   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:13.163080   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:13.163197   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:13.163225   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:13.163235   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:13.163280   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:13.163356   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:13.163382   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:13.163388   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:13.163424   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:13.163520   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:13.913213   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:13.913269   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:13.913303   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:13.932302   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:13.967941   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:13.967981   98925 retry.go:31] will retry after 294.777291ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:14.298886   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:14.298917   98925 retry.go:31] will retry after 324.614281ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:14.660046   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:14.660081   98925 retry.go:31] will retry after 559.181784ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:15.255114   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:15.255195   98925 retry.go:31] will retry after 170.421208ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:15.426816   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:15.446041   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:15.482037   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:15.482072   98925 retry.go:31] will retry after 367.007577ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:15.884982   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:15.885017   98925 retry.go:31] will retry after 328.315028ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:16.248794   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:16.248826   98925 retry.go:31] will retry after 636.10788ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:16.921403   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:16.921495   98925 provision.go:87] duration metric: took 3.77774819s to configureAuth
	W0918 17:26:16.921525   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:16.921542   98925 retry.go:31] will retry after 58.042µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:16.922659   98925 provision.go:84] configureAuth start
	I0918 17:26:16.922734   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:16.940909   98925 provision.go:143] copyHostCerts
	I0918 17:26:16.940950   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:16.940984   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:16.940997   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:16.941066   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:16.941178   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:16.941205   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:16.941216   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:16.941253   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:16.941334   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:16.941364   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:16.941372   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:16.941404   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:16.941492   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:17.002997   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:17.003051   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:17.003103   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:17.021406   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:17.056848   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:17.056881   98925 retry.go:31] will retry after 242.205608ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:17.334921   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:17.334958   98925 retry.go:31] will retry after 220.793813ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:17.591737   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:17.591767   98925 retry.go:31] will retry after 759.607147ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:18.387683   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:18.387759   98925 retry.go:31] will retry after 338.570068ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:18.727328   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:18.746752   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:18.782383   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:18.782413   98925 retry.go:31] will retry after 180.572211ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:18.999419   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:18.999448   98925 retry.go:31] will retry after 348.717939ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:19.384905   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:19.384940   98925 retry.go:31] will retry after 710.784154ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:20.131973   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:20.132083   98925 provision.go:87] duration metric: took 3.209398955s to configureAuth
	W0918 17:26:20.132096   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:20.132109   98925 retry.go:31] will retry after 168.4µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:20.133224   98925 provision.go:84] configureAuth start
	I0918 17:26:20.133306   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:20.152029   98925 provision.go:143] copyHostCerts
	I0918 17:26:20.152064   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:20.152092   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:20.152104   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:20.152162   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:20.152255   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:20.152273   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:20.152278   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:20.152300   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:20.152360   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:20.152378   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:20.152384   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:20.152403   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:20.152467   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:20.531209   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:20.531267   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:20.531299   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:20.548921   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:20.584922   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:20.584951   98925 retry.go:31] will retry after 276.953641ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:20.898136   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:20.898164   98925 retry.go:31] will retry after 405.251794ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:21.339797   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:21.339834   98925 retry.go:31] will retry after 618.916339ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:21.997155   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:21.997227   98925 retry.go:31] will retry after 205.144717ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:22.202607   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:22.220884   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:22.256204   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:22.256238   98925 retry.go:31] will retry after 338.505919ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:22.631259   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:22.631289   98925 retry.go:31] will retry after 205.205861ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:22.872166   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:22.872201   98925 retry.go:31] will retry after 745.855504ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:23.655411   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:23.655519   98925 provision.go:87] duration metric: took 3.522276589s to configureAuth
	W0918 17:26:23.655533   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:23.655549   98925 retry.go:31] will retry after 302.053µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:23.656696   98925 provision.go:84] configureAuth start
	I0918 17:26:23.656775   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:23.675639   98925 provision.go:143] copyHostCerts
	I0918 17:26:23.675675   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:23.675715   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:23.675727   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:23.675791   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:23.675906   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:23.675935   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:23.675946   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:23.675982   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:23.676098   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:23.676121   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:23.676126   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:23.676159   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:23.676264   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:23.991930   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:23.992002   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:23.992050   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:24.010640   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:24.045832   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:24.045859   98925 retry.go:31] will retry after 298.7223ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:24.382377   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:24.382405   98925 retry.go:31] will retry after 553.455501ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:24.971921   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:24.971953   98925 retry.go:31] will retry after 464.676699ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:25.473028   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:25.473108   98925 retry.go:31] will retry after 291.995463ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:25.765637   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:25.784088   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:25.819267   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:25.819294   98925 retry.go:31] will retry after 195.979888ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:26.051065   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:26.051103   98925 retry.go:31] will retry after 510.573556ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:26.597564   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:26.597612   98925 retry.go:31] will retry after 805.231325ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:27.438422   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:27.438543   98925 provision.go:87] duration metric: took 3.781824764s to configureAuth
	W0918 17:26:27.438557   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:27.438570   98925 retry.go:31] will retry after 405.568µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:27.439709   98925 provision.go:84] configureAuth start
	I0918 17:26:27.439799   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:27.458559   98925 provision.go:143] copyHostCerts
	I0918 17:26:27.458598   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:27.458633   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:27.458644   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:27.458700   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:27.458788   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:27.458806   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:27.458811   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:27.458836   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:27.458893   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:27.458909   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:27.458913   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:27.458931   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:27.459035   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:27.708304   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:27.708360   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:27.708395   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:27.726754   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:27.762721   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:27.762756   98925 retry.go:31] will retry after 353.390604ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:28.151465   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:28.151518   98925 retry.go:31] will retry after 324.165141ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:28.511971   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:28.512006   98925 retry.go:31] will retry after 735.762576ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:29.282816   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:29.282844   98925 retry.go:31] will retry after 435.368276ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:29.753559   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:29.753653   98925 provision.go:87] duration metric: took 2.313925087s to configureAuth
	W0918 17:26:29.753664   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:29.753676   98925 retry.go:31] will retry after 716.51µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:29.754807   98925 provision.go:84] configureAuth start
	I0918 17:26:29.754878   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:29.773348   98925 provision.go:143] copyHostCerts
	I0918 17:26:29.773382   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:29.773410   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:29.773426   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:29.773483   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:29.773628   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:29.773658   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:29.773665   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:29.773701   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:29.773787   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:29.773815   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:29.773822   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:29.773861   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:29.773951   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:30.053254   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:30.053310   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:30.053355   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:30.072361   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:30.108478   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:30.108540   98925 retry.go:31] will retry after 203.143386ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:30.347939   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:30.347969   98925 retry.go:31] will retry after 437.190438ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:30.820765   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:30.820815   98925 retry.go:31] will retry after 509.160894ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:31.366140   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:31.366219   98925 retry.go:31] will retry after 198.380926ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:31.565744   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:31.584192   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:31.619779   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:31.619824   98925 retry.go:31] will retry after 157.640608ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:31.814075   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:31.814107   98925 retry.go:31] will retry after 202.556502ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:32.052434   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:32.052465   98925 retry.go:31] will retry after 422.553211ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:32.511967   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:32.512067   98925 provision.go:87] duration metric: took 2.75724108s to configureAuth
	W0918 17:26:32.512079   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:32.512092   98925 retry.go:31] will retry after 801.991µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:32.513214   98925 provision.go:84] configureAuth start
	I0918 17:26:32.513302   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:32.531614   98925 provision.go:143] copyHostCerts
	I0918 17:26:32.531673   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:32.531706   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:32.531715   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:32.531783   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:32.531902   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:32.531940   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:32.531950   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:32.531985   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:32.532070   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:32.532091   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:32.532100   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:32.532132   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:32.532217   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:32.717414   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:32.717475   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:32.717532   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:32.735903   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:32.772170   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:32.772196   98925 retry.go:31] will retry after 322.158158ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:33.130739   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:33.130784   98925 retry.go:31] will retry after 212.695665ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:33.379101   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:33.379130   98925 retry.go:31] will retry after 511.073845ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:33.926022   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:33.926115   98925 retry.go:31] will retry after 311.313901ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:34.237678   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:34.258144   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:34.293636   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:34.293665   98925 retry.go:31] will retry after 360.381059ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:34.690399   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:34.690437   98925 retry.go:31] will retry after 492.538799ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:35.219281   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:35.219314   98925 retry.go:31] will retry after 625.413357ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:35.881230   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:35.881320   98925 provision.go:87] duration metric: took 3.368084047s to configureAuth
	W0918 17:26:35.881332   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:35.881345   98925 retry.go:31] will retry after 1.062632ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:35.882487   98925 provision.go:84] configureAuth start
	I0918 17:26:35.882569   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:35.902117   98925 provision.go:143] copyHostCerts
	I0918 17:26:35.902155   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:35.902186   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:35.902195   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:35.902257   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:35.902356   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:35.902375   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:35.902379   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:35.902402   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:35.902458   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:35.902476   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:35.902480   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:35.902525   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:35.902605   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:36.571987   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:36.572052   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:36.572083   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:36.590702   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:36.626866   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:36.626896   98925 retry.go:31] will retry after 344.099015ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:37.009728   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:37.009755   98925 retry.go:31] will retry after 493.353769ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:37.539913   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:37.539940   98925 retry.go:31] will retry after 356.804209ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:37.932870   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:37.932948   98925 retry.go:31] will retry after 343.413093ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:38.277589   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:38.296460   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:38.332222   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:38.332247   98925 retry.go:31] will retry after 288.775405ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:38.657733   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:38.657769   98925 retry.go:31] will retry after 345.793717ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:39.039605   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:39.039637   98925 retry.go:31] will retry after 370.881257ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:39.446733   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:39.446761   98925 retry.go:31] will retry after 464.57461ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:39.947723   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:39.947808   98925 provision.go:87] duration metric: took 4.06529098s to configureAuth
	W0918 17:26:39.947819   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:39.947833   98925 retry.go:31] will retry after 1.205388ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:39.950024   98925 provision.go:84] configureAuth start
	I0918 17:26:39.950099   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:39.967244   98925 provision.go:143] copyHostCerts
	I0918 17:26:39.967289   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:39.967320   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:39.967329   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:39.967388   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:39.967474   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:39.967497   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:39.967518   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:39.967555   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:39.967621   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:39.967647   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:39.967654   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:39.967676   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:39.967753   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:40.877992   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:40.878074   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:40.878123   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:40.897064   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:40.933673   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:40.933709   98925 retry.go:31] will retry after 273.244784ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:41.245149   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:41.245183   98925 retry.go:31] will retry after 486.358829ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:41.767534   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:41.767560   98925 retry.go:31] will retry after 303.517071ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:42.108138   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:42.108179   98925 retry.go:31] will retry after 563.296352ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:42.707616   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:42.707681   98925 retry.go:31] will retry after 164.544328ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:42.873125   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:42.891455   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:42.926583   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:42.926612   98925 retry.go:31] will retry after 234.931399ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:43.197818   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:43.197843   98925 retry.go:31] will retry after 488.865967ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:43.722922   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:43.722960   98925 retry.go:31] will retry after 726.9546ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:44.486493   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:44.486599   98925 provision.go:87] duration metric: took 4.536558137s to configureAuth
	W0918 17:26:44.486609   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:44.486633   98925 retry.go:31] will retry after 2.10841ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:44.488781   98925 provision.go:84] configureAuth start
	I0918 17:26:44.488869   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:44.506679   98925 provision.go:143] copyHostCerts
	I0918 17:26:44.506712   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:44.506738   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:44.506746   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:44.506812   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:44.506905   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:44.506964   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:44.506974   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:44.507044   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:44.507118   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:44.507142   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:44.507151   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:44.507183   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:44.507258   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:44.805920   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:44.805974   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:44.806021   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:44.824351   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:44.860922   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:44.860950   98925 retry.go:31] will retry after 192.319866ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:45.090397   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:45.090426   98925 retry.go:31] will retry after 281.86925ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:45.407741   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:45.407773   98925 retry.go:31] will retry after 811.832007ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:46.255299   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:46.255383   98925 retry.go:31] will retry after 187.087489ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:46.442639   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:46.461443   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:46.496954   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:46.496981   98925 retry.go:31] will retry after 318.002309ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:46.852336   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:46.852378   98925 retry.go:31] will retry after 313.017508ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:47.200848   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:47.200882   98925 retry.go:31] will retry after 384.202752ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:47.621230   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:47.621345   98925 provision.go:87] duration metric: took 3.132533037s to configureAuth
	W0918 17:26:47.621360   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:47.621373   98925 retry.go:31] will retry after 3.572654ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:47.625577   98925 provision.go:84] configureAuth start
	I0918 17:26:47.625648   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:47.644175   98925 provision.go:143] copyHostCerts
	I0918 17:26:47.644219   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:47.644270   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:47.644281   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:47.644353   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:47.644434   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:47.644453   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:47.644458   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:47.644481   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:47.644553   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:47.644572   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:47.644579   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:47.644600   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:47.644655   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:47.941135   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:47.941193   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:47.941228   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:47.959825   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:47.995908   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:47.995944   98925 retry.go:31] will retry after 166.759776ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:48.200403   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:48.200429   98925 retry.go:31] will retry after 348.152332ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:48.584073   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:48.584106   98925 retry.go:31] will retry after 304.438367ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:48.925813   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:48.925844   98925 retry.go:31] will retry after 718.138128ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:49.681547   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:49.681627   98925 retry.go:31] will retry after 221.075853ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:49.903065   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:49.921239   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:49.957181   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:49.957211   98925 retry.go:31] will retry after 188.275303ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:50.182148   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:50.182178   98925 retry.go:31] will retry after 199.452506ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:50.418632   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:50.418658   98925 retry.go:31] will retry after 809.573612ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:51.264143   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:51.264241   98925 provision.go:87] duration metric: took 3.63864232s to configureAuth
	W0918 17:26:51.264252   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:51.264263   98925 retry.go:31] will retry after 3.048841ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:51.267457   98925 provision.go:84] configureAuth start
	I0918 17:26:51.267563   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:51.286206   98925 provision.go:143] copyHostCerts
	I0918 17:26:51.286246   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:51.286275   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:51.286281   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:51.286354   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:51.286448   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:51.286471   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:51.286476   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:51.286524   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:51.286598   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:51.286624   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:51.286633   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:51.286665   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:51.286737   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:51.401910   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:51.401967   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:51.402009   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:51.420590   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:51.455907   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:51.455939   98925 retry.go:31] will retry after 258.214985ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:51.750678   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:51.750708   98925 retry.go:31] will retry after 397.103703ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:52.183779   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:52.183809   98925 retry.go:31] will retry after 748.172201ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:52.968647   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:52.968737   98925 retry.go:31] will retry after 355.657506ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:53.325377   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:53.344760   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:53.380904   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:53.380933   98925 retry.go:31] will retry after 216.759142ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:53.635410   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:53.635437   98925 retry.go:31] will retry after 200.206862ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:53.872384   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:53.872420   98925 retry.go:31] will retry after 476.884988ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:54.387122   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:54.387218   98925 provision.go:87] duration metric: took 3.119738426s to configureAuth
	W0918 17:26:54.387231   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:54.387243   98925 retry.go:31] will retry after 5.435017ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:54.393528   98925 provision.go:84] configureAuth start
	I0918 17:26:54.393617   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:54.412428   98925 provision.go:143] copyHostCerts
	I0918 17:26:54.412468   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:54.412521   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:54.412536   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:54.412613   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:54.412715   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:54.412741   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:54.412755   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:54.412791   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:54.412867   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:54.412893   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:54.412903   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:54.412934   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:54.413015   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:54.622068   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:54.622127   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:54.622173   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:54.641085   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:54.678569   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:54.678602   98925 retry.go:31] will retry after 278.796466ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:54.994490   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:54.994568   98925 retry.go:31] will retry after 308.423933ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:55.339158   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:55.339185   98925 retry.go:31] will retry after 533.610636ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:55.908431   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:55.908541   98925 retry.go:31] will retry after 261.452162ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:56.171040   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:56.188823   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:56.224373   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:56.224406   98925 retry.go:31] will retry after 365.00025ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:56.625131   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:56.625168   98925 retry.go:31] will retry after 409.106024ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:57.070513   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:57.070546   98925 retry.go:31] will retry after 294.673606ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:57.402276   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:57.402371   98925 provision.go:87] duration metric: took 3.008816984s to configureAuth
	W0918 17:26:57.402384   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:57.402398   98925 retry.go:31] will retry after 17.022303ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:57.419699   98925 provision.go:84] configureAuth start
	I0918 17:26:57.419817   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:57.439026   98925 provision.go:143] copyHostCerts
	I0918 17:26:57.439065   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:57.439121   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:57.439133   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:57.439206   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:57.439317   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:57.439345   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:57.439352   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:57.439396   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:57.439467   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:57.439493   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:57.439513   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:57.439546   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:57.439622   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]

                                                
                                                
** /stderr **
ha_test.go:564: failed to start cluster. args "out/minikube-linux-amd64 -p ha-078118 start --wait true --alsologtostderr -v 5 --driver=docker  --container-runtime=crio" : signal: killed
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======>  post-mortem[TestMultiControlPlane/serial/RestartCluster]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======>  post-mortem[TestMultiControlPlane/serial/RestartCluster]: docker inspect <======
helpers_test.go:239: (dbg) Run:  docker inspect ha-078118
helpers_test.go:243: (dbg) docker inspect ha-078118:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7",
	        "Created": "2025-09-18T16:57:02.681891976Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 99123,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2025-09-18T17:03:57.833756092Z",
	            "FinishedAt": "2025-09-18T17:03:57.109330452Z"
	        },
	        "Image": "sha256:c6b5532e987b5b4f5fc9cb0336e378ed49c0542bad8cbfc564b71e977a6269de",
	        "ResolvConfPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/hostname",
	        "HostsPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/hosts",
	        "LogPath": "/var/lib/docker/containers/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7/0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7-json.log",
	        "Name": "/ha-078118",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ha-078118:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "ha-078118",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "private",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 3221225472,
	            "NanoCpus": 0,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 6442450944,
	            "MemorySwappiness": null,
	            "OomKillDisable": null,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "ID": "0cb187fb2895b66f6c6c7950ef9700d4b2f3f906abe2320aaf5fce67553f3db7",
	                "LowerDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91-init/diff:/var/lib/docker/overlay2/1fd2bbb67ab9e5bb8d4549665a1a228eadda56df39fee53908cd735ea16a4e10/diff",
	                "MergedDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/merged",
	                "UpperDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/diff",
	                "WorkDir": "/var/lib/docker/overlay2/cae03e6de6c9f8de87cefc5c924ff73957953131159440a021416d52efb45c91/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "ha-078118",
	                "Source": "/var/lib/docker/volumes/ha-078118/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "ha-078118",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ha-078118",
	                "name.minikube.sigs.k8s.io": "ha-078118",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "8e2e4dbe7133172954e76f9688c349cf185bba1f46d42b290843d4b648cb6214",
	            "SandboxKey": "/var/run/docker/netns/8e2e4dbe7133",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32828"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32829"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32832"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32830"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32831"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ha-078118": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "6a:bc:60:7a:e8:a5",
	                    "DriverOpts": null,
	                    "GwPriority": 0,
	                    "NetworkID": "0aa191750de6e44eaf49073a9e05a52994c63ccafcb0870d32aaf105d93cb724",
	                    "EndpointID": "1cef20218285c8ec817054537bac4848df93c2de91bee39827cf9c09768e4084",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "ha-078118",
	                        "0cb187fb2895"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-078118 -n ha-078118
helpers_test.go:252: <<< TestMultiControlPlane/serial/RestartCluster FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======>  post-mortem[TestMultiControlPlane/serial/RestartCluster]: minikube logs <======
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p ha-078118 logs -n 25: (1.285392191s)
helpers_test.go:260: TestMultiControlPlane/serial/RestartCluster logs: 
-- stdout --
	
	==> Audit <==
	┌─────────┬──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬───────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
	│ COMMAND │                                                                 ARGS                                                                 │  PROFILE  │  USER   │ VERSION │     START TIME      │      END TIME       │
	├─────────┼──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼───────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
	│ cp      │ ha-078118 cp ha-078118-m03:/home/docker/cp-test.txt ha-078118-m04:/home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test_ha-078118-m03_ha-078118-m04.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp testdata/cp-test.txt ha-078118-m04:/home/docker/cp-test.txt                                                             │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt /tmp/TestMultiControlPlaneserialCopyFile1931775572/001/cp-test_ha-078118-m04.txt │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118:/home/docker/cp-test_ha-078118-m04_ha-078118.txt                       │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118.txt                                                 │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m02:/home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m02 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m02.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ cp      │ ha-078118 cp ha-078118-m04:/home/docker/cp-test.txt ha-078118-m03:/home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt               │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m04 sudo cat /home/docker/cp-test.txt                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ ssh     │ ha-078118 ssh -n ha-078118-m03 sudo cat /home/docker/cp-test_ha-078118-m04_ha-078118-m03.txt                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │                     │
	│ node    │ ha-078118 node stop m02 --alsologtostderr -v 5                                                                                       │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ node    │ ha-078118 node start m02 --alsologtostderr -v 5                                                                                      │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:00 UTC │ 18 Sep 25 17:00 UTC │
	│ node    │ ha-078118 node list --alsologtostderr -v 5                                                                                           │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:01 UTC │                     │
	│ stop    │ ha-078118 stop --alsologtostderr -v 5                                                                                                │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:01 UTC │ 18 Sep 25 17:01 UTC │
	│ start   │ ha-078118 start --wait true --alsologtostderr -v 5                                                                                   │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:01 UTC │                     │
	│ node    │ ha-078118 node list --alsologtostderr -v 5                                                                                           │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:02 UTC │                     │
	│ node    │ ha-078118 node delete m03 --alsologtostderr -v 5                                                                                     │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:02 UTC │ 18 Sep 25 17:03 UTC │
	│ stop    │ ha-078118 stop --alsologtostderr -v 5                                                                                                │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:03 UTC │ 18 Sep 25 17:03 UTC │
	│ start   │ ha-078118 start --wait true --alsologtostderr -v 5 --driver=docker  --container-runtime=crio                                         │ ha-078118 │ jenkins │ v1.37.0 │ 18 Sep 25 17:03 UTC │                     │
	└─────────┴──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴───────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
	
	
	==> Last Start <==
	Log file created at: 2025/09/18 17:03:57
	Running on machine: ubuntu-20-agent-4
	Binary: Built with gc go1.24.6 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0918 17:03:57.594373   98925 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:03:57.594655   98925 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:03:57.594663   98925 out.go:374] Setting ErrFile to fd 2...
	I0918 17:03:57.594668   98925 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:03:57.594895   98925 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:03:57.595320   98925 out.go:368] Setting JSON to false
	I0918 17:03:57.596151   98925 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":2789,"bootTime":1758212249,"procs":193,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 17:03:57.596237   98925 start.go:140] virtualization: kvm guest
	I0918 17:03:57.598717   98925 out.go:179] * [ha-078118] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 17:03:57.600208   98925 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 17:03:57.600207   98925 notify.go:220] Checking for updates...
	I0918 17:03:57.602648   98925 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 17:03:57.604010   98925 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:03:57.608766   98925 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 17:03:57.610424   98925 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 17:03:57.611661   98925 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 17:03:57.613545   98925 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:03:57.614250   98925 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 17:03:57.638851   98925 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 17:03:57.638983   98925 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:03:57.695587   98925 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:0 ContainersPaused:0 ContainersStopped:3 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 17:03:57.684953795 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:03:57.695706   98925 docker.go:318] overlay module found
	I0918 17:03:57.698232   98925 out.go:179] * Using the docker driver based on existing profile
	I0918 17:03:57.699567   98925 start.go:304] selected driver: docker
	I0918 17:03:57.699584   98925 start.go:924] validating driver "docker" against &{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNam
es:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:f
alse logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs
: AutoPauseInterval:1m0s}
	I0918 17:03:57.699699   98925 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 17:03:57.699788   98925 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:03:57.758843   98925 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:0 ContainersPaused:0 ContainersStopped:3 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:24 OomKillDisable:false NGoroutines:45 SystemTime:2025-09-18 17:03:57.74842303 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[ma
p[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:03:57.759422   98925 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:03:57.759451   98925 cni.go:84] Creating CNI manager for ""
	I0918 17:03:57.759497   98925 cni.go:136] multinode detected (3 nodes found), recommending kindnet
	I0918 17:03:57.759585   98925 start.go:348] cluster config:
	{Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: N
etworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:fal
se nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:03:57.761857   98925 out.go:179] * Starting "ha-078118" primary control-plane node in "ha-078118" cluster
	I0918 17:03:57.763122   98925 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:03:57.764409   98925 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:03:57.765526   98925 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:03:57.765563   98925 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:03:57.765569   98925 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
	I0918 17:03:57.765672   98925 cache.go:58] Caching tarball of preloaded images
	I0918 17:03:57.765752   98925 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:03:57.765763   98925 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:03:57.765873   98925 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:03:57.785986   98925 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:03:57.786007   98925 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:03:57.786022   98925 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:03:57.786044   98925 start.go:360] acquireMachinesLock for ha-078118: {Name:mk24a1b2c9ed1c42e9ffd635727b36c75401a437 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:03:57.786093   98925 start.go:364] duration metric: took 36.376µs to acquireMachinesLock for "ha-078118"
	I0918 17:03:57.786122   98925 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:03:57.786126   98925 fix.go:54] fixHost starting: 
	I0918 17:03:57.786320   98925 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:03:57.804531   98925 fix.go:112] recreateIfNeeded on ha-078118: state=Stopped err=<nil>
	W0918 17:03:57.804560   98925 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:03:57.806679   98925 out.go:252] * Restarting existing docker container for "ha-078118" ...
	I0918 17:03:57.806737   98925 cli_runner.go:164] Run: docker start ha-078118
	I0918 17:03:58.041262   98925 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:03:58.060595   98925 kic.go:430] container "ha-078118" state is running.
	I0918 17:03:58.061033   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:03:58.080513   98925 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:03:58.080761   98925 machine.go:93] provisionDockerMachine start ...
	I0918 17:03:58.080833   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:03:58.100738   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:03:58.101016   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32828 <nil> <nil>}
	I0918 17:03:58.101029   98925 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:03:58.101685   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52750->127.0.0.1:32828: read: connection reset by peer
	I0918 17:04:01.238733   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 17:04:01.238763   98925 ubuntu.go:182] provisioning hostname "ha-078118"
	I0918 17:04:01.238834   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:04:01.258055   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:04:01.258346   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32828 <nil> <nil>}
	I0918 17:04:01.258364   98925 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118 && echo "ha-078118" | sudo tee /etc/hostname
	I0918 17:04:01.407711   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118
	
	I0918 17:04:01.407786   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:04:01.427630   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:04:01.427847   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32828 <nil> <nil>}
	I0918 17:04:01.427868   98925 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:04:01.565143   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:04:01.565174   98925 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:04:01.565192   98925 ubuntu.go:190] setting up certificates
	I0918 17:04:01.565200   98925 provision.go:84] configureAuth start
	I0918 17:04:01.565260   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:04:01.583813   98925 provision.go:143] copyHostCerts
	I0918 17:04:01.583854   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:04:01.583890   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:04:01.583911   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:04:01.583997   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:04:01.584130   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:04:01.584160   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:04:01.584168   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:04:01.584215   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:04:01.584303   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:04:01.584329   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:04:01.584336   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:04:01.584378   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:04:01.584491   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118 san=[127.0.0.1 192.168.49.2 ha-078118 localhost minikube]
	I0918 17:04:01.819899   98925 provision.go:177] copyRemoteCerts
	I0918 17:04:01.819969   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:04:01.820019   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:04:01.838846   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:04:01.936269   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 17:04:01.936338   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:04:01.961659   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 17:04:01.961712   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)
	I0918 17:04:01.988103   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 17:04:01.988195   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:04:02.014756   98925 provision.go:87] duration metric: took 449.541141ms to configureAuth
	I0918 17:04:02.014782   98925 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:04:02.015062   98925 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:04:02.015169   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:04:02.035480   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:04:02.035772   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32828 <nil> <nil>}
	I0918 17:04:02.035798   98925 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:04:02.330029   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:04:02.330064   98925 machine.go:96] duration metric: took 4.249285196s to provisionDockerMachine
	I0918 17:04:02.330078   98925 start.go:293] postStartSetup for "ha-078118" (driver="docker")
	I0918 17:04:02.330091   98925 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:04:02.330158   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:04:02.330196   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:04:02.351033   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:04:02.448754   98925 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:04:02.452309   98925 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:04:02.452338   98925 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:04:02.452345   98925 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:04:02.452351   98925 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:04:02.452363   98925 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:04:02.452421   98925 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:04:02.452533   98925 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:04:02.452547   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 17:04:02.452651   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:04:02.462223   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:04:02.487591   98925 start.go:296] duration metric: took 157.495588ms for postStartSetup
	I0918 17:04:02.487676   98925 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:04:02.487707   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:04:02.506069   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:04:02.598804   98925 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:04:02.603432   98925 fix.go:56] duration metric: took 4.817299115s for fixHost
	I0918 17:04:02.603451   98925 start.go:83] releasing machines lock for "ha-078118", held for 4.817337719s
	I0918 17:04:02.603531   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118
	I0918 17:04:02.621923   98925 ssh_runner.go:195] Run: cat /version.json
	I0918 17:04:02.621979   98925 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:04:02.621981   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:04:02.622088   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:04:02.640799   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:04:02.641940   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:04:02.804562   98925 ssh_runner.go:195] Run: systemctl --version
	I0918 17:04:02.809239   98925 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:04:02.948676   98925 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:04:02.953707   98925 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:04:02.963082   98925 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:04:02.963152   98925 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:04:02.973150   98925 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:04:02.973175   98925 start.go:495] detecting cgroup driver to use...
	I0918 17:04:02.973210   98925 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:04:02.973252   98925 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:04:02.985878   98925 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:04:02.997962   98925 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:04:02.998022   98925 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:04:03.011574   98925 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:04:03.023470   98925 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:04:03.090015   98925 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:04:03.156516   98925 docker.go:234] disabling docker service ...
	I0918 17:04:03.156570   98925 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:04:03.169081   98925 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:04:03.180644   98925 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:04:03.244437   98925 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:04:03.308493   98925 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:04:03.320106   98925 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:04:03.338047   98925 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:04:03.338121   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:03.348200   98925 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:04:03.348264   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:03.358132   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:03.368068   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:03.378226   98925 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:04:03.387878   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:03.398333   98925 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:03.408651   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:03.419278   98925 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:04:03.428742   98925 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:04:03.438161   98925 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:04:03.503358   98925 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:04:03.600553   98925 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:04:03.600607   98925 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:04:03.604332   98925 start.go:563] Will wait 60s for crictl version
	I0918 17:04:03.604381   98925 ssh_runner.go:195] Run: which crictl
	I0918 17:04:03.607979   98925 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:04:03.642240   98925 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 17:04:03.642310   98925 ssh_runner.go:195] Run: crio --version
	I0918 17:04:03.677761   98925 ssh_runner.go:195] Run: crio --version
	I0918 17:04:03.715740   98925 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 17:04:03.716941   98925 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:04:03.733826   98925 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 17:04:03.737760   98925 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:04:03.750310   98925 kubeadm.go:875] updating cluster {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIP
s:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:fa
lse metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterv
al:1m0s} ...
	I0918 17:04:03.750492   98925 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:04:03.750579   98925 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:04:03.794898   98925 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:04:03.794921   98925 crio.go:433] Images already preloaded, skipping extraction
	I0918 17:04:03.794967   98925 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:04:03.829067   98925 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:04:03.829088   98925 cache_images.go:85] Images are preloaded, skipping loading
	I0918 17:04:03.829095   98925 kubeadm.go:926] updating node { 192.168.49.2 8443 v1.34.0 crio true true} ...
	I0918 17:04:03.829197   98925 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 17:04:03.829256   98925 ssh_runner.go:195] Run: crio config
	I0918 17:04:03.872946   98925 cni.go:84] Creating CNI manager for ""
	I0918 17:04:03.872968   98925 cni.go:136] multinode detected (3 nodes found), recommending kindnet
	I0918 17:04:03.872979   98925 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0918 17:04:03.873002   98925 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.34.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-078118 NodeName:ha-078118 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manif
ests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0918 17:04:03.873121   98925 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "ha-078118"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.49.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	kubernetesVersion: v1.34.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: systemd
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0918 17:04:03.873140   98925 kube-vip.go:115] generating kube-vip config ...
	I0918 17:04:03.873180   98925 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 17:04:03.885882   98925 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:04:03.885998   98925 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 17:04:03.886049   98925 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 17:04:03.895467   98925 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 17:04:03.895549   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests
	I0918 17:04:03.904754   98925 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (359 bytes)
	I0918 17:04:03.922634   98925 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 17:04:03.940888   98925 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2205 bytes)
	I0918 17:04:03.959544   98925 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 17:04:03.977715   98925 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 17:04:03.981411   98925 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:04:03.993676   98925 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:04:04.061078   98925 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:04:04.085058   98925 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.2
	I0918 17:04:04.085078   98925 certs.go:194] generating shared ca certs ...
	I0918 17:04:04.085097   98925 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:04:04.085263   98925 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 17:04:04.085339   98925 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 17:04:04.085354   98925 certs.go:256] generating profile certs ...
	I0918 17:04:04.085451   98925 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 17:04:04.085480   98925 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.b995b0dc
	I0918 17:04:04.085496   98925 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.b995b0dc with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2 192.168.49.3 192.168.49.254]
	I0918 17:04:04.160148   98925 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.b995b0dc ...
	I0918 17:04:04.160174   98925 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.b995b0dc: {Name:mkb34757c7a4eb6e083919115700eaf7e30d8097 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:04:04.160346   98925 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.b995b0dc ...
	I0918 17:04:04.160366   98925 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.b995b0dc: {Name:mk6902309b7ede2f8f875fb920044a4cd0c4dde0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:04:04.160464   98925 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt.b995b0dc -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt
	I0918 17:04:04.160666   98925 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.b995b0dc -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key
	I0918 17:04:04.160877   98925 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 17:04:04.160894   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 17:04:04.160907   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 17:04:04.160922   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 17:04:04.160946   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 17:04:04.160964   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 17:04:04.160982   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 17:04:04.160996   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 17:04:04.161023   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 17:04:04.161098   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 17:04:04.161139   98925 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 17:04:04.161153   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 17:04:04.161189   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 17:04:04.161220   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 17:04:04.161249   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 17:04:04.161315   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:04:04.161363   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 17:04:04.161386   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:04:04.161400   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 17:04:04.161931   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 17:04:04.188732   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 17:04:04.214486   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 17:04:04.239835   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 17:04:04.265084   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I0918 17:04:04.291194   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 17:04:04.316780   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 17:04:04.341677   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 17:04:04.367789   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 17:04:04.393742   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 17:04:04.419125   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 17:04:04.445672   98925 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0918 17:04:04.465313   98925 ssh_runner.go:195] Run: openssl version
	I0918 17:04:04.471226   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 17:04:04.481994   98925 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 17:04:04.485914   98925 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 17:04:04.485972   98925 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 17:04:04.492901   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 17:04:04.502114   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 17:04:04.512379   98925 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 17:04:04.516044   98925 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 17:04:04.516109   98925 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 17:04:04.522965   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 17:04:04.532481   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 17:04:04.542631   98925 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:04:04.546239   98925 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:04:04.546309   98925 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:04:04.553421   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 17:04:04.562895   98925 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 17:04:04.566588   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0918 17:04:04.573365   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0918 17:04:04.580853   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0918 17:04:04.588465   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0918 17:04:04.595699   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0918 17:04:04.602651   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0918 17:04:04.609622   98925 kubeadm.go:392] StartCluster: {Name:ha-078118 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[
] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m04 IP: Port:0 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:false Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false
metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:
1m0s}
	I0918 17:04:04.609792   98925 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0918 17:04:04.609870   98925 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0918 17:04:04.652226   98925 cri.go:89] found id: ""
	I0918 17:04:04.652287   98925 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0918 17:04:04.663357   98925 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0918 17:04:04.663379   98925 kubeadm.go:589] restartPrimaryControlPlane start ...
	I0918 17:04:04.663429   98925 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0918 17:04:04.675832   98925 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:04:04.676375   98925 kubeconfig.go:47] verify endpoint returned: get endpoint: "ha-078118" does not appear in /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:04:04.676567   98925 kubeconfig.go:62] /home/jenkins/minikube-integration/20370-7845/kubeconfig needs updating (will repair): [kubeconfig missing "ha-078118" cluster setting kubeconfig missing "ha-078118" context setting]
	I0918 17:04:04.677032   98925 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:04:04.678037   98925 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, Us
erAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0918 17:04:04.678561   98925 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false
	I0918 17:04:04.678582   98925 envvar.go:172] "Feature gate default state" feature="InOrderInformers" enabled=true
	I0918 17:04:04.678590   98925 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false
	I0918 17:04:04.678596   98925 envvar.go:172] "Feature gate default state" feature="ClientsAllowCBOR" enabled=false
	I0918 17:04:04.678602   98925 envvar.go:172] "Feature gate default state" feature="ClientsPreferCBOR" enabled=false
	I0918 17:04:04.678638   98925 cert_rotation.go:141] "Starting client certificate rotation controller" logger="tls-transport-cache"
	I0918 17:04:04.679022   98925 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0918 17:04:04.691527   98925 kubeadm.go:626] The running cluster does not require reconfiguration: 192.168.49.2
	I0918 17:04:04.691555   98925 kubeadm.go:593] duration metric: took 28.168236ms to restartPrimaryControlPlane
	I0918 17:04:04.691566   98925 kubeadm.go:394] duration metric: took 81.955818ms to StartCluster
	I0918 17:04:04.691588   98925 settings.go:142] acquiring lock: {Name:mk72fea03aefe901db9522a467405d86665fedd0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:04:04.691651   98925 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:04:04.692430   98925 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:04:04.692711   98925 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:04:04.692737   98925 start.go:241] waiting for startup goroutines ...
	I0918 17:04:04.692747   98925 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0918 17:04:04.693214   98925 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:04:04.695176   98925 out.go:179] * Enabled addons: 
	I0918 17:04:04.697268   98925 addons.go:514] duration metric: took 4.514845ms for enable addons: enabled=[]
	I0918 17:04:04.697308   98925 start.go:246] waiting for cluster config update ...
	I0918 17:04:04.697318   98925 start.go:255] writing updated cluster config ...
	I0918 17:04:04.699124   98925 out.go:203] 
	I0918 17:04:04.701411   98925 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:04:04.701544   98925 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:04:04.703314   98925 out.go:179] * Starting "ha-078118-m02" control-plane node in "ha-078118" cluster
	I0918 17:04:04.704895   98925 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:04:04.707334   98925 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:04:04.708690   98925 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:04:04.708718   98925 cache.go:58] Caching tarball of preloaded images
	I0918 17:04:04.708765   98925 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:04:04.708842   98925 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:04:04.708853   98925 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:04:04.708994   98925 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:04:04.737396   98925 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:04:04.737425   98925 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:04:04.737463   98925 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:04:04.737554   98925 start.go:360] acquireMachinesLock for ha-078118-m02: {Name:mk65f6a883861f2032241e1132c63effea2ab61f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:04:04.737627   98925 start.go:364] duration metric: took 48.809µs to acquireMachinesLock for "ha-078118-m02"
	I0918 17:04:04.737685   98925 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:04:04.737696   98925 fix.go:54] fixHost starting: m02
	I0918 17:04:04.738019   98925 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:04:04.761465   98925 fix.go:112] recreateIfNeeded on ha-078118-m02: state=Stopped err=<nil>
	W0918 17:04:04.761496   98925 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:04:04.763421   98925 out.go:252] * Restarting existing docker container for "ha-078118-m02" ...
	I0918 17:04:04.763513   98925 cli_runner.go:164] Run: docker start ha-078118-m02
	I0918 17:04:05.047202   98925 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:04:05.070655   98925 kic.go:430] container "ha-078118-m02" state is running.
	I0918 17:04:05.071012   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:04:05.091008   98925 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:04:05.091287   98925 machine.go:93] provisionDockerMachine start ...
	I0918 17:04:05.091350   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:05.111230   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:04:05.111458   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32833 <nil> <nil>}
	I0918 17:04:05.111470   98925 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:04:05.112079   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:51368->127.0.0.1:32833: read: connection reset by peer
	I0918 17:04:08.248492   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 17:04:08.248541   98925 ubuntu.go:182] provisioning hostname "ha-078118-m02"
	I0918 17:04:08.248592   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:08.269007   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:04:08.269256   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32833 <nil> <nil>}
	I0918 17:04:08.269275   98925 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m02 && echo "ha-078118-m02" | sudo tee /etc/hostname
	I0918 17:04:08.418819   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-078118-m02
	
	I0918 17:04:08.418914   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:08.437638   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:04:08.437882   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32833 <nil> <nil>}
	I0918 17:04:08.437900   98925 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m02' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m02/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m02' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:04:08.588208   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:04:08.588238   98925 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:04:08.588258   98925 ubuntu.go:190] setting up certificates
	I0918 17:04:08.588270   98925 provision.go:84] configureAuth start
	I0918 17:04:08.588330   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:04:08.611747   98925 provision.go:143] copyHostCerts
	I0918 17:04:08.611788   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:04:08.611825   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:04:08.611837   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:04:08.611927   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:04:08.612029   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:04:08.612063   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:04:08.612073   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:04:08.612116   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:04:08.612243   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:04:08.612286   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:04:08.612295   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:04:08.612338   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:04:08.612417   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m02 san=[127.0.0.1 192.168.49.3 ha-078118-m02 localhost minikube]
	I0918 17:04:08.764892   98925 provision.go:177] copyRemoteCerts
	I0918 17:04:08.764963   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:04:08.765014   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:08.788345   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32833 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:04:08.898920   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0918 17:04:08.898989   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:04:08.932774   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0918 17:04:08.932832   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
	I0918 17:04:08.970263   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0918 17:04:08.970327   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:04:09.006703   98925 provision.go:87] duration metric: took 418.417936ms to configureAuth
	I0918 17:04:09.006746   98925 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:04:09.007001   98925 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:04:09.007123   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:09.028985   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:04:09.029244   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32833 <nil> <nil>}
	I0918 17:04:09.029264   98925 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:04:09.459889   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:04:09.459917   98925 machine.go:96] duration metric: took 4.36861554s to provisionDockerMachine
	I0918 17:04:09.459931   98925 start.go:293] postStartSetup for "ha-078118-m02" (driver="docker")
	I0918 17:04:09.459944   98925 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:04:09.460020   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:04:09.460072   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:09.483808   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32833 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:04:09.604387   98925 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:04:09.609911   98925 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:04:09.609950   98925 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:04:09.609963   98925 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:04:09.609970   98925 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:04:09.609984   98925 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:04:09.610044   98925 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:04:09.610164   98925 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:04:09.610174   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /etc/ssl/certs/113682.pem
	I0918 17:04:09.610292   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:04:09.625217   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:04:09.664622   98925 start.go:296] duration metric: took 204.673856ms for postStartSetup
	I0918 17:04:09.664715   98925 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:04:09.664769   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:09.685164   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32833 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:04:09.781054   98925 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:04:09.785698   98925 fix.go:56] duration metric: took 5.047998942s for fixHost
	I0918 17:04:09.785717   98925 start.go:83] releasing machines lock for "ha-078118-m02", held for 5.0480764s
	I0918 17:04:09.785790   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m02
	I0918 17:04:09.805706   98925 out.go:179] * Found network options:
	I0918 17:04:09.807043   98925 out.go:179]   - NO_PROXY=192.168.49.2
	W0918 17:04:09.808236   98925 proxy.go:120] fail to check proxy env: Error ip not in block
	W0918 17:04:09.808284   98925 proxy.go:120] fail to check proxy env: Error ip not in block
	I0918 17:04:09.808345   98925 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:04:09.808378   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:09.808401   98925 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:04:09.808463   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m02
	I0918 17:04:09.826545   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32833 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:04:09.826797   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32833 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m02/id_rsa Username:docker}
	I0918 17:04:10.055703   98925 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:04:10.060676   98925 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:04:10.070388   98925 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:04:10.070470   98925 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:04:10.080620   98925 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:04:10.080643   98925 start.go:495] detecting cgroup driver to use...
	I0918 17:04:10.080672   98925 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:04:10.080709   98925 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:04:10.094054   98925 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:04:10.105732   98925 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:04:10.105786   98925 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:04:10.118591   98925 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:04:10.130249   98925 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:04:10.234830   98925 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:04:10.343115   98925 docker.go:234] disabling docker service ...
	I0918 17:04:10.343212   98925 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:04:10.356190   98925 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:04:10.367993   98925 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:04:10.463003   98925 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:04:10.582142   98925 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:04:10.599981   98925 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:04:10.630631   98925 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:04:10.630701   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:10.651513   98925 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:04:10.651657   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:10.673539   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:10.694103   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:10.713110   98925 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:04:10.729312   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:10.746714   98925 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:10.763191   98925 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:04:10.784627   98925 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:04:10.799255   98925 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:04:10.810939   98925 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:04:10.954859   98925 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:05:41.347134   98925 ssh_runner.go:235] Completed: sudo systemctl restart crio: (1m30.392221643s)
	I0918 17:05:41.347190   98925 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:05:41.347242   98925 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:05:41.351691   98925 start.go:563] Will wait 60s for crictl version
	I0918 17:05:41.351748   98925 ssh_runner.go:195] Run: which crictl
	I0918 17:05:41.355515   98925 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:05:41.391779   98925 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 17:05:41.391858   98925 ssh_runner.go:195] Run: crio --version
	I0918 17:05:41.427005   98925 ssh_runner.go:195] Run: crio --version
	I0918 17:05:41.465310   98925 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 17:05:41.466762   98925 out.go:179]   - env NO_PROXY=192.168.49.2
	I0918 17:05:41.468185   98925 cli_runner.go:164] Run: docker network inspect ha-078118 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:05:41.486222   98925 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0918 17:05:41.490481   98925 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:05:41.502788   98925 mustload.go:65] Loading cluster: ha-078118
	I0918 17:05:41.503008   98925 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:05:41.503241   98925 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:05:41.522395   98925 host.go:66] Checking if "ha-078118" exists ...
	I0918 17:05:41.522734   98925 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118 for IP: 192.168.49.3
	I0918 17:05:41.522759   98925 certs.go:194] generating shared ca certs ...
	I0918 17:05:41.522779   98925 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:05:41.522926   98925 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 17:05:41.522982   98925 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 17:05:41.523001   98925 certs.go:256] generating profile certs ...
	I0918 17:05:41.523150   98925 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key
	I0918 17:05:41.523233   98925 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key.77376cdd
	I0918 17:05:41.523285   98925 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key
	I0918 17:05:41.523298   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0918 17:05:41.523312   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0918 17:05:41.523325   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0918 17:05:41.523338   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0918 17:05:41.523350   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0918 17:05:41.523368   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0918 17:05:41.523380   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0918 17:05:41.523398   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0918 17:05:41.523495   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 17:05:41.523556   98925 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 17:05:41.523567   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 17:05:41.523599   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 17:05:41.523624   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 17:05:41.523644   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 17:05:41.523681   98925 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:05:41.523711   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:05:41.523722   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem -> /usr/share/ca-certificates/11368.pem
	I0918 17:05:41.523736   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> /usr/share/ca-certificates/113682.pem
	I0918 17:05:41.523780   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118
	I0918 17:05:41.542943   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32828 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118/id_rsa Username:docker}
	I0918 17:05:41.632805   98925 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub
	I0918 17:05:41.637040   98925 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)
	I0918 17:05:41.650599   98925 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key
	I0918 17:05:41.654432   98925 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)
	I0918 17:05:41.668031   98925 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt
	I0918 17:05:41.671942   98925 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)
	I0918 17:05:41.685644   98925 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key
	I0918 17:05:41.689404   98925 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)
	I0918 17:05:41.703009   98925 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt
	I0918 17:05:41.707200   98925 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)
	I0918 17:05:41.720273   98925 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key
	I0918 17:05:41.724095   98925 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)
	I0918 17:05:41.737178   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 17:05:41.764232   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 17:05:41.790974   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 17:05:41.817439   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 17:05:41.843145   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1432 bytes)
	I0918 17:05:41.870665   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 17:05:41.897068   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 17:05:41.922855   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 17:05:41.948562   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 17:05:41.976113   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 17:05:42.003777   98925 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 17:05:42.031230   98925 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)
	I0918 17:05:42.052629   98925 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)
	I0918 17:05:42.071817   98925 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)
	I0918 17:05:42.091629   98925 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)
	I0918 17:05:42.111814   98925 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)
	I0918 17:05:42.131120   98925 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)
	I0918 17:05:42.150925   98925 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)
	I0918 17:05:42.170339   98925 ssh_runner.go:195] Run: openssl version
	I0918 17:05:42.177305   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 17:05:42.188103   98925 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 17:05:42.191993   98925 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 17:05:42.192052   98925 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 17:05:42.199271   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 17:05:42.208980   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 17:05:42.220181   98925 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:05:42.224204   98925 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:05:42.224259   98925 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:05:42.231241   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 17:05:42.241058   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 17:05:42.251492   98925 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 17:05:42.255774   98925 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 17:05:42.255831   98925 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 17:05:42.262833   98925 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 17:05:42.272374   98925 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 17:05:42.276032   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0918 17:05:42.282782   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0918 17:05:42.289559   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0918 17:05:42.296669   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0918 17:05:42.303973   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0918 17:05:42.310810   98925 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0918 17:05:42.317723   98925 kubeadm.go:926] updating node {m02 192.168.49.3 8443 v1.34.0 crio true true} ...
	I0918 17:05:42.317845   98925 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=ha-078118-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.3
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:ha-078118 Namespace:default APIServerHAVIP:192.168.49.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 17:05:42.317873   98925 kube-vip.go:115] generating kube-vip config ...
	I0918 17:05:42.317927   98925 ssh_runner.go:195] Run: sudo sh -c "lsmod | grep ip_vs"
	I0918 17:05:42.330738   98925 kube-vip.go:163] giving up enabling control-plane load-balancing as ipvs kernel modules appears not to be available: sudo sh -c "lsmod | grep ip_vs": Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:05:42.330802   98925 kube-vip.go:137] kube-vip config:
	apiVersion: v1
	kind: Pod
	metadata:
	  creationTimestamp: null
	  name: kube-vip
	  namespace: kube-system
	spec:
	  containers:
	  - args:
	    - manager
	    env:
	    - name: vip_arp
	      value: "true"
	    - name: port
	      value: "8443"
	    - name: vip_nodename
	      valueFrom:
	        fieldRef:
	          fieldPath: spec.nodeName
	    - name: vip_interface
	      value: eth0
	    - name: vip_cidr
	      value: "32"
	    - name: dns_mode
	      value: first
	    - name: cp_enable
	      value: "true"
	    - name: cp_namespace
	      value: kube-system
	    - name: vip_leaderelection
	      value: "true"
	    - name: vip_leasename
	      value: plndr-cp-lock
	    - name: vip_leaseduration
	      value: "5"
	    - name: vip_renewdeadline
	      value: "3"
	    - name: vip_retryperiod
	      value: "1"
	    - name: address
	      value: 192.168.49.254
	    - name: prometheus_server
	      value: :2112
	    image: ghcr.io/kube-vip/kube-vip:v1.0.0
	    imagePullPolicy: IfNotPresent
	    name: kube-vip
	    resources: {}
	    securityContext:
	      capabilities:
	        add:
	        - NET_ADMIN
	        - NET_RAW
	    volumeMounts:
	    - mountPath: /etc/kubernetes/admin.conf
	      name: kubeconfig
	  hostAliases:
	  - hostnames:
	    - kubernetes
	    ip: 127.0.0.1
	  hostNetwork: true
	  volumes:
	  - hostPath:
	      path: "/etc/kubernetes/admin.conf"
	    name: kubeconfig
	status: {}
	I0918 17:05:42.330850   98925 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 17:05:42.340207   98925 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 17:05:42.340276   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests
	I0918 17:05:42.350019   98925 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (363 bytes)
	I0918 17:05:42.368663   98925 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 17:05:42.387086   98925 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1358 bytes)
	I0918 17:05:42.406088   98925 ssh_runner.go:195] Run: grep 192.168.49.254	control-plane.minikube.internal$ /etc/hosts
	I0918 17:05:42.409827   98925 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:05:42.421529   98925 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:05:42.531439   98925 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:05:42.544241   98925 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.49.3 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:05:42.544529   98925 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:05:42.546649   98925 out.go:179] * Verifying Kubernetes components...
	I0918 17:05:42.547817   98925 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:05:42.660699   98925 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:05:42.673813   98925 kapi.go:59] client config for ha-078118: &rest.Config{Host:"https://192.168.49.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.crt", KeyFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/client.key", CAFile:"/home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},
UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x27f41c0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), WarningHandlerWithContext:rest.WarningHandlerWithContext(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	W0918 17:05:42.673894   98925 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.49.254:8443 with https://192.168.49.2:8443
	I0918 17:05:42.674300   98925 node_ready.go:35] waiting up to 6m0s for node "ha-078118-m02" to be "Ready" ...
	W0918 17:05:44.679163   98925 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 17:05:47.178363   98925 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 17:05:49.178592   98925 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	W0918 17:05:51.677997   98925 node_ready.go:57] node "ha-078118-m02" has "Ready":"False" status (will retry)
	I0918 17:05:52.177644   98925 node_ready.go:49] node "ha-078118-m02" is "Ready"
	I0918 17:05:52.177667   98925 node_ready.go:38] duration metric: took 9.503338102s for node "ha-078118-m02" to be "Ready" ...
	I0918 17:05:52.177679   98925 api_server.go:52] waiting for apiserver process to appear ...
	I0918 17:05:52.177724   98925 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:05:52.189641   98925 api_server.go:72] duration metric: took 9.645348546s to wait for apiserver process to appear ...
	I0918 17:05:52.189671   98925 api_server.go:88] waiting for apiserver healthz status ...
	I0918 17:05:52.189692   98925 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0918 17:05:52.193626   98925 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0918 17:05:52.194554   98925 api_server.go:141] control plane version: v1.34.0
	I0918 17:05:52.194574   98925 api_server.go:131] duration metric: took 4.897305ms to wait for apiserver health ...
	I0918 17:05:52.194582   98925 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 17:05:52.199386   98925 system_pods.go:59] 17 kube-system pods found
	I0918 17:05:52.199420   98925 system_pods.go:61] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 17:05:52.199427   98925 system_pods.go:61] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 17:05:52.199433   98925 system_pods.go:61] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 17:05:52.199436   98925 system_pods.go:61] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 17:05:52.199440   98925 system_pods.go:61] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 17:05:52.199445   98925 system_pods.go:61] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 17:05:52.199450   98925 system_pods.go:61] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 17:05:52.199458   98925 system_pods.go:61] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 17:05:52.199463   98925 system_pods.go:61] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 17:05:52.199469   98925 system_pods.go:61] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 17:05:52.199477   98925 system_pods.go:61] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 17:05:52.199483   98925 system_pods.go:61] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 17:05:52.199489   98925 system_pods.go:61] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 17:05:52.199493   98925 system_pods.go:61] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 17:05:52.199513   98925 system_pods.go:61] "kube-vip-ha-078118" [d3c28c72-f791-4e3f-bd5f-91fc9bcb1fee] Running
	I0918 17:05:52.199518   98925 system_pods.go:61] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 17:05:52.199527   98925 system_pods.go:61] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 17:05:52.199535   98925 system_pods.go:74] duration metric: took 4.946851ms to wait for pod list to return data ...
	I0918 17:05:52.199544   98925 default_sa.go:34] waiting for default service account to be created ...
	I0918 17:05:52.202524   98925 default_sa.go:45] found service account: "default"
	I0918 17:05:52.202545   98925 default_sa.go:55] duration metric: took 2.993182ms for default service account to be created ...
	I0918 17:05:52.202554   98925 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 17:05:52.206107   98925 system_pods.go:86] 17 kube-system pods found
	I0918 17:05:52.206133   98925 system_pods.go:89] "coredns-66bc5c9577-g9xk6" [74f8e6bc-8929-43a4-94fa-29301c1d703a] Running
	I0918 17:05:52.206139   98925 system_pods.go:89] "coredns-66bc5c9577-q42l7" [c21094f1-585a-4109-b526-3a115d45f35f] Running
	I0918 17:05:52.206143   98925 system_pods.go:89] "etcd-ha-078118" [fe2216c8-ca81-413d-9bb0-dc8693a4b367] Running
	I0918 17:05:52.206146   98925 system_pods.go:89] "etcd-ha-078118-m02" [98378965-966c-4bee-9a37-ce84514102cf] Running
	I0918 17:05:52.206150   98925 system_pods.go:89] "kindnet-jnlbr" [414e87e9-225c-41f4-9a90-177bf7817b25] Running
	I0918 17:05:52.206153   98925 system_pods.go:89] "kindnet-vqp76" [ccbd1a85-07b6-4166-8822-2b3617723baf] Running
	I0918 17:05:52.206156   98925 system_pods.go:89] "kube-apiserver-ha-078118" [7d054153-088f-4fef-a314-31791f2b5e63] Running
	I0918 17:05:52.206160   98925 system_pods.go:89] "kube-apiserver-ha-078118-m02" [dd5865a8-6cd1-4541-b23b-746cb0e2ba85] Running
	I0918 17:05:52.206163   98925 system_pods.go:89] "kube-controller-manager-ha-078118" [bb01f41e-00df-42a6-99b9-754f28226c16] Running
	I0918 17:05:52.206169   98925 system_pods.go:89] "kube-controller-manager-ha-078118-m02" [d76e689c-6cb0-4384-ba9a-4f6ed0217805] Running
	I0918 17:05:52.206173   98925 system_pods.go:89] "kube-proxy-b98xh" [688140e3-0820-4d55-8092-45fc70c4f6fc] Running
	I0918 17:05:52.206176   98925 system_pods.go:89] "kube-proxy-t5wdg" [3332c298-2ec7-4dd8-9926-b38815b4bd8d] Running
	I0918 17:05:52.206179   98925 system_pods.go:89] "kube-scheduler-ha-078118" [d74e90bf-f675-415a-aa34-f41bebee7b1e] Running
	I0918 17:05:52.206182   98925 system_pods.go:89] "kube-scheduler-ha-078118-m02" [645fd274-afc2-4e1d-b781-7947a00f91a9] Running
	I0918 17:05:52.206185   98925 system_pods.go:89] "kube-vip-ha-078118" [d3c28c72-f791-4e3f-bd5f-91fc9bcb1fee] Running
	I0918 17:05:52.206188   98925 system_pods.go:89] "kube-vip-ha-078118-m02" [14988b1e-850e-46d6-8f48-a232b5fc11f3] Running
	I0918 17:05:52.206191   98925 system_pods.go:89] "storage-provisioner" [b8b82cbe-871b-4734-860b-aacf9e83acb0] Running
	I0918 17:05:52.206196   98925 system_pods.go:126] duration metric: took 3.63714ms to wait for k8s-apps to be running ...
	I0918 17:05:52.206205   98925 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 17:05:52.206246   98925 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:05:52.218830   98925 system_svc.go:56] duration metric: took 12.606279ms WaitForService to wait for kubelet
	I0918 17:05:52.218866   98925 kubeadm.go:578] duration metric: took 9.674575514s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:05:52.218886   98925 node_conditions.go:102] verifying NodePressure condition ...
	I0918 17:05:52.222581   98925 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:05:52.222611   98925 node_conditions.go:123] node cpu capacity is 8
	I0918 17:05:52.222629   98925 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:05:52.222634   98925 node_conditions.go:123] node cpu capacity is 8
	I0918 17:05:52.222641   98925 node_conditions.go:105] duration metric: took 3.748884ms to run NodePressure ...
	I0918 17:05:52.222656   98925 start.go:241] waiting for startup goroutines ...
	I0918 17:05:52.222683   98925 start.go:255] writing updated cluster config ...
	I0918 17:05:52.225578   98925 out.go:203] 
	I0918 17:05:52.227263   98925 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:05:52.227358   98925 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:05:52.229196   98925 out.go:179] * Starting "ha-078118-m04" worker node in "ha-078118" cluster
	I0918 17:05:52.231011   98925 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:05:52.232562   98925 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:05:52.233828   98925 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:05:52.233854   98925 cache.go:58] Caching tarball of preloaded images
	I0918 17:05:52.233932   98925 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:05:52.233956   98925 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:05:52.233964   98925 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:05:52.234054   98925 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:05:52.255101   98925 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:05:52.255122   98925 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:05:52.255141   98925 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:05:52.255171   98925 start.go:360] acquireMachinesLock for ha-078118-m04: {Name:mkdcee71069a15ce1d36f6cf5f43097fe7468c48 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:05:52.255239   98925 start.go:364] duration metric: took 48.479µs to acquireMachinesLock for "ha-078118-m04"
	I0918 17:05:52.255271   98925 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:05:52.255282   98925 fix.go:54] fixHost starting: m04
	I0918 17:05:52.255490   98925 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:05:52.274190   98925 fix.go:112] recreateIfNeeded on ha-078118-m04: state=Stopped err=<nil>
	W0918 17:05:52.274229   98925 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:05:52.276134   98925 out.go:252] * Restarting existing docker container for "ha-078118-m04" ...
	I0918 17:05:52.276219   98925 cli_runner.go:164] Run: docker start ha-078118-m04
	I0918 17:05:52.534028   98925 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:05:52.553831   98925 kic.go:430] container "ha-078118-m04" state is running.
	I0918 17:05:52.554236   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:05:52.575159   98925 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/ha-078118/config.json ...
	I0918 17:05:52.575538   98925 machine.go:93] provisionDockerMachine start ...
	I0918 17:05:52.575622   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:05:52.597102   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:05:52.597346   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32838 <nil> <nil>}
	I0918 17:05:52.597358   98925 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:05:52.598003   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:52942->127.0.0.1:32838: read: connection reset by peer
	I0918 17:05:55.634175   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:05:58.670550   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:01.708553   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:04.744918   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:07.780591   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:10.818323   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:13.855234   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:16.893073   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:19.929815   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:22.966522   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:26.002302   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:29.039127   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:32.076960   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:35.113986   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:38.149759   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:41.187141   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:44.222787   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:47.260408   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:50.297588   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:53.333910   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:56.370213   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:06:59.407000   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:02.444365   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:05.479905   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:08.515842   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:11.552931   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:14.589522   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:17.626638   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:20.663745   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:23.699895   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:26.736782   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:29.774311   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:32.809768   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:35.846456   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:38.884332   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:41.921241   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:44.957195   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:47.993908   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:51.032626   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:54.068384   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:07:57.105890   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:00.143675   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:03.180125   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:06.217085   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:09.253450   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:12.291017   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:15.326374   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:18.361896   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:21.399667   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:24.437162   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:27.475160   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:30.511774   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:33.548566   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:36.585383   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:39.621897   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:42.659283   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:45.694870   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:48.731564   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:51.768889   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:54.769855   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:08:54.769889   98925 ubuntu.go:182] provisioning hostname "ha-078118-m04"
	I0918 17:08:54.769959   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:08:54.788837   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:08:54.789114   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32838 <nil> <nil>}
	I0918 17:08:54.789148   98925 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m04 && echo "ha-078118-m04" | sudo tee /etc/hostname
	I0918 17:08:54.824590   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:08:57.861147   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:00.898100   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:03.934426   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:06.972764   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:10.011415   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:13.047413   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:16.084176   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:19.120974   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:22.158597   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:25.195764   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:28.231869   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:31.268697   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:34.304934   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:37.342400   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:40.379002   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:43.414801   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:46.450596   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:49.488045   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:52.524000   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:55.560573   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:09:58.597044   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:01.634548   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:04.672683   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:07.709978   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:10.747858   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:13.784978   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:16.822136   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:19.859647   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:22.896452   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:25.932115   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:28.968739   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:32.007168   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:35.043833   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:38.080543   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:41.117724   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:44.153958   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:47.192024   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:50.229203   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:53.264678   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:56.302007   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:10:59.338648   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:02.376277   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:05.411573   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:08.447479   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:11.485052   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:14.521797   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:17.559912   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:20.596792   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:23.634228   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:26.671462   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:29.709736   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:32.747315   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:35.784034   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:38.820804   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:41.857431   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:44.893862   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:47.929690   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:50.966600   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:54.003791   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:11:57.005612   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:11:57.005705   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:11:57.025591   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:11:57.025808   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32838 <nil> <nil>}
	I0918 17:11:57.025825   98925 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m04' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m04/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m04' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:11:57.061790   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:00.098689   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:03.134810   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:06.171350   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:09.208668   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:12.246362   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:15.282613   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:18.318965   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:21.357169   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:24.393483   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:27.429465   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:30.467239   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:33.503326   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:36.539551   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:39.577065   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:42.615043   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:45.651325   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:48.688024   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:51.724938   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:54.760195   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:12:57.797184   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:00.835178   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:03.871063   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:06.908796   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:09.946406   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:12.983597   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:16.020457   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:19.055927   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:22.092456   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:25.128953   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:28.165032   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:31.203910   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:34.240790   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:37.278940   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:40.316696   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:43.353386   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:46.388901   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:49.426100   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:52.463001   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:55.498818   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:13:58.536699   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:01.575055   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:04.611351   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:07.648283   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:10.685807   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:13.722198   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:16.760493   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:19.798480   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:22.834595   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:25.870876   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:28.906858   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:31.945170   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:34.981486   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:38.017085   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:41.054492   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:44.091544   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:47.128191   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:50.164676   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:53.200802   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:56.237111   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:59.238215   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:14:59.238287   98925 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:14:59.238320   98925 ubuntu.go:190] setting up certificates
	I0918 17:14:59.238335   98925 provision.go:84] configureAuth start
	I0918 17:14:59.238401   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:14:59.257482   98925 provision.go:143] copyHostCerts
	I0918 17:14:59.257535   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:14:59.257567   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:14:59.257573   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:14:59.257656   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:14:59.257756   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:14:59.257804   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:14:59.257815   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:14:59.257857   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:14:59.257984   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:14:59.258010   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:14:59.258016   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:14:59.258053   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:14:59.258128   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:14:59.380643   98925 provision.go:177] copyRemoteCerts
	I0918 17:14:59.380699   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:14:59.380741   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:14:59.398407   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:14:59.433425   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:59.433470   98925 retry.go:31] will retry after 268.35155ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:14:59.739537   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:14:59.739579   98925 retry.go:31] will retry after 461.787446ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:00.237031   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:00.237066   98925 retry.go:31] will retry after 393.307667ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:00.666200   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:00.666268   98925 retry.go:31] will retry after 170.568408ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:00.837750   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:00.855596   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:00.891558   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:00.891592   98925 retry.go:31] will retry after 314.580969ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:01.242485   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:01.242539   98925 retry.go:31] will retry after 523.845907ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:01.802191   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:01.802226   98925 retry.go:31] will retry after 838.778289ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:02.678361   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:02.678441   98925 provision.go:87] duration metric: took 3.440096954s to configureAuth
	W0918 17:15:02.678447   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:02.678459   98925 retry.go:31] will retry after 84.66µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:02.679728   98925 provision.go:84] configureAuth start
	I0918 17:15:02.679818   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:02.698388   98925 provision.go:143] copyHostCerts
	I0918 17:15:02.698428   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:02.698463   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:02.698473   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:02.698556   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:02.698643   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:02.698662   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:02.698669   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:02.698690   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:02.698735   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:02.698751   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:02.698757   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:02.698775   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:02.698826   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:02.871319   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:02.871385   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:02.871435   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:02.889297   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:02.925389   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:02.925415   98925 retry.go:31] will retry after 228.591069ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:03.190038   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:03.190081   98925 retry.go:31] will retry after 425.118971ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:03.651705   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:03.651748   98925 retry.go:31] will retry after 717.03324ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:04.404289   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:04.404360   98925 retry.go:31] will retry after 329.393621ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:04.734838   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:04.754276   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:04.790424   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:04.790451   98925 retry.go:31] will retry after 132.792964ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:04.959153   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:04.959181   98925 retry.go:31] will retry after 422.781555ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:05.418286   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:05.418319   98925 retry.go:31] will retry after 307.736158ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:05.762285   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:05.762313   98925 retry.go:31] will retry after 776.314053ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:06.574535   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:06.574631   98925 provision.go:87] duration metric: took 3.894880474s to configureAuth
	W0918 17:15:06.574643   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:06.574660   98925 retry.go:31] will retry after 218.855µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:06.575780   98925 provision.go:84] configureAuth start
	I0918 17:15:06.575854   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:06.593791   98925 provision.go:143] copyHostCerts
	I0918 17:15:06.593824   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:06.593853   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:06.593858   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:06.593916   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:06.594007   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:06.594026   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:06.594030   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:06.594052   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:06.594124   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:06.594143   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:06.594157   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:06.594182   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:06.594246   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:06.786722   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:06.786776   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:06.786807   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:06.804920   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:06.839913   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:06.839939   98925 retry.go:31] will retry after 325.634731ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:07.202127   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:07.202155   98925 retry.go:31] will retry after 320.243692ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:07.558281   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:07.558311   98925 retry.go:31] will retry after 342.723191ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:07.937590   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:07.937627   98925 retry.go:31] will retry after 799.497734ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:08.773155   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:08.773229   98925 provision.go:87] duration metric: took 2.197431877s to configureAuth
	W0918 17:15:08.773238   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:08.773247   98925 retry.go:31] will retry after 254.729µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:08.774382   98925 provision.go:84] configureAuth start
	I0918 17:15:08.774452   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:08.791922   98925 provision.go:143] copyHostCerts
	I0918 17:15:08.791957   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:08.791982   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:08.791988   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:08.792043   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:08.792134   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:08.792156   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:08.792162   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:08.792184   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:08.792240   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:08.792256   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:08.792262   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:08.792282   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:08.792360   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:09.031569   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:09.031624   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:09.031656   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:09.050288   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:09.085720   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:09.085746   98925 retry.go:31] will retry after 218.750642ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:09.340825   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:09.340853   98925 retry.go:31] will retry after 544.639731ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:09.921852   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:09.921877   98925 retry.go:31] will retry after 546.940836ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:10.504773   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:10.504840   98925 retry.go:31] will retry after 192.87596ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:10.698311   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:10.716918   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:10.752129   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:10.752164   98925 retry.go:31] will retry after 200.277929ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:10.988213   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:10.988243   98925 retry.go:31] will retry after 403.083564ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:11.426924   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:11.426951   98925 retry.go:31] will retry after 302.512661ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:11.766259   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:11.766357   98925 provision.go:87] duration metric: took 2.991954366s to configureAuth
	W0918 17:15:11.766372   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:11.766384   98925 retry.go:31] will retry after 279.806µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:11.767530   98925 provision.go:84] configureAuth start
	I0918 17:15:11.767612   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:11.785539   98925 provision.go:143] copyHostCerts
	I0918 17:15:11.785580   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:11.785610   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:11.785618   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:11.785674   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:11.785761   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:11.785781   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:11.785788   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:11.785809   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:11.785864   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:11.785881   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:11.785887   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:11.785913   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:11.785976   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:11.830245   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:11.830301   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:11.830339   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:11.848741   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:11.884243   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:11.884268   98925 retry.go:31] will retry after 257.771631ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:12.178319   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:12.178356   98925 retry.go:31] will retry after 431.897997ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:12.646744   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:12.646770   98925 retry.go:31] will retry after 725.600553ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:13.407750   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:13.407834   98925 retry.go:31] will retry after 344.872036ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:13.753455   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:13.772979   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:13.808333   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:13.808367   98925 retry.go:31] will retry after 175.449039ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:14.020293   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:14.020335   98925 retry.go:31] will retry after 349.43257ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:14.406574   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:14.406606   98925 retry.go:31] will retry after 657.102406ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:15.099800   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:15.099891   98925 provision.go:87] duration metric: took 3.332339605s to configureAuth
	W0918 17:15:15.099904   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:15.099917   98925 retry.go:31] will retry after 325.636µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:15.101042   98925 provision.go:84] configureAuth start
	I0918 17:15:15.101107   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:15.119793   98925 provision.go:143] copyHostCerts
	I0918 17:15:15.119828   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:15.119861   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:15.119869   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:15.119926   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:15.120015   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:15.120035   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:15.120041   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:15.120062   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:15.120123   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:15.120140   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:15.120146   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:15.120165   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:15.120232   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:15.239984   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:15.240043   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:15.240085   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:15.259177   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:15.294353   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:15.294383   98925 retry.go:31] will retry after 126.755455ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:15.457390   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:15.457421   98925 retry.go:31] will retry after 304.398533ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:15.798319   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:15.798350   98925 retry.go:31] will retry after 456.616907ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:16.291469   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:16.291543   98925 retry.go:31] will retry after 665.162816ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:16.993007   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:16.993114   98925 retry.go:31] will retry after 135.127627ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:17.128468   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:17.146857   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:17.182996   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:17.183036   98925 retry.go:31] will retry after 292.261015ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:17.510824   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:17.510859   98925 retry.go:31] will retry after 193.50588ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:17.741129   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:17.741158   98925 retry.go:31] will retry after 784.483212ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:18.561494   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:18.561553   98925 retry.go:31] will retry after 462.393645ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:19.059929   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:19.060034   98925 provision.go:87] duration metric: took 3.958975958s to configureAuth
	W0918 17:15:19.060048   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:19.060063   98925 retry.go:31] will retry after 519.65µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:19.061239   98925 provision.go:84] configureAuth start
	I0918 17:15:19.061314   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:19.078987   98925 provision.go:143] copyHostCerts
	I0918 17:15:19.079020   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:19.079048   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:19.079057   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:19.079115   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:19.079210   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:19.079229   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:19.079233   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:19.079254   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:19.079312   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:19.079328   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:19.079334   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:19.079358   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:19.079422   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:19.232890   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:19.232947   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:19.232979   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:19.251270   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:19.286860   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:19.286893   98925 retry.go:31] will retry after 236.829994ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:19.559820   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:19.559848   98925 retry.go:31] will retry after 477.627076ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:20.073928   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:20.073960   98925 retry.go:31] will retry after 775.525785ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:20.885980   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:20.886064   98925 retry.go:31] will retry after 225.727784ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:21.112577   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:21.131231   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:21.166801   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:21.166835   98925 retry.go:31] will retry after 197.802417ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:21.400942   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:21.400971   98925 retry.go:31] will retry after 358.391406ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:21.795806   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:21.795834   98925 retry.go:31] will retry after 608.7734ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:22.440866   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:22.440899   98925 retry.go:31] will retry after 587.669933ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:23.064909   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:23.065104   98925 provision.go:87] duration metric: took 4.003840029s to configureAuth
	W0918 17:15:23.065133   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:23.065150   98925 retry.go:31] will retry after 624.101µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:23.066281   98925 provision.go:84] configureAuth start
	I0918 17:15:23.066424   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:23.085440   98925 provision.go:143] copyHostCerts
	I0918 17:15:23.085490   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:23.085558   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:23.085568   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:23.085618   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:23.085704   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:23.085722   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:23.085728   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:23.085749   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:23.085806   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:23.085822   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:23.085828   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:23.085847   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:23.085910   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:23.171932   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:23.171994   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:23.172030   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:23.191005   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:23.226259   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:23.226294   98925 retry.go:31] will retry after 171.560384ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:23.433916   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:23.433947   98925 retry.go:31] will retry after 499.206949ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:23.968964   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:23.968998   98925 retry.go:31] will retry after 654.190756ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:24.659387   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:24.659460   98925 retry.go:31] will retry after 251.11801ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:24.910860   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:24.929478   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:24.965250   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:24.965277   98925 retry.go:31] will retry after 154.62241ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:25.155845   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:25.155873   98925 retry.go:31] will retry after 264.824164ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:25.456964   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:25.457009   98925 retry.go:31] will retry after 553.552537ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:26.045840   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:26.045939   98925 provision.go:87] duration metric: took 2.979640326s to configureAuth
	W0918 17:15:26.045951   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:26.045963   98925 retry.go:31] will retry after 2.04296ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:26.048123   98925 provision.go:84] configureAuth start
	I0918 17:15:26.048213   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:26.067174   98925 provision.go:143] copyHostCerts
	I0918 17:15:26.067222   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:26.067251   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:26.067260   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:26.067334   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:26.067446   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:26.067472   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:26.067483   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:26.067532   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:26.067619   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:26.067644   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:26.067654   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:26.067680   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:26.067767   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:26.182542   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:26.182603   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:26.182635   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:26.201459   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:26.237657   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:26.237689   98925 retry.go:31] will retry after 254.464025ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:26.528614   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:26.528644   98925 retry.go:31] will retry after 425.679195ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:26.990533   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:26.990564   98925 retry.go:31] will retry after 311.44155ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:27.338524   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:27.338610   98925 retry.go:31] will retry after 244.52069ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:27.583943   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:27.601649   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:27.639575   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:27.639609   98925 retry.go:31] will retry after 159.844577ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:27.835839   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:27.835871   98925 retry.go:31] will retry after 249.184829ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:28.121401   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:28.121434   98925 retry.go:31] will retry after 501.41332ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:28.658969   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:28.659000   98925 retry.go:31] will retry after 724.88604ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:29.420417   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:29.420495   98925 provision.go:87] duration metric: took 3.372355438s to configureAuth
	W0918 17:15:29.420530   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:29.420544   98925 retry.go:31] will retry after 3.580205ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:29.424752   98925 provision.go:84] configureAuth start
	I0918 17:15:29.424828   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:29.443097   98925 provision.go:143] copyHostCerts
	I0918 17:15:29.443130   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:29.443158   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:29.443166   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:29.443219   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:29.443308   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:29.443326   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:29.443330   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:29.443351   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:29.443408   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:29.443424   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:29.443431   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:29.443450   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:29.443536   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:29.518307   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:29.518364   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:29.518431   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:29.536979   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:29.573427   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:29.573463   98925 retry.go:31] will retry after 199.335368ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:29.811301   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:29.811334   98925 retry.go:31] will retry after 327.323314ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:30.174329   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:30.174356   98925 retry.go:31] will retry after 321.977277ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:30.532995   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:30.533026   98925 retry.go:31] will retry after 935.956822ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:31.504577   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:31.504666   98925 provision.go:87] duration metric: took 2.079891414s to configureAuth
	W0918 17:15:31.504676   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:31.504687   98925 retry.go:31] will retry after 4.655172ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:31.509896   98925 provision.go:84] configureAuth start
	I0918 17:15:31.510003   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:31.528992   98925 provision.go:143] copyHostCerts
	I0918 17:15:31.529059   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:31.529105   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:31.529116   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:31.529184   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:31.529301   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:31.529323   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:31.529332   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:31.529367   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:31.529447   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:31.529469   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:31.529479   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:31.529531   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:31.529622   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:31.768227   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:31.768284   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:31.768331   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:31.786738   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:31.824048   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:31.824088   98925 retry.go:31] will retry after 284.086569ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:32.143631   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:32.143664   98925 retry.go:31] will retry after 550.501991ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:32.730522   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:32.730554   98925 retry.go:31] will retry after 489.218319ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:33.255619   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:33.255685   98925 retry.go:31] will retry after 169.023343ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:33.425084   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:33.444455   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:33.480162   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:33.480190   98925 retry.go:31] will retry after 280.925286ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:33.798461   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:33.798491   98925 retry.go:31] will retry after 432.125725ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:34.266848   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:34.266884   98925 retry.go:31] will retry after 543.023851ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:34.847474   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:34.847585   98925 provision.go:87] duration metric: took 3.337666934s to configureAuth
	W0918 17:15:34.847599   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:34.847612   98925 retry.go:31] will retry after 6.022902ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:34.853863   98925 provision.go:84] configureAuth start
	I0918 17:15:34.853936   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:34.873183   98925 provision.go:143] copyHostCerts
	I0918 17:15:34.873219   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:34.873244   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:34.873253   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:34.873324   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:34.873443   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:34.873469   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:34.873479   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:34.873528   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:34.873612   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:34.873638   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:34.873647   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:34.873683   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:34.873781   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:34.967712   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:34.967767   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:34.967811   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:34.987519   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:35.023048   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:35.023087   98925 retry.go:31] will retry after 178.693072ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:35.238873   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:35.238901   98925 retry.go:31] will retry after 219.792409ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:35.495106   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:35.495142   98925 retry.go:31] will retry after 292.870647ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:35.824186   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:35.824267   98925 retry.go:31] will retry after 139.901523ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:35.964758   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:35.984327   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:36.019887   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:36.019925   98925 retry.go:31] will retry after 186.863506ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:36.243541   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:36.243568   98925 retry.go:31] will retry after 418.127314ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:36.697646   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:36.697683   98925 retry.go:31] will retry after 347.770879ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:37.083439   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:37.083559   98925 provision.go:87] duration metric: took 2.229676494s to configureAuth
	W0918 17:15:37.083572   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:37.083583   98925 retry.go:31] will retry after 4.936759ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:37.088827   98925 provision.go:84] configureAuth start
	I0918 17:15:37.088923   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:37.108259   98925 provision.go:143] copyHostCerts
	I0918 17:15:37.108320   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:37.108358   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:37.108369   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:37.108436   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:37.108551   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:37.108580   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:37.108589   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:37.108624   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:37.108692   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:37.108716   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:37.108723   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:37.108754   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:37.108824   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:37.526521   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:37.526582   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:37.526616   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:37.544994   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:37.581123   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:37.581158   98925 retry.go:31] will retry after 249.854321ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:37.867377   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:37.867407   98925 retry.go:31] will retry after 402.240557ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:38.306363   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:38.306401   98925 retry.go:31] will retry after 757.465073ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:39.099774   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:39.099853   98925 retry.go:31] will retry after 169.725244ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:39.270332   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:39.288455   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:39.323947   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:39.323973   98925 retry.go:31] will retry after 233.865825ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:39.594018   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:39.594044   98925 retry.go:31] will retry after 533.184665ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:40.162570   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:40.162595   98925 retry.go:31] will retry after 425.912722ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:40.624369   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:40.624460   98925 provision.go:87] duration metric: took 3.535608935s to configureAuth
	W0918 17:15:40.624472   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:40.624491   98925 retry.go:31] will retry after 14.814643ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:40.639771   98925 provision.go:84] configureAuth start
	I0918 17:15:40.639885   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:40.659842   98925 provision.go:143] copyHostCerts
	I0918 17:15:40.659885   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:40.659922   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:40.659935   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:40.660006   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:40.660107   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:40.660149   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:40.660160   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:40.660194   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:40.660263   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:40.660288   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:40.660301   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:40.660332   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:40.660404   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:41.222857   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:41.222913   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:41.222945   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:41.241222   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:41.277407   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:41.277444   98925 retry.go:31] will retry after 290.853287ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:41.604288   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:41.604320   98925 retry.go:31] will retry after 418.619425ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:42.058732   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:42.058759   98925 retry.go:31] will retry after 714.947499ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:42.809985   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:42.810069   98925 retry.go:31] will retry after 269.319715ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:43.079585   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:43.098748   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:43.135311   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:43.135349   98925 retry.go:31] will retry after 258.802621ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:43.431015   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:43.431085   98925 retry.go:31] will retry after 341.973185ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:43.808660   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:43.808687   98925 retry.go:31] will retry after 511.614169ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:44.356439   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:44.356563   98925 provision.go:87] duration metric: took 3.716764446s to configureAuth
	W0918 17:15:44.356578   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:44.356589   98925 retry.go:31] will retry after 23.365135ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:44.380836   98925 provision.go:84] configureAuth start
	I0918 17:15:44.380913   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:44.399522   98925 provision.go:143] copyHostCerts
	I0918 17:15:44.399560   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:44.399599   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:44.399611   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:44.399676   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:44.399770   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:44.399797   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:44.399804   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:44.399840   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:44.400030   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:44.400064   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:44.400072   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:44.400113   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:44.400198   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:44.839710   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:44.839768   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:44.839815   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:44.858242   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:44.895123   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:44.895163   98925 retry.go:31] will retry after 187.572464ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:45.118959   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:45.118994   98925 retry.go:31] will retry after 489.581843ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:45.645160   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:45.645195   98925 retry.go:31] will retry after 390.680376ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:46.072161   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:46.072239   98925 retry.go:31] will retry after 334.844677ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:46.407854   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:46.426682   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:46.462783   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:46.462815   98925 retry.go:31] will retry after 150.601455ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:46.649259   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:46.649291   98925 retry.go:31] will retry after 377.833407ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:47.063140   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:47.063173   98925 retry.go:31] will retry after 708.609343ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:47.806813   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:47.806900   98925 provision.go:87] duration metric: took 3.426042007s to configureAuth
	W0918 17:15:47.806910   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:47.806924   98925 retry.go:31] will retry after 22.606508ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:47.830187   98925 provision.go:84] configureAuth start
	I0918 17:15:47.830289   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:47.849178   98925 provision.go:143] copyHostCerts
	I0918 17:15:47.849222   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:47.849251   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:47.849260   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:47.849314   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:47.849401   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:47.849421   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:47.849428   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:47.849450   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:47.849518   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:47.849544   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:47.849552   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:47.849576   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:47.849639   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:48.098401   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:48.098454   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:48.098484   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:48.117097   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:48.152826   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:48.152857   98925 retry.go:31] will retry after 267.733312ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:48.456891   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:48.456938   98925 retry.go:31] will retry after 226.71043ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:48.719529   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:48.719561   98925 retry.go:31] will retry after 631.416726ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:49.386409   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:49.386489   98925 retry.go:31] will retry after 260.083381ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:49.646934   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:49.666615   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:49.701785   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:49.701815   98925 retry.go:31] will retry after 301.717887ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:50.039859   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:50.039899   98925 retry.go:31] will retry after 476.440642ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:50.551792   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:50.551826   98925 retry.go:31] will retry after 765.183642ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:51.352884   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:51.352963   98925 provision.go:87] duration metric: took 3.522733966s to configureAuth
	W0918 17:15:51.352975   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:51.353001   98925 retry.go:31] will retry after 55.843325ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:51.409251   98925 provision.go:84] configureAuth start
	I0918 17:15:51.409361   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:51.427770   98925 provision.go:143] copyHostCerts
	I0918 17:15:51.427806   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:51.427834   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:51.427843   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:51.427902   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:51.427978   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:51.427998   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:51.428005   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:51.428026   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:51.428069   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:51.428086   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:51.428094   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:51.428119   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:51.428197   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:51.525672   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:51.525730   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:51.525762   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:51.543950   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:51.580493   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:51.580537   98925 retry.go:31] will retry after 171.654123ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:51.788347   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:51.788373   98925 retry.go:31] will retry after 266.521376ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:52.091304   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:52.091331   98925 retry.go:31] will retry after 556.771368ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:52.686253   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:52.686285   98925 retry.go:31] will retry after 475.441177ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:53.197865   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:53.197948   98925 retry.go:31] will retry after 286.552371ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:53.485521   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:53.503951   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:53.540076   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:53.540110   98925 retry.go:31] will retry after 189.527948ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:53.766013   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:53.766051   98925 retry.go:31] will retry after 376.558212ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:54.179475   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:54.179527   98925 retry.go:31] will retry after 656.975157ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:54.873023   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:54.873053   98925 retry.go:31] will retry after 546.362301ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:55.454916   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:55.455012   98925 provision.go:87] duration metric: took 4.045717874s to configureAuth
	W0918 17:15:55.455027   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:55.455039   98925 retry.go:31] will retry after 77.366167ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:55.533363   98925 provision.go:84] configureAuth start
	I0918 17:15:55.533452   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:55.552156   98925 provision.go:143] copyHostCerts
	I0918 17:15:55.552193   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:55.552230   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:55.552238   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:55.552307   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:55.552427   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:55.552457   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:55.552468   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:55.552516   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:55.552587   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:55.552624   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:55.552631   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:55.552661   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:55.552737   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:55.718776   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:55.718830   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:55.718864   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:55.736737   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:55.772285   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:55.772310   98925 retry.go:31] will retry after 180.64953ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:55.989467   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:55.989513   98925 retry.go:31] will retry after 373.425539ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:56.397961   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:56.397998   98925 retry.go:31] will retry after 573.326801ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:57.006887   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:57.006966   98925 retry.go:31] will retry after 345.690185ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:57.353603   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:57.372225   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:57.407589   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:57.407622   98925 retry.go:31] will retry after 259.194461ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:57.703102   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:57.703140   98925 retry.go:31] will retry after 344.562115ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:58.083956   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:58.083992   98925 retry.go:31] will retry after 398.870491ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:58.519597   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:58.519705   98925 provision.go:87] duration metric: took 2.986316742s to configureAuth
	W0918 17:15:58.519719   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:58.519731   98925 retry.go:31] will retry after 64.0582ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:58.583892   98925 provision.go:84] configureAuth start
	I0918 17:15:58.583975   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:15:58.602215   98925 provision.go:143] copyHostCerts
	I0918 17:15:58.602252   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:58.602288   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:15:58.602299   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:15:58.602377   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:15:58.602480   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:58.602520   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:15:58.602531   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:15:58.602565   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:15:58.602672   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:58.602697   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:15:58.602708   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:15:58.602741   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:15:58.602814   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:15:59.095416   98925 provision.go:177] copyRemoteCerts
	I0918 17:15:59.095478   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:15:59.095528   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:15:59.114401   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:15:59.150254   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:59.150284   98925 retry.go:31] will retry after 139.937696ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:59.325685   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:59.325723   98925 retry.go:31] will retry after 511.345828ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:15:59.873413   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:15:59.873448   98925 retry.go:31] will retry after 519.006591ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:00.428112   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:00.428140   98925 retry.go:31] will retry after 471.634435ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:00.936415   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:00.936534   98925 provision.go:87] duration metric: took 2.352617944s to configureAuth
	W0918 17:16:00.936550   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:00.936563   98925 retry.go:31] will retry after 145.832808ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:01.082892   98925 provision.go:84] configureAuth start
	I0918 17:16:01.082980   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:01.101958   98925 provision.go:143] copyHostCerts
	I0918 17:16:01.101995   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:01.102038   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:01.102050   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:01.102119   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:01.102378   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:01.102413   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:01.102418   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:01.102457   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:01.102551   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:01.102579   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:01.102584   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:01.102614   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:01.102700   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:01.360565   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:01.360618   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:01.360653   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:01.378917   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:01.414692   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:01.414718   98925 retry.go:31] will retry after 325.0379ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:01.776951   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:01.776981   98925 retry.go:31] will retry after 520.226286ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:02.333218   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:02.333250   98925 retry.go:31] will retry after 552.838137ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:02.922305   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:02.922401   98925 retry.go:31] will retry after 143.1223ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:03.065659   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:03.083948   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:03.118886   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:03.118918   98925 retry.go:31] will retry after 359.967624ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:03.516028   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:03.516084   98925 retry.go:31] will retry after 475.894999ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:04.028339   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:04.028373   98925 retry.go:31] will retry after 402.591536ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:04.467083   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:04.467200   98925 provision.go:87] duration metric: took 3.384280817s to configureAuth
	W0918 17:16:04.467213   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:04.467225   98925 retry.go:31] will retry after 136.744499ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:04.604553   98925 provision.go:84] configureAuth start
	I0918 17:16:04.604660   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:04.623100   98925 provision.go:143] copyHostCerts
	I0918 17:16:04.623135   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:04.623162   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:04.623168   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:04.623222   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:04.623321   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:04.623341   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:04.623349   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:04.623383   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:04.623469   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:04.623489   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:04.623509   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:04.623543   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:04.623628   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:04.870972   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:04.871045   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:04.871093   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:04.889706   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:04.924861   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:04.924889   98925 retry.go:31] will retry after 281.383585ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:05.243091   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:05.243116   98925 retry.go:31] will retry after 486.022533ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:05.766841   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:05.766886   98925 retry.go:31] will retry after 670.729101ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:06.473254   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:06.473331   98925 retry.go:31] will retry after 182.80492ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:06.656729   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:06.675456   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:06.711470   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:06.711533   98925 retry.go:31] will retry after 190.419537ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:06.938391   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:06.938425   98925 retry.go:31] will retry after 270.734207ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:07.244853   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:07.244882   98925 retry.go:31] will retry after 374.435362ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:07.654920   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:07.654946   98925 retry.go:31] will retry after 812.624255ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:08.504185   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:08.504278   98925 provision.go:87] duration metric: took 3.899683162s to configureAuth
	W0918 17:16:08.504292   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:08.504312   98925 retry.go:31] will retry after 212.529948ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:08.717550   98925 provision.go:84] configureAuth start
	I0918 17:16:08.717667   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:08.735045   98925 provision.go:143] copyHostCerts
	I0918 17:16:08.735086   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:08.735115   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:08.735124   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:08.735182   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:08.735276   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:08.735296   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:08.735303   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:08.735326   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:08.735405   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:08.735422   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:08.735426   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:08.735448   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:08.735522   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:08.809570   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:08.809630   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:08.809667   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:08.829013   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:08.864610   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:08.864643   98925 retry.go:31] will retry after 246.117797ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:09.146654   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:09.146684   98925 retry.go:31] will retry after 404.702948ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:09.588100   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:09.588131   98925 retry.go:31] will retry after 299.317341ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:09.922494   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:09.922541   98925 retry.go:31] will retry after 879.095975ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:10.837794   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:10.837871   98925 provision.go:87] duration metric: took 2.12029402s to configureAuth
	W0918 17:16:10.837879   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:10.837932   98925 retry.go:31] will retry after 429.583693ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:11.268563   98925 provision.go:84] configureAuth start
	I0918 17:16:11.268643   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:11.286963   98925 provision.go:143] copyHostCerts
	I0918 17:16:11.287013   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:11.287050   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:11.287060   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:11.287122   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:11.287226   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:11.287251   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:11.287263   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:11.287293   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:11.287345   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:11.287364   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:11.287368   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:11.287387   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:11.287438   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:11.434158   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:11.434215   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:11.434249   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:11.452720   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:11.487934   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:11.487962   98925 retry.go:31] will retry after 187.206322ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:11.710486   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:11.710529   98925 retry.go:31] will retry after 330.747383ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:12.077476   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:12.077522   98925 retry.go:31] will retry after 385.664414ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:12.499402   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:12.499438   98925 retry.go:31] will retry after 574.769966ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:13.110229   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:13.110327   98925 provision.go:87] duration metric: took 1.841736272s to configureAuth
	W0918 17:16:13.110341   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:13.110354   98925 retry.go:31] will retry after 1.099114165s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:14.210581   98925 provision.go:84] configureAuth start
	I0918 17:16:14.210679   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:14.229593   98925 provision.go:143] copyHostCerts
	I0918 17:16:14.229632   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:14.229661   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:14.229668   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:14.229724   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:14.229806   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:14.229825   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:14.229829   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:14.229851   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:14.229929   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:14.229945   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:14.229952   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:14.229970   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:14.230038   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:14.499019   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:14.499087   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:14.499135   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:14.518345   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:14.554081   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:14.554110   98925 retry.go:31] will retry after 283.483489ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:14.875212   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:14.875247   98925 retry.go:31] will retry after 346.448624ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:15.258728   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:15.258760   98925 retry.go:31] will retry after 409.684209ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:15.705283   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:15.705320   98925 retry.go:31] will retry after 590.755274ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:16.332597   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:16.332692   98925 provision.go:87] duration metric: took 2.122086065s to configureAuth
	W0918 17:16:16.332709   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:16.332723   98925 retry.go:31] will retry after 873.891735ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:17.206720   98925 provision.go:84] configureAuth start
	I0918 17:16:17.206816   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:17.225185   98925 provision.go:143] copyHostCerts
	I0918 17:16:17.225226   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:17.225262   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:17.225272   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:17.225344   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:17.225434   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:17.225459   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:17.225467   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:17.225520   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:17.225593   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:17.225616   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:17.225625   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:17.225652   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:17.225724   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:17.327478   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:17.327547   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:17.327580   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:17.346274   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:17.381452   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:17.381481   98925 retry.go:31] will retry after 269.470525ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:17.688836   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:17.688869   98925 retry.go:31] will retry after 522.334692ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:18.247457   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:18.247495   98925 retry.go:31] will retry after 481.819911ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:18.765396   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:18.765474   98925 retry.go:31] will retry after 241.089827ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:19.006909   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:19.024833   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:19.060381   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:19.060410   98925 retry.go:31] will retry after 165.090599ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:19.261437   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:19.261474   98925 retry.go:31] will retry after 506.35158ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:19.803260   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:19.803293   98925 retry.go:31] will retry after 555.106778ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:20.395232   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:20.395264   98925 retry.go:31] will retry after 557.511502ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:20.988756   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:20.988833   98925 provision.go:87] duration metric: took 3.78207371s to configureAuth
	W0918 17:16:20.988841   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:20.988851   98925 retry.go:31] will retry after 2.262260324s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:23.251559   98925 provision.go:84] configureAuth start
	I0918 17:16:23.251666   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:23.270802   98925 provision.go:143] copyHostCerts
	I0918 17:16:23.270837   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:23.270864   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:23.270870   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:23.270936   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:23.271027   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:23.271048   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:23.271053   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:23.271076   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:23.271163   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:23.271187   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:23.271197   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:23.271228   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:23.271304   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:23.388045   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:23.388118   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:23.388177   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:23.406369   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:23.442773   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:23.442810   98925 retry.go:31] will retry after 363.813606ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:23.842796   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:23.842825   98925 retry.go:31] will retry after 432.801316ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:24.311895   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:24.311923   98925 retry.go:31] will retry after 309.356734ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:24.658307   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:24.658396   98925 retry.go:31] will retry after 220.794692ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:24.879848   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:24.898118   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:24.934394   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:24.934432   98925 retry.go:31] will retry after 190.457795ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:25.161937   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:25.161986   98925 retry.go:31] will retry after 454.67117ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:25.653475   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:25.653517   98925 retry.go:31] will retry after 453.076295ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:26.142623   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:26.142720   98925 provision.go:87] duration metric: took 2.891137972s to configureAuth
	W0918 17:16:26.142732   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:26.142749   98925 retry.go:31] will retry after 2.489870814s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:28.632846   98925 provision.go:84] configureAuth start
	I0918 17:16:28.632959   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:28.652479   98925 provision.go:143] copyHostCerts
	I0918 17:16:28.652530   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:28.652566   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:28.652576   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:28.652643   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:28.652747   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:28.652774   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:28.652782   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:28.652815   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:28.652882   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:28.652910   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:28.652920   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:28.652954   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:28.653025   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:29.057226   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:29.057284   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:29.057315   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:29.076278   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:29.112540   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:29.112574   98925 retry.go:31] will retry after 177.20504ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:29.325554   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:29.325588   98925 retry.go:31] will retry after 245.321786ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:29.607132   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:29.607166   98925 retry.go:31] will retry after 693.764641ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:30.337495   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:30.337545   98925 retry.go:31] will retry after 618.896523ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:30.994058   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:30.994157   98925 provision.go:87] duration metric: took 2.361285265s to configureAuth
	W0918 17:16:30.994169   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:30.994179   98925 retry.go:31] will retry after 4.838105643s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:35.833220   98925 provision.go:84] configureAuth start
	I0918 17:16:35.833312   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:35.851706   98925 provision.go:143] copyHostCerts
	I0918 17:16:35.851738   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:35.851764   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:35.851770   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:35.851825   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:35.851898   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:35.851916   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:35.851920   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:35.851939   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:35.851983   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:35.851999   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:35.852005   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:35.852022   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:35.852074   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:36.226763   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:36.226824   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:36.226858   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:36.245557   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:36.281187   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:36.281213   98925 retry.go:31] will retry after 363.710903ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:36.681864   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:36.681893   98925 retry.go:31] will retry after 398.852782ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:37.117587   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:37.117631   98925 retry.go:31] will retry after 557.02421ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:37.711181   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:37.711274   98925 retry.go:31] will retry after 341.786055ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:38.053746   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:38.073341   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:38.110539   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:38.110568   98925 retry.go:31] will retry after 358.471077ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:38.506452   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:38.506489   98925 retry.go:31] will retry after 258.274031ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:38.801300   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:38.801330   98925 retry.go:31] will retry after 670.02118ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:39.507734   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:39.507820   98925 provision.go:87] duration metric: took 3.674573855s to configureAuth
	W0918 17:16:39.507831   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:39.507845   98925 retry.go:31] will retry after 3.072900033s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:42.582567   98925 provision.go:84] configureAuth start
	I0918 17:16:42.582744   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:42.601032   98925 provision.go:143] copyHostCerts
	I0918 17:16:42.601100   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:42.601138   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:42.601147   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:42.601201   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:42.601275   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:42.601293   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:42.601302   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:42.601330   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:42.601375   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:42.601391   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:42.601397   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:42.601415   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:42.601463   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:42.791723   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:42.791781   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:42.791813   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:42.810857   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:42.847226   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:42.847251   98925 retry.go:31] will retry after 179.066143ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:43.062310   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:43.062362   98925 retry.go:31] will retry after 444.747023ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:43.544966   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:43.545001   98925 retry.go:31] will retry after 438.412023ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:44.021096   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:44.021168   98925 retry.go:31] will retry after 280.423604ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:44.302767   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:44.321408   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:44.357152   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:44.357191   98925 retry.go:31] will retry after 129.513966ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:44.524126   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:44.524157   98925 retry.go:31] will retry after 302.389742ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:44.863722   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:44.863766   98925 retry.go:31] will retry after 322.992055ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:45.223006   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:45.223094   98925 retry.go:31] will retry after 621.633647ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:45.881579   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:45.881693   98925 provision.go:87] duration metric: took 3.299096949s to configureAuth
	W0918 17:16:45.881711   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:45.881724   98925 retry.go:31] will retry after 7.249483941s: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:53.132300   98925 provision.go:84] configureAuth start
	I0918 17:16:53.132383   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:16:53.151279   98925 provision.go:143] copyHostCerts
	I0918 17:16:53.151312   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:53.151353   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:16:53.151362   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:16:53.151417   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:16:53.151491   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:53.151529   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:16:53.151540   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:16:53.151565   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:16:53.151615   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:53.151631   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:16:53.151638   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:16:53.151656   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:16:53.151708   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:16:53.749803   98925 provision.go:177] copyRemoteCerts
	I0918 17:16:53.749858   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:16:53.749893   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:53.768982   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:53.806621   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:53.806667   98925 retry.go:31] will retry after 194.21686ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:54.036656   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:54.036683   98925 retry.go:31] will retry after 303.062777ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:54.375864   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:54.375896   98925 retry.go:31] will retry after 366.941892ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:54.779034   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:54.779063   98925 retry.go:31] will retry after 982.788008ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:55.799737   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:55.799861   98925 provision.go:87] duration metric: took 2.667534162s to configureAuth
	W0918 17:16:55.799876   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:55.799889   98925 ubuntu.go:202] Error configuring auth during provisioning Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:55.799900   98925 machine.go:96] duration metric: took 11m3.224345916s to provisionDockerMachine
	I0918 17:16:55.799963   98925 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:16:55.800001   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:55.818456   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:55.855555   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:55.855582   98925 retry.go:31] will retry after 282.574969ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:56.174599   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:56.174629   98925 retry.go:31] will retry after 290.455822ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:56.501451   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:56.501481   98925 retry.go:31] will retry after 692.583759ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:57.229789   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:57.229815   98925 retry.go:31] will retry after 496.643512ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:57.762665   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:57.762751   98925 start.go:268] error running df -h /var: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:57.762766   98925 start.go:235] error getting percentage of /var that is free: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:57.762823   98925 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:16:57.762867   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:57.782701   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:57.818850   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:57.818887   98925 retry.go:31] will retry after 154.422259ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:58.010350   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:58.010380   98925 retry.go:31] will retry after 264.826686ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:58.311633   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:58.311662   98925 retry.go:31] will retry after 711.001206ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:59.059712   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:59.059770   98925 retry.go:31] will retry after 373.295613ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:59.433340   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:16:59.452430   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:16:59.489457   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:59.489491   98925 retry.go:31] will retry after 293.106044ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:16:59.818396   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:16:59.818430   98925 retry.go:31] will retry after 249.595529ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:17:00.105085   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:00.105113   98925 retry.go:31] will retry after 691.50438ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:17:00.833188   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:00.833221   98925 retry.go:31] will retry after 541.186888ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:17:01.409667   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:17:01.409762   98925 start.go:283] error running df -BG /var: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:17:01.409780   98925 start.go:240] error getting GiB of /var that is available: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:01.409789   98925 fix.go:56] duration metric: took 11m9.154507562s for fixHost
	I0918 17:17:01.409798   98925 start.go:83] releasing machines lock for "ha-078118-m04", held for 11m9.154548806s
	W0918 17:17:01.409818   98925 start.go:714] error starting host: provision: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:17:01.409893   98925 out.go:285] ! StartHost failed, but will try again: provision: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:01.409906   98925 start.go:729] Will try again in 5 seconds ...
	I0918 17:17:06.410981   98925 start.go:360] acquireMachinesLock for ha-078118-m04: {Name:mkdcee71069a15ce1d36f6cf5f43097fe7468c48 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:17:06.411105   98925 start.go:364] duration metric: took 64.444µs to acquireMachinesLock for "ha-078118-m04"
	I0918 17:17:06.411128   98925 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:17:06.411135   98925 fix.go:54] fixHost starting: m04
	I0918 17:17:06.411360   98925 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:17:06.428896   98925 fix.go:112] recreateIfNeeded on ha-078118-m04: state=Running err=<nil>
	W0918 17:17:06.428923   98925 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:17:06.431127   98925 out.go:252] * Updating the running docker "ha-078118-m04" container ...
	I0918 17:17:06.431165   98925 machine.go:93] provisionDockerMachine start ...
	I0918 17:17:06.431232   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:17:06.450558   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:17:06.450819   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32838 <nil> <nil>}
	I0918 17:17:06.450834   98925 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:17:06.486356   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:09.524393   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:12.560266   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:15.595619   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:18.632933   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:21.670739   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:24.708244   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:27.744364   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:30.783558   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:33.820732   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:36.858571   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:39.897432   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:42.932887   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:45.969359   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:49.006437   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:52.043744   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:55.080445   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:17:58.117410   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:01.155542   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:04.192808   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:07.229077   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:10.266704   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:13.303381   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:16.339962   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:19.378803   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:22.416539   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:25.452951   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:28.489055   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:31.526402   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:34.563566   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:37.601328   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:40.639029   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:43.675764   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:46.713380   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:49.751357   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:52.788320   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:55.824026   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:18:58.860350   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:01.899060   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:04.935763   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:07.971578   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:11.009081   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:14.046009   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:17.084154   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:20.122129   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:23.158710   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:26.194313   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:29.230761   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:32.268243   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:35.305019   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:38.341354   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:41.377922   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:44.414442   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:47.451743   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:50.488237   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:53.523656   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:56.560150   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:19:59.597544   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:02.632922   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:05.670137   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:08.670820   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:20:08.670856   98925 ubuntu.go:182] provisioning hostname "ha-078118-m04"
	I0918 17:20:08.670917   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:20:08.692379   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:20:08.692614   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32838 <nil> <nil>}
	I0918 17:20:08.692633   98925 main.go:141] libmachine: About to run SSH command:
	sudo hostname ha-078118-m04 && echo "ha-078118-m04" | sudo tee /etc/hostname
	I0918 17:20:08.728465   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:11.767277   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:14.803437   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:17.839403   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:20.879040   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:23.916030   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:26.952310   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:29.989950   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:33.026080   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:36.063030   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:39.100517   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:42.137833   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:45.174081   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:48.209927   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:51.248045   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:54.284455   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:20:57.320935   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:00.357693   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:03.393125   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:06.429660   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:09.466577   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:12.505527   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:15.542731   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:18.579129   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:21.616853   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:24.654676   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:27.692616   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:30.728933   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:33.765612   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:36.801918   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:39.839996   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:42.876340   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:45.913153   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:48.949539   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:51.985287   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:55.021376   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:21:58.057576   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:01.094248   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:04.130462   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:07.167270   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:10.203615   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:13.239443   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:16.277036   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:19.313390   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:22.351797   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:25.388038   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:28.423882   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:31.459541   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:34.496661   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:37.534279   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:40.572774   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:43.608018   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:46.643986   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:49.683229   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:52.718572   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:55.755393   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:22:58.791782   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:01.829640   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:04.865931   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:07.902419   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:10.903573   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:23:10.903659   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:23:10.922956   98925 main.go:141] libmachine: Using SSH client type: native
	I0918 17:23:10.923203   98925 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 32838 <nil> <nil>}
	I0918 17:23:10.923221   98925 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sha-078118-m04' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-078118-m04/g' /etc/hosts;
				else 
					echo '127.0.1.1 ha-078118-m04' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:23:10.959134   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:13.995727   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:17.032966   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:20.072186   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:23.108861   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:26.146050   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:29.182864   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:32.220202   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:35.255834   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:38.295690   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:41.334186   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:44.370204   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:47.406730   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:50.444224   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:53.480237   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:56.517649   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:23:59.553997   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:02.591468   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:05.627866   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:08.664222   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:11.701228   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:14.738462   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:17.775043   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:20.811758   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:23.848370   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:26.886058   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:29.923106   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:32.959379   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:35.996139   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:39.032804   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:42.070839   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:45.106685   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:48.142745   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:51.179556   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:54.215894   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:24:57.252851   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:00.290960   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:03.326589   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:06.363965   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:09.399628   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:12.437724   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:15.473635   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:18.509068   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:21.547568   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:24.585365   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:27.622772   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:30.661349   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:33.696861   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:36.734799   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:39.772535   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:42.808983   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:45.845805   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:48.882433   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:51.920379   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:54.956695   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:25:57.993410   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:01.031174   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:04.067317   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:07.106070   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:10.142813   98925 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:13.143677   98925 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:26:13.143706   98925 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:26:13.143729   98925 ubuntu.go:190] setting up certificates
	I0918 17:26:13.143740   98925 provision.go:84] configureAuth start
	I0918 17:26:13.143796   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:13.162899   98925 provision.go:143] copyHostCerts
	I0918 17:26:13.162939   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:13.162975   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:13.162987   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:13.163080   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:13.163197   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:13.163225   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:13.163235   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:13.163280   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:13.163356   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:13.163382   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:13.163388   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:13.163424   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:13.163520   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:13.913213   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:13.913269   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:13.913303   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:13.932302   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:13.967941   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:13.967981   98925 retry.go:31] will retry after 294.777291ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:14.298886   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:14.298917   98925 retry.go:31] will retry after 324.614281ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:14.660046   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:14.660081   98925 retry.go:31] will retry after 559.181784ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:15.255114   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:15.255195   98925 retry.go:31] will retry after 170.421208ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:15.426816   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:15.446041   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:15.482037   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:15.482072   98925 retry.go:31] will retry after 367.007577ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:15.884982   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:15.885017   98925 retry.go:31] will retry after 328.315028ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:16.248794   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:16.248826   98925 retry.go:31] will retry after 636.10788ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:16.921403   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:16.921495   98925 provision.go:87] duration metric: took 3.77774819s to configureAuth
	W0918 17:26:16.921525   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:16.921542   98925 retry.go:31] will retry after 58.042µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:16.922659   98925 provision.go:84] configureAuth start
	I0918 17:26:16.922734   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:16.940909   98925 provision.go:143] copyHostCerts
	I0918 17:26:16.940950   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:16.940984   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:16.940997   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:16.941066   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:16.941178   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:16.941205   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:16.941216   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:16.941253   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:16.941334   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:16.941364   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:16.941372   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:16.941404   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:16.941492   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:17.002997   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:17.003051   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:17.003103   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:17.021406   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:17.056848   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:17.056881   98925 retry.go:31] will retry after 242.205608ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:17.334921   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:17.334958   98925 retry.go:31] will retry after 220.793813ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:17.591737   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:17.591767   98925 retry.go:31] will retry after 759.607147ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:18.387683   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:18.387759   98925 retry.go:31] will retry after 338.570068ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:18.727328   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:18.746752   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:18.782383   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:18.782413   98925 retry.go:31] will retry after 180.572211ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:18.999419   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:18.999448   98925 retry.go:31] will retry after 348.717939ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:19.384905   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:19.384940   98925 retry.go:31] will retry after 710.784154ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:20.131973   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:20.132083   98925 provision.go:87] duration metric: took 3.209398955s to configureAuth
	W0918 17:26:20.132096   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:20.132109   98925 retry.go:31] will retry after 168.4µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:20.133224   98925 provision.go:84] configureAuth start
	I0918 17:26:20.133306   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:20.152029   98925 provision.go:143] copyHostCerts
	I0918 17:26:20.152064   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:20.152092   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:20.152104   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:20.152162   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:20.152255   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:20.152273   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:20.152278   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:20.152300   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:20.152360   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:20.152378   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:20.152384   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:20.152403   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:20.152467   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:20.531209   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:20.531267   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:20.531299   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:20.548921   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:20.584922   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:20.584951   98925 retry.go:31] will retry after 276.953641ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:20.898136   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:20.898164   98925 retry.go:31] will retry after 405.251794ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:21.339797   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:21.339834   98925 retry.go:31] will retry after 618.916339ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:21.997155   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:21.997227   98925 retry.go:31] will retry after 205.144717ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:22.202607   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:22.220884   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:22.256204   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:22.256238   98925 retry.go:31] will retry after 338.505919ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:22.631259   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:22.631289   98925 retry.go:31] will retry after 205.205861ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:22.872166   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:22.872201   98925 retry.go:31] will retry after 745.855504ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:23.655411   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:23.655519   98925 provision.go:87] duration metric: took 3.522276589s to configureAuth
	W0918 17:26:23.655533   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:23.655549   98925 retry.go:31] will retry after 302.053µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:23.656696   98925 provision.go:84] configureAuth start
	I0918 17:26:23.656775   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:23.675639   98925 provision.go:143] copyHostCerts
	I0918 17:26:23.675675   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:23.675715   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:23.675727   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:23.675791   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:23.675906   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:23.675935   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:23.675946   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:23.675982   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:23.676098   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:23.676121   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:23.676126   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:23.676159   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:23.676264   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:23.991930   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:23.992002   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:23.992050   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:24.010640   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:24.045832   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:24.045859   98925 retry.go:31] will retry after 298.7223ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:24.382377   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:24.382405   98925 retry.go:31] will retry after 553.455501ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:24.971921   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:24.971953   98925 retry.go:31] will retry after 464.676699ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:25.473028   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:25.473108   98925 retry.go:31] will retry after 291.995463ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:25.765637   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:25.784088   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:25.819267   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:25.819294   98925 retry.go:31] will retry after 195.979888ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:26.051065   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:26.051103   98925 retry.go:31] will retry after 510.573556ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:26.597564   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:26.597612   98925 retry.go:31] will retry after 805.231325ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:27.438422   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:27.438543   98925 provision.go:87] duration metric: took 3.781824764s to configureAuth
	W0918 17:26:27.438557   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:27.438570   98925 retry.go:31] will retry after 405.568µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:27.439709   98925 provision.go:84] configureAuth start
	I0918 17:26:27.439799   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:27.458559   98925 provision.go:143] copyHostCerts
	I0918 17:26:27.458598   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:27.458633   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:27.458644   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:27.458700   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:27.458788   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:27.458806   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:27.458811   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:27.458836   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:27.458893   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:27.458909   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:27.458913   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:27.458931   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:27.459035   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:27.708304   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:27.708360   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:27.708395   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:27.726754   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:27.762721   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:27.762756   98925 retry.go:31] will retry after 353.390604ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:28.151465   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:28.151518   98925 retry.go:31] will retry after 324.165141ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:28.511971   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:28.512006   98925 retry.go:31] will retry after 735.762576ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:29.282816   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:29.282844   98925 retry.go:31] will retry after 435.368276ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:29.753559   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:29.753653   98925 provision.go:87] duration metric: took 2.313925087s to configureAuth
	W0918 17:26:29.753664   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:29.753676   98925 retry.go:31] will retry after 716.51µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:29.754807   98925 provision.go:84] configureAuth start
	I0918 17:26:29.754878   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:29.773348   98925 provision.go:143] copyHostCerts
	I0918 17:26:29.773382   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:29.773410   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:29.773426   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:29.773483   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:29.773628   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:29.773658   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:29.773665   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:29.773701   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:29.773787   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:29.773815   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:29.773822   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:29.773861   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:29.773951   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:30.053254   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:30.053310   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:30.053355   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:30.072361   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:30.108478   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:30.108540   98925 retry.go:31] will retry after 203.143386ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:30.347939   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:30.347969   98925 retry.go:31] will retry after 437.190438ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:30.820765   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:30.820815   98925 retry.go:31] will retry after 509.160894ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:31.366140   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:31.366219   98925 retry.go:31] will retry after 198.380926ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:31.565744   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:31.584192   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:31.619779   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:31.619824   98925 retry.go:31] will retry after 157.640608ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:31.814075   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:31.814107   98925 retry.go:31] will retry after 202.556502ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:32.052434   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:32.052465   98925 retry.go:31] will retry after 422.553211ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:32.511967   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:32.512067   98925 provision.go:87] duration metric: took 2.75724108s to configureAuth
	W0918 17:26:32.512079   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:32.512092   98925 retry.go:31] will retry after 801.991µs: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:32.513214   98925 provision.go:84] configureAuth start
	I0918 17:26:32.513302   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:32.531614   98925 provision.go:143] copyHostCerts
	I0918 17:26:32.531673   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:32.531706   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:32.531715   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:32.531783   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:32.531902   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:32.531940   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:32.531950   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:32.531985   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:32.532070   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:32.532091   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:32.532100   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:32.532132   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:32.532217   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:32.717414   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:32.717475   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:32.717532   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:32.735903   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:32.772170   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:32.772196   98925 retry.go:31] will retry after 322.158158ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:33.130739   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:33.130784   98925 retry.go:31] will retry after 212.695665ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:33.379101   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:33.379130   98925 retry.go:31] will retry after 511.073845ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:33.926022   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:33.926115   98925 retry.go:31] will retry after 311.313901ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:34.237678   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:34.258144   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:34.293636   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:34.293665   98925 retry.go:31] will retry after 360.381059ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:34.690399   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:34.690437   98925 retry.go:31] will retry after 492.538799ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:35.219281   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:35.219314   98925 retry.go:31] will retry after 625.413357ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:35.881230   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:35.881320   98925 provision.go:87] duration metric: took 3.368084047s to configureAuth
	W0918 17:26:35.881332   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:35.881345   98925 retry.go:31] will retry after 1.062632ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:35.882487   98925 provision.go:84] configureAuth start
	I0918 17:26:35.882569   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:35.902117   98925 provision.go:143] copyHostCerts
	I0918 17:26:35.902155   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:35.902186   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:35.902195   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:35.902257   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:35.902356   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:35.902375   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:35.902379   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:35.902402   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:35.902458   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:35.902476   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:35.902480   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:35.902525   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:35.902605   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:36.571987   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:36.572052   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:36.572083   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:36.590702   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:36.626866   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:36.626896   98925 retry.go:31] will retry after 344.099015ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:37.009728   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:37.009755   98925 retry.go:31] will retry after 493.353769ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:37.539913   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:37.539940   98925 retry.go:31] will retry after 356.804209ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:37.932870   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:37.932948   98925 retry.go:31] will retry after 343.413093ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:38.277589   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:38.296460   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:38.332222   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:38.332247   98925 retry.go:31] will retry after 288.775405ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:38.657733   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:38.657769   98925 retry.go:31] will retry after 345.793717ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:39.039605   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:39.039637   98925 retry.go:31] will retry after 370.881257ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:39.446733   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:39.446761   98925 retry.go:31] will retry after 464.57461ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:39.947723   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:39.947808   98925 provision.go:87] duration metric: took 4.06529098s to configureAuth
	W0918 17:26:39.947819   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:39.947833   98925 retry.go:31] will retry after 1.205388ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:39.950024   98925 provision.go:84] configureAuth start
	I0918 17:26:39.950099   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:39.967244   98925 provision.go:143] copyHostCerts
	I0918 17:26:39.967289   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:39.967320   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:39.967329   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:39.967388   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:39.967474   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:39.967497   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:39.967518   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:39.967555   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:39.967621   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:39.967647   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:39.967654   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:39.967676   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:39.967753   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:40.877992   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:40.878074   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:40.878123   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:40.897064   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:40.933673   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:40.933709   98925 retry.go:31] will retry after 273.244784ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:41.245149   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:41.245183   98925 retry.go:31] will retry after 486.358829ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:41.767534   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:41.767560   98925 retry.go:31] will retry after 303.517071ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:42.108138   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:42.108179   98925 retry.go:31] will retry after 563.296352ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:42.707616   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:42.707681   98925 retry.go:31] will retry after 164.544328ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:42.873125   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:42.891455   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:42.926583   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:42.926612   98925 retry.go:31] will retry after 234.931399ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:43.197818   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:43.197843   98925 retry.go:31] will retry after 488.865967ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:43.722922   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:43.722960   98925 retry.go:31] will retry after 726.9546ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:44.486493   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:44.486599   98925 provision.go:87] duration metric: took 4.536558137s to configureAuth
	W0918 17:26:44.486609   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:44.486633   98925 retry.go:31] will retry after 2.10841ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:44.488781   98925 provision.go:84] configureAuth start
	I0918 17:26:44.488869   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:44.506679   98925 provision.go:143] copyHostCerts
	I0918 17:26:44.506712   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:44.506738   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:44.506746   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:44.506812   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:44.506905   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:44.506964   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:44.506974   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:44.507044   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:44.507118   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:44.507142   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:44.507151   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:44.507183   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:44.507258   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:44.805920   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:44.805974   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:44.806021   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:44.824351   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:44.860922   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:44.860950   98925 retry.go:31] will retry after 192.319866ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:45.090397   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:45.090426   98925 retry.go:31] will retry after 281.86925ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:45.407741   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:45.407773   98925 retry.go:31] will retry after 811.832007ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:46.255299   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:46.255383   98925 retry.go:31] will retry after 187.087489ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:46.442639   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:46.461443   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:46.496954   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:46.496981   98925 retry.go:31] will retry after 318.002309ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:46.852336   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:46.852378   98925 retry.go:31] will retry after 313.017508ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:47.200848   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:47.200882   98925 retry.go:31] will retry after 384.202752ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:47.621230   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:47.621345   98925 provision.go:87] duration metric: took 3.132533037s to configureAuth
	W0918 17:26:47.621360   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:47.621373   98925 retry.go:31] will retry after 3.572654ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:47.625577   98925 provision.go:84] configureAuth start
	I0918 17:26:47.625648   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:47.644175   98925 provision.go:143] copyHostCerts
	I0918 17:26:47.644219   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:47.644270   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:47.644281   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:47.644353   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:47.644434   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:47.644453   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:47.644458   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:47.644481   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:47.644553   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:47.644572   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:47.644579   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:47.644600   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:47.644655   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:47.941135   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:47.941193   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:47.941228   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:47.959825   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:47.995908   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:47.995944   98925 retry.go:31] will retry after 166.759776ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:48.200403   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:48.200429   98925 retry.go:31] will retry after 348.152332ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:48.584073   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:48.584106   98925 retry.go:31] will retry after 304.438367ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:48.925813   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:48.925844   98925 retry.go:31] will retry after 718.138128ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:49.681547   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:49.681627   98925 retry.go:31] will retry after 221.075853ms: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:49.903065   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:49.921239   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:49.957181   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:49.957211   98925 retry.go:31] will retry after 188.275303ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:50.182148   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:50.182178   98925 retry.go:31] will retry after 199.452506ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:50.418632   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:50.418658   98925 retry.go:31] will retry after 809.573612ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:51.264143   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:51.264241   98925 provision.go:87] duration metric: took 3.63864232s to configureAuth
	W0918 17:26:51.264252   98925 ubuntu.go:193] configureAuth failed: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:51.264263   98925 retry.go:31] will retry after 3.048841ms: Temporary Error: NewSession: new client: new client: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:51.267457   98925 provision.go:84] configureAuth start
	I0918 17:26:51.267563   98925 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ha-078118-m04
	I0918 17:26:51.286206   98925 provision.go:143] copyHostCerts
	I0918 17:26:51.286246   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:51.286275   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:26:51.286281   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:26:51.286354   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:26:51.286448   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:51.286471   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:26:51.286476   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:26:51.286524   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:26:51.286598   98925 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:51.286624   98925 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:26:51.286633   98925 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:26:51.286665   98925 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:26:51.286737   98925 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.ha-078118-m04 san=[127.0.0.1 192.168.49.5 ha-078118-m04 localhost minikube]
	I0918 17:26:51.401910   98925 provision.go:177] copyRemoteCerts
	I0918 17:26:51.401967   98925 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:26:51.402009   98925 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ha-078118-m04
	I0918 17:26:51.420590   98925 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32838 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/ha-078118-m04/id_rsa Username:docker}
	W0918 17:26:51.455907   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:51.455939   98925 retry.go:31] will retry after 258.214985ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:51.750678   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:51.750708   98925 retry.go:31] will retry after 397.103703ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	W0918 17:26:52.183779   98925 sshutil.go:64] dial failure (will retry): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	I0918 17:26:52.183809   98925 retry.go:31] will retry after 748.172201ms: ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain
	
	
	==> CRI-O <==
	Sep 18 17:04:10 ha-078118 crio[559]: time="2025-09-18 17:04:10.768623784Z" level=info msg="Started container" PID=1313 containerID=ede5dfb053ec112aa44a521d4a0df69e309b8df821b02840e79da8a0797ab6a2 description=kube-system/coredns-66bc5c9577-q42l7/coredns id=dba74ab5-5a52-417e-b4d5-8c8607899a15 name=/runtime.v1.RuntimeService/StartContainer sandboxID=f61c7bb814392b8dbad8c4cb06f3a35f4a77d15e6db338ffe78262a7c2cf65ab
	Sep 18 17:04:10 ha-078118 crio[559]: time="2025-09-18 17:04:10.768637384Z" level=info msg="Started container" PID=1315 containerID=7c74a0b44f89fbc827151c15542f0e91293add6906088693065cc234c5f9dc99 description=default/busybox-7b57f96db7-8z4jq/busybox id=ee9bb2dd-67ea-4bb2-bd17-74799866840e name=/runtime.v1.RuntimeService/StartContainer sandboxID=22e4454486fe924c3684280a4e5314a2343872de94440c9e82a59233274e0cc8
	Sep 18 17:04:21 ha-078118 crio[559]: time="2025-09-18 17:04:21.181768484Z" level=info msg="CNI monitoring event \"/etc/cni/net.d/10-kindnet.conflist.temp\": CREATE"
	Sep 18 17:04:21 ha-078118 crio[559]: time="2025-09-18 17:04:21.186047605Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
	Sep 18 17:04:21 ha-078118 crio[559]: time="2025-09-18 17:04:21.186080118Z" level=info msg="Updated default CNI network name to kindnet"
	Sep 18 17:04:21 ha-078118 crio[559]: time="2025-09-18 17:04:21.186094528Z" level=info msg="CNI monitoring event \"/etc/cni/net.d/10-kindnet.conflist.temp\": WRITE"
	Sep 18 17:04:21 ha-078118 crio[559]: time="2025-09-18 17:04:21.189756931Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
	Sep 18 17:04:21 ha-078118 crio[559]: time="2025-09-18 17:04:21.189784350Z" level=info msg="Updated default CNI network name to kindnet"
	Sep 18 17:04:21 ha-078118 crio[559]: time="2025-09-18 17:04:21.189796566Z" level=info msg="CNI monitoring event \"/etc/cni/net.d/10-kindnet.conflist.temp\": RENAME"
	Sep 18 17:04:21 ha-078118 crio[559]: time="2025-09-18 17:04:21.193365222Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
	Sep 18 17:04:21 ha-078118 crio[559]: time="2025-09-18 17:04:21.193400299Z" level=info msg="Updated default CNI network name to kindnet"
	Sep 18 17:04:21 ha-078118 crio[559]: time="2025-09-18 17:04:21.193426056Z" level=info msg="CNI monitoring event \"/etc/cni/net.d/10-kindnet.conflist\": CREATE"
	Sep 18 17:04:21 ha-078118 crio[559]: time="2025-09-18 17:04:21.197018279Z" level=info msg="Found CNI network kindnet (type=ptp) at /etc/cni/net.d/10-kindnet.conflist"
	Sep 18 17:04:21 ha-078118 crio[559]: time="2025-09-18 17:04:21.197046446Z" level=info msg="Updated default CNI network name to kindnet"
	Sep 18 17:04:41 ha-078118 crio[559]: time="2025-09-18 17:04:41.266667879Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=d35aa264-11df-4a6d-abcc-ad175f5684d7 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:04:41 ha-078118 crio[559]: time="2025-09-18 17:04:41.266987629Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,RepoTags:[gcr.io/k8s-minikube/storage-provisioner:v5],RepoDigests:[gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944 gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f],Size_:31470524,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=d35aa264-11df-4a6d-abcc-ad175f5684d7 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:04:41 ha-078118 crio[559]: time="2025-09-18 17:04:41.267694705Z" level=info msg="Checking image status: gcr.io/k8s-minikube/storage-provisioner:v5" id=03e521f7-0044-4381-8b6c-269820a33397 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:04:41 ha-078118 crio[559]: time="2025-09-18 17:04:41.267902807Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,RepoTags:[gcr.io/k8s-minikube/storage-provisioner:v5],RepoDigests:[gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944 gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f],Size_:31470524,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=03e521f7-0044-4381-8b6c-269820a33397 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:04:41 ha-078118 crio[559]: time="2025-09-18 17:04:41.268832955Z" level=info msg="Creating container: kube-system/storage-provisioner/storage-provisioner" id=d4802ecf-f6f4-4d8f-b3f7-9c2b4bf56787 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 17:04:41 ha-078118 crio[559]: time="2025-09-18 17:04:41.268985788Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 17:04:41 ha-078118 crio[559]: time="2025-09-18 17:04:41.280928223Z" level=warning msg="Failed to open /etc/passwd: open /var/lib/containers/storage/overlay/0dfbae3213bce595a2d4fe32dd20b8b35a098445714f87ae6ce149298f25cfe0/merged/etc/passwd: no such file or directory"
	Sep 18 17:04:41 ha-078118 crio[559]: time="2025-09-18 17:04:41.280975167Z" level=warning msg="Failed to open /etc/group: open /var/lib/containers/storage/overlay/0dfbae3213bce595a2d4fe32dd20b8b35a098445714f87ae6ce149298f25cfe0/merged/etc/group: no such file or directory"
	Sep 18 17:04:41 ha-078118 crio[559]: time="2025-09-18 17:04:41.341133391Z" level=info msg="Created container dd25491f43668065ea062e97f94af73550e15925bb09a86c525e9a36919219af: kube-system/storage-provisioner/storage-provisioner" id=d4802ecf-f6f4-4d8f-b3f7-9c2b4bf56787 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 17:04:41 ha-078118 crio[559]: time="2025-09-18 17:04:41.341751257Z" level=info msg="Starting container: dd25491f43668065ea062e97f94af73550e15925bb09a86c525e9a36919219af" id=ee59a3a2-efcc-4e91-8ecc-03050644f8a2 name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 17:04:41 ha-078118 crio[559]: time="2025-09-18 17:04:41.348815539Z" level=info msg="Started container" PID=1684 containerID=dd25491f43668065ea062e97f94af73550e15925bb09a86c525e9a36919219af description=kube-system/storage-provisioner/storage-provisioner id=ee59a3a2-efcc-4e91-8ecc-03050644f8a2 name=/runtime.v1.RuntimeService/StartContainer sandboxID=7599713ceef6cb71460a7929e79183dda4164faa57a2344bfcec024d8d14449f
	
	
	==> container status <==
	CONTAINER           IMAGE                                                              CREATED             STATE               NAME                      ATTEMPT             POD ID              POD
	dd25491f43668       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562   22 minutes ago      Running             storage-provisioner       4                   7599713ceef6c       storage-provisioner
	ede5dfb053ec1       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969   22 minutes ago      Running             coredns                   2                   f61c7bb814392       coredns-66bc5c9577-q42l7
	7c74a0b44f89f       8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a   22 minutes ago      Running             busybox                   1                   22e4454486fe9       busybox-7b57f96db7-8z4jq
	c6684d05207d3       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969   22 minutes ago      Running             coredns                   2                   0357e9603bb59       coredns-66bc5c9577-g9xk6
	2db521366a206       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562   22 minutes ago      Exited              storage-provisioner       3                   7599713ceef6c       storage-provisioner
	9b1b328f9233d       409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c   22 minutes ago      Running             kindnet-cni               2                   ee736983cc83e       kindnet-vqp76
	3a743c99dfe03       df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce   22 minutes ago      Running             kube-proxy                2                   65a5f46d0836b       kube-proxy-b98xh
	43048a92d5839       a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634   22 minutes ago      Running             kube-controller-manager   2                   c26eaf4321889       kube-controller-manager-ha-078118
	3b65eba8e30c8       5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115   22 minutes ago      Running             etcd                      2                   a9ccbdccacce7       etcd-ha-078118
	842c69441e845       46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc   22 minutes ago      Running             kube-scheduler            2                   ae517ed2a07bb       kube-scheduler-ha-078118
	6619114399ef8       90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90   22 minutes ago      Running             kube-apiserver            2                   9a6bf8cb7f7b6       kube-apiserver-ha-078118
	28ecd0ad097ae       765655ea6078171c416896d7cc155c1263a0411d30caaa03d7365aecb99fdf23   22 minutes ago      Running             kube-vip                  2                   209af448cbe87       kube-vip-ha-078118
	
	
	==> coredns [c6684d05207d3936b10b3d7844245d14571ed5799b4408b8cc77d7e3f81968e8] <==
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
	.:53
	[INFO] plugin/reload: Running configuration SHA512 = 9e2996f8cb67ac53e0259ab1f8d615d07d1beb0bd07e6a1e39769c3bf486a905bb991cc47f8d2f14d0d3a90a87dfc625a0b4c524fed169d8158c40657c0694b1
	CoreDNS-1.12.1
	linux/amd64, go1.24.1, 707c7c1
	[INFO] 127.0.0.1:48829 - 37717 "HINFO IN 2048841733525433178.8151176625366763875. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.01927045s
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	[ERROR] plugin/kubernetes: Unhandled Error
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	[ERROR] plugin/kubernetes: Unhandled Error
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	[ERROR] plugin/kubernetes: Unhandled Error
	
	
	==> coredns [ede5dfb053ec112aa44a521d4a0df69e309b8df821b02840e79da8a0797ab6a2] <==
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server
	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API
	.:53
	[INFO] plugin/reload: Running configuration SHA512 = 9e2996f8cb67ac53e0259ab1f8d615d07d1beb0bd07e6a1e39769c3bf486a905bb991cc47f8d2f14d0d3a90a87dfc625a0b4c524fed169d8158c40657c0694b1
	CoreDNS-1.12.1
	linux/amd64, go1.24.1, 707c7c1
	[INFO] 127.0.0.1:54839 - 52461 "HINFO IN 2930237926206193246.4384494755853909047. udp 57 false 512" NXDOMAIN qr,rd,ra 132 0.027362394s
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	[ERROR] plugin/kubernetes: Unhandled Error
	[ERROR] plugin/kubernetes: Unhandled Error
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	[ERROR] plugin/kubernetes: Unhandled Error
	
	
	==> describe nodes <==
	Name:               ha-078118
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2025_09_18T16_57_20_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:57:14 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:26:56 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 17:25:48 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 17:25:48 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 17:25:48 +0000   Thu, 18 Sep 2025 16:57:13 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 17:25:48 +0000   Thu, 18 Sep 2025 16:57:34 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ha-078118
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 46242c4d8ebc4188b8311460c493a1ef
	  System UUID:                910bee46-adcd-4833-91ec-cea7d3c2588c
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (11 in total)
	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---
	  default                     busybox-7b57f96db7-8z4jq             0 (0%)        0 (0%)      0 (0%)           0 (0%)         24m
	  kube-system                 coredns-66bc5c9577-g9xk6             100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     29m
	  kube-system                 coredns-66bc5c9577-q42l7             100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     29m
	  kube-system                 etcd-ha-078118                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         29m
	  kube-system                 kindnet-vqp76                        100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      29m
	  kube-system                 kube-apiserver-ha-078118             250m (3%)     0 (0%)      0 (0%)           0 (0%)         29m
	  kube-system                 kube-controller-manager-ha-078118    200m (2%)     0 (0%)      0 (0%)           0 (0%)         29m
	  kube-system                 kube-proxy-b98xh                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         29m
	  kube-system                 kube-scheduler-ha-078118             100m (1%)     0 (0%)      0 (0%)           0 (0%)         29m
	  kube-system                 kube-vip-ha-078118                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         24m
	  kube-system                 storage-provisioner                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         29m
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (11%)  100m (1%)
	  memory             290Mi (0%)  390Mi (1%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                From             Message
	  ----    ------                   ----               ----             -------
	  Normal  Starting                 29m                kube-proxy       
	  Normal  Starting                 22m                kube-proxy       
	  Normal  Starting                 24m                kube-proxy       
	  Normal  Starting                 29m                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  29m (x8 over 29m)  kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    29m (x8 over 29m)  kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     29m (x8 over 29m)  kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  NodeHasSufficientPID     29m                kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  Starting                 29m                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  29m                kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    29m                kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  RegisteredNode           29m                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  NodeReady                29m                kubelet          Node ha-078118 status is now: NodeReady
	  Normal  RegisteredNode           29m                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           28m                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           26m                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  NodeHasNoDiskPressure    25m (x8 over 25m)  kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 25m                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  25m (x8 over 25m)  kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     25m (x8 over 25m)  kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           24m                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           24m                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           24m                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  Starting                 22m                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  22m (x8 over 22m)  kubelet          Node ha-078118 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    22m (x8 over 22m)  kubelet          Node ha-078118 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     22m (x8 over 22m)  kubelet          Node ha-078118 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           22m                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	  Normal  RegisteredNode           22m                node-controller  Node ha-078118 event: Registered Node ha-078118 in Controller
	
	
	Name:               ha-078118-m02
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ha-078118-m02
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=ha-078118
	                    minikube.k8s.io/primary=false
	                    minikube.k8s.io/updated_at=2025_09_18T16_57_51_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 16:57:50 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ha-078118-m02
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:26:57 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 17:24:53 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 17:24:53 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 17:24:53 +0000   Thu, 18 Sep 2025 16:57:50 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 17:24:53 +0000   Thu, 18 Sep 2025 17:05:51 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.3
	  Hostname:    ha-078118-m02
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 2a22028596b24a078240c0ec9969c515
	  System UUID:                0093212b-e7dd-4bdc-8376-480f39da7714
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.1.0/24
	PodCIDRs:                     10.244.1.0/24
	Non-terminated Pods:          (9 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     busybox-7b57f96db7-bzrv2                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         27m
	  default                     busybox-7b57f96db7-t7rzr                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         27m
	  kube-system                 etcd-ha-078118-m02                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         29m
	  kube-system                 kindnet-jnlbr                            100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      29m
	  kube-system                 kube-apiserver-ha-078118-m02             250m (3%)     0 (0%)      0 (0%)           0 (0%)         29m
	  kube-system                 kube-controller-manager-ha-078118-m02    200m (2%)     0 (0%)      0 (0%)           0 (0%)         29m
	  kube-system                 kube-proxy-t5wdg                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         29m
	  kube-system                 kube-scheduler-ha-078118-m02             100m (1%)     0 (0%)      0 (0%)           0 (0%)         29m
	  kube-system                 kube-vip-ha-078118-m02                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         29m
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%)   100m (1%)
	  memory             150Mi (0%)  50Mi (0%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type     Reason                   Age                From             Message
	  ----     ------                   ----               ----             -------
	  Normal   Starting                 21m                kube-proxy       
	  Normal   Starting                 29m                kube-proxy       
	  Normal   RegisteredNode           29m                node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal   RegisteredNode           29m                node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal   RegisteredNode           28m                node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal   Starting                 26m                kubelet          Starting kubelet.
	  Normal   NodeHasSufficientPID     26m (x8 over 26m)  kubelet          Node ha-078118-m02 status is now: NodeHasSufficientPID
	  Normal   NodeHasNoDiskPressure    26m (x8 over 26m)  kubelet          Node ha-078118-m02 status is now: NodeHasNoDiskPressure
	  Normal   NodeHasSufficientMemory  26m (x8 over 26m)  kubelet          Node ha-078118-m02 status is now: NodeHasSufficientMemory
	  Normal   RegisteredNode           26m                node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal   NodeHasSufficientPID     25m (x8 over 25m)  kubelet          Node ha-078118-m02 status is now: NodeHasSufficientPID
	  Normal   NodeHasNoDiskPressure    25m (x8 over 25m)  kubelet          Node ha-078118-m02 status is now: NodeHasNoDiskPressure
	  Normal   Starting                 25m                kubelet          Starting kubelet.
	  Normal   NodeHasSufficientMemory  25m (x8 over 25m)  kubelet          Node ha-078118-m02 status is now: NodeHasSufficientMemory
	  Normal   RegisteredNode           24m                node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal   RegisteredNode           24m                node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal   RegisteredNode           24m                node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal   Starting                 22m                kubelet          Starting kubelet.
	  Normal   NodeHasSufficientMemory  22m (x8 over 22m)  kubelet          Node ha-078118-m02 status is now: NodeHasSufficientMemory
	  Normal   NodeHasNoDiskPressure    22m (x8 over 22m)  kubelet          Node ha-078118-m02 status is now: NodeHasNoDiskPressure
	  Normal   NodeHasSufficientPID     22m (x8 over 22m)  kubelet          Node ha-078118-m02 status is now: NodeHasSufficientPID
	  Normal   RegisteredNode           22m                node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Normal   RegisteredNode           22m                node-controller  Node ha-078118-m02 event: Registered Node ha-078118-m02 in Controller
	  Warning  ContainerGCFailed        21m                kubelet          rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory"
	
	
	==> dmesg <==
	[  +0.089038] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
	[  +0.028015] systemd[1]: /lib/systemd/system/snapd.service:23: Unknown key name 'RestartMode' in section 'Service', ignoring.
	[  +7.570818] kauditd_printk_skb: 47 callbacks suppressed
	[Sep18 16:41] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.013586] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023854] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023944] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023869] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000008] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +1.023927] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000033] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +2.047789] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +4.031621] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000030] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[  +8.127251] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000009] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[Sep18 16:42] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000025] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	[ +32.253146] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: fa 36 28 54 6f 88 02 5d 01 4c 3c 5c 08 00
	
	
	==> etcd [3b65eba8e30c8676a68101e03ef4944f80bc8b00c9db6697f5d5265fa0047e45] <==
	{"level":"warn","ts":"2025-09-18T17:26:58.441654Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:58.541736Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:58.582284Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:58.630147Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:58.635615Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:58.642047Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:58.671636Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:58.742273Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:58.842020Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:58.911474Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:58.941599Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:59.002112Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:59.007280Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:59.009760Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:59.014473Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:59.022587Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:59.030166Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:59.033381Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:59.035960Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:59.037876Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:59.039491Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:59.041263Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:59.048237Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:59.057086Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	{"level":"warn","ts":"2025-09-18T17:26:59.087188Z","caller":"rafthttp/peer.go:254","msg":"dropped internal Raft message since sending buffer is full","message-type":"MsgHeartbeat","local-member-id":"aec36adc501070cc","from":"aec36adc501070cc","remote-peer-id":"4e0bda6b41205435","remote-peer-name":"pipeline","remote-peer-active":false}
	
	
	==> kernel <==
	 17:26:59 up  1:09,  0 users,  load average: 0.24, 0.21, 0.29
	Linux ha-078118 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [9b1b328f9233d6efffcc0abc9130a8faafb9faead88ae0fb3657c03fdaff9e08] <==
	I0918 17:25:51.182549       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:26:01.187845       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:26:01.187884       1 main.go:301] handling current node
	I0918 17:26:01.187899       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:26:01.187904       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:26:11.182615       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:26:11.182656       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:26:11.182864       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:26:11.182883       1 main.go:301] handling current node
	I0918 17:26:21.182668       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:26:21.182724       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:26:21.182923       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:26:21.182934       1 main.go:301] handling current node
	I0918 17:26:31.182565       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:26:31.182612       1 main.go:301] handling current node
	I0918 17:26:31.182646       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:26:31.182653       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:26:41.181996       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:26:41.182044       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	I0918 17:26:41.182263       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:26:41.182276       1 main.go:301] handling current node
	I0918 17:26:51.182521       1 main.go:297] Handling node with IPs: map[192.168.49.2:{}]
	I0918 17:26:51.182565       1 main.go:301] handling current node
	I0918 17:26:51.182581       1 main.go:297] Handling node with IPs: map[192.168.49.3:{}]
	I0918 17:26:51.182586       1 main.go:324] Node ha-078118-m02 has CIDR [10.244.1.0/24] 
	
	
	==> kube-apiserver [6619114399ef858a23bfea943db588c6e09732e8af74be096560c69f8c87bee3] <==
	I0918 17:13:11.867169       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:13:40.169831       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:14:09.563211       1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
	I0918 17:14:14.573119       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:14:40.359515       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:15:28.205765       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:16:08.243083       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:16:35.243699       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:17:30.360405       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:17:36.511431       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:18:38.516192       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:18:51.770469       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:19:57.509642       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:20:05.519894       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:21:17.131032       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:21:33.174784       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:22:17.952423       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:22:36.192908       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:23:33.463229       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:23:37.131680       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:24:09.563907       1 cidrallocator.go:277] updated ClusterIP allocator for Service CIDR 10.96.0.0/12
	I0918 17:24:38.625448       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:24:47.462865       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:25:46.712871       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	I0918 17:26:15.339929       1 stats.go:136] "Error getting keys" err="empty key: \"\""
	
	
	==> kube-controller-manager [43048a92d5839c23da2c52852cbb86d6e0149c70d2bbb834423355d509dc12fb] <==
	E0918 17:04:32.888465       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:04:32.888469       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:04:32.888476       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:04:52.889588       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:04:52.889615       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:04:52.889621       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:04:52.889626       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:04:52.889630       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	E0918 17:04:52.889634       1 gc_controller.go:151] "Failed to get node" err="node \"ha-078118-m03\" not found" logger="pod-garbage-collector-controller" node="ha-078118-m03"
	I0918 17:04:52.900717       1 gc_controller.go:343] "PodGC is force deleting Pod" logger="pod-garbage-collector-controller" pod="default/busybox-7b57f96db7-95578"
	I0918 17:04:52.922430       1 gc_controller.go:259] "Forced deletion of orphaned Pod succeeded" logger="pod-garbage-collector-controller" pod="default/busybox-7b57f96db7-95578"
	I0918 17:04:52.922463       1 gc_controller.go:343] "PodGC is force deleting Pod" logger="pod-garbage-collector-controller" pod="kube-system/kindnet-f2b4b"
	I0918 17:04:52.943033       1 gc_controller.go:259] "Forced deletion of orphaned Pod succeeded" logger="pod-garbage-collector-controller" pod="kube-system/kindnet-f2b4b"
	I0918 17:04:52.943075       1 gc_controller.go:343] "PodGC is force deleting Pod" logger="pod-garbage-collector-controller" pod="kube-system/kube-proxy-2pjrn"
	I0918 17:04:52.963866       1 gc_controller.go:259] "Forced deletion of orphaned Pod succeeded" logger="pod-garbage-collector-controller" pod="kube-system/kube-proxy-2pjrn"
	I0918 17:04:52.963902       1 gc_controller.go:343] "PodGC is force deleting Pod" logger="pod-garbage-collector-controller" pod="kube-system/kube-vip-ha-078118-m03"
	I0918 17:04:52.979684       1 gc_controller.go:259] "Forced deletion of orphaned Pod succeeded" logger="pod-garbage-collector-controller" pod="kube-system/kube-vip-ha-078118-m03"
	I0918 17:04:52.979721       1 gc_controller.go:343] "PodGC is force deleting Pod" logger="pod-garbage-collector-controller" pod="kube-system/kube-apiserver-ha-078118-m03"
	I0918 17:04:53.000433       1 gc_controller.go:259] "Forced deletion of orphaned Pod succeeded" logger="pod-garbage-collector-controller" pod="kube-system/kube-apiserver-ha-078118-m03"
	I0918 17:04:53.000469       1 gc_controller.go:343] "PodGC is force deleting Pod" logger="pod-garbage-collector-controller" pod="kube-system/kube-scheduler-ha-078118-m03"
	I0918 17:04:53.015877       1 gc_controller.go:259] "Forced deletion of orphaned Pod succeeded" logger="pod-garbage-collector-controller" pod="kube-system/kube-scheduler-ha-078118-m03"
	I0918 17:04:53.015912       1 gc_controller.go:343] "PodGC is force deleting Pod" logger="pod-garbage-collector-controller" pod="kube-system/etcd-ha-078118-m03"
	I0918 17:04:53.035594       1 gc_controller.go:259] "Forced deletion of orphaned Pod succeeded" logger="pod-garbage-collector-controller" pod="kube-system/etcd-ha-078118-m03"
	I0918 17:04:53.035625       1 gc_controller.go:343] "PodGC is force deleting Pod" logger="pod-garbage-collector-controller" pod="kube-system/kube-controller-manager-ha-078118-m03"
	I0918 17:04:53.056370       1 gc_controller.go:259] "Forced deletion of orphaned Pod succeeded" logger="pod-garbage-collector-controller" pod="kube-system/kube-controller-manager-ha-078118-m03"
	
	
	==> kube-proxy [3a743c99dfe0329700943a99c04808008ef1a9ac5cab63fc43a52fe172d05a68] <==
	I0918 17:04:10.767944       1 server_linux.go:53] "Using iptables proxy"
	I0918 17:04:10.846866       1 shared_informer.go:349] "Waiting for caches to sync" controller="node informer cache"
	I0918 17:04:10.948126       1 shared_informer.go:356] "Caches are synced" controller="node informer cache"
	I0918 17:04:10.948252       1 server.go:219] "Successfully retrieved NodeIPs" NodeIPs=["192.168.49.2"]
	E0918 17:04:10.948375       1 server.go:256] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
	I0918 17:04:10.975075       1 server.go:265] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0918 17:04:10.975205       1 server_linux.go:132] "Using iptables Proxier"
	I0918 17:04:10.982883       1 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
	I0918 17:04:10.983400       1 server.go:527] "Version info" version="v1.34.0"
	I0918 17:04:10.983480       1 server.go:529] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 17:04:10.984982       1 config.go:106] "Starting endpoint slice config controller"
	I0918 17:04:10.985004       1 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config"
	I0918 17:04:10.985077       1 config.go:403] "Starting serviceCIDR config controller"
	I0918 17:04:10.985086       1 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config"
	I0918 17:04:10.985111       1 config.go:200] "Starting service config controller"
	I0918 17:04:10.985124       1 shared_informer.go:349] "Waiting for caches to sync" controller="service config"
	I0918 17:04:10.985450       1 config.go:309] "Starting node config controller"
	I0918 17:04:10.986194       1 shared_informer.go:349] "Waiting for caches to sync" controller="node config"
	I0918 17:04:10.986209       1 shared_informer.go:356] "Caches are synced" controller="node config"
	I0918 17:04:11.085823       1 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config"
	I0918 17:04:11.085849       1 shared_informer.go:356] "Caches are synced" controller="service config"
	I0918 17:04:11.085866       1 shared_informer.go:356] "Caches are synced" controller="endpoint slice config"
	
	
	==> kube-scheduler [842c69441e845ead0676f16f948acd79bf80c19fd36c2454236ae28ab874d96e] <==
	I0918 17:04:05.258464       1 serving.go:386] Generated self-signed cert in-memory
	W0918 17:04:09.550931       1 requestheader_controller.go:204] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'
	W0918 17:04:09.550970       1 authentication.go:397] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"
	W0918 17:04:09.550983       1 authentication.go:398] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0918 17:04:09.550993       1 authentication.go:399] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0918 17:04:09.577454       1 server.go:175] "Starting Kubernetes Scheduler" version="v1.34.0"
	I0918 17:04:09.577585       1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 17:04:09.580680       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0918 17:04:09.580722       1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0918 17:04:09.581128       1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
	I0918 17:04:09.581154       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
	I0918 17:04:09.681789       1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	
	
	==> kubelet <==
	Sep 18 17:24:54 ha-078118 kubelet[716]: E0918 17:24:54.336116     716 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758216294335797268  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:25:04 ha-078118 kubelet[716]: E0918 17:25:04.337685     716 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758216304337403406  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:25:04 ha-078118 kubelet[716]: E0918 17:25:04.337715     716 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758216304337403406  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:25:14 ha-078118 kubelet[716]: E0918 17:25:14.338895     716 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758216314338662136  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:25:14 ha-078118 kubelet[716]: E0918 17:25:14.338936     716 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758216314338662136  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:25:24 ha-078118 kubelet[716]: E0918 17:25:24.340276     716 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758216324340058764  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:25:24 ha-078118 kubelet[716]: E0918 17:25:24.340307     716 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758216324340058764  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:25:34 ha-078118 kubelet[716]: E0918 17:25:34.341909     716 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758216334341662899  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:25:34 ha-078118 kubelet[716]: E0918 17:25:34.341950     716 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758216334341662899  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:25:44 ha-078118 kubelet[716]: E0918 17:25:44.342878     716 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758216344342661112  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:25:44 ha-078118 kubelet[716]: E0918 17:25:44.342916     716 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758216344342661112  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:25:54 ha-078118 kubelet[716]: E0918 17:25:54.344570     716 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758216354344295530  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:25:54 ha-078118 kubelet[716]: E0918 17:25:54.344608     716 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758216354344295530  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:26:04 ha-078118 kubelet[716]: E0918 17:26:04.345981     716 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758216364345739379  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:26:04 ha-078118 kubelet[716]: E0918 17:26:04.346018     716 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758216364345739379  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:26:14 ha-078118 kubelet[716]: E0918 17:26:14.347165     716 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758216374346947321  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:26:14 ha-078118 kubelet[716]: E0918 17:26:14.347204     716 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758216374346947321  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:26:24 ha-078118 kubelet[716]: E0918 17:26:24.348295     716 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758216384348076154  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:26:24 ha-078118 kubelet[716]: E0918 17:26:24.348532     716 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758216384348076154  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:26:34 ha-078118 kubelet[716]: E0918 17:26:34.349744     716 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758216394349553504  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:26:34 ha-078118 kubelet[716]: E0918 17:26:34.349774     716 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758216394349553504  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:26:44 ha-078118 kubelet[716]: E0918 17:26:44.350933     716 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758216404350655527  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:26:44 ha-078118 kubelet[716]: E0918 17:26:44.350971     716 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758216404350655527  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:26:54 ha-078118 kubelet[716]: E0918 17:26:54.352155     716 eviction_manager.go:259] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: image_filesystems:{timestamp:1758216414351939592  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	Sep 18 17:26:54 ha-078118 kubelet[716]: E0918 17:26:54.352193     716 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: image_filesystems:{timestamp:1758216414351939592  fs_id:{mountpoint:\"/var/lib/containers/storage/overlay-images\"}  used_bytes:{value:149445}  inodes_used:{value:69}}"
	

                                                
                                                
-- /stdout --
helpers_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-078118 -n ha-078118
helpers_test.go:269: (dbg) Run:  kubectl --context ha-078118 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:293: <<< TestMultiControlPlane/serial/RestartCluster FAILED: end of post-mortem logs <<<
helpers_test.go:294: ---------------------/post-mortem---------------------------------
--- FAIL: TestMultiControlPlane/serial/RestartCluster (1382.47s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (7.64s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 pause -p default-k8s-diff-port-804544 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-804544 -n default-k8s-diff-port-804544
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-804544 -n default-k8s-diff-port-804544: exit status 2 (334.309852ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-diff-port-804544 -n default-k8s-diff-port-804544
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-diff-port-804544 -n default-k8s-diff-port-804544: exit status 2 (346.121473ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 unpause -p default-k8s-diff-port-804544 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-804544 -n default-k8s-diff-port-804544
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-804544 -n default-k8s-diff-port-804544: exit status 2 (380.363049ms)

                                                
                                                
-- stdout --
	Running

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-diff-port-804544 -n default-k8s-diff-port-804544
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-diff-port-804544 -n default-k8s-diff-port-804544: exit status 2 (341.877409ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: post-unpause kubelet status = "Stopped"; want = "Running"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======>  post-mortem[TestStartStop/group/default-k8s-diff-port/serial/Pause]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======>  post-mortem[TestStartStop/group/default-k8s-diff-port/serial/Pause]: docker inspect <======
helpers_test.go:239: (dbg) Run:  docker inspect default-k8s-diff-port-804544
helpers_test.go:243: (dbg) docker inspect default-k8s-diff-port-804544:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "269f3d4aa72cda3a966c9a506e1c80eac35663055eb0e589cecaf1ce540554a4",
	        "Created": "2025-09-18T17:47:02.35854927Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 303964,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2025-09-18T17:48:05.463226539Z",
	            "FinishedAt": "2025-09-18T17:48:04.251088463Z"
	        },
	        "Image": "sha256:c6b5532e987b5b4f5fc9cb0336e378ed49c0542bad8cbfc564b71e977a6269de",
	        "ResolvConfPath": "/var/lib/docker/containers/269f3d4aa72cda3a966c9a506e1c80eac35663055eb0e589cecaf1ce540554a4/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/269f3d4aa72cda3a966c9a506e1c80eac35663055eb0e589cecaf1ce540554a4/hostname",
	        "HostsPath": "/var/lib/docker/containers/269f3d4aa72cda3a966c9a506e1c80eac35663055eb0e589cecaf1ce540554a4/hosts",
	        "LogPath": "/var/lib/docker/containers/269f3d4aa72cda3a966c9a506e1c80eac35663055eb0e589cecaf1ce540554a4/269f3d4aa72cda3a966c9a506e1c80eac35663055eb0e589cecaf1ce540554a4-json.log",
	        "Name": "/default-k8s-diff-port-804544",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "default-k8s-diff-port-804544:/var",
	                "/lib/modules:/lib/modules:ro"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "default-k8s-diff-port-804544",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8444/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "private",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 3221225472,
	            "NanoCpus": 0,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 6442450944,
	            "MemorySwappiness": null,
	            "OomKillDisable": null,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "ID": "269f3d4aa72cda3a966c9a506e1c80eac35663055eb0e589cecaf1ce540554a4",
	                "LowerDir": "/var/lib/docker/overlay2/441907fb9ac7ef8f9de885b88ce749a8c9f2bed7a74da921e144ddfa53653500-init/diff:/var/lib/docker/overlay2/1fd2bbb67ab9e5bb8d4549665a1a228eadda56df39fee53908cd735ea16a4e10/diff",
	                "MergedDir": "/var/lib/docker/overlay2/441907fb9ac7ef8f9de885b88ce749a8c9f2bed7a74da921e144ddfa53653500/merged",
	                "UpperDir": "/var/lib/docker/overlay2/441907fb9ac7ef8f9de885b88ce749a8c9f2bed7a74da921e144ddfa53653500/diff",
	                "WorkDir": "/var/lib/docker/overlay2/441907fb9ac7ef8f9de885b88ce749a8c9f2bed7a74da921e144ddfa53653500/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "default-k8s-diff-port-804544",
	                "Source": "/var/lib/docker/volumes/default-k8s-diff-port-804544/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "default-k8s-diff-port-804544",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8444/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "default-k8s-diff-port-804544",
	                "name.minikube.sigs.k8s.io": "default-k8s-diff-port-804544",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "aefc542d1ec51051c68c9ce06fba9f53f6b543849c0e7e16e5c632e2881f5824",
	            "SandboxKey": "/var/run/docker/netns/aefc542d1ec5",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33107"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33108"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33111"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33109"
	                    }
	                ],
	                "8444/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33110"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "default-k8s-diff-port-804544": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.85.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "3e:8f:da:a2:ba:fa",
	                    "DriverOpts": null,
	                    "GwPriority": 0,
	                    "NetworkID": "f42923e7256b73f73e187b3fa79467c8697361e3bd8ba9e460f9495998bb7372",
	                    "EndpointID": "5a149f6583c93ec72d846729c817578d0c7c2a194959ba0d0f12d065fc1106d3",
	                    "Gateway": "192.168.85.1",
	                    "IPAddress": "192.168.85.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "default-k8s-diff-port-804544",
	                        "269f3d4aa72c"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-804544 -n default-k8s-diff-port-804544
helpers_test.go:252: <<< TestStartStop/group/default-k8s-diff-port/serial/Pause FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======>  post-mortem[TestStartStop/group/default-k8s-diff-port/serial/Pause]: minikube logs <======
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 -p default-k8s-diff-port-804544 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p default-k8s-diff-port-804544 logs -n 25: (1.356423443s)
helpers_test.go:260: TestStartStop/group/default-k8s-diff-port/serial/Pause logs: 
-- stdout --
	
	==> Audit <==
	┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬──────────────
───────┐
	│ COMMAND │                                                                                                                     ARGS                                                                                                                      │           PROFILE            │  USER   │ VERSION │     START TIME      │      END TIME       │
	├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼──────────────
───────┤
	│ addons  │ enable metrics-server -p newest-cni-956166 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain                                                                                                       │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ stop    │ -p newest-cni-956166 --alsologtostderr -v=3                                                                                                                                                                                                   │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ image   │ old-k8s-version-525513 image list --format=json                                                                                                                                                                                               │ old-k8s-version-525513       │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ pause   │ -p old-k8s-version-525513 --alsologtostderr -v=1                                                                                                                                                                                              │ old-k8s-version-525513       │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ addons  │ enable dashboard -p newest-cni-956166 --images=MetricsScraper=registry.k8s.io/echoserver:1.4                                                                                                                                                  │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ start   │ -p newest-cni-956166 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0 │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ unpause │ -p old-k8s-version-525513 --alsologtostderr -v=1                                                                                                                                                                                              │ old-k8s-version-525513       │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ delete  │ -p old-k8s-version-525513                                                                                                                                                                                                                     │ old-k8s-version-525513       │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ addons  │ enable metrics-server -p default-k8s-diff-port-804544 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain                                                                                            │ default-k8s-diff-port-804544 │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ delete  │ -p old-k8s-version-525513                                                                                                                                                                                                                     │ old-k8s-version-525513       │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ start   │ -p auto-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=crio                                                                                                                       │ auto-749287                  │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │                     │
	│ stop    │ -p default-k8s-diff-port-804544 --alsologtostderr -v=3                                                                                                                                                                                        │ default-k8s-diff-port-804544 │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:48 UTC │
	│ image   │ newest-cni-956166 image list --format=json                                                                                                                                                                                                    │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ pause   │ -p newest-cni-956166 --alsologtostderr -v=1                                                                                                                                                                                                   │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ addons  │ enable dashboard -p embed-certs-391175 --images=MetricsScraper=registry.k8s.io/echoserver:1.4                                                                                                                                                 │ embed-certs-391175           │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ start   │ -p embed-certs-391175 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0                                                                                        │ embed-certs-391175           │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │                     │
	│ unpause │ -p newest-cni-956166 --alsologtostderr -v=1                                                                                                                                                                                                   │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ delete  │ -p newest-cni-956166                                                                                                                                                                                                                          │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ delete  │ -p newest-cni-956166                                                                                                                                                                                                                          │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ start   │ -p kindnet-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=crio                                                                                                      │ kindnet-749287               │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │                     │
	│ addons  │ enable dashboard -p default-k8s-diff-port-804544 --images=MetricsScraper=registry.k8s.io/echoserver:1.4                                                                                                                                       │ default-k8s-diff-port-804544 │ jenkins │ v1.37.0 │ 18 Sep 25 17:48 UTC │ 18 Sep 25 17:48 UTC │
	│ start   │ -p default-k8s-diff-port-804544 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0                                                                      │ default-k8s-diff-port-804544 │ jenkins │ v1.37.0 │ 18 Sep 25 17:48 UTC │ 18 Sep 25 17:48 UTC │
	│ image   │ default-k8s-diff-port-804544 image list --format=json                                                                                                                                                                                         │ default-k8s-diff-port-804544 │ jenkins │ v1.37.0 │ 18 Sep 25 17:48 UTC │ 18 Sep 25 17:48 UTC │
	│ pause   │ -p default-k8s-diff-port-804544 --alsologtostderr -v=1                                                                                                                                                                                        │ default-k8s-diff-port-804544 │ jenkins │ v1.37.0 │ 18 Sep 25 17:48 UTC │ 18 Sep 25 17:48 UTC │
	│ unpause │ -p default-k8s-diff-port-804544 --alsologtostderr -v=1                                                                                                                                                                                        │ default-k8s-diff-port-804544 │ jenkins │ v1.37.0 │ 18 Sep 25 17:48 UTC │ 18 Sep 25 17:48 UTC │
	└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴──────────────
───────┘
	
	
	==> Last Start <==
	Log file created at: 2025/09/18 17:48:05
	Running on machine: ubuntu-20-agent-4
	Binary: Built with gc go1.24.6 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0918 17:48:05.104467  303479 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:48:05.104675  303479 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:48:05.104688  303479 out.go:374] Setting ErrFile to fd 2...
	I0918 17:48:05.104694  303479 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:48:05.105016  303479 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:48:05.105649  303479 out.go:368] Setting JSON to false
	I0918 17:48:05.107089  303479 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":5436,"bootTime":1758212249,"procs":302,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 17:48:05.107167  303479 start.go:140] virtualization: kvm guest
	I0918 17:48:05.112217  303479 out.go:179] * [default-k8s-diff-port-804544] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 17:48:05.114302  303479 notify.go:220] Checking for updates...
	I0918 17:48:05.114347  303479 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 17:48:05.116328  303479 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 17:48:05.117812  303479 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:48:05.119295  303479 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 17:48:05.120666  303479 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 17:48:05.122239  303479 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 17:48:05.124219  303479 config.go:182] Loaded profile config "default-k8s-diff-port-804544": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:48:05.124981  303479 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 17:48:05.158579  303479 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 17:48:05.158756  303479 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:48:05.253058  303479 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:67 OomKillDisable:false NGoroutines:79 SystemTime:2025-09-18 17:48:05.240339273 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:48:05.253257  303479 docker.go:318] overlay module found
	I0918 17:48:05.255655  303479 out.go:179] * Using the docker driver based on existing profile
	I0918 17:48:05.257411  303479 start.go:304] selected driver: docker
	I0918 17:48:05.257438  303479 start.go:924] validating driver "docker" against &{Name:default-k8s-diff-port-804544 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:default-k8s-diff-port-804544 Namespace:default APIServerHAVIP: APIServerName
:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2
000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:48:05.257600  303479 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 17:48:05.258347  303479 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:48:05.348898  303479 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:68 OomKillDisable:false NGoroutines:79 SystemTime:2025-09-18 17:48:05.333390393 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:48:05.349481  303479 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:48:05.349534  303479 cni.go:84] Creating CNI manager for ""
	I0918 17:48:05.349648  303479 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0918 17:48:05.349841  303479 start.go:348] cluster config:
	{Name:default-k8s-diff-port-804544 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:default-k8s-diff-port-804544 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR
untime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mou
ntType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:48:05.355928  303479 out.go:179] * Starting "default-k8s-diff-port-804544" primary control-plane node in "default-k8s-diff-port-804544" cluster
	I0918 17:48:05.360395  303479 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:48:05.365141  303479 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:48:05.367134  303479 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:48:05.367189  303479 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
	I0918 17:48:05.367199  303479 cache.go:58] Caching tarball of preloaded images
	I0918 17:48:05.367264  303479 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:48:05.367456  303479 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:48:05.367522  303479 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:48:05.367740  303479 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/config.json ...
	I0918 17:48:05.398121  303479 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:48:05.398170  303479 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:48:05.398204  303479 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:48:05.398253  303479 start.go:360] acquireMachinesLock for default-k8s-diff-port-804544: {Name:mk320d693d9925aca2155df4806cccf3e3eeddcc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:48:05.398356  303479 start.go:364] duration metric: took 83.388µs to acquireMachinesLock for "default-k8s-diff-port-804544"
	I0918 17:48:05.398392  303479 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:48:05.398399  303479 fix.go:54] fixHost starting: 
	I0918 17:48:05.398726  303479 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-804544 --format={{.State.Status}}
	I0918 17:48:05.424565  303479 fix.go:112] recreateIfNeeded on default-k8s-diff-port-804544: state=Stopped err=<nil>
	W0918 17:48:05.424627  303479 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:48:06.426494  298506 node_ready.go:49] node "embed-certs-391175" is "Ready"
	I0918 17:48:06.426543  298506 node_ready.go:38] duration metric: took 2.372809674s for node "embed-certs-391175" to be "Ready" ...
	I0918 17:48:06.426560  298506 api_server.go:52] waiting for apiserver process to appear ...
	I0918 17:48:06.426614  298506 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:48:07.250023  298506 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (2.967119451s)
	I0918 17:48:07.250058  298506 addons.go:479] Verifying addon metrics-server=true in "embed-certs-391175"
	I0918 17:48:07.250142  298506 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.871659647s)
	I0918 17:48:07.250188  298506 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (2.80426162s)
	I0918 17:48:07.250300  298506 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (2.763840851s)
	I0918 17:48:07.250349  298506 api_server.go:72] duration metric: took 3.37276742s to wait for apiserver process to appear ...
	I0918 17:48:07.250370  298506 api_server.go:88] waiting for apiserver healthz status ...
	I0918 17:48:07.250395  298506 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0918 17:48:07.253179  298506 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p embed-certs-391175 addons enable metrics-server
	
	I0918 17:48:07.255763  298506 api_server.go:279] https://192.168.76.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/storage-object-count-tracker-hook ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/start-system-namespaces-controller ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
	[+]poststarthook/start-legacy-token-tracking-controller ok
	[+]poststarthook/start-service-ip-repair-controllers ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/bootstrap-controller ok
	[+]poststarthook/start-kubernetes-service-cidr-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-status-local-available-controller ok
	[+]poststarthook/apiservice-status-remote-available-controller ok
	[+]poststarthook/apiservice-registration-controller ok
	[-]poststarthook/apiservice-discovery-controller failed: reason withheld
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0918 17:48:07.255793  298506 api_server.go:103] status: https://192.168.76.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/storage-object-count-tracker-hook ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/start-system-namespaces-controller ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
	[+]poststarthook/start-legacy-token-tracking-controller ok
	[+]poststarthook/start-service-ip-repair-controllers ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/bootstrap-controller ok
	[+]poststarthook/start-kubernetes-service-cidr-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-status-local-available-controller ok
	[+]poststarthook/apiservice-status-remote-available-controller ok
	[+]poststarthook/apiservice-registration-controller ok
	[-]poststarthook/apiservice-discovery-controller failed: reason withheld
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0918 17:48:07.265916  298506 out.go:179] * Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
	I0918 17:48:03.826988  294960 out.go:252]   - Booting up control plane ...
	I0918 17:48:03.827126  294960 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0918 17:48:03.827238  294960 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0918 17:48:03.827354  294960 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0918 17:48:03.827564  294960 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0918 17:48:03.827711  294960 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
	I0918 17:48:03.827918  294960 kubeadm.go:310] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
	I0918 17:48:03.828105  294960 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0918 17:48:03.828178  294960 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0918 17:48:03.889445  294960 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
	I0918 17:48:03.890167  294960 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
	I0918 17:48:05.394426  294960 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.502077397s
	I0918 17:48:05.400856  294960 kubeadm.go:310] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
	I0918 17:48:05.401257  294960 kubeadm.go:310] [control-plane-check] Checking kube-apiserver at https://192.168.103.2:8443/livez
	I0918 17:48:05.401649  294960 kubeadm.go:310] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
	I0918 17:48:05.402067  294960 kubeadm.go:310] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
	I0918 17:48:07.238970  294960 kubeadm.go:310] [control-plane-check] kube-controller-manager is healthy after 1.836416815s
	I0918 17:48:05.180040  301185 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/kindnet-749287/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 17:48:05.223854  301185 cli_runner.go:164] Run: docker container inspect kindnet-749287 --format={{.State.Status}}
	I0918 17:48:05.249738  301185 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0918 17:48:05.249821  301185 kic_runner.go:114] Args: [docker exec --privileged kindnet-749287 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0918 17:48:05.324625  301185 cli_runner.go:164] Run: docker container inspect kindnet-749287 --format={{.State.Status}}
	I0918 17:48:05.351757  301185 machine.go:93] provisionDockerMachine start ...
	I0918 17:48:05.351839  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:05.381491  301185 main.go:141] libmachine: Using SSH client type: native
	I0918 17:48:05.381863  301185 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33102 <nil> <nil>}
	I0918 17:48:05.381878  301185 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:48:05.540552  301185 main.go:141] libmachine: SSH cmd err, output: <nil>: kindnet-749287
	
	I0918 17:48:05.540588  301185 ubuntu.go:182] provisioning hostname "kindnet-749287"
	I0918 17:48:05.540649  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:05.568903  301185 main.go:141] libmachine: Using SSH client type: native
	I0918 17:48:05.569253  301185 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33102 <nil> <nil>}
	I0918 17:48:05.569273  301185 main.go:141] libmachine: About to run SSH command:
	sudo hostname kindnet-749287 && echo "kindnet-749287" | sudo tee /etc/hostname
	I0918 17:48:05.739443  301185 main.go:141] libmachine: SSH cmd err, output: <nil>: kindnet-749287
	
	I0918 17:48:05.739541  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:05.763520  301185 main.go:141] libmachine: Using SSH client type: native
	I0918 17:48:05.764018  301185 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33102 <nil> <nil>}
	I0918 17:48:05.764107  301185 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\skindnet-749287' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 kindnet-749287/g' /etc/hosts;
				else 
					echo '127.0.1.1 kindnet-749287' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:48:05.918815  301185 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:48:05.919039  301185 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:48:05.919085  301185 ubuntu.go:190] setting up certificates
	I0918 17:48:05.919104  301185 provision.go:84] configureAuth start
	I0918 17:48:05.919177  301185 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kindnet-749287
	I0918 17:48:05.946958  301185 provision.go:143] copyHostCerts
	I0918 17:48:05.947027  301185 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:48:05.947034  301185 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:48:05.947107  301185 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:48:05.947195  301185 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:48:05.947200  301185 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:48:05.947224  301185 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:48:05.947288  301185 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:48:05.947292  301185 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:48:05.947319  301185 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:48:05.947388  301185 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.kindnet-749287 san=[127.0.0.1 192.168.94.2 kindnet-749287 localhost minikube]
	I0918 17:48:06.305934  301185 provision.go:177] copyRemoteCerts
	I0918 17:48:06.306008  301185 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:48:06.306050  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:06.332971  301185 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33102 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/kindnet-749287/id_rsa Username:docker}
	I0918 17:48:06.454967  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:48:06.506815  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1212 bytes)
	I0918 17:48:06.551607  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0918 17:48:06.604930  301185 provision.go:87] duration metric: took 685.810104ms to configureAuth
	I0918 17:48:06.604970  301185 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:48:06.605190  301185 config.go:182] Loaded profile config "kindnet-749287": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:48:06.605323  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:06.633121  301185 main.go:141] libmachine: Using SSH client type: native
	I0918 17:48:06.633542  301185 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33102 <nil> <nil>}
	I0918 17:48:06.633569  301185 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:48:06.976830  301185 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:48:06.976858  301185 machine.go:96] duration metric: took 1.625078464s to provisionDockerMachine
	I0918 17:48:06.976870  301185 client.go:171] duration metric: took 6.882132146s to LocalClient.Create
	I0918 17:48:06.976891  301185 start.go:167] duration metric: took 6.882193007s to libmachine.API.Create "kindnet-749287"
	I0918 17:48:06.976901  301185 start.go:293] postStartSetup for "kindnet-749287" (driver="docker")
	I0918 17:48:06.976912  301185 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:48:06.976974  301185 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:48:06.977051  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:07.001727  301185 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33102 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/kindnet-749287/id_rsa Username:docker}
	I0918 17:48:07.115596  301185 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:48:07.121597  301185 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:48:07.121645  301185 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:48:07.121657  301185 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:48:07.121665  301185 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:48:07.121678  301185 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:48:07.121733  301185 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:48:07.121819  301185 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:48:07.121925  301185 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:48:07.135143  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:48:07.184869  301185 start.go:296] duration metric: took 207.942976ms for postStartSetup
	I0918 17:48:07.185421  301185 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kindnet-749287
	I0918 17:48:07.208761  301185 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/config.json ...
	I0918 17:48:07.209107  301185 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:48:07.209164  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:07.238295  301185 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33102 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/kindnet-749287/id_rsa Username:docker}
	I0918 17:48:07.337414  301185 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:48:07.342305  301185 start.go:128] duration metric: took 7.24996556s to createHost
	I0918 17:48:07.342334  301185 start.go:83] releasing machines lock for "kindnet-749287", held for 7.250116172s
	I0918 17:48:07.342412  301185 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kindnet-749287
	I0918 17:48:07.363873  301185 ssh_runner.go:195] Run: cat /version.json
	I0918 17:48:07.363935  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:07.363951  301185 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:48:07.364025  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:07.391914  301185 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33102 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/kindnet-749287/id_rsa Username:docker}
	I0918 17:48:07.392218  301185 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33102 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/kindnet-749287/id_rsa Username:docker}
	I0918 17:48:07.497595  301185 ssh_runner.go:195] Run: systemctl --version
	I0918 17:48:07.599296  301185 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:48:07.765046  301185 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:48:07.772258  301185 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:48:07.806946  301185 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:48:07.807048  301185 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:48:07.853131  301185 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0918 17:48:07.853160  301185 start.go:495] detecting cgroup driver to use...
	I0918 17:48:07.853194  301185 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:48:07.853242  301185 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:48:07.882764  301185 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:48:07.910886  301185 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:48:07.910941  301185 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:48:07.931477  301185 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:48:07.964223  301185 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:48:08.073551  301185 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:48:08.179257  301185 docker.go:234] disabling docker service ...
	I0918 17:48:08.179376  301185 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:48:08.203120  301185 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:48:08.218419  301185 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:48:08.297076  301185 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:48:08.476238  301185 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:48:08.491354  301185 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:48:08.510542  301185 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:48:08.510606  301185 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:08.523664  301185 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:48:08.523728  301185 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:08.535366  301185 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:08.545993  301185 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:08.556785  301185 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:48:08.567322  301185 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:08.578309  301185 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:08.596137  301185 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:08.607164  301185 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:48:08.616951  301185 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:48:08.626246  301185 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:48:08.697201  301185 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:48:08.800759  301185 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:48:08.800828  301185 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:48:08.804946  301185 start.go:563] Will wait 60s for crictl version
	I0918 17:48:08.805020  301185 ssh_runner.go:195] Run: which crictl
	I0918 17:48:08.808636  301185 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:48:08.844224  301185 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 17:48:08.844322  301185 ssh_runner.go:195] Run: crio --version
	I0918 17:48:08.882935  301185 ssh_runner.go:195] Run: crio --version
	I0918 17:48:08.920370  301185 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 17:48:08.921780  301185 cli_runner.go:164] Run: docker network inspect kindnet-749287 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:48:08.939439  301185 ssh_runner.go:195] Run: grep 192.168.94.1	host.minikube.internal$ /etc/hosts
	I0918 17:48:08.943551  301185 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:48:08.956549  301185 kubeadm.go:875] updating cluster {Name:kindnet-749287 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:kindnet-749287 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]
DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath
: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0918 17:48:08.956662  301185 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:48:08.956713  301185 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:48:09.028600  301185 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:48:09.028620  301185 crio.go:433] Images already preloaded, skipping extraction
	I0918 17:48:09.028668  301185 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:48:09.063048  301185 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:48:09.063069  301185 cache_images.go:85] Images are preloaded, skipping loading
	I0918 17:48:09.063076  301185 kubeadm.go:926] updating node { 192.168.94.2 8443 v1.34.0 crio true true} ...
	I0918 17:48:09.063163  301185 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=kindnet-749287 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:kindnet-749287 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet}
	I0918 17:48:09.063231  301185 ssh_runner.go:195] Run: crio config
	I0918 17:48:09.110322  301185 cni.go:84] Creating CNI manager for "kindnet"
	I0918 17:48:09.110348  301185 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0918 17:48:09.110367  301185 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.34.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:kindnet-749287 NodeName:kindnet-749287 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.94.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubern
etes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0918 17:48:09.110477  301185 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.94.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "kindnet-749287"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.94.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	kubernetesVersion: v1.34.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: systemd
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0918 17:48:09.110558  301185 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 17:48:09.120864  301185 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 17:48:09.120937  301185 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0918 17:48:09.132859  301185 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (364 bytes)
	I0918 17:48:09.159225  301185 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 17:48:09.184935  301185 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2210 bytes)
	I0918 17:48:09.209125  301185 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts
	I0918 17:48:09.213649  301185 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:48:09.227320  301185 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:48:09.304679  301185 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:48:09.335266  301185 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287 for IP: 192.168.94.2
	I0918 17:48:09.335292  301185 certs.go:194] generating shared ca certs ...
	I0918 17:48:09.335312  301185 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:09.335494  301185 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 17:48:09.335566  301185 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 17:48:09.335582  301185 certs.go:256] generating profile certs ...
	I0918 17:48:09.335663  301185 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/client.key
	I0918 17:48:09.335684  301185 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/client.crt with IP's: []
	I0918 17:48:09.806556  301185 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/client.crt ...
	I0918 17:48:09.806589  301185 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/client.crt: {Name:mk25796bff40fc31d4e0c600ce3b6d3ed5f6141a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:09.806761  301185 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/client.key ...
	I0918 17:48:09.806780  301185 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/client.key: {Name:mk99edbdc5c4d80f956bfbe95e77bb5967766175 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:09.806915  301185 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.key.590fa789
	I0918 17:48:09.806939  301185 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.crt.590fa789 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.94.2]
	I0918 17:48:08.370783  294960 kubeadm.go:310] [control-plane-check] kube-scheduler is healthy after 2.968520123s
	I0918 17:48:09.904439  294960 kubeadm.go:310] [control-plane-check] kube-apiserver is healthy after 4.502263248s
	I0918 17:48:09.917571  294960 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0918 17:48:09.930930  294960 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0918 17:48:09.941740  294960 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0918 17:48:09.942052  294960 kubeadm.go:310] [mark-control-plane] Marking the node auto-749287 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0918 17:48:09.951666  294960 kubeadm.go:310] [bootstrap-token] Using token: n3gjls.z0hyfn3dcwlakor4
	I0918 17:48:07.267260  298506 addons.go:514] duration metric: took 3.389497828s for enable addons: enabled=[metrics-server storage-provisioner dashboard default-storageclass]
	I0918 17:48:07.751193  298506 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0918 17:48:07.757003  298506 api_server.go:279] https://192.168.76.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/storage-object-count-tracker-hook ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/start-system-namespaces-controller ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
	[+]poststarthook/start-legacy-token-tracking-controller ok
	[+]poststarthook/start-service-ip-repair-controllers ok
	[+]poststarthook/rbac/bootstrap-roles ok
	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/bootstrap-controller ok
	[+]poststarthook/start-kubernetes-service-cidr-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-status-local-available-controller ok
	[+]poststarthook/apiservice-status-remote-available-controller ok
	[+]poststarthook/apiservice-registration-controller ok
	[-]poststarthook/apiservice-discovery-controller failed: reason withheld
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0918 17:48:07.757040  298506 api_server.go:103] status: https://192.168.76.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/storage-object-count-tracker-hook ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/start-system-namespaces-controller ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
	[+]poststarthook/start-legacy-token-tracking-controller ok
	[+]poststarthook/start-service-ip-repair-controllers ok
	[+]poststarthook/rbac/bootstrap-roles ok
	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/bootstrap-controller ok
	[+]poststarthook/start-kubernetes-service-cidr-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-status-local-available-controller ok
	[+]poststarthook/apiservice-status-remote-available-controller ok
	[+]poststarthook/apiservice-registration-controller ok
	[-]poststarthook/apiservice-discovery-controller failed: reason withheld
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0918 17:48:08.250596  298506 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0918 17:48:08.258243  298506 api_server.go:279] https://192.168.76.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/storage-object-count-tracker-hook ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/start-system-namespaces-controller ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
	[+]poststarthook/start-legacy-token-tracking-controller ok
	[+]poststarthook/start-service-ip-repair-controllers ok
	[+]poststarthook/rbac/bootstrap-roles ok
	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/bootstrap-controller ok
	[+]poststarthook/start-kubernetes-service-cidr-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-status-local-available-controller ok
	[+]poststarthook/apiservice-status-remote-available-controller ok
	[+]poststarthook/apiservice-registration-controller ok
	[-]poststarthook/apiservice-discovery-controller failed: reason withheld
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0918 17:48:08.258408  298506 api_server.go:103] status: https://192.168.76.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/storage-object-count-tracker-hook ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/start-system-namespaces-controller ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
	[+]poststarthook/start-legacy-token-tracking-controller ok
	[+]poststarthook/start-service-ip-repair-controllers ok
	[+]poststarthook/rbac/bootstrap-roles ok
	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/bootstrap-controller ok
	[+]poststarthook/start-kubernetes-service-cidr-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-status-local-available-controller ok
	[+]poststarthook/apiservice-status-remote-available-controller ok
	[+]poststarthook/apiservice-registration-controller ok
	[-]poststarthook/apiservice-discovery-controller failed: reason withheld
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0918 17:48:08.750643  298506 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0918 17:48:08.754994  298506 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0918 17:48:08.755962  298506 api_server.go:141] control plane version: v1.34.0
	I0918 17:48:08.755984  298506 api_server.go:131] duration metric: took 1.505605247s to wait for apiserver health ...
	I0918 17:48:08.755992  298506 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 17:48:08.759910  298506 system_pods.go:59] 9 kube-system pods found
	I0918 17:48:08.759960  298506 system_pods.go:61] "coredns-66bc5c9577-lqtmx" [80dcdb4a-f2c0-403e-b8b6-d70646739519] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:48:08.759972  298506 system_pods.go:61] "etcd-embed-certs-391175" [c529332f-8dc2-43b2-82bd-7bb0cea77a5d] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:48:08.759984  298506 system_pods.go:61] "kindnet-cv76q" [4064d452-4888-4fb4-9e81-7269ba69e7bc] Running
	I0918 17:48:08.759994  298506 system_pods.go:61] "kube-apiserver-embed-certs-391175" [afedd34b-54aa-4182-84c4-264e12f40153] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:48:08.760005  298506 system_pods.go:61] "kube-controller-manager-embed-certs-391175" [05281ee5-2e94-4bff-9415-285fa467ecea] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:48:08.760012  298506 system_pods.go:61] "kube-proxy-rsj4n" [aba63634-f57e-4ae4-be71-7c0870519271] Running
	I0918 17:48:08.760018  298506 system_pods.go:61] "kube-scheduler-embed-certs-391175" [5b379f3e-13ab-4af9-bfc0-bdfe8852541d] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:48:08.760027  298506 system_pods.go:61] "metrics-server-746fcd58dc-zh7h8" [a7cfa6fc-a177-4d40-943c-b274829703f3] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0918 17:48:08.760035  298506 system_pods.go:61] "storage-provisioner" [92cdfb5d-3b8d-4e5d-9e8e-1c25b96e5f02] Running
	I0918 17:48:08.760044  298506 system_pods.go:74] duration metric: took 4.045548ms to wait for pod list to return data ...
	I0918 17:48:08.760063  298506 default_sa.go:34] waiting for default service account to be created ...
	I0918 17:48:08.762414  298506 default_sa.go:45] found service account: "default"
	I0918 17:48:08.762435  298506 default_sa.go:55] duration metric: took 2.366122ms for default service account to be created ...
	I0918 17:48:08.762443  298506 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 17:48:08.765310  298506 system_pods.go:86] 9 kube-system pods found
	I0918 17:48:08.765342  298506 system_pods.go:89] "coredns-66bc5c9577-lqtmx" [80dcdb4a-f2c0-403e-b8b6-d70646739519] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:48:08.765355  298506 system_pods.go:89] "etcd-embed-certs-391175" [c529332f-8dc2-43b2-82bd-7bb0cea77a5d] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:48:08.765363  298506 system_pods.go:89] "kindnet-cv76q" [4064d452-4888-4fb4-9e81-7269ba69e7bc] Running
	I0918 17:48:08.765370  298506 system_pods.go:89] "kube-apiserver-embed-certs-391175" [afedd34b-54aa-4182-84c4-264e12f40153] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:48:08.765380  298506 system_pods.go:89] "kube-controller-manager-embed-certs-391175" [05281ee5-2e94-4bff-9415-285fa467ecea] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:48:08.765386  298506 system_pods.go:89] "kube-proxy-rsj4n" [aba63634-f57e-4ae4-be71-7c0870519271] Running
	I0918 17:48:08.765394  298506 system_pods.go:89] "kube-scheduler-embed-certs-391175" [5b379f3e-13ab-4af9-bfc0-bdfe8852541d] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:48:08.765402  298506 system_pods.go:89] "metrics-server-746fcd58dc-zh7h8" [a7cfa6fc-a177-4d40-943c-b274829703f3] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0918 17:48:08.765412  298506 system_pods.go:89] "storage-provisioner" [92cdfb5d-3b8d-4e5d-9e8e-1c25b96e5f02] Running
	I0918 17:48:08.765421  298506 system_pods.go:126] duration metric: took 2.972723ms to wait for k8s-apps to be running ...
	I0918 17:48:08.765430  298506 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 17:48:08.765482  298506 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:48:08.779303  298506 system_svc.go:56] duration metric: took 13.865895ms WaitForService to wait for kubelet
	I0918 17:48:08.779328  298506 kubeadm.go:578] duration metric: took 4.901749532s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:48:08.779353  298506 node_conditions.go:102] verifying NodePressure condition ...
	I0918 17:48:08.782308  298506 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:48:08.782330  298506 node_conditions.go:123] node cpu capacity is 8
	I0918 17:48:08.782342  298506 node_conditions.go:105] duration metric: took 2.985202ms to run NodePressure ...
	I0918 17:48:08.782355  298506 start.go:241] waiting for startup goroutines ...
	I0918 17:48:08.782367  298506 start.go:246] waiting for cluster config update ...
	I0918 17:48:08.782388  298506 start.go:255] writing updated cluster config ...
	I0918 17:48:08.782687  298506 ssh_runner.go:195] Run: rm -f paused
	I0918 17:48:08.786765  298506 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
	I0918 17:48:08.790495  298506 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-lqtmx" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:05.427546  303479 out.go:252] * Restarting existing docker container for "default-k8s-diff-port-804544" ...
	I0918 17:48:05.427629  303479 cli_runner.go:164] Run: docker start default-k8s-diff-port-804544
	I0918 17:48:05.740714  303479 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-804544 --format={{.State.Status}}
	I0918 17:48:05.762961  303479 kic.go:430] container "default-k8s-diff-port-804544" state is running.
	I0918 17:48:05.765461  303479 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-804544
	I0918 17:48:05.787013  303479 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/config.json ...
	I0918 17:48:05.787252  303479 machine.go:93] provisionDockerMachine start ...
	I0918 17:48:05.787333  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:05.807634  303479 main.go:141] libmachine: Using SSH client type: native
	I0918 17:48:05.807951  303479 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33107 <nil> <nil>}
	I0918 17:48:05.807969  303479 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:48:05.808599  303479 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:58054->127.0.0.1:33107: read: connection reset by peer
	I0918 17:48:08.948311  303479 main.go:141] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-804544
	
	I0918 17:48:08.948344  303479 ubuntu.go:182] provisioning hostname "default-k8s-diff-port-804544"
	I0918 17:48:08.948427  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:08.967763  303479 main.go:141] libmachine: Using SSH client type: native
	I0918 17:48:08.967983  303479 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33107 <nil> <nil>}
	I0918 17:48:08.968001  303479 main.go:141] libmachine: About to run SSH command:
	sudo hostname default-k8s-diff-port-804544 && echo "default-k8s-diff-port-804544" | sudo tee /etc/hostname
	I0918 17:48:09.122310  303479 main.go:141] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-804544
	
	I0918 17:48:09.122411  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:09.145976  303479 main.go:141] libmachine: Using SSH client type: native
	I0918 17:48:09.146332  303479 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33107 <nil> <nil>}
	I0918 17:48:09.146366  303479 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sdefault-k8s-diff-port-804544' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-804544/g' /etc/hosts;
				else 
					echo '127.0.1.1 default-k8s-diff-port-804544' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:48:09.288833  303479 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:48:09.288862  303479 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:48:09.288908  303479 ubuntu.go:190] setting up certificates
	I0918 17:48:09.288922  303479 provision.go:84] configureAuth start
	I0918 17:48:09.288987  303479 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-804544
	I0918 17:48:09.313853  303479 provision.go:143] copyHostCerts
	I0918 17:48:09.313982  303479 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:48:09.314001  303479 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:48:09.314115  303479 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:48:09.314241  303479 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:48:09.314250  303479 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:48:09.314301  303479 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:48:09.314376  303479 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:48:09.314382  303479 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:48:09.314415  303479 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:48:09.314482  303479 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.default-k8s-diff-port-804544 san=[127.0.0.1 192.168.85.2 default-k8s-diff-port-804544 localhost minikube]
	I0918 17:48:09.471029  303479 provision.go:177] copyRemoteCerts
	I0918 17:48:09.471100  303479 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:48:09.471145  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:09.496957  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:09.604546  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:48:09.635687  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
	I0918 17:48:09.666534  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0918 17:48:09.696708  303479 provision.go:87] duration metric: took 407.767847ms to configureAuth
	I0918 17:48:09.696736  303479 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:48:09.696952  303479 config.go:182] Loaded profile config "default-k8s-diff-port-804544": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:48:09.697080  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:09.719357  303479 main.go:141] libmachine: Using SSH client type: native
	I0918 17:48:09.719680  303479 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33107 <nil> <nil>}
	I0918 17:48:09.719710  303479 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:48:10.035395  303479 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:48:10.035427  303479 machine.go:96] duration metric: took 4.248160549s to provisionDockerMachine
	I0918 17:48:10.035443  303479 start.go:293] postStartSetup for "default-k8s-diff-port-804544" (driver="docker")
	I0918 17:48:10.035458  303479 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:48:10.035552  303479 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:48:10.035606  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:10.059909  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:09.953153  294960 out.go:252]   - Configuring RBAC rules ...
	I0918 17:48:09.953311  294960 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0918 17:48:09.957471  294960 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0918 17:48:09.964972  294960 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0918 17:48:09.968611  294960 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0918 17:48:09.972097  294960 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0918 17:48:09.977283  294960 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0918 17:48:10.311613  294960 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0918 17:48:10.730996  294960 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0918 17:48:11.311064  294960 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0918 17:48:11.312305  294960 kubeadm.go:310] 
	I0918 17:48:11.312399  294960 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0918 17:48:11.312408  294960 kubeadm.go:310] 
	I0918 17:48:11.312551  294960 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0918 17:48:11.312571  294960 kubeadm.go:310] 
	I0918 17:48:11.312605  294960 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0918 17:48:11.312688  294960 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0918 17:48:11.312753  294960 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0918 17:48:11.312759  294960 kubeadm.go:310] 
	I0918 17:48:11.312829  294960 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0918 17:48:11.312834  294960 kubeadm.go:310] 
	I0918 17:48:11.312896  294960 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0918 17:48:11.312902  294960 kubeadm.go:310] 
	I0918 17:48:11.312971  294960 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0918 17:48:11.313070  294960 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0918 17:48:11.313176  294960 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0918 17:48:11.313182  294960 kubeadm.go:310] 
	I0918 17:48:11.313297  294960 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0918 17:48:11.313399  294960 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0918 17:48:11.313410  294960 kubeadm.go:310] 
	I0918 17:48:11.313557  294960 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token n3gjls.z0hyfn3dcwlakor4 \
	I0918 17:48:11.313734  294960 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 \
	I0918 17:48:11.313766  294960 kubeadm.go:310] 	--control-plane 
	I0918 17:48:11.313786  294960 kubeadm.go:310] 
	I0918 17:48:11.313923  294960 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0918 17:48:11.313940  294960 kubeadm.go:310] 
	I0918 17:48:11.314039  294960 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token n3gjls.z0hyfn3dcwlakor4 \
	I0918 17:48:11.314157  294960 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 
	I0918 17:48:11.317672  294960 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1037-gcp\n", err: exit status 1
	I0918 17:48:11.317845  294960 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0918 17:48:11.317875  294960 cni.go:84] Creating CNI manager for ""
	I0918 17:48:11.317894  294960 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0918 17:48:11.320056  294960 out.go:179] * Configuring CNI (Container Networking Interface) ...
	I0918 17:48:10.163485  303479 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:48:10.167969  303479 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:48:10.168008  303479 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:48:10.168018  303479 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:48:10.168029  303479 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:48:10.168053  303479 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:48:10.168120  303479 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:48:10.168228  303479 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:48:10.168354  303479 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:48:10.179838  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:48:10.212534  303479 start.go:296] duration metric: took 177.074663ms for postStartSetup
	I0918 17:48:10.212612  303479 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:48:10.212655  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:10.232318  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:10.324562  303479 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:48:10.329580  303479 fix.go:56] duration metric: took 4.931174847s for fixHost
	I0918 17:48:10.329607  303479 start.go:83] releasing machines lock for "default-k8s-diff-port-804544", held for 4.93123986s
	I0918 17:48:10.329672  303479 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-804544
	I0918 17:48:10.353462  303479 ssh_runner.go:195] Run: cat /version.json
	I0918 17:48:10.353555  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:10.353734  303479 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:48:10.353791  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:10.376333  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:10.376642  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:10.566440  303479 ssh_runner.go:195] Run: systemctl --version
	I0918 17:48:10.573393  303479 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:48:10.720918  303479 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:48:10.726559  303479 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:48:10.739103  303479 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:48:10.739172  303479 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:48:10.749525  303479 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:48:10.749545  303479 start.go:495] detecting cgroup driver to use...
	I0918 17:48:10.749580  303479 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:48:10.749632  303479 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:48:10.763610  303479 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:48:10.786031  303479 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:48:10.786093  303479 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:48:10.808236  303479 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:48:10.822732  303479 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:48:10.898696  303479 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:48:10.992036  303479 docker.go:234] disabling docker service ...
	I0918 17:48:10.992161  303479 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:48:11.008272  303479 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:48:11.024219  303479 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:48:11.104944  303479 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:48:11.189638  303479 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:48:11.201555  303479 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:48:11.221741  303479 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:48:11.221798  303479 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:11.232631  303479 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:48:11.232701  303479 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:11.243426  303479 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:11.254019  303479 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:11.266013  303479 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:48:11.275968  303479 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:11.286844  303479 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:11.298143  303479 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:11.310718  303479 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:48:11.322028  303479 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:48:11.331566  303479 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:48:11.429010  303479 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:48:11.559293  303479 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:48:11.559365  303479 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:48:11.563837  303479 start.go:563] Will wait 60s for crictl version
	I0918 17:48:11.563894  303479 ssh_runner.go:195] Run: which crictl
	I0918 17:48:11.567596  303479 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:48:11.615666  303479 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 17:48:11.615754  303479 ssh_runner.go:195] Run: crio --version
	I0918 17:48:11.660828  303479 ssh_runner.go:195] Run: crio --version
	I0918 17:48:11.721908  303479 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 17:48:11.321456  294960 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0918 17:48:11.325671  294960 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.0/kubectl ...
	I0918 17:48:11.325691  294960 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
	I0918 17:48:11.346180  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0918 17:48:11.656480  294960 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0918 17:48:11.656640  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:11.656753  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes auto-749287 minikube.k8s.io/updated_at=2025_09_18T17_48_11_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596 minikube.k8s.io/name=auto-749287 minikube.k8s.io/primary=true
	I0918 17:48:11.755703  294960 ops.go:34] apiserver oom_adj: -16
	I0918 17:48:11.755728  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:12.256452  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:11.724233  303479 cli_runner.go:164] Run: docker network inspect default-k8s-diff-port-804544 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:48:11.748268  303479 ssh_runner.go:195] Run: grep 192.168.85.1	host.minikube.internal$ /etc/hosts
	I0918 17:48:11.754138  303479 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:48:11.769717  303479 kubeadm.go:875] updating cluster {Name:default-k8s-diff-port-804544 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:default-k8s-diff-port-804544 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0918 17:48:11.769840  303479 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:48:11.769889  303479 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:48:11.824094  303479 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:48:11.824122  303479 crio.go:433] Images already preloaded, skipping extraction
	I0918 17:48:11.824178  303479 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:48:11.861042  303479 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:48:11.861068  303479 cache_images.go:85] Images are preloaded, skipping loading
	I0918 17:48:11.861077  303479 kubeadm.go:926] updating node { 192.168.85.2 8444 v1.34.0 crio true true} ...
	I0918 17:48:11.861206  303479 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=default-k8s-diff-port-804544 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:default-k8s-diff-port-804544 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 17:48:11.861292  303479 ssh_runner.go:195] Run: crio config
	I0918 17:48:11.908989  303479 cni.go:84] Creating CNI manager for ""
	I0918 17:48:11.909016  303479 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0918 17:48:11.909033  303479 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0918 17:48:11.909058  303479 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8444 KubernetesVersion:v1.34.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-diff-port-804544 NodeName:default-k8s-diff-port-804544 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.c
rt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0918 17:48:11.909217  303479 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.85.2
	  bindPort: 8444
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "default-k8s-diff-port-804544"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.85.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8444
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	kubernetesVersion: v1.34.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: systemd
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0918 17:48:11.909289  303479 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 17:48:11.919715  303479 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 17:48:11.919777  303479 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0918 17:48:11.929954  303479 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (378 bytes)
	I0918 17:48:11.951390  303479 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 17:48:11.971370  303479 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2224 bytes)
	I0918 17:48:11.992253  303479 ssh_runner.go:195] Run: grep 192.168.85.2	control-plane.minikube.internal$ /etc/hosts
	I0918 17:48:11.996337  303479 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:48:12.008583  303479 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:48:12.079937  303479 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:48:12.107653  303479 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544 for IP: 192.168.85.2
	I0918 17:48:12.107673  303479 certs.go:194] generating shared ca certs ...
	I0918 17:48:12.107688  303479 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:12.107849  303479 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 17:48:12.107905  303479 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 17:48:12.107920  303479 certs.go:256] generating profile certs ...
	I0918 17:48:12.108032  303479 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/client.key
	I0918 17:48:12.108191  303479 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/apiserver.key.1f167964
	I0918 17:48:12.108254  303479 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/proxy-client.key
	I0918 17:48:12.108421  303479 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 17:48:12.108465  303479 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 17:48:12.108478  303479 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 17:48:12.108527  303479 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 17:48:12.108560  303479 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 17:48:12.108590  303479 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 17:48:12.108644  303479 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:48:12.109384  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 17:48:12.141717  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 17:48:12.171779  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 17:48:12.209586  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 17:48:12.240274  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
	I0918 17:48:12.270111  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 17:48:12.302989  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 17:48:12.335955  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0918 17:48:12.364993  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 17:48:12.394233  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 17:48:12.427913  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 17:48:12.459448  303479 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0918 17:48:12.479324  303479 ssh_runner.go:195] Run: openssl version
	I0918 17:48:12.486622  303479 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 17:48:12.502635  303479 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:48:12.508433  303479 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:48:12.508601  303479 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:48:12.517653  303479 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 17:48:12.529183  303479 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 17:48:12.542394  303479 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 17:48:12.546456  303479 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 17:48:12.546543  303479 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 17:48:12.553981  303479 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 17:48:12.564443  303479 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 17:48:12.576613  303479 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 17:48:12.581037  303479 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 17:48:12.581099  303479 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 17:48:12.589229  303479 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 17:48:12.599826  303479 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 17:48:12.604396  303479 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0918 17:48:12.613175  303479 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0918 17:48:12.622347  303479 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0918 17:48:12.631735  303479 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0918 17:48:12.641669  303479 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0918 17:48:12.650147  303479 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0918 17:48:12.658222  303479 kubeadm.go:392] StartCluster: {Name:default-k8s-diff-port-804544 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:default-k8s-diff-port-804544 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServe
rNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docke
r MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:48:12.658325  303479 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0918 17:48:12.658400  303479 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0918 17:48:12.708559  303479 cri.go:89] found id: ""
	I0918 17:48:12.708636  303479 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0918 17:48:12.720154  303479 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0918 17:48:12.720181  303479 kubeadm.go:589] restartPrimaryControlPlane start ...
	I0918 17:48:12.720227  303479 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0918 17:48:12.735084  303479 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:48:12.736177  303479 kubeconfig.go:47] verify endpoint returned: get endpoint: "default-k8s-diff-port-804544" does not appear in /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:48:12.736817  303479 kubeconfig.go:62] /home/jenkins/minikube-integration/20370-7845/kubeconfig needs updating (will repair): [kubeconfig missing "default-k8s-diff-port-804544" cluster setting kubeconfig missing "default-k8s-diff-port-804544" context setting]
	I0918 17:48:12.737817  303479 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:12.740027  303479 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0918 17:48:12.756604  303479 kubeadm.go:626] The running cluster does not require reconfiguration: 192.168.85.2
	I0918 17:48:12.756648  303479 kubeadm.go:593] duration metric: took 36.459793ms to restartPrimaryControlPlane
	I0918 17:48:12.756663  303479 kubeadm.go:394] duration metric: took 98.453146ms to StartCluster
	I0918 17:48:12.756683  303479 settings.go:142] acquiring lock: {Name:mk72fea03aefe901db9522a467405d86665fedd0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:12.756776  303479 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:48:12.758936  303479 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:12.759959  303479 config.go:182] Loaded profile config "default-k8s-diff-port-804544": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:48:12.760074  303479 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0918 17:48:12.760159  303479 addons.go:69] Setting storage-provisioner=true in profile "default-k8s-diff-port-804544"
	I0918 17:48:12.760178  303479 addons.go:238] Setting addon storage-provisioner=true in "default-k8s-diff-port-804544"
	W0918 17:48:12.760187  303479 addons.go:247] addon storage-provisioner should already be in state true
	I0918 17:48:12.760214  303479 host.go:66] Checking if "default-k8s-diff-port-804544" exists ...
	I0918 17:48:12.760707  303479 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-804544 --format={{.State.Status}}
	I0918 17:48:12.760894  303479 addons.go:69] Setting default-storageclass=true in profile "default-k8s-diff-port-804544"
	I0918 17:48:12.760913  303479 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-diff-port-804544"
	I0918 17:48:12.761187  303479 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-804544 --format={{.State.Status}}
	I0918 17:48:12.761351  303479 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:48:12.761547  303479 addons.go:69] Setting dashboard=true in profile "default-k8s-diff-port-804544"
	I0918 17:48:12.761588  303479 addons.go:238] Setting addon dashboard=true in "default-k8s-diff-port-804544"
	W0918 17:48:12.761605  303479 addons.go:247] addon dashboard should already be in state true
	I0918 17:48:12.761653  303479 host.go:66] Checking if "default-k8s-diff-port-804544" exists ...
	I0918 17:48:12.762156  303479 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-804544 --format={{.State.Status}}
	I0918 17:48:12.762387  303479 addons.go:69] Setting metrics-server=true in profile "default-k8s-diff-port-804544"
	I0918 17:48:12.762410  303479 addons.go:238] Setting addon metrics-server=true in "default-k8s-diff-port-804544"
	W0918 17:48:12.762418  303479 addons.go:247] addon metrics-server should already be in state true
	I0918 17:48:12.762442  303479 host.go:66] Checking if "default-k8s-diff-port-804544" exists ...
	I0918 17:48:12.762917  303479 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-804544 --format={{.State.Status}}
	I0918 17:48:12.765552  303479 out.go:179] * Verifying Kubernetes components...
	I0918 17:48:12.767256  303479 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:48:12.805393  303479 addons.go:238] Setting addon default-storageclass=true in "default-k8s-diff-port-804544"
	W0918 17:48:12.805535  303479 addons.go:247] addon default-storageclass should already be in state true
	I0918 17:48:12.805631  303479 host.go:66] Checking if "default-k8s-diff-port-804544" exists ...
	I0918 17:48:12.805474  303479 out.go:179]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0918 17:48:12.806330  303479 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-804544 --format={{.State.Status}}
	I0918 17:48:12.807479  303479 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 17:48:12.807653  303479 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0918 17:48:12.807736  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:12.814859  303479 out.go:179]   - Using image docker.io/kubernetesui/dashboard:v2.7.0
	I0918 17:48:12.816767  303479 out.go:179]   - Using image fake.domain/registry.k8s.io/echoserver:1.4
	I0918 17:48:12.818609  303479 addons.go:435] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0918 17:48:12.818754  303479 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0918 17:48:12.818683  303479 out.go:179]   - Using image registry.k8s.io/echoserver:1.4
	I0918 17:48:10.002781  301185 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.crt.590fa789 ...
	I0918 17:48:10.002810  301185 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.crt.590fa789: {Name:mkb47f569517fcbaca291128f648750d4e66ac4d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:10.003002  301185 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.key.590fa789 ...
	I0918 17:48:10.003025  301185 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.key.590fa789: {Name:mk6a4c2b3a00b064ec2c14abb2e5cd86cc2d01c4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:10.003135  301185 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.crt.590fa789 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.crt
	I0918 17:48:10.003227  301185 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.key.590fa789 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.key
	I0918 17:48:10.003289  301185 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/proxy-client.key
	I0918 17:48:10.003305  301185 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/proxy-client.crt with IP's: []
	I0918 17:48:10.261001  301185 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/proxy-client.crt ...
	I0918 17:48:10.261036  301185 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/proxy-client.crt: {Name:mke7e2d53d3c5afa81b389d541064830dbbcdbe4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:10.261206  301185 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/proxy-client.key ...
	I0918 17:48:10.261217  301185 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/proxy-client.key: {Name:mkfe3a1dac1aef743534bff0abc1218fd0660b3a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:10.261397  301185 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 17:48:10.261433  301185 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 17:48:10.261443  301185 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 17:48:10.261469  301185 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 17:48:10.261491  301185 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 17:48:10.261535  301185 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 17:48:10.261579  301185 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:48:10.262199  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 17:48:10.289247  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 17:48:10.318363  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 17:48:10.355021  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 17:48:10.390386  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
	I0918 17:48:10.419884  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0918 17:48:10.449863  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 17:48:10.479680  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 17:48:10.511857  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 17:48:10.548579  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 17:48:10.588311  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 17:48:10.615412  301185 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0918 17:48:10.635541  301185 ssh_runner.go:195] Run: openssl version
	I0918 17:48:10.641333  301185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 17:48:10.651332  301185 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:48:10.655485  301185 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:48:10.655579  301185 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:48:10.662954  301185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 17:48:10.673114  301185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 17:48:10.687148  301185 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 17:48:10.691394  301185 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 17:48:10.691462  301185 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 17:48:10.699420  301185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 17:48:10.710679  301185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 17:48:10.723356  301185 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 17:48:10.727808  301185 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 17:48:10.727873  301185 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 17:48:10.736686  301185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 17:48:10.748624  301185 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 17:48:10.752827  301185 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0918 17:48:10.752874  301185 kubeadm.go:392] StartCluster: {Name:kindnet-749287 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:kindnet-749287 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DN
SDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: S
ocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:48:10.752932  301185 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0918 17:48:10.752979  301185 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0918 17:48:10.805536  301185 cri.go:89] found id: ""
	I0918 17:48:10.805607  301185 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0918 17:48:10.817663  301185 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0918 17:48:10.827867  301185 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
	I0918 17:48:10.827932  301185 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0918 17:48:10.839211  301185 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0918 17:48:10.839232  301185 kubeadm.go:157] found existing configuration files:
	
	I0918 17:48:10.839279  301185 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0918 17:48:10.849278  301185 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0918 17:48:10.849353  301185 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0918 17:48:10.863045  301185 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0918 17:48:10.873346  301185 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0918 17:48:10.873403  301185 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0918 17:48:10.883713  301185 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0918 17:48:10.893477  301185 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0918 17:48:10.893569  301185 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0918 17:48:10.905372  301185 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0918 17:48:10.918256  301185 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0918 17:48:10.918318  301185 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0918 17:48:10.932624  301185 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0918 17:48:11.007005  301185 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1037-gcp\n", err: exit status 1
	I0918 17:48:11.082484  301185 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	W0918 17:48:10.800240  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:12.840855  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	I0918 17:48:12.819039  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:12.821766  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0918 17:48:12.821787  303479 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0918 17:48:12.821916  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:12.840192  303479 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
	I0918 17:48:12.840387  303479 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0918 17:48:12.841023  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:12.859407  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:12.863312  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:12.876767  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:12.895128  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:13.009746  303479 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:48:13.040757  303479 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 17:48:13.058076  303479 node_ready.go:35] waiting up to 6m0s for node "default-k8s-diff-port-804544" to be "Ready" ...
	I0918 17:48:13.060138  303479 addons.go:435] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0918 17:48:13.060160  303479 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
	I0918 17:48:13.073655  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0918 17:48:13.073683  303479 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0918 17:48:13.074780  303479 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0918 17:48:13.103159  303479 addons.go:435] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0918 17:48:13.103188  303479 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0918 17:48:13.119048  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0918 17:48:13.119087  303479 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0918 17:48:13.171368  303479 addons.go:435] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0918 17:48:13.171396  303479 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0918 17:48:13.173784  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0918 17:48:13.173829  303479 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	W0918 17:48:13.177176  303479 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8444/openapi/v2?timeout=32s": dial tcp [::1]:8444: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 17:48:13.177298  303479 retry.go:31] will retry after 228.838058ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8444/openapi/v2?timeout=32s": dial tcp [::1]:8444: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	W0918 17:48:13.197958  303479 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8444/openapi/v2?timeout=32s": dial tcp [::1]:8444: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 17:48:13.198004  303479 retry.go:31] will retry after 173.708642ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8444/openapi/v2?timeout=32s": dial tcp [::1]:8444: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 17:48:13.209723  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0918 17:48:13.209757  303479 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
	I0918 17:48:13.215853  303479 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0918 17:48:13.244191  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0918 17:48:13.244223  303479 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0918 17:48:13.272195  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0918 17:48:13.272262  303479 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0918 17:48:13.324103  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0918 17:48:13.324144  303479 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0918 17:48:13.355823  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0918 17:48:13.355851  303479 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0918 17:48:13.372553  303479 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0918 17:48:13.385672  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0918 17:48:13.385699  303479 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0918 17:48:13.407196  303479 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 17:48:13.417761  303479 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0918 17:48:14.976467  303479 node_ready.go:49] node "default-k8s-diff-port-804544" is "Ready"
	I0918 17:48:14.976516  303479 node_ready.go:38] duration metric: took 1.918393379s for node "default-k8s-diff-port-804544" to be "Ready" ...
	I0918 17:48:14.976535  303479 api_server.go:52] waiting for apiserver process to appear ...
	I0918 17:48:14.976596  303479 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:48:15.781565  303479 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (2.565669251s)
	I0918 17:48:15.781720  303479 addons.go:479] Verifying addon metrics-server=true in "default-k8s-diff-port-804544"
	I0918 17:48:15.781660  303479 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (2.409063519s)
	I0918 17:48:15.804486  303479 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.397254001s)
	I0918 17:48:15.804631  303479 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (2.386830376s)
	I0918 17:48:15.804676  303479 api_server.go:72] duration metric: took 3.043292091s to wait for apiserver process to appear ...
	I0918 17:48:15.804692  303479 api_server.go:88] waiting for apiserver healthz status ...
	I0918 17:48:15.804713  303479 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0918 17:48:15.806321  303479 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p default-k8s-diff-port-804544 addons enable metrics-server
	
	I0918 17:48:15.807753  303479 out.go:179] * Enabled addons: metrics-server, default-storageclass, storage-provisioner, dashboard
	I0918 17:48:12.756800  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:13.255880  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:13.755895  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:14.256622  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:14.755852  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:15.256628  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:15.756594  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:16.255933  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:16.366923  294960 kubeadm.go:1105] duration metric: took 4.710329155s to wait for elevateKubeSystemPrivileges
	I0918 17:48:16.366960  294960 kubeadm.go:394] duration metric: took 17.475951077s to StartCluster
	I0918 17:48:16.366980  294960 settings.go:142] acquiring lock: {Name:mk72fea03aefe901db9522a467405d86665fedd0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:16.367040  294960 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:48:16.369557  294960 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:16.369825  294960 start.go:235] Will wait 15m0s for node &{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:48:16.369843  294960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0918 17:48:16.370121  294960 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0918 17:48:16.370220  294960 addons.go:69] Setting storage-provisioner=true in profile "auto-749287"
	I0918 17:48:16.370242  294960 addons.go:238] Setting addon storage-provisioner=true in "auto-749287"
	I0918 17:48:16.370276  294960 host.go:66] Checking if "auto-749287" exists ...
	I0918 17:48:16.370455  294960 addons.go:69] Setting default-storageclass=true in profile "auto-749287"
	I0918 17:48:16.370518  294960 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "auto-749287"
	I0918 17:48:16.370547  294960 config.go:182] Loaded profile config "auto-749287": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:48:16.371004  294960 cli_runner.go:164] Run: docker container inspect auto-749287 --format={{.State.Status}}
	I0918 17:48:16.371391  294960 cli_runner.go:164] Run: docker container inspect auto-749287 --format={{.State.Status}}
	I0918 17:48:16.372337  294960 out.go:179] * Verifying Kubernetes components...
	I0918 17:48:16.373760  294960 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:48:16.401355  294960 addons.go:238] Setting addon default-storageclass=true in "auto-749287"
	I0918 17:48:16.401440  294960 host.go:66] Checking if "auto-749287" exists ...
	I0918 17:48:16.404478  294960 cli_runner.go:164] Run: docker container inspect auto-749287 --format={{.State.Status}}
	I0918 17:48:16.406486  294960 out.go:179]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0918 17:48:16.408022  294960 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 17:48:16.408076  294960 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0918 17:48:16.408171  294960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" auto-749287
	I0918 17:48:16.440911  294960 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
	I0918 17:48:16.440936  294960 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0918 17:48:16.441020  294960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" auto-749287
	I0918 17:48:16.445952  294960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33092 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/auto-749287/id_rsa Username:docker}
	I0918 17:48:16.478355  294960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33092 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/auto-749287/id_rsa Username:docker}
	I0918 17:48:16.502739  294960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.103.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0918 17:48:16.553265  294960 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:48:16.596034  294960 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 17:48:16.625912  294960 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0918 17:48:16.799487  294960 start.go:976] {"host.minikube.internal": 192.168.103.1} host record injected into CoreDNS's ConfigMap
	I0918 17:48:16.803842  294960 node_ready.go:35] waiting up to 15m0s for node "auto-749287" to be "Ready" ...
	I0918 17:48:17.255399  294960 out.go:179] * Enabled addons: storage-provisioner, default-storageclass
	I0918 17:48:17.256805  294960 addons.go:514] duration metric: took 886.676709ms for enable addons: enabled=[storage-provisioner default-storageclass]
	I0918 17:48:17.305368  294960 kapi.go:214] "coredns" deployment in "kube-system" namespace and "auto-749287" context rescaled to 1 replicas
	W0918 17:48:15.308753  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:17.796291  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:19.796966  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	I0918 17:48:15.809096  303479 addons.go:514] duration metric: took 3.049012182s for enable addons: enabled=[metrics-server default-storageclass storage-provisioner dashboard]
	I0918 17:48:15.810139  303479 api_server.go:279] https://192.168.85.2:8444/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/storage-object-count-tracker-hook ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/start-system-namespaces-controller ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
	[+]poststarthook/start-legacy-token-tracking-controller ok
	[+]poststarthook/start-service-ip-repair-controllers ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/bootstrap-controller ok
	[+]poststarthook/start-kubernetes-service-cidr-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-status-local-available-controller ok
	[+]poststarthook/apiservice-status-remote-available-controller ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-discovery-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0918 17:48:15.810164  303479 api_server.go:103] status: https://192.168.85.2:8444/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/storage-object-count-tracker-hook ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/start-system-namespaces-controller ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
	[+]poststarthook/start-legacy-token-tracking-controller ok
	[+]poststarthook/start-service-ip-repair-controllers ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/bootstrap-controller ok
	[+]poststarthook/start-kubernetes-service-cidr-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-status-local-available-controller ok
	[+]poststarthook/apiservice-status-remote-available-controller ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-discovery-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0918 17:48:16.305662  303479 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0918 17:48:16.311424  303479 api_server.go:279] https://192.168.85.2:8444/healthz returned 200:
	ok
	I0918 17:48:16.312703  303479 api_server.go:141] control plane version: v1.34.0
	I0918 17:48:16.312731  303479 api_server.go:131] duration metric: took 508.031161ms to wait for apiserver health ...
	I0918 17:48:16.312742  303479 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 17:48:16.318459  303479 system_pods.go:59] 9 kube-system pods found
	I0918 17:48:16.318495  303479 system_pods.go:61] "coredns-66bc5c9577-zfhpw" [6be0d1d2-f397-428d-9330-6bfe82a23504] Running
	I0918 17:48:16.318525  303479 system_pods.go:61] "etcd-default-k8s-diff-port-804544" [f1d11375-dbcd-4f9f-8341-a4c292acccb5] Running
	I0918 17:48:16.318531  303479 system_pods.go:61] "kindnet-prnkj" [991ae076-d3da-46c4-b2c5-95048010b581] Running
	I0918 17:48:16.318537  303479 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-804544" [6b550354-3745-4458-8c6b-1fcdb6783518] Running
	I0918 17:48:16.318546  303479 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-804544" [dc2d14f1-44d3-4f76-8a39-46d9917be28e] Running
	I0918 17:48:16.318552  303479 system_pods.go:61] "kube-proxy-9k22b" [7db34416-66b2-4425-96f1-3f31b0e3e26a] Running
	I0918 17:48:16.318560  303479 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-804544" [2b5f89ee-999d-4dff-9f1a-e820b66d3a4d] Running
	I0918 17:48:16.318570  303479 system_pods.go:61] "metrics-server-746fcd58dc-dhzlj" [ae0876dd-f568-4e2d-a39a-4502588d52ce] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0918 17:48:16.318583  303479 system_pods.go:61] "storage-provisioner" [a3395f9b-051b-40ac-aa5b-b067b9ac0f43] Running
	I0918 17:48:16.318598  303479 system_pods.go:74] duration metric: took 5.847933ms to wait for pod list to return data ...
	I0918 17:48:16.318610  303479 default_sa.go:34] waiting for default service account to be created ...
	I0918 17:48:16.321231  303479 default_sa.go:45] found service account: "default"
	I0918 17:48:16.321249  303479 default_sa.go:55] duration metric: took 2.633751ms for default service account to be created ...
	I0918 17:48:16.321258  303479 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 17:48:16.324472  303479 system_pods.go:86] 9 kube-system pods found
	I0918 17:48:16.324511  303479 system_pods.go:89] "coredns-66bc5c9577-zfhpw" [6be0d1d2-f397-428d-9330-6bfe82a23504] Running
	I0918 17:48:16.324520  303479 system_pods.go:89] "etcd-default-k8s-diff-port-804544" [f1d11375-dbcd-4f9f-8341-a4c292acccb5] Running
	I0918 17:48:16.324528  303479 system_pods.go:89] "kindnet-prnkj" [991ae076-d3da-46c4-b2c5-95048010b581] Running
	I0918 17:48:16.324534  303479 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-804544" [6b550354-3745-4458-8c6b-1fcdb6783518] Running
	I0918 17:48:16.324540  303479 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-804544" [dc2d14f1-44d3-4f76-8a39-46d9917be28e] Running
	I0918 17:48:16.324545  303479 system_pods.go:89] "kube-proxy-9k22b" [7db34416-66b2-4425-96f1-3f31b0e3e26a] Running
	I0918 17:48:16.324551  303479 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-804544" [2b5f89ee-999d-4dff-9f1a-e820b66d3a4d] Running
	I0918 17:48:16.324560  303479 system_pods.go:89] "metrics-server-746fcd58dc-dhzlj" [ae0876dd-f568-4e2d-a39a-4502588d52ce] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0918 17:48:16.324566  303479 system_pods.go:89] "storage-provisioner" [a3395f9b-051b-40ac-aa5b-b067b9ac0f43] Running
	I0918 17:48:16.324576  303479 system_pods.go:126] duration metric: took 3.313137ms to wait for k8s-apps to be running ...
	I0918 17:48:16.324591  303479 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 17:48:16.324643  303479 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:48:16.342265  303479 system_svc.go:56] duration metric: took 17.66309ms WaitForService to wait for kubelet
	I0918 17:48:16.342324  303479 kubeadm.go:578] duration metric: took 3.580940641s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:48:16.342346  303479 node_conditions.go:102] verifying NodePressure condition ...
	I0918 17:48:16.347375  303479 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:48:16.347404  303479 node_conditions.go:123] node cpu capacity is 8
	I0918 17:48:16.347418  303479 node_conditions.go:105] duration metric: took 5.06647ms to run NodePressure ...
	I0918 17:48:16.347434  303479 start.go:241] waiting for startup goroutines ...
	I0918 17:48:16.347445  303479 start.go:246] waiting for cluster config update ...
	I0918 17:48:16.347459  303479 start.go:255] writing updated cluster config ...
	I0918 17:48:16.347804  303479 ssh_runner.go:195] Run: rm -f paused
	I0918 17:48:16.354227  303479 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
	I0918 17:48:16.361725  303479 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-zfhpw" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:16.368055  303479 pod_ready.go:94] pod "coredns-66bc5c9577-zfhpw" is "Ready"
	I0918 17:48:16.368087  303479 pod_ready.go:86] duration metric: took 6.332886ms for pod "coredns-66bc5c9577-zfhpw" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:16.372036  303479 pod_ready.go:83] waiting for pod "etcd-default-k8s-diff-port-804544" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:16.379684  303479 pod_ready.go:94] pod "etcd-default-k8s-diff-port-804544" is "Ready"
	I0918 17:48:16.379716  303479 pod_ready.go:86] duration metric: took 7.659793ms for pod "etcd-default-k8s-diff-port-804544" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:16.384320  303479 pod_ready.go:83] waiting for pod "kube-apiserver-default-k8s-diff-port-804544" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:16.396454  303479 pod_ready.go:94] pod "kube-apiserver-default-k8s-diff-port-804544" is "Ready"
	I0918 17:48:16.396531  303479 pod_ready.go:86] duration metric: took 12.18252ms for pod "kube-apiserver-default-k8s-diff-port-804544" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:16.403337  303479 pod_ready.go:83] waiting for pod "kube-controller-manager-default-k8s-diff-port-804544" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:16.768835  303479 pod_ready.go:94] pod "kube-controller-manager-default-k8s-diff-port-804544" is "Ready"
	I0918 17:48:16.768865  303479 pod_ready.go:86] duration metric: took 365.469847ms for pod "kube-controller-manager-default-k8s-diff-port-804544" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:16.959453  303479 pod_ready.go:83] waiting for pod "kube-proxy-9k22b" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:17.359775  303479 pod_ready.go:94] pod "kube-proxy-9k22b" is "Ready"
	I0918 17:48:17.359802  303479 pod_ready.go:86] duration metric: took 400.244603ms for pod "kube-proxy-9k22b" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:17.558846  303479 pod_ready.go:83] waiting for pod "kube-scheduler-default-k8s-diff-port-804544" in "kube-system" namespace to be "Ready" or be gone ...
	W0918 17:48:19.565185  303479 pod_ready.go:104] pod "kube-scheduler-default-k8s-diff-port-804544" is not "Ready", error: <nil>
	W0918 17:48:18.807278  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:20.807490  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:22.297391  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:24.797737  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:22.064112  303479 pod_ready.go:104] pod "kube-scheduler-default-k8s-diff-port-804544" is not "Ready", error: <nil>
	W0918 17:48:24.064927  303479 pod_ready.go:104] pod "kube-scheduler-default-k8s-diff-port-804544" is not "Ready", error: <nil>
	W0918 17:48:23.307579  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:25.807708  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:27.296703  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:29.796316  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:26.564359  303479 pod_ready.go:104] pod "kube-scheduler-default-k8s-diff-port-804544" is not "Ready", error: <nil>
	W0918 17:48:28.564973  303479 pod_ready.go:104] pod "kube-scheduler-default-k8s-diff-port-804544" is not "Ready", error: <nil>
	W0918 17:48:28.307563  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:30.307705  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:32.308119  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:31.064606  303479 pod_ready.go:104] pod "kube-scheduler-default-k8s-diff-port-804544" is not "Ready", error: <nil>
	I0918 17:48:32.563662  303479 pod_ready.go:94] pod "kube-scheduler-default-k8s-diff-port-804544" is "Ready"
	I0918 17:48:32.563693  303479 pod_ready.go:86] duration metric: took 15.004823181s for pod "kube-scheduler-default-k8s-diff-port-804544" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:32.563708  303479 pod_ready.go:40] duration metric: took 16.209436272s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
	I0918 17:48:32.609590  303479 start.go:623] kubectl: 1.34.1, cluster: 1.34.0 (minor skew: 0)
	I0918 17:48:32.611647  303479 out.go:179] * Done! kubectl is now configured to use "default-k8s-diff-port-804544" cluster and "default" namespace by default
	W0918 17:48:31.796402  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:33.797246  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:34.807058  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:37.306875  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:36.296248  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:38.795957  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:39.306948  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:41.307149  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:40.796220  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:42.796286  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:44.796613  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:43.307372  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:45.307492  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:47.307593  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	
	
	==> CRI-O <==
	Sep 18 17:48:34 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:34.212344633Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce,RepoTags:[registry.k8s.io/kube-proxy:v1.34.0],RepoDigests:[registry.k8s.io/kube-proxy@sha256:364da8a25c742d7a35e9635cb8cf42c1faf5b367760d0f9f9a75bdd1f9d52067 registry.k8s.io/kube-proxy@sha256:5f71731a5eadcf74f3997dfc159bf5ca36e48c3387c19082fc21871e0dbb19af],Size_:73138071,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=88d84b1d-b185-44c5-814a-c3cb9b4eab17 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:34 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:34.213096661Z" level=info msg="Checking image status: registry.k8s.io/kube-proxy:v1.34.0" id=50a3c9c5-5f03-41f1-8f1e-4cd460b34bba name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:34 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:34.213304006Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce,RepoTags:[registry.k8s.io/kube-proxy:v1.34.0],RepoDigests:[registry.k8s.io/kube-proxy@sha256:364da8a25c742d7a35e9635cb8cf42c1faf5b367760d0f9f9a75bdd1f9d52067 registry.k8s.io/kube-proxy@sha256:5f71731a5eadcf74f3997dfc159bf5ca36e48c3387c19082fc21871e0dbb19af],Size_:73138071,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=50a3c9c5-5f03-41f1-8f1e-4cd460b34bba name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:34 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:34.214252189Z" level=info msg="Creating container: kube-system/kube-proxy-9k22b/kube-proxy" id=f00195c8-3eee-40ff-9591-9f28619fef95 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 17:48:34 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:34.214388979Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 17:48:34 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:34.286009909Z" level=info msg="Created container b6f2f167bd56af9c24ebb913bc00789d71ac73ac920515deb77d7f2d1800d479: kube-system/kube-proxy-9k22b/kube-proxy" id=f00195c8-3eee-40ff-9591-9f28619fef95 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 17:48:34 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:34.286671522Z" level=info msg="Starting container: b6f2f167bd56af9c24ebb913bc00789d71ac73ac920515deb77d7f2d1800d479" id=d60de1a1-30ed-4309-8e65-769ccc5a4c15 name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 17:48:34 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:34.294432920Z" level=info msg="Started container" PID=1990 containerID=b6f2f167bd56af9c24ebb913bc00789d71ac73ac920515deb77d7f2d1800d479 description=kube-system/kube-proxy-9k22b/kube-proxy id=d60de1a1-30ed-4309-8e65-769ccc5a4c15 name=/runtime.v1.RuntimeService/StartContainer sandboxID=3a262d9e976cce605db881613707bda1f5b554e273425abc8508c029d2e06523
	Sep 18 17:48:35 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:35.314214275Z" level=info msg="Removing container: 4f38f518c9fddf92cc6307cf33a6cdf57bacd8cbb54f72ee502c9e7642c46bc2" id=aec6d9be-10d2-4165-b48a-815704187e7d name=/runtime.v1.RuntimeService/RemoveContainer
	Sep 18 17:48:35 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:35.332742574Z" level=info msg="Removed container 4f38f518c9fddf92cc6307cf33a6cdf57bacd8cbb54f72ee502c9e7642c46bc2: kube-system/kube-proxy-9k22b/kube-proxy" id=aec6d9be-10d2-4165-b48a-815704187e7d name=/runtime.v1.RuntimeService/RemoveContainer
	Sep 18 17:48:36 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:36.211828465Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=2e0c0ec3-a3de-41ad-afe6-a5f4cb32aaf2 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:36 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:36.212143650Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=2e0c0ec3-a3de-41ad-afe6-a5f4cb32aaf2 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:36 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:36.212698719Z" level=info msg="Pulling image: fake.domain/registry.k8s.io/echoserver:1.4" id=0015949f-aa35-4b01-aed7-4368f1c05845 name=/runtime.v1.ImageService/PullImage
	Sep 18 17:48:36 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:36.260437566Z" level=info msg="Trying to access \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.211121801Z" level=info msg="Checking image status: registry.k8s.io/echoserver:1.4" id=7aa249b3-fc9d-4c5b-9fd4-8f7b8d68ffc0 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.211372855Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7,RepoTags:[registry.k8s.io/echoserver:1.4],RepoDigests:[registry.k8s.io/echoserver@sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb],Size_:145080634,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=7aa249b3-fc9d-4c5b-9fd4-8f7b8d68ffc0 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.212899663Z" level=info msg="Checking image status: registry.k8s.io/echoserver:1.4" id=cebcce04-b217-4e86-ac47-5b2a5de2d2b2 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.213117727Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7,RepoTags:[registry.k8s.io/echoserver:1.4],RepoDigests:[registry.k8s.io/echoserver@sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb],Size_:145080634,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=cebcce04-b217-4e86-ac47-5b2a5de2d2b2 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.215006289Z" level=info msg="Creating container: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-rt24n/dashboard-metrics-scraper" id=40df8ed1-6bb5-447f-9adf-d0531b9fe7a0 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.215183237Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.291332009Z" level=info msg="Created container c56b06de40b74a5884bca2cabb84e963b595ce8b89cc2fdbd8895e63aad1e1c9: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-rt24n/dashboard-metrics-scraper" id=40df8ed1-6bb5-447f-9adf-d0531b9fe7a0 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.292155238Z" level=info msg="Starting container: c56b06de40b74a5884bca2cabb84e963b595ce8b89cc2fdbd8895e63aad1e1c9" id=45d34636-597e-4252-9eba-4a9b62df9bd5 name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.299731113Z" level=info msg="Started container" PID=2054 containerID=c56b06de40b74a5884bca2cabb84e963b595ce8b89cc2fdbd8895e63aad1e1c9 description=kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-rt24n/dashboard-metrics-scraper id=45d34636-597e-4252-9eba-4a9b62df9bd5 name=/runtime.v1.RuntimeService/StartContainer sandboxID=f8347c6fd365a00c173b57cfaa0e4ed63989e1d70d689f0ecacc06532d68ca04
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.337058503Z" level=info msg="Removing container: c62c9325fcf0b096bf9d37ca785da310739168d0e9186a410c3a4e771125f041" id=441943d9-f903-4680-8e4b-aa998ae7f342 name=/runtime.v1.RuntimeService/RemoveContainer
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.353925066Z" level=info msg="Removed container c62c9325fcf0b096bf9d37ca785da310739168d0e9186a410c3a4e771125f041: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-rt24n/dashboard-metrics-scraper" id=441943d9-f903-4680-8e4b-aa998ae7f342 name=/runtime.v1.RuntimeService/RemoveContainer
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                                      CREATED             STATE               NAME                        ATTEMPT             POD ID              POD
	c56b06de40b74       a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7                                           5 seconds ago       Exited              dashboard-metrics-scraper   2                   f8347c6fd365a       dashboard-metrics-scraper-6ffb444bf9-rt24n
	b6f2f167bd56a       df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce                                           15 seconds ago      Exited              kube-proxy                  3                   3a262d9e976cc       kube-proxy-9k22b
	045779b5e2ef0       docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93   21 seconds ago      Running             kubernetes-dashboard        0                   7c6e18c15de8f       kubernetes-dashboard-855c9754f9-svs5n
	d3ae5fa88c9ee       56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c                                           31 seconds ago      Running             busybox                     1                   8c9a1139ebde1       busybox
	e99e7002a8a79       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                           31 seconds ago      Exited              storage-provisioner         1                   ad899cd584001       storage-provisioner
	0b0b24b0019e2       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                           31 seconds ago      Running             coredns                     1                   1d3b270bde844       coredns-66bc5c9577-zfhpw
	01a98143560b1       409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c                                           31 seconds ago      Running             kindnet-cni                 1                   fc348fd2133eb       kindnet-prnkj
	fb4df4429ab22       46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc                                           36 seconds ago      Running             kube-scheduler              1                   1c9c8e39da379       kube-scheduler-default-k8s-diff-port-804544
	9fea6b9ef6cfd       90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90                                           36 seconds ago      Running             kube-apiserver              1                   34e77b452d775       kube-apiserver-default-k8s-diff-port-804544
	e18934e7725a2       a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634                                           36 seconds ago      Running             kube-controller-manager     1                   261212d44c3b1       kube-controller-manager-default-k8s-diff-port-804544
	7e091ef510cce       5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115                                           36 seconds ago      Running             etcd                        1                   deb50b3382732       etcd-default-k8s-diff-port-804544
	
	
	==> coredns [0b0b24b0019e2ebe56a3b204ea6076643ad5804e3eafdcbaafaad2efe0e660d8] <==
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:40683->192.168.85.1:53: i/o timeout
	[INFO] 127.0.0.1:59989 - 10331 "HINFO IN 6100432509177264649.3868697612483183808. udp 57 false 512" - - 0 6.001019543s
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:39204->192.168.85.1:53: i/o timeout
	[INFO] 127.0.0.1:52230 - 55585 "HINFO IN 6100432509177264649.3868697612483183808. udp 57 false 512" - - 0 4.001375208s
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:59411->192.168.85.1:53: i/o timeout
	[INFO] 127.0.0.1:53244 - 26416 "HINFO IN 6100432509177264649.3868697612483183808. udp 57 false 512" - - 0 2.00059555s
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:34495->192.168.85.1:53: i/o timeout
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] 127.0.0.1:53673 - 65295 "HINFO IN 6100432509177264649.3868697612483183808. udp 57 false 512" - - 0 2.000243765s
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:57672->192.168.85.1:53: i/o timeout
	[INFO] 127.0.0.1:34810 - 36709 "HINFO IN 6100432509177264649.3868697612483183808. udp 57 false 512" - - 0 2.000313481s
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:39344->192.168.85.1:53: i/o timeout
	[INFO] 127.0.0.1:39272 - 58827 "HINFO IN 6100432509177264649.3868697612483183808. udp 57 false 512" - - 0 2.000270448s
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:51710->192.168.85.1:53: i/o timeout
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] 127.0.0.1:37247 - 4165 "HINFO IN 6100432509177264649.3868697612483183808. udp 57 false 512" - - 0 2.000804289s
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:37824->192.168.85.1:53: i/o timeout
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	[ERROR] plugin/kubernetes: Unhandled Error
	[ERROR] plugin/kubernetes: Unhandled Error
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	[ERROR] plugin/kubernetes: Unhandled Error
	[INFO] 127.0.0.1:50960 - 292 "HINFO IN 6100432509177264649.3868697612483183808. udp 57 false 512" - - 0 2.000823745s
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:42411->192.168.85.1:53: i/o timeout
	
	
	==> describe nodes <==
	Name:               default-k8s-diff-port-804544
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=default-k8s-diff-port-804544
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=default-k8s-diff-port-804544
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2025_09_18T17_47_18_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 17:47:15 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  default-k8s-diff-port-804544
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:48:35 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 17:48:15 +0000   Thu, 18 Sep 2025 17:47:13 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 17:48:15 +0000   Thu, 18 Sep 2025 17:47:13 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 17:48:15 +0000   Thu, 18 Sep 2025 17:47:13 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 17:48:15 +0000   Thu, 18 Sep 2025 17:47:33 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.85.2
	  Hostname:    default-k8s-diff-port-804544
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 2760dd99259b4246b783f886bcd8ffbb
	  System UUID:                d12e83b6-3b84-4281-86c4-52d39e59de37
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (12 in total)
	  Namespace                   Name                                                    CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                    ------------  ----------  ---------------  -------------  ---
	  default                     busybox                                                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         72s
	  kube-system                 coredns-66bc5c9577-zfhpw                                100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     86s
	  kube-system                 etcd-default-k8s-diff-port-804544                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         93s
	  kube-system                 kindnet-prnkj                                           100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      87s
	  kube-system                 kube-apiserver-default-k8s-diff-port-804544             250m (3%)     0 (0%)      0 (0%)           0 (0%)         92s
	  kube-system                 kube-controller-manager-default-k8s-diff-port-804544    200m (2%)     0 (0%)      0 (0%)           0 (0%)         92s
	  kube-system                 kube-proxy-9k22b                                        0 (0%)        0 (0%)      0 (0%)           0 (0%)         87s
	  kube-system                 kube-scheduler-default-k8s-diff-port-804544             100m (1%)     0 (0%)      0 (0%)           0 (0%)         92s
	  kube-system                 metrics-server-746fcd58dc-dhzlj                         100m (1%)     0 (0%)      200Mi (0%)       0 (0%)         62s
	  kube-system                 storage-provisioner                                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         86s
	  kubernetes-dashboard        dashboard-metrics-scraper-6ffb444bf9-rt24n              0 (0%)        0 (0%)      0 (0%)           0 (0%)         30s
	  kubernetes-dashboard        kubernetes-dashboard-855c9754f9-svs5n                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         30s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (11%)  100m (1%)
	  memory             420Mi (1%)  220Mi (0%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                From             Message
	  ----    ------                   ----               ----             -------
	  Normal  Starting                 86s                kube-proxy       
	  Normal  NodeHasSufficientMemory  92s                kubelet          Node default-k8s-diff-port-804544 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    92s                kubelet          Node default-k8s-diff-port-804544 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     92s                kubelet          Node default-k8s-diff-port-804544 status is now: NodeHasSufficientPID
	  Normal  Starting                 92s                kubelet          Starting kubelet.
	  Normal  RegisteredNode           88s                node-controller  Node default-k8s-diff-port-804544 event: Registered Node default-k8s-diff-port-804544 in Controller
	  Normal  NodeReady                76s                kubelet          Node default-k8s-diff-port-804544 status is now: NodeReady
	  Normal  Starting                 37s                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  37s (x8 over 37s)  kubelet          Node default-k8s-diff-port-804544 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    37s (x8 over 37s)  kubelet          Node default-k8s-diff-port-804544 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     37s (x8 over 37s)  kubelet          Node default-k8s-diff-port-804544 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           31s                node-controller  Node default-k8s-diff-port-804544 event: Registered Node default-k8s-diff-port-804544 in Controller
	  Normal  Starting                 2s                 kubelet          Starting kubelet.
	  Normal  Starting                 1s                 kubelet          Starting kubelet.
	  Normal  Starting                 0s                 kubelet          Starting kubelet.
	
	
	==> dmesg <==
	[  +0.997605] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.003327] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.996474] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.505292] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.495250] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.999891] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.006265] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.993922] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.507054] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +1.501580] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.992816] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.507754] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +1.501603] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.991314] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.510025] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +1.501325] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.989128] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.511977] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +1.501358] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.987099] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.514401] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +1.501630] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +1.351251] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.500488] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +1.501327] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	
	
	==> etcd [7e091ef510cceadafa5385da99f5eff3809bb5e8617ce07b0731f6a2b40ba600] <==
	{"level":"warn","ts":"2025-09-18T17:48:13.941860Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43106","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:13.955757Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43110","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:13.965766Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43126","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:13.974841Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43136","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:13.985322Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43150","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:13.995540Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43174","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.008557Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43194","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.017746Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43222","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.027158Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43232","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.037314Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43252","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.046182Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43266","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.058722Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43284","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.065318Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43302","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.077278Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43310","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.091664Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43322","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.102096Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43340","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.109846Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43356","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.118828Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43370","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.127542Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43384","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.135936Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43400","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.144631Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43420","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.156238Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43458","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.164660Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43474","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.173033Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43498","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.227904Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43524","server-name":"","error":"EOF"}
	
	
	==> kernel <==
	 17:48:49 up  1:31,  0 users,  load average: 3.08, 3.00, 2.03
	Linux default-k8s-diff-port-804544 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [01a98143560b1d4e791e8d53e9949f7722290664b9359d1fccebe62e3d8039a4] <==
	I0918 17:48:17.902958       1 main.go:109] connected to apiserver: https://10.96.0.1:443
	I0918 17:48:17.903199       1 main.go:139] hostIP = 192.168.85.2
	podIP = 192.168.85.2
	I0918 17:48:17.903393       1 main.go:148] setting mtu 1500 for CNI 
	I0918 17:48:17.903414       1 main.go:178] kindnetd IP family: "ipv4"
	I0918 17:48:17.903442       1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
	time="2025-09-18T17:48:18Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
	I0918 17:48:18.108099       1 controller.go:377] "Starting controller" name="kube-network-policies"
	I0918 17:48:18.108127       1 controller.go:381] "Waiting for informer caches to sync"
	I0918 17:48:18.108138       1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
	I0918 17:48:18.108254       1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
	E0918 17:48:48.109281       1 reflector.go:200] "Failed to watch" err="failed to list *v1.NetworkPolicy: Get \"https://10.96.0.1:443/apis/networking.k8s.io/v1/networkpolicies?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.NetworkPolicy"
	E0918 17:48:48.109530       1 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: Get \"https://10.96.0.1:443/api/v1/nodes?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.Node"
	E0918 17:48:48.110728       1 reflector.go:200] "Failed to watch" err="failed to list *v1.Pod: Get \"https://10.96.0.1:443/api/v1/pods?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.Pod"
	E0918 17:48:48.110853       1 reflector.go:200] "Failed to watch" err="failed to list *v1.Namespace: Get \"https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.Namespace"
	
	
	==> kube-apiserver [9fea6b9ef6cfd7931a8802642fe88cac2d98c47ded9e858a83411e65b7192d54] <==
	E0918 17:48:15.040973       1 controller.go:146] "Unhandled Error" err=<
		Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
		, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	 > logger="UnhandledError"
	I0918 17:48:15.405905       1 controller.go:667] quota admission added evaluator for: deployments.apps
	I0918 17:48:15.504324       1 controller.go:667] quota admission added evaluator for: namespaces
	I0918 17:48:15.586445       1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0918 17:48:15.599451       1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	I0918 17:48:15.608840       1 controller.go:667] quota admission added evaluator for: serviceaccounts
	I0918 17:48:15.670291       1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.102.2.75"}
	I0918 17:48:15.685186       1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.103.69.231"}
	I0918 17:48:15.824941       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
	W0918 17:48:16.037421       1 handler_proxy.go:99] no RequestInfo found in the context
	E0918 17:48:16.037456       1 controller.go:113] "Unhandled Error" err="loading OpenAPI spec for \"v1beta1.metrics.k8s.io\" failed with: Error, could not get list of group versions for APIService" logger="UnhandledError"
	I0918 17:48:16.037468       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0918 17:48:16.037524       1 handler_proxy.go:99] no RequestInfo found in the context
	E0918 17:48:16.037594       1 controller.go:102] "Unhandled Error" err=<
		loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
		, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	 > logger="UnhandledError"
	I0918 17:48:16.038649       1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0918 17:48:18.898361       1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0918 17:48:18.997319       1 controller.go:667] quota admission added evaluator for: endpoints
	I0918 17:48:19.049105       1 controller.go:667] quota admission added evaluator for: replicasets.apps
	I0918 17:48:19.098952       1 controller.go:667] quota admission added evaluator for: daemonsets.apps
	
	
	==> kube-controller-manager [e18934e7725a251323e6218ece37b7c0f10ad34d1495c2542dcd0673801977a6] <==
	I0918 17:48:18.444740       1 shared_informer.go:356] "Caches are synced" controller="job"
	I0918 17:48:18.444892       1 shared_informer.go:356] "Caches are synced" controller="resource_claim"
	I0918 17:48:18.444910       1 shared_informer.go:356] "Caches are synced" controller="legacy-service-account-token-cleaner"
	I0918 17:48:18.444920       1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice_mirroring"
	I0918 17:48:18.444989       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-serving"
	I0918 17:48:18.444896       1 shared_informer.go:356] "Caches are synced" controller="endpoint"
	I0918 17:48:18.445146       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrapproving"
	I0918 17:48:18.445699       1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
	I0918 17:48:18.445713       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-client"
	I0918 17:48:18.446849       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
	I0918 17:48:18.446883       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kube-apiserver-client"
	I0918 17:48:18.454203       1 shared_informer.go:356] "Caches are synced" controller="resource quota"
	I0918 17:48:18.463478       1 shared_informer.go:356] "Caches are synced" controller="resource quota"
	I0918 17:48:18.466654       1 shared_informer.go:356] "Caches are synced" controller="daemon sets"
	I0918 17:48:18.468987       1 shared_informer.go:356] "Caches are synced" controller="ReplicaSet"
	I0918 17:48:18.468997       1 shared_informer.go:356] "Caches are synced" controller="namespace"
	I0918 17:48:18.472384       1 shared_informer.go:356] "Caches are synced" controller="stateful set"
	I0918 17:48:18.476892       1 shared_informer.go:356] "Caches are synced" controller="cronjob"
	I0918 17:48:18.476958       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	I0918 17:48:18.477037       1 garbagecollector.go:154] "Garbage collector: all resource monitors have synced" logger="garbage-collector-controller"
	I0918 17:48:18.477047       1 garbagecollector.go:157] "Proceeding to collect garbage" logger="garbage-collector-controller"
	I0918 17:48:18.480811       1 shared_informer.go:356] "Caches are synced" controller="deployment"
	I0918 17:48:18.484750       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	E0918 17:48:48.461016       1 resource_quota_controller.go:446] "Unhandled Error" err="unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1" logger="UnhandledError"
	I0918 17:48:48.498513       1 garbagecollector.go:787] "failed to discover some groups" logger="garbage-collector-controller" groups="map[\"metrics.k8s.io/v1beta1\":\"stale GroupVersion discovery: metrics.k8s.io/v1beta1\"]"
	
	
	==> kube-proxy [b6f2f167bd56af9c24ebb913bc00789d71ac73ac920515deb77d7f2d1800d479] <==
	E0918 17:48:34.334941       1 run.go:72] "command failed" err="failed complete: too many open files"
	
	
	==> kube-scheduler [fb4df4429ab22ae76d58fc66db255e7b170cfda10f5b9590e86b28d4c64bb7ba] <==
	I0918 17:48:14.346047       1 serving.go:386] Generated self-signed cert in-memory
	I0918 17:48:15.405239       1 server.go:175] "Starting Kubernetes Scheduler" version="v1.34.0"
	I0918 17:48:15.405281       1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 17:48:15.412673       1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
	I0918 17:48:15.412720       1 shared_informer.go:349] "Waiting for caches to sync" controller="RequestHeaderAuthRequestController"
	I0918 17:48:15.412775       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0918 17:48:15.412792       1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0918 17:48:15.412800       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
	I0918 17:48:15.412823       1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
	I0918 17:48:15.414385       1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
	I0918 17:48:15.414472       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
	I0918 17:48:15.513164       1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0918 17:48:15.513204       1 shared_informer.go:356] "Caches are synced" controller="RequestHeaderAuthRequestController"
	I0918 17:48:15.516839       1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
	
	
	==> kubelet <==
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.209560    2548 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: E0918 17:48:49.209669    2548 file_linux.go:61] "Unable to read config path" err="unable to create inotify: too many open files" path="/etc/kubernetes/manifests"
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.210848    2548 kuberuntime_manager.go:291] "Container runtime initialized" containerRuntime="cri-o" version="1.24.6" apiVersion="v1"
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.211547    2548 kubelet.go:940] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.211599    2548 kubelet.go:964] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: E0918 17:48:49.211659    2548 plugins.go:580] "Error initializing dynamic plugin prober" err="error initializing watcher: too many open files"
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.212407    2548 server.go:1262] "Started kubelet"
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.212548    2548 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.212787    2548 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.212867    2548 server_v1.go:49] "podresources" method="list" useActivePods=true
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.213166    2548 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.214019    2548 server.go:310] "Adding debug handlers to kubelet server"
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.214668    2548 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.215096    2548 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/kubelet/pki/kubelet.crt::/var/lib/kubelet/pki/kubelet.key"
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: E0918 17:48:49.215143    2548 dynamic_serving_content.go:144] "Failed to watch cert and key file, will retry later" err="error creating fsnotify watcher: too many open files"
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: E0918 17:48:49.217629    2548 kubelet_node_status.go:404] "Error getting the current node from lister" err="node \"default-k8s-diff-port-804544\" not found"
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.217683    2548 volume_manager.go:313] "Starting Kubelet Volume Manager"
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.217785    2548 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.220839    2548 factory.go:223] Registration of the crio container factory successfully
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.220924    2548 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: I0918 17:48:49.220939    2548 factory.go:223] Registration of the systemd container factory successfully
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: E0918 17:48:49.220957    2548 manager.go:294] Registration of the raw container factory failed: inotify_init: too many open files
	Sep 18 17:48:49 default-k8s-diff-port-804544 kubelet[2548]: E0918 17:48:49.220973    2548 kubelet.go:1686] "Failed to start cAdvisor" err="inotify_init: too many open files"
	Sep 18 17:48:49 default-k8s-diff-port-804544 systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE
	Sep 18 17:48:49 default-k8s-diff-port-804544 systemd[1]: kubelet.service: Failed with result 'exit-code'.
	
	
	==> kubernetes-dashboard [045779b5e2ef0e177a700830e1ab49bf7050686bbb68ca072c0ba212a791b99b] <==
	2025/09/18 17:48:28 Starting overwatch
	2025/09/18 17:48:28 Using namespace: kubernetes-dashboard
	2025/09/18 17:48:28 Using in-cluster config to connect to apiserver
	2025/09/18 17:48:28 Using secret token for csrf signing
	2025/09/18 17:48:28 Initializing csrf token from kubernetes-dashboard-csrf secret
	
	
	==> storage-provisioner [e99e7002a8a797335f7b3236b606823af97173355233c4e25946e11640c87d0e] <==
	I0918 17:48:17.784866       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	F0918 17:48:47.789416       1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
	

                                                
                                                
-- /stdout --
helpers_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-804544 -n default-k8s-diff-port-804544
helpers_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-804544 -n default-k8s-diff-port-804544: exit status 2 (327.157402ms)

                                                
                                                
-- stdout --
	Running

                                                
                                                
-- /stdout --
helpers_test.go:262: status error: exit status 2 (may be ok)
helpers_test.go:269: (dbg) Run:  kubectl --context default-k8s-diff-port-804544 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:280: non-running pods: metrics-server-746fcd58dc-dhzlj
helpers_test.go:282: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/Pause]: describe non-running pods <======
helpers_test.go:285: (dbg) Run:  kubectl --context default-k8s-diff-port-804544 describe pod metrics-server-746fcd58dc-dhzlj
helpers_test.go:285: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-804544 describe pod metrics-server-746fcd58dc-dhzlj: exit status 1 (63.654589ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "metrics-server-746fcd58dc-dhzlj" not found

                                                
                                                
** /stderr **
helpers_test.go:287: kubectl --context default-k8s-diff-port-804544 describe pod metrics-server-746fcd58dc-dhzlj: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:223: ======>  post-mortem[TestStartStop/group/default-k8s-diff-port/serial/Pause]: network settings <======
helpers_test.go:230: HOST ENV snapshots: PROXY env: HTTP_PROXY="<empty>" HTTPS_PROXY="<empty>" NO_PROXY="<empty>"
helpers_test.go:238: ======>  post-mortem[TestStartStop/group/default-k8s-diff-port/serial/Pause]: docker inspect <======
helpers_test.go:239: (dbg) Run:  docker inspect default-k8s-diff-port-804544
helpers_test.go:243: (dbg) docker inspect default-k8s-diff-port-804544:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "269f3d4aa72cda3a966c9a506e1c80eac35663055eb0e589cecaf1ce540554a4",
	        "Created": "2025-09-18T17:47:02.35854927Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 303964,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2025-09-18T17:48:05.463226539Z",
	            "FinishedAt": "2025-09-18T17:48:04.251088463Z"
	        },
	        "Image": "sha256:c6b5532e987b5b4f5fc9cb0336e378ed49c0542bad8cbfc564b71e977a6269de",
	        "ResolvConfPath": "/var/lib/docker/containers/269f3d4aa72cda3a966c9a506e1c80eac35663055eb0e589cecaf1ce540554a4/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/269f3d4aa72cda3a966c9a506e1c80eac35663055eb0e589cecaf1ce540554a4/hostname",
	        "HostsPath": "/var/lib/docker/containers/269f3d4aa72cda3a966c9a506e1c80eac35663055eb0e589cecaf1ce540554a4/hosts",
	        "LogPath": "/var/lib/docker/containers/269f3d4aa72cda3a966c9a506e1c80eac35663055eb0e589cecaf1ce540554a4/269f3d4aa72cda3a966c9a506e1c80eac35663055eb0e589cecaf1ce540554a4-json.log",
	        "Name": "/default-k8s-diff-port-804544",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "default-k8s-diff-port-804544:/var",
	                "/lib/modules:/lib/modules:ro"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "default-k8s-diff-port-804544",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8444/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "private",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 3221225472,
	            "NanoCpus": 0,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 6442450944,
	            "MemorySwappiness": null,
	            "OomKillDisable": null,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "ID": "269f3d4aa72cda3a966c9a506e1c80eac35663055eb0e589cecaf1ce540554a4",
	                "LowerDir": "/var/lib/docker/overlay2/441907fb9ac7ef8f9de885b88ce749a8c9f2bed7a74da921e144ddfa53653500-init/diff:/var/lib/docker/overlay2/1fd2bbb67ab9e5bb8d4549665a1a228eadda56df39fee53908cd735ea16a4e10/diff",
	                "MergedDir": "/var/lib/docker/overlay2/441907fb9ac7ef8f9de885b88ce749a8c9f2bed7a74da921e144ddfa53653500/merged",
	                "UpperDir": "/var/lib/docker/overlay2/441907fb9ac7ef8f9de885b88ce749a8c9f2bed7a74da921e144ddfa53653500/diff",
	                "WorkDir": "/var/lib/docker/overlay2/441907fb9ac7ef8f9de885b88ce749a8c9f2bed7a74da921e144ddfa53653500/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "default-k8s-diff-port-804544",
	                "Source": "/var/lib/docker/volumes/default-k8s-diff-port-804544/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "default-k8s-diff-port-804544",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8444/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "default-k8s-diff-port-804544",
	                "name.minikube.sigs.k8s.io": "default-k8s-diff-port-804544",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "aefc542d1ec51051c68c9ce06fba9f53f6b543849c0e7e16e5c632e2881f5824",
	            "SandboxKey": "/var/run/docker/netns/aefc542d1ec5",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33107"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33108"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33111"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33109"
	                    }
	                ],
	                "8444/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "33110"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "default-k8s-diff-port-804544": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.85.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "3e:8f:da:a2:ba:fa",
	                    "DriverOpts": null,
	                    "GwPriority": 0,
	                    "NetworkID": "f42923e7256b73f73e187b3fa79467c8697361e3bd8ba9e460f9495998bb7372",
	                    "EndpointID": "5a149f6583c93ec72d846729c817578d0c7c2a194959ba0d0f12d065fc1106d3",
	                    "Gateway": "192.168.85.1",
	                    "IPAddress": "192.168.85.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "default-k8s-diff-port-804544",
	                        "269f3d4aa72c"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-804544 -n default-k8s-diff-port-804544
helpers_test.go:252: <<< TestStartStop/group/default-k8s-diff-port/serial/Pause FAILED: start of post-mortem logs <<<
helpers_test.go:253: ======>  post-mortem[TestStartStop/group/default-k8s-diff-port/serial/Pause]: minikube logs <======
helpers_test.go:255: (dbg) Run:  out/minikube-linux-amd64 -p default-k8s-diff-port-804544 logs -n 25
helpers_test.go:255: (dbg) Done: out/minikube-linux-amd64 -p default-k8s-diff-port-804544 logs -n 25: (1.478182228s)
helpers_test.go:260: TestStartStop/group/default-k8s-diff-port/serial/Pause logs: 
-- stdout --
	
	==> Audit <==
	┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────────────┬─────────┬─────────┬─────────────────────┬──────────────
───────┐
	│ COMMAND │                                                                                                                     ARGS                                                                                                                      │           PROFILE            │  USER   │ VERSION │     START TIME      │      END TIME       │
	├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────┼─────────┼─────────┼─────────────────────┼──────────────
───────┤
	│ addons  │ enable metrics-server -p newest-cni-956166 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain                                                                                                       │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ stop    │ -p newest-cni-956166 --alsologtostderr -v=3                                                                                                                                                                                                   │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ image   │ old-k8s-version-525513 image list --format=json                                                                                                                                                                                               │ old-k8s-version-525513       │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ pause   │ -p old-k8s-version-525513 --alsologtostderr -v=1                                                                                                                                                                                              │ old-k8s-version-525513       │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ addons  │ enable dashboard -p newest-cni-956166 --images=MetricsScraper=registry.k8s.io/echoserver:1.4                                                                                                                                                  │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ start   │ -p newest-cni-956166 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0 │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ unpause │ -p old-k8s-version-525513 --alsologtostderr -v=1                                                                                                                                                                                              │ old-k8s-version-525513       │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ delete  │ -p old-k8s-version-525513                                                                                                                                                                                                                     │ old-k8s-version-525513       │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ addons  │ enable metrics-server -p default-k8s-diff-port-804544 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain                                                                                            │ default-k8s-diff-port-804544 │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ delete  │ -p old-k8s-version-525513                                                                                                                                                                                                                     │ old-k8s-version-525513       │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ start   │ -p auto-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=crio                                                                                                                       │ auto-749287                  │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │                     │
	│ stop    │ -p default-k8s-diff-port-804544 --alsologtostderr -v=3                                                                                                                                                                                        │ default-k8s-diff-port-804544 │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:48 UTC │
	│ image   │ newest-cni-956166 image list --format=json                                                                                                                                                                                                    │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ pause   │ -p newest-cni-956166 --alsologtostderr -v=1                                                                                                                                                                                                   │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ addons  │ enable dashboard -p embed-certs-391175 --images=MetricsScraper=registry.k8s.io/echoserver:1.4                                                                                                                                                 │ embed-certs-391175           │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ start   │ -p embed-certs-391175 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0                                                                                        │ embed-certs-391175           │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │                     │
	│ unpause │ -p newest-cni-956166 --alsologtostderr -v=1                                                                                                                                                                                                   │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ delete  │ -p newest-cni-956166                                                                                                                                                                                                                          │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ delete  │ -p newest-cni-956166                                                                                                                                                                                                                          │ newest-cni-956166            │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │ 18 Sep 25 17:47 UTC │
	│ start   │ -p kindnet-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=crio                                                                                                      │ kindnet-749287               │ jenkins │ v1.37.0 │ 18 Sep 25 17:47 UTC │                     │
	│ addons  │ enable dashboard -p default-k8s-diff-port-804544 --images=MetricsScraper=registry.k8s.io/echoserver:1.4                                                                                                                                       │ default-k8s-diff-port-804544 │ jenkins │ v1.37.0 │ 18 Sep 25 17:48 UTC │ 18 Sep 25 17:48 UTC │
	│ start   │ -p default-k8s-diff-port-804544 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0                                                                      │ default-k8s-diff-port-804544 │ jenkins │ v1.37.0 │ 18 Sep 25 17:48 UTC │ 18 Sep 25 17:48 UTC │
	│ image   │ default-k8s-diff-port-804544 image list --format=json                                                                                                                                                                                         │ default-k8s-diff-port-804544 │ jenkins │ v1.37.0 │ 18 Sep 25 17:48 UTC │ 18 Sep 25 17:48 UTC │
	│ pause   │ -p default-k8s-diff-port-804544 --alsologtostderr -v=1                                                                                                                                                                                        │ default-k8s-diff-port-804544 │ jenkins │ v1.37.0 │ 18 Sep 25 17:48 UTC │ 18 Sep 25 17:48 UTC │
	│ unpause │ -p default-k8s-diff-port-804544 --alsologtostderr -v=1                                                                                                                                                                                        │ default-k8s-diff-port-804544 │ jenkins │ v1.37.0 │ 18 Sep 25 17:48 UTC │ 18 Sep 25 17:48 UTC │
	└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────┴─────────┴─────────┴─────────────────────┴──────────────
───────┘
	
	
	==> Last Start <==
	Log file created at: 2025/09/18 17:48:05
	Running on machine: ubuntu-20-agent-4
	Binary: Built with gc go1.24.6 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0918 17:48:05.104467  303479 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:48:05.104675  303479 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:48:05.104688  303479 out.go:374] Setting ErrFile to fd 2...
	I0918 17:48:05.104694  303479 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:48:05.105016  303479 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:48:05.105649  303479 out.go:368] Setting JSON to false
	I0918 17:48:05.107089  303479 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":5436,"bootTime":1758212249,"procs":302,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 17:48:05.107167  303479 start.go:140] virtualization: kvm guest
	I0918 17:48:05.112217  303479 out.go:179] * [default-k8s-diff-port-804544] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 17:48:05.114302  303479 notify.go:220] Checking for updates...
	I0918 17:48:05.114347  303479 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 17:48:05.116328  303479 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 17:48:05.117812  303479 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:48:05.119295  303479 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 17:48:05.120666  303479 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 17:48:05.122239  303479 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 17:48:05.124219  303479 config.go:182] Loaded profile config "default-k8s-diff-port-804544": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:48:05.124981  303479 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 17:48:05.158579  303479 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 17:48:05.158756  303479 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:48:05.253058  303479 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:67 OomKillDisable:false NGoroutines:79 SystemTime:2025-09-18 17:48:05.240339273 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:48:05.253257  303479 docker.go:318] overlay module found
	I0918 17:48:05.255655  303479 out.go:179] * Using the docker driver based on existing profile
	I0918 17:48:05.257411  303479 start.go:304] selected driver: docker
	I0918 17:48:05.257438  303479 start.go:924] validating driver "docker" against &{Name:default-k8s-diff-port-804544 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:default-k8s-diff-port-804544 Namespace:default APIServerHAVIP: APIServerName
:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2
000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:48:05.257600  303479 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 17:48:05.258347  303479 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:48:05.348898  303479 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:68 OomKillDisable:false NGoroutines:79 SystemTime:2025-09-18 17:48:05.333390393 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:48:05.349481  303479 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:48:05.349534  303479 cni.go:84] Creating CNI manager for ""
	I0918 17:48:05.349648  303479 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0918 17:48:05.349841  303479 start.go:348] cluster config:
	{Name:default-k8s-diff-port-804544 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:default-k8s-diff-port-804544 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerR
untime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mou
ntType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:48:05.355928  303479 out.go:179] * Starting "default-k8s-diff-port-804544" primary control-plane node in "default-k8s-diff-port-804544" cluster
	I0918 17:48:05.360395  303479 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:48:05.365141  303479 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:48:05.367134  303479 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:48:05.367189  303479 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
	I0918 17:48:05.367199  303479 cache.go:58] Caching tarball of preloaded images
	I0918 17:48:05.367264  303479 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:48:05.367456  303479 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:48:05.367522  303479 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:48:05.367740  303479 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/config.json ...
	I0918 17:48:05.398121  303479 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:48:05.398170  303479 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:48:05.398204  303479 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:48:05.398253  303479 start.go:360] acquireMachinesLock for default-k8s-diff-port-804544: {Name:mk320d693d9925aca2155df4806cccf3e3eeddcc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:48:05.398356  303479 start.go:364] duration metric: took 83.388µs to acquireMachinesLock for "default-k8s-diff-port-804544"
	I0918 17:48:05.398392  303479 start.go:96] Skipping create...Using existing machine configuration
	I0918 17:48:05.398399  303479 fix.go:54] fixHost starting: 
	I0918 17:48:05.398726  303479 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-804544 --format={{.State.Status}}
	I0918 17:48:05.424565  303479 fix.go:112] recreateIfNeeded on default-k8s-diff-port-804544: state=Stopped err=<nil>
	W0918 17:48:05.424627  303479 fix.go:138] unexpected machine state, will restart: <nil>
	I0918 17:48:06.426494  298506 node_ready.go:49] node "embed-certs-391175" is "Ready"
	I0918 17:48:06.426543  298506 node_ready.go:38] duration metric: took 2.372809674s for node "embed-certs-391175" to be "Ready" ...
	I0918 17:48:06.426560  298506 api_server.go:52] waiting for apiserver process to appear ...
	I0918 17:48:06.426614  298506 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:48:07.250023  298506 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (2.967119451s)
	I0918 17:48:07.250058  298506 addons.go:479] Verifying addon metrics-server=true in "embed-certs-391175"
	I0918 17:48:07.250142  298506 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.871659647s)
	I0918 17:48:07.250188  298506 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (2.80426162s)
	I0918 17:48:07.250300  298506 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (2.763840851s)
	I0918 17:48:07.250349  298506 api_server.go:72] duration metric: took 3.37276742s to wait for apiserver process to appear ...
	I0918 17:48:07.250370  298506 api_server.go:88] waiting for apiserver healthz status ...
	I0918 17:48:07.250395  298506 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0918 17:48:07.253179  298506 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p embed-certs-391175 addons enable metrics-server
	
	I0918 17:48:07.255763  298506 api_server.go:279] https://192.168.76.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/storage-object-count-tracker-hook ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/start-system-namespaces-controller ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
	[+]poststarthook/start-legacy-token-tracking-controller ok
	[+]poststarthook/start-service-ip-repair-controllers ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/bootstrap-controller ok
	[+]poststarthook/start-kubernetes-service-cidr-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-status-local-available-controller ok
	[+]poststarthook/apiservice-status-remote-available-controller ok
	[+]poststarthook/apiservice-registration-controller ok
	[-]poststarthook/apiservice-discovery-controller failed: reason withheld
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0918 17:48:07.255793  298506 api_server.go:103] status: https://192.168.76.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/storage-object-count-tracker-hook ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/start-system-namespaces-controller ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
	[+]poststarthook/start-legacy-token-tracking-controller ok
	[+]poststarthook/start-service-ip-repair-controllers ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/bootstrap-controller ok
	[+]poststarthook/start-kubernetes-service-cidr-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-status-local-available-controller ok
	[+]poststarthook/apiservice-status-remote-available-controller ok
	[+]poststarthook/apiservice-registration-controller ok
	[-]poststarthook/apiservice-discovery-controller failed: reason withheld
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0918 17:48:07.265916  298506 out.go:179] * Enabled addons: metrics-server, storage-provisioner, dashboard, default-storageclass
	I0918 17:48:03.826988  294960 out.go:252]   - Booting up control plane ...
	I0918 17:48:03.827126  294960 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0918 17:48:03.827238  294960 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0918 17:48:03.827354  294960 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0918 17:48:03.827564  294960 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0918 17:48:03.827711  294960 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/instance-config.yaml"
	I0918 17:48:03.827918  294960 kubeadm.go:310] [patches] Applied patch of type "application/strategic-merge-patch+json" to target "kubeletconfiguration"
	I0918 17:48:03.828105  294960 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0918 17:48:03.828178  294960 kubeadm.go:310] [kubelet-start] Starting the kubelet
	I0918 17:48:03.889445  294960 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
	I0918 17:48:03.890167  294960 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
	I0918 17:48:05.394426  294960 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.502077397s
	I0918 17:48:05.400856  294960 kubeadm.go:310] [control-plane-check] Waiting for healthy control plane components. This can take up to 4m0s
	I0918 17:48:05.401257  294960 kubeadm.go:310] [control-plane-check] Checking kube-apiserver at https://192.168.103.2:8443/livez
	I0918 17:48:05.401649  294960 kubeadm.go:310] [control-plane-check] Checking kube-controller-manager at https://127.0.0.1:10257/healthz
	I0918 17:48:05.402067  294960 kubeadm.go:310] [control-plane-check] Checking kube-scheduler at https://127.0.0.1:10259/livez
	I0918 17:48:07.238970  294960 kubeadm.go:310] [control-plane-check] kube-controller-manager is healthy after 1.836416815s
	I0918 17:48:05.180040  301185 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/kindnet-749287/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 17:48:05.223854  301185 cli_runner.go:164] Run: docker container inspect kindnet-749287 --format={{.State.Status}}
	I0918 17:48:05.249738  301185 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0918 17:48:05.249821  301185 kic_runner.go:114] Args: [docker exec --privileged kindnet-749287 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0918 17:48:05.324625  301185 cli_runner.go:164] Run: docker container inspect kindnet-749287 --format={{.State.Status}}
	I0918 17:48:05.351757  301185 machine.go:93] provisionDockerMachine start ...
	I0918 17:48:05.351839  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:05.381491  301185 main.go:141] libmachine: Using SSH client type: native
	I0918 17:48:05.381863  301185 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33102 <nil> <nil>}
	I0918 17:48:05.381878  301185 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:48:05.540552  301185 main.go:141] libmachine: SSH cmd err, output: <nil>: kindnet-749287
	
	I0918 17:48:05.540588  301185 ubuntu.go:182] provisioning hostname "kindnet-749287"
	I0918 17:48:05.540649  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:05.568903  301185 main.go:141] libmachine: Using SSH client type: native
	I0918 17:48:05.569253  301185 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33102 <nil> <nil>}
	I0918 17:48:05.569273  301185 main.go:141] libmachine: About to run SSH command:
	sudo hostname kindnet-749287 && echo "kindnet-749287" | sudo tee /etc/hostname
	I0918 17:48:05.739443  301185 main.go:141] libmachine: SSH cmd err, output: <nil>: kindnet-749287
	
	I0918 17:48:05.739541  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:05.763520  301185 main.go:141] libmachine: Using SSH client type: native
	I0918 17:48:05.764018  301185 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33102 <nil> <nil>}
	I0918 17:48:05.764107  301185 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\skindnet-749287' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 kindnet-749287/g' /etc/hosts;
				else 
					echo '127.0.1.1 kindnet-749287' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:48:05.918815  301185 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:48:05.919039  301185 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:48:05.919085  301185 ubuntu.go:190] setting up certificates
	I0918 17:48:05.919104  301185 provision.go:84] configureAuth start
	I0918 17:48:05.919177  301185 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kindnet-749287
	I0918 17:48:05.946958  301185 provision.go:143] copyHostCerts
	I0918 17:48:05.947027  301185 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:48:05.947034  301185 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:48:05.947107  301185 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:48:05.947195  301185 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:48:05.947200  301185 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:48:05.947224  301185 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:48:05.947288  301185 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:48:05.947292  301185 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:48:05.947319  301185 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:48:05.947388  301185 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.kindnet-749287 san=[127.0.0.1 192.168.94.2 kindnet-749287 localhost minikube]
	I0918 17:48:06.305934  301185 provision.go:177] copyRemoteCerts
	I0918 17:48:06.306008  301185 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:48:06.306050  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:06.332971  301185 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33102 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/kindnet-749287/id_rsa Username:docker}
	I0918 17:48:06.454967  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:48:06.506815  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1212 bytes)
	I0918 17:48:06.551607  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0918 17:48:06.604930  301185 provision.go:87] duration metric: took 685.810104ms to configureAuth
	I0918 17:48:06.604970  301185 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:48:06.605190  301185 config.go:182] Loaded profile config "kindnet-749287": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:48:06.605323  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:06.633121  301185 main.go:141] libmachine: Using SSH client type: native
	I0918 17:48:06.633542  301185 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33102 <nil> <nil>}
	I0918 17:48:06.633569  301185 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:48:06.976830  301185 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:48:06.976858  301185 machine.go:96] duration metric: took 1.625078464s to provisionDockerMachine
	I0918 17:48:06.976870  301185 client.go:171] duration metric: took 6.882132146s to LocalClient.Create
	I0918 17:48:06.976891  301185 start.go:167] duration metric: took 6.882193007s to libmachine.API.Create "kindnet-749287"
	I0918 17:48:06.976901  301185 start.go:293] postStartSetup for "kindnet-749287" (driver="docker")
	I0918 17:48:06.976912  301185 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:48:06.976974  301185 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:48:06.977051  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:07.001727  301185 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33102 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/kindnet-749287/id_rsa Username:docker}
	I0918 17:48:07.115596  301185 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:48:07.121597  301185 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:48:07.121645  301185 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:48:07.121657  301185 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:48:07.121665  301185 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:48:07.121678  301185 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:48:07.121733  301185 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:48:07.121819  301185 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:48:07.121925  301185 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:48:07.135143  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:48:07.184869  301185 start.go:296] duration metric: took 207.942976ms for postStartSetup
	I0918 17:48:07.185421  301185 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kindnet-749287
	I0918 17:48:07.208761  301185 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/config.json ...
	I0918 17:48:07.209107  301185 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:48:07.209164  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:07.238295  301185 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33102 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/kindnet-749287/id_rsa Username:docker}
	I0918 17:48:07.337414  301185 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:48:07.342305  301185 start.go:128] duration metric: took 7.24996556s to createHost
	I0918 17:48:07.342334  301185 start.go:83] releasing machines lock for "kindnet-749287", held for 7.250116172s
	I0918 17:48:07.342412  301185 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kindnet-749287
	I0918 17:48:07.363873  301185 ssh_runner.go:195] Run: cat /version.json
	I0918 17:48:07.363935  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:07.363951  301185 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:48:07.364025  301185 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kindnet-749287
	I0918 17:48:07.391914  301185 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33102 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/kindnet-749287/id_rsa Username:docker}
	I0918 17:48:07.392218  301185 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33102 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/kindnet-749287/id_rsa Username:docker}
	I0918 17:48:07.497595  301185 ssh_runner.go:195] Run: systemctl --version
	I0918 17:48:07.599296  301185 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:48:07.765046  301185 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:48:07.772258  301185 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:48:07.806946  301185 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:48:07.807048  301185 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:48:07.853131  301185 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0918 17:48:07.853160  301185 start.go:495] detecting cgroup driver to use...
	I0918 17:48:07.853194  301185 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:48:07.853242  301185 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:48:07.882764  301185 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:48:07.910886  301185 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:48:07.910941  301185 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:48:07.931477  301185 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:48:07.964223  301185 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:48:08.073551  301185 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:48:08.179257  301185 docker.go:234] disabling docker service ...
	I0918 17:48:08.179376  301185 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:48:08.203120  301185 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:48:08.218419  301185 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:48:08.297076  301185 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:48:08.476238  301185 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:48:08.491354  301185 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:48:08.510542  301185 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:48:08.510606  301185 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:08.523664  301185 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:48:08.523728  301185 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:08.535366  301185 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:08.545993  301185 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:08.556785  301185 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:48:08.567322  301185 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:08.578309  301185 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:08.596137  301185 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:08.607164  301185 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:48:08.616951  301185 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:48:08.626246  301185 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:48:08.697201  301185 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:48:08.800759  301185 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:48:08.800828  301185 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:48:08.804946  301185 start.go:563] Will wait 60s for crictl version
	I0918 17:48:08.805020  301185 ssh_runner.go:195] Run: which crictl
	I0918 17:48:08.808636  301185 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:48:08.844224  301185 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 17:48:08.844322  301185 ssh_runner.go:195] Run: crio --version
	I0918 17:48:08.882935  301185 ssh_runner.go:195] Run: crio --version
	I0918 17:48:08.920370  301185 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 17:48:08.921780  301185 cli_runner.go:164] Run: docker network inspect kindnet-749287 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:48:08.939439  301185 ssh_runner.go:195] Run: grep 192.168.94.1	host.minikube.internal$ /etc/hosts
	I0918 17:48:08.943551  301185 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.94.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:48:08.956549  301185 kubeadm.go:875] updating cluster {Name:kindnet-749287 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:kindnet-749287 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]
DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath
: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0918 17:48:08.956662  301185 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:48:08.956713  301185 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:48:09.028600  301185 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:48:09.028620  301185 crio.go:433] Images already preloaded, skipping extraction
	I0918 17:48:09.028668  301185 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:48:09.063048  301185 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:48:09.063069  301185 cache_images.go:85] Images are preloaded, skipping loading
	I0918 17:48:09.063076  301185 kubeadm.go:926] updating node { 192.168.94.2 8443 v1.34.0 crio true true} ...
	I0918 17:48:09.063163  301185 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=kindnet-749287 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.94.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:kindnet-749287 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet}
	I0918 17:48:09.063231  301185 ssh_runner.go:195] Run: crio config
	I0918 17:48:09.110322  301185 cni.go:84] Creating CNI manager for "kindnet"
	I0918 17:48:09.110348  301185 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0918 17:48:09.110367  301185 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.94.2 APIServerPort:8443 KubernetesVersion:v1.34.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:kindnet-749287 NodeName:kindnet-749287 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.94.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.94.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubern
etes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0918 17:48:09.110477  301185 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.94.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "kindnet-749287"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.94.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.94.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	kubernetesVersion: v1.34.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: systemd
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0918 17:48:09.110558  301185 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 17:48:09.120864  301185 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 17:48:09.120937  301185 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0918 17:48:09.132859  301185 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (364 bytes)
	I0918 17:48:09.159225  301185 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 17:48:09.184935  301185 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2210 bytes)
	I0918 17:48:09.209125  301185 ssh_runner.go:195] Run: grep 192.168.94.2	control-plane.minikube.internal$ /etc/hosts
	I0918 17:48:09.213649  301185 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.94.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:48:09.227320  301185 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:48:09.304679  301185 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:48:09.335266  301185 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287 for IP: 192.168.94.2
	I0918 17:48:09.335292  301185 certs.go:194] generating shared ca certs ...
	I0918 17:48:09.335312  301185 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:09.335494  301185 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 17:48:09.335566  301185 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 17:48:09.335582  301185 certs.go:256] generating profile certs ...
	I0918 17:48:09.335663  301185 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/client.key
	I0918 17:48:09.335684  301185 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/client.crt with IP's: []
	I0918 17:48:09.806556  301185 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/client.crt ...
	I0918 17:48:09.806589  301185 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/client.crt: {Name:mk25796bff40fc31d4e0c600ce3b6d3ed5f6141a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:09.806761  301185 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/client.key ...
	I0918 17:48:09.806780  301185 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/client.key: {Name:mk99edbdc5c4d80f956bfbe95e77bb5967766175 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:09.806915  301185 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.key.590fa789
	I0918 17:48:09.806939  301185 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.crt.590fa789 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.94.2]
	I0918 17:48:08.370783  294960 kubeadm.go:310] [control-plane-check] kube-scheduler is healthy after 2.968520123s
	I0918 17:48:09.904439  294960 kubeadm.go:310] [control-plane-check] kube-apiserver is healthy after 4.502263248s
	I0918 17:48:09.917571  294960 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0918 17:48:09.930930  294960 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0918 17:48:09.941740  294960 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
	I0918 17:48:09.942052  294960 kubeadm.go:310] [mark-control-plane] Marking the node auto-749287 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0918 17:48:09.951666  294960 kubeadm.go:310] [bootstrap-token] Using token: n3gjls.z0hyfn3dcwlakor4
	I0918 17:48:07.267260  298506 addons.go:514] duration metric: took 3.389497828s for enable addons: enabled=[metrics-server storage-provisioner dashboard default-storageclass]
	I0918 17:48:07.751193  298506 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0918 17:48:07.757003  298506 api_server.go:279] https://192.168.76.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/storage-object-count-tracker-hook ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/start-system-namespaces-controller ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
	[+]poststarthook/start-legacy-token-tracking-controller ok
	[+]poststarthook/start-service-ip-repair-controllers ok
	[+]poststarthook/rbac/bootstrap-roles ok
	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/bootstrap-controller ok
	[+]poststarthook/start-kubernetes-service-cidr-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-status-local-available-controller ok
	[+]poststarthook/apiservice-status-remote-available-controller ok
	[+]poststarthook/apiservice-registration-controller ok
	[-]poststarthook/apiservice-discovery-controller failed: reason withheld
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0918 17:48:07.757040  298506 api_server.go:103] status: https://192.168.76.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/storage-object-count-tracker-hook ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/start-system-namespaces-controller ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
	[+]poststarthook/start-legacy-token-tracking-controller ok
	[+]poststarthook/start-service-ip-repair-controllers ok
	[+]poststarthook/rbac/bootstrap-roles ok
	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/bootstrap-controller ok
	[+]poststarthook/start-kubernetes-service-cidr-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-status-local-available-controller ok
	[+]poststarthook/apiservice-status-remote-available-controller ok
	[+]poststarthook/apiservice-registration-controller ok
	[-]poststarthook/apiservice-discovery-controller failed: reason withheld
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0918 17:48:08.250596  298506 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0918 17:48:08.258243  298506 api_server.go:279] https://192.168.76.2:8443/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/storage-object-count-tracker-hook ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/start-system-namespaces-controller ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
	[+]poststarthook/start-legacy-token-tracking-controller ok
	[+]poststarthook/start-service-ip-repair-controllers ok
	[+]poststarthook/rbac/bootstrap-roles ok
	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/bootstrap-controller ok
	[+]poststarthook/start-kubernetes-service-cidr-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-status-local-available-controller ok
	[+]poststarthook/apiservice-status-remote-available-controller ok
	[+]poststarthook/apiservice-registration-controller ok
	[-]poststarthook/apiservice-discovery-controller failed: reason withheld
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0918 17:48:08.258408  298506 api_server.go:103] status: https://192.168.76.2:8443/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/storage-object-count-tracker-hook ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/start-system-namespaces-controller ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
	[+]poststarthook/start-legacy-token-tracking-controller ok
	[+]poststarthook/start-service-ip-repair-controllers ok
	[+]poststarthook/rbac/bootstrap-roles ok
	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/bootstrap-controller ok
	[+]poststarthook/start-kubernetes-service-cidr-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-status-local-available-controller ok
	[+]poststarthook/apiservice-status-remote-available-controller ok
	[+]poststarthook/apiservice-registration-controller ok
	[-]poststarthook/apiservice-discovery-controller failed: reason withheld
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0918 17:48:08.750643  298506 api_server.go:253] Checking apiserver healthz at https://192.168.76.2:8443/healthz ...
	I0918 17:48:08.754994  298506 api_server.go:279] https://192.168.76.2:8443/healthz returned 200:
	ok
	I0918 17:48:08.755962  298506 api_server.go:141] control plane version: v1.34.0
	I0918 17:48:08.755984  298506 api_server.go:131] duration metric: took 1.505605247s to wait for apiserver health ...
	I0918 17:48:08.755992  298506 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 17:48:08.759910  298506 system_pods.go:59] 9 kube-system pods found
	I0918 17:48:08.759960  298506 system_pods.go:61] "coredns-66bc5c9577-lqtmx" [80dcdb4a-f2c0-403e-b8b6-d70646739519] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:48:08.759972  298506 system_pods.go:61] "etcd-embed-certs-391175" [c529332f-8dc2-43b2-82bd-7bb0cea77a5d] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:48:08.759984  298506 system_pods.go:61] "kindnet-cv76q" [4064d452-4888-4fb4-9e81-7269ba69e7bc] Running
	I0918 17:48:08.759994  298506 system_pods.go:61] "kube-apiserver-embed-certs-391175" [afedd34b-54aa-4182-84c4-264e12f40153] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:48:08.760005  298506 system_pods.go:61] "kube-controller-manager-embed-certs-391175" [05281ee5-2e94-4bff-9415-285fa467ecea] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:48:08.760012  298506 system_pods.go:61] "kube-proxy-rsj4n" [aba63634-f57e-4ae4-be71-7c0870519271] Running
	I0918 17:48:08.760018  298506 system_pods.go:61] "kube-scheduler-embed-certs-391175" [5b379f3e-13ab-4af9-bfc0-bdfe8852541d] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:48:08.760027  298506 system_pods.go:61] "metrics-server-746fcd58dc-zh7h8" [a7cfa6fc-a177-4d40-943c-b274829703f3] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0918 17:48:08.760035  298506 system_pods.go:61] "storage-provisioner" [92cdfb5d-3b8d-4e5d-9e8e-1c25b96e5f02] Running
	I0918 17:48:08.760044  298506 system_pods.go:74] duration metric: took 4.045548ms to wait for pod list to return data ...
	I0918 17:48:08.760063  298506 default_sa.go:34] waiting for default service account to be created ...
	I0918 17:48:08.762414  298506 default_sa.go:45] found service account: "default"
	I0918 17:48:08.762435  298506 default_sa.go:55] duration metric: took 2.366122ms for default service account to be created ...
	I0918 17:48:08.762443  298506 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 17:48:08.765310  298506 system_pods.go:86] 9 kube-system pods found
	I0918 17:48:08.765342  298506 system_pods.go:89] "coredns-66bc5c9577-lqtmx" [80dcdb4a-f2c0-403e-b8b6-d70646739519] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])
	I0918 17:48:08.765355  298506 system_pods.go:89] "etcd-embed-certs-391175" [c529332f-8dc2-43b2-82bd-7bb0cea77a5d] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])
	I0918 17:48:08.765363  298506 system_pods.go:89] "kindnet-cv76q" [4064d452-4888-4fb4-9e81-7269ba69e7bc] Running
	I0918 17:48:08.765370  298506 system_pods.go:89] "kube-apiserver-embed-certs-391175" [afedd34b-54aa-4182-84c4-264e12f40153] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])
	I0918 17:48:08.765380  298506 system_pods.go:89] "kube-controller-manager-embed-certs-391175" [05281ee5-2e94-4bff-9415-285fa467ecea] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])
	I0918 17:48:08.765386  298506 system_pods.go:89] "kube-proxy-rsj4n" [aba63634-f57e-4ae4-be71-7c0870519271] Running
	I0918 17:48:08.765394  298506 system_pods.go:89] "kube-scheduler-embed-certs-391175" [5b379f3e-13ab-4af9-bfc0-bdfe8852541d] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])
	I0918 17:48:08.765402  298506 system_pods.go:89] "metrics-server-746fcd58dc-zh7h8" [a7cfa6fc-a177-4d40-943c-b274829703f3] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0918 17:48:08.765412  298506 system_pods.go:89] "storage-provisioner" [92cdfb5d-3b8d-4e5d-9e8e-1c25b96e5f02] Running
	I0918 17:48:08.765421  298506 system_pods.go:126] duration metric: took 2.972723ms to wait for k8s-apps to be running ...
	I0918 17:48:08.765430  298506 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 17:48:08.765482  298506 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:48:08.779303  298506 system_svc.go:56] duration metric: took 13.865895ms WaitForService to wait for kubelet
	I0918 17:48:08.779328  298506 kubeadm.go:578] duration metric: took 4.901749532s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:48:08.779353  298506 node_conditions.go:102] verifying NodePressure condition ...
	I0918 17:48:08.782308  298506 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:48:08.782330  298506 node_conditions.go:123] node cpu capacity is 8
	I0918 17:48:08.782342  298506 node_conditions.go:105] duration metric: took 2.985202ms to run NodePressure ...
	I0918 17:48:08.782355  298506 start.go:241] waiting for startup goroutines ...
	I0918 17:48:08.782367  298506 start.go:246] waiting for cluster config update ...
	I0918 17:48:08.782388  298506 start.go:255] writing updated cluster config ...
	I0918 17:48:08.782687  298506 ssh_runner.go:195] Run: rm -f paused
	I0918 17:48:08.786765  298506 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
	I0918 17:48:08.790495  298506 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-lqtmx" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:05.427546  303479 out.go:252] * Restarting existing docker container for "default-k8s-diff-port-804544" ...
	I0918 17:48:05.427629  303479 cli_runner.go:164] Run: docker start default-k8s-diff-port-804544
	I0918 17:48:05.740714  303479 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-804544 --format={{.State.Status}}
	I0918 17:48:05.762961  303479 kic.go:430] container "default-k8s-diff-port-804544" state is running.
	I0918 17:48:05.765461  303479 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-804544
	I0918 17:48:05.787013  303479 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/config.json ...
	I0918 17:48:05.787252  303479 machine.go:93] provisionDockerMachine start ...
	I0918 17:48:05.787333  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:05.807634  303479 main.go:141] libmachine: Using SSH client type: native
	I0918 17:48:05.807951  303479 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33107 <nil> <nil>}
	I0918 17:48:05.807969  303479 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:48:05.808599  303479 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:58054->127.0.0.1:33107: read: connection reset by peer
	I0918 17:48:08.948311  303479 main.go:141] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-804544
	
	I0918 17:48:08.948344  303479 ubuntu.go:182] provisioning hostname "default-k8s-diff-port-804544"
	I0918 17:48:08.948427  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:08.967763  303479 main.go:141] libmachine: Using SSH client type: native
	I0918 17:48:08.967983  303479 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33107 <nil> <nil>}
	I0918 17:48:08.968001  303479 main.go:141] libmachine: About to run SSH command:
	sudo hostname default-k8s-diff-port-804544 && echo "default-k8s-diff-port-804544" | sudo tee /etc/hostname
	I0918 17:48:09.122310  303479 main.go:141] libmachine: SSH cmd err, output: <nil>: default-k8s-diff-port-804544
	
	I0918 17:48:09.122411  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:09.145976  303479 main.go:141] libmachine: Using SSH client type: native
	I0918 17:48:09.146332  303479 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33107 <nil> <nil>}
	I0918 17:48:09.146366  303479 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sdefault-k8s-diff-port-804544' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 default-k8s-diff-port-804544/g' /etc/hosts;
				else 
					echo '127.0.1.1 default-k8s-diff-port-804544' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:48:09.288833  303479 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:48:09.288862  303479 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:48:09.288908  303479 ubuntu.go:190] setting up certificates
	I0918 17:48:09.288922  303479 provision.go:84] configureAuth start
	I0918 17:48:09.288987  303479 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-804544
	I0918 17:48:09.313853  303479 provision.go:143] copyHostCerts
	I0918 17:48:09.313982  303479 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:48:09.314001  303479 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:48:09.314115  303479 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:48:09.314241  303479 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:48:09.314250  303479 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:48:09.314301  303479 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:48:09.314376  303479 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:48:09.314382  303479 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:48:09.314415  303479 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:48:09.314482  303479 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.default-k8s-diff-port-804544 san=[127.0.0.1 192.168.85.2 default-k8s-diff-port-804544 localhost minikube]
	I0918 17:48:09.471029  303479 provision.go:177] copyRemoteCerts
	I0918 17:48:09.471100  303479 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:48:09.471145  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:09.496957  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:09.604546  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:48:09.635687  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1249 bytes)
	I0918 17:48:09.666534  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
	I0918 17:48:09.696708  303479 provision.go:87] duration metric: took 407.767847ms to configureAuth
	I0918 17:48:09.696736  303479 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:48:09.696952  303479 config.go:182] Loaded profile config "default-k8s-diff-port-804544": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:48:09.697080  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:09.719357  303479 main.go:141] libmachine: Using SSH client type: native
	I0918 17:48:09.719680  303479 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33107 <nil> <nil>}
	I0918 17:48:09.719710  303479 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:48:10.035395  303479 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0918 17:48:10.035427  303479 machine.go:96] duration metric: took 4.248160549s to provisionDockerMachine
	I0918 17:48:10.035443  303479 start.go:293] postStartSetup for "default-k8s-diff-port-804544" (driver="docker")
	I0918 17:48:10.035458  303479 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0918 17:48:10.035552  303479 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0918 17:48:10.035606  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:10.059909  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:09.953153  294960 out.go:252]   - Configuring RBAC rules ...
	I0918 17:48:09.953311  294960 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0918 17:48:09.957471  294960 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0918 17:48:09.964972  294960 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0918 17:48:09.968611  294960 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0918 17:48:09.972097  294960 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0918 17:48:09.977283  294960 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0918 17:48:10.311613  294960 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0918 17:48:10.730996  294960 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
	I0918 17:48:11.311064  294960 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
	I0918 17:48:11.312305  294960 kubeadm.go:310] 
	I0918 17:48:11.312399  294960 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
	I0918 17:48:11.312408  294960 kubeadm.go:310] 
	I0918 17:48:11.312551  294960 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
	I0918 17:48:11.312571  294960 kubeadm.go:310] 
	I0918 17:48:11.312605  294960 kubeadm.go:310]   mkdir -p $HOME/.kube
	I0918 17:48:11.312688  294960 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0918 17:48:11.312753  294960 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0918 17:48:11.312759  294960 kubeadm.go:310] 
	I0918 17:48:11.312829  294960 kubeadm.go:310] Alternatively, if you are the root user, you can run:
	I0918 17:48:11.312834  294960 kubeadm.go:310] 
	I0918 17:48:11.312896  294960 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0918 17:48:11.312902  294960 kubeadm.go:310] 
	I0918 17:48:11.312971  294960 kubeadm.go:310] You should now deploy a pod network to the cluster.
	I0918 17:48:11.313070  294960 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0918 17:48:11.313176  294960 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0918 17:48:11.313182  294960 kubeadm.go:310] 
	I0918 17:48:11.313297  294960 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
	I0918 17:48:11.313399  294960 kubeadm.go:310] and service account keys on each node and then running the following as root:
	I0918 17:48:11.313410  294960 kubeadm.go:310] 
	I0918 17:48:11.313557  294960 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token n3gjls.z0hyfn3dcwlakor4 \
	I0918 17:48:11.313734  294960 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 \
	I0918 17:48:11.313766  294960 kubeadm.go:310] 	--control-plane 
	I0918 17:48:11.313786  294960 kubeadm.go:310] 
	I0918 17:48:11.313923  294960 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
	I0918 17:48:11.313940  294960 kubeadm.go:310] 
	I0918 17:48:11.314039  294960 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token n3gjls.z0hyfn3dcwlakor4 \
	I0918 17:48:11.314157  294960 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:2d6961dc54bd3667aecf31f5dc1be2433caaaf6126d318cba22db9431264e073 
	I0918 17:48:11.317672  294960 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1037-gcp\n", err: exit status 1
	I0918 17:48:11.317845  294960 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0918 17:48:11.317875  294960 cni.go:84] Creating CNI manager for ""
	I0918 17:48:11.317894  294960 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0918 17:48:11.320056  294960 out.go:179] * Configuring CNI (Container Networking Interface) ...
	I0918 17:48:10.163485  303479 ssh_runner.go:195] Run: cat /etc/os-release
	I0918 17:48:10.167969  303479 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0918 17:48:10.168008  303479 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0918 17:48:10.168018  303479 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0918 17:48:10.168029  303479 info.go:137] Remote host: Ubuntu 22.04.5 LTS
	I0918 17:48:10.168053  303479 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/addons for local assets ...
	I0918 17:48:10.168120  303479 filesync.go:126] Scanning /home/jenkins/minikube-integration/20370-7845/.minikube/files for local assets ...
	I0918 17:48:10.168228  303479 filesync.go:149] local asset: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem -> 113682.pem in /etc/ssl/certs
	I0918 17:48:10.168354  303479 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0918 17:48:10.179838  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:48:10.212534  303479 start.go:296] duration metric: took 177.074663ms for postStartSetup
	I0918 17:48:10.212612  303479 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:48:10.212655  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:10.232318  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:10.324562  303479 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:48:10.329580  303479 fix.go:56] duration metric: took 4.931174847s for fixHost
	I0918 17:48:10.329607  303479 start.go:83] releasing machines lock for "default-k8s-diff-port-804544", held for 4.93123986s
	I0918 17:48:10.329672  303479 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" default-k8s-diff-port-804544
	I0918 17:48:10.353462  303479 ssh_runner.go:195] Run: cat /version.json
	I0918 17:48:10.353555  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:10.353734  303479 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0918 17:48:10.353791  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:10.376333  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:10.376642  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:10.566440  303479 ssh_runner.go:195] Run: systemctl --version
	I0918 17:48:10.573393  303479 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0918 17:48:10.720918  303479 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0918 17:48:10.726559  303479 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:48:10.739103  303479 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0918 17:48:10.739172  303479 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0918 17:48:10.749525  303479 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable
	I0918 17:48:10.749545  303479 start.go:495] detecting cgroup driver to use...
	I0918 17:48:10.749580  303479 detect.go:190] detected "systemd" cgroup driver on host os
	I0918 17:48:10.749632  303479 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0918 17:48:10.763610  303479 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0918 17:48:10.786031  303479 docker.go:218] disabling cri-docker service (if available) ...
	I0918 17:48:10.786093  303479 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0918 17:48:10.808236  303479 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0918 17:48:10.822732  303479 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0918 17:48:10.898696  303479 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0918 17:48:10.992036  303479 docker.go:234] disabling docker service ...
	I0918 17:48:10.992161  303479 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0918 17:48:11.008272  303479 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0918 17:48:11.024219  303479 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0918 17:48:11.104944  303479 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0918 17:48:11.189638  303479 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0918 17:48:11.201555  303479 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0918 17:48:11.221741  303479 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10.1" pause image...
	I0918 17:48:11.221798  303479 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10.1"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:11.232631  303479 crio.go:70] configuring cri-o to use "systemd" as cgroup driver...
	I0918 17:48:11.232701  303479 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "systemd"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:11.243426  303479 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:11.254019  303479 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:11.266013  303479 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0918 17:48:11.275968  303479 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:11.286844  303479 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:11.298143  303479 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"
	I0918 17:48:11.310718  303479 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0918 17:48:11.322028  303479 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0918 17:48:11.331566  303479 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:48:11.429010  303479 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0918 17:48:11.559293  303479 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock
	I0918 17:48:11.559365  303479 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0918 17:48:11.563837  303479 start.go:563] Will wait 60s for crictl version
	I0918 17:48:11.563894  303479 ssh_runner.go:195] Run: which crictl
	I0918 17:48:11.567596  303479 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0918 17:48:11.615666  303479 start.go:579] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0918 17:48:11.615754  303479 ssh_runner.go:195] Run: crio --version
	I0918 17:48:11.660828  303479 ssh_runner.go:195] Run: crio --version
	I0918 17:48:11.721908  303479 out.go:179] * Preparing Kubernetes v1.34.0 on CRI-O 1.24.6 ...
	I0918 17:48:11.321456  294960 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0918 17:48:11.325671  294960 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.34.0/kubectl ...
	I0918 17:48:11.325691  294960 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
	I0918 17:48:11.346180  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0918 17:48:11.656480  294960 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0918 17:48:11.656640  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:11.656753  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes auto-749287 minikube.k8s.io/updated_at=2025_09_18T17_48_11_0700 minikube.k8s.io/version=v1.37.0 minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596 minikube.k8s.io/name=auto-749287 minikube.k8s.io/primary=true
	I0918 17:48:11.755703  294960 ops.go:34] apiserver oom_adj: -16
	I0918 17:48:11.755728  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:12.256452  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:11.724233  303479 cli_runner.go:164] Run: docker network inspect default-k8s-diff-port-804544 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:48:11.748268  303479 ssh_runner.go:195] Run: grep 192.168.85.1	host.minikube.internal$ /etc/hosts
	I0918 17:48:11.754138  303479 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.85.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:48:11.769717  303479 kubeadm.go:875] updating cluster {Name:default-k8s-diff-port-804544 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:default-k8s-diff-port-804544 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APISe
rverNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:do
cker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
	I0918 17:48:11.769840  303479 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:48:11.769889  303479 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:48:11.824094  303479 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:48:11.824122  303479 crio.go:433] Images already preloaded, skipping extraction
	I0918 17:48:11.824178  303479 ssh_runner.go:195] Run: sudo crictl images --output json
	I0918 17:48:11.861042  303479 crio.go:514] all images are preloaded for cri-o runtime.
	I0918 17:48:11.861068  303479 cache_images.go:85] Images are preloaded, skipping loading
	I0918 17:48:11.861077  303479 kubeadm.go:926] updating node { 192.168.85.2 8444 v1.34.0 crio true true} ...
	I0918 17:48:11.861206  303479 kubeadm.go:938] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.34.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --enforce-node-allocatable= --hostname-override=default-k8s-diff-port-804544 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.85.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.34.0 ClusterName:default-k8s-diff-port-804544 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
	I0918 17:48:11.861292  303479 ssh_runner.go:195] Run: crio config
	I0918 17:48:11.908989  303479 cni.go:84] Creating CNI manager for ""
	I0918 17:48:11.909016  303479 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0918 17:48:11.909033  303479 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
	I0918 17:48:11.909058  303479 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.85.2 APIServerPort:8444 KubernetesVersion:v1.34.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:default-k8s-diff-port-804544 NodeName:default-k8s-diff-port-804544 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.85.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.85.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.c
rt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0918 17:48:11.909217  303479 kubeadm.go:195] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.85.2
	  bindPort: 8444
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "default-k8s-diff-port-804544"
	  kubeletExtraArgs:
	    - name: "node-ip"
	      value: "192.168.85.2"
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta4
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.85.2"]
	  extraArgs:
	    - name: "enable-admission-plugins"
	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    - name: "allocate-node-cidrs"
	      value: "true"
	    - name: "leader-elect"
	      value: "false"
	scheduler:
	  extraArgs:
	    - name: "leader-elect"
	      value: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8444
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	kubernetesVersion: v1.34.0
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: systemd
	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%"
	  nodefs.inodesFree: "0%"
	  imagefs.available: "0%"
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0918 17:48:11.909289  303479 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.34.0
	I0918 17:48:11.919715  303479 binaries.go:44] Found k8s binaries, skipping transfer
	I0918 17:48:11.919777  303479 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0918 17:48:11.929954  303479 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (378 bytes)
	I0918 17:48:11.951390  303479 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0918 17:48:11.971370  303479 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2224 bytes)
	I0918 17:48:11.992253  303479 ssh_runner.go:195] Run: grep 192.168.85.2	control-plane.minikube.internal$ /etc/hosts
	I0918 17:48:11.996337  303479 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.85.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0918 17:48:12.008583  303479 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:48:12.079937  303479 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:48:12.107653  303479 certs.go:68] Setting up /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544 for IP: 192.168.85.2
	I0918 17:48:12.107673  303479 certs.go:194] generating shared ca certs ...
	I0918 17:48:12.107688  303479 certs.go:226] acquiring lock for ca certs: {Name:mk42e0bb4748fa470c0e37cdcc089ad55bb338d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:12.107849  303479 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key
	I0918 17:48:12.107905  303479 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key
	I0918 17:48:12.107920  303479 certs.go:256] generating profile certs ...
	I0918 17:48:12.108032  303479 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/client.key
	I0918 17:48:12.108191  303479 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/apiserver.key.1f167964
	I0918 17:48:12.108254  303479 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/proxy-client.key
	I0918 17:48:12.108421  303479 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 17:48:12.108465  303479 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 17:48:12.108478  303479 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 17:48:12.108527  303479 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 17:48:12.108560  303479 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 17:48:12.108590  303479 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 17:48:12.108644  303479 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:48:12.109384  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 17:48:12.141717  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 17:48:12.171779  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 17:48:12.209586  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 17:48:12.240274  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)
	I0918 17:48:12.270111  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0918 17:48:12.302989  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 17:48:12.335955  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/default-k8s-diff-port-804544/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
	I0918 17:48:12.364993  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 17:48:12.394233  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 17:48:12.427913  303479 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 17:48:12.459448  303479 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0918 17:48:12.479324  303479 ssh_runner.go:195] Run: openssl version
	I0918 17:48:12.486622  303479 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 17:48:12.502635  303479 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:48:12.508433  303479 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:48:12.508601  303479 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:48:12.517653  303479 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 17:48:12.529183  303479 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 17:48:12.542394  303479 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 17:48:12.546456  303479 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 17:48:12.546543  303479 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 17:48:12.553981  303479 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 17:48:12.564443  303479 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 17:48:12.576613  303479 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 17:48:12.581037  303479 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 17:48:12.581099  303479 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 17:48:12.589229  303479 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 17:48:12.599826  303479 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 17:48:12.604396  303479 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400
	I0918 17:48:12.613175  303479 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400
	I0918 17:48:12.622347  303479 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400
	I0918 17:48:12.631735  303479 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400
	I0918 17:48:12.641669  303479 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400
	I0918 17:48:12.650147  303479 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400
	I0918 17:48:12.658222  303479 kubeadm.go:392] StartCluster: {Name:default-k8s-diff-port-804544 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:default-k8s-diff-port-804544 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServe
rNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docke
r MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:48:12.658325  303479 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0918 17:48:12.658400  303479 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0918 17:48:12.708559  303479 cri.go:89] found id: ""
	I0918 17:48:12.708636  303479 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0918 17:48:12.720154  303479 kubeadm.go:408] found existing configuration files, will attempt cluster restart
	I0918 17:48:12.720181  303479 kubeadm.go:589] restartPrimaryControlPlane start ...
	I0918 17:48:12.720227  303479 ssh_runner.go:195] Run: sudo test -d /data/minikube
	I0918 17:48:12.735084  303479 kubeadm.go:130] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:48:12.736177  303479 kubeconfig.go:47] verify endpoint returned: get endpoint: "default-k8s-diff-port-804544" does not appear in /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:48:12.736817  303479 kubeconfig.go:62] /home/jenkins/minikube-integration/20370-7845/kubeconfig needs updating (will repair): [kubeconfig missing "default-k8s-diff-port-804544" cluster setting kubeconfig missing "default-k8s-diff-port-804544" context setting]
	I0918 17:48:12.737817  303479 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:12.740027  303479 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new
	I0918 17:48:12.756604  303479 kubeadm.go:626] The running cluster does not require reconfiguration: 192.168.85.2
	I0918 17:48:12.756648  303479 kubeadm.go:593] duration metric: took 36.459793ms to restartPrimaryControlPlane
	I0918 17:48:12.756663  303479 kubeadm.go:394] duration metric: took 98.453146ms to StartCluster
	I0918 17:48:12.756683  303479 settings.go:142] acquiring lock: {Name:mk72fea03aefe901db9522a467405d86665fedd0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:12.756776  303479 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:48:12.758936  303479 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:12.759959  303479 config.go:182] Loaded profile config "default-k8s-diff-port-804544": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:48:12.760074  303479 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:true default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0918 17:48:12.760159  303479 addons.go:69] Setting storage-provisioner=true in profile "default-k8s-diff-port-804544"
	I0918 17:48:12.760178  303479 addons.go:238] Setting addon storage-provisioner=true in "default-k8s-diff-port-804544"
	W0918 17:48:12.760187  303479 addons.go:247] addon storage-provisioner should already be in state true
	I0918 17:48:12.760214  303479 host.go:66] Checking if "default-k8s-diff-port-804544" exists ...
	I0918 17:48:12.760707  303479 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-804544 --format={{.State.Status}}
	I0918 17:48:12.760894  303479 addons.go:69] Setting default-storageclass=true in profile "default-k8s-diff-port-804544"
	I0918 17:48:12.760913  303479 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-diff-port-804544"
	I0918 17:48:12.761187  303479 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-804544 --format={{.State.Status}}
	I0918 17:48:12.761351  303479 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.85.2 Port:8444 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:48:12.761547  303479 addons.go:69] Setting dashboard=true in profile "default-k8s-diff-port-804544"
	I0918 17:48:12.761588  303479 addons.go:238] Setting addon dashboard=true in "default-k8s-diff-port-804544"
	W0918 17:48:12.761605  303479 addons.go:247] addon dashboard should already be in state true
	I0918 17:48:12.761653  303479 host.go:66] Checking if "default-k8s-diff-port-804544" exists ...
	I0918 17:48:12.762156  303479 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-804544 --format={{.State.Status}}
	I0918 17:48:12.762387  303479 addons.go:69] Setting metrics-server=true in profile "default-k8s-diff-port-804544"
	I0918 17:48:12.762410  303479 addons.go:238] Setting addon metrics-server=true in "default-k8s-diff-port-804544"
	W0918 17:48:12.762418  303479 addons.go:247] addon metrics-server should already be in state true
	I0918 17:48:12.762442  303479 host.go:66] Checking if "default-k8s-diff-port-804544" exists ...
	I0918 17:48:12.762917  303479 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-804544 --format={{.State.Status}}
	I0918 17:48:12.765552  303479 out.go:179] * Verifying Kubernetes components...
	I0918 17:48:12.767256  303479 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:48:12.805393  303479 addons.go:238] Setting addon default-storageclass=true in "default-k8s-diff-port-804544"
	W0918 17:48:12.805535  303479 addons.go:247] addon default-storageclass should already be in state true
	I0918 17:48:12.805631  303479 host.go:66] Checking if "default-k8s-diff-port-804544" exists ...
	I0918 17:48:12.805474  303479 out.go:179]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0918 17:48:12.806330  303479 cli_runner.go:164] Run: docker container inspect default-k8s-diff-port-804544 --format={{.State.Status}}
	I0918 17:48:12.807479  303479 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 17:48:12.807653  303479 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0918 17:48:12.807736  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:12.814859  303479 out.go:179]   - Using image docker.io/kubernetesui/dashboard:v2.7.0
	I0918 17:48:12.816767  303479 out.go:179]   - Using image fake.domain/registry.k8s.io/echoserver:1.4
	I0918 17:48:12.818609  303479 addons.go:435] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0918 17:48:12.818754  303479 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0918 17:48:12.818683  303479 out.go:179]   - Using image registry.k8s.io/echoserver:1.4
	I0918 17:48:10.002781  301185 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.crt.590fa789 ...
	I0918 17:48:10.002810  301185 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.crt.590fa789: {Name:mkb47f569517fcbaca291128f648750d4e66ac4d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:10.003002  301185 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.key.590fa789 ...
	I0918 17:48:10.003025  301185 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.key.590fa789: {Name:mk6a4c2b3a00b064ec2c14abb2e5cd86cc2d01c4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:10.003135  301185 certs.go:381] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.crt.590fa789 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.crt
	I0918 17:48:10.003227  301185 certs.go:385] copying /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.key.590fa789 -> /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.key
	I0918 17:48:10.003289  301185 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/proxy-client.key
	I0918 17:48:10.003305  301185 crypto.go:68] Generating cert /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/proxy-client.crt with IP's: []
	I0918 17:48:10.261001  301185 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/proxy-client.crt ...
	I0918 17:48:10.261036  301185 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/proxy-client.crt: {Name:mke7e2d53d3c5afa81b389d541064830dbbcdbe4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:10.261206  301185 crypto.go:164] Writing key to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/proxy-client.key ...
	I0918 17:48:10.261217  301185 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/proxy-client.key: {Name:mkfe3a1dac1aef743534bff0abc1218fd0660b3a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:10.261397  301185 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem (1338 bytes)
	W0918 17:48:10.261433  301185 certs.go:480] ignoring /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368_empty.pem, impossibly tiny 0 bytes
	I0918 17:48:10.261443  301185 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem (1679 bytes)
	I0918 17:48:10.261469  301185 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem (1078 bytes)
	I0918 17:48:10.261491  301185 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem (1123 bytes)
	I0918 17:48:10.261535  301185 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem (1679 bytes)
	I0918 17:48:10.261579  301185 certs.go:484] found cert: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem (1708 bytes)
	I0918 17:48:10.262199  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0918 17:48:10.289247  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0918 17:48:10.318363  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0918 17:48:10.355021  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
	I0918 17:48:10.390386  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
	I0918 17:48:10.419884  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0918 17:48:10.449863  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0918 17:48:10.479680  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kindnet-749287/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0918 17:48:10.511857  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0918 17:48:10.548579  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/11368.pem --> /usr/share/ca-certificates/11368.pem (1338 bytes)
	I0918 17:48:10.588311  301185 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/ssl/certs/113682.pem --> /usr/share/ca-certificates/113682.pem (1708 bytes)
	I0918 17:48:10.615412  301185 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0918 17:48:10.635541  301185 ssh_runner.go:195] Run: openssl version
	I0918 17:48:10.641333  301185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0918 17:48:10.651332  301185 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:48:10.655485  301185 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 18 16:38 /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:48:10.655579  301185 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0918 17:48:10.662954  301185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0918 17:48:10.673114  301185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/11368.pem && ln -fs /usr/share/ca-certificates/11368.pem /etc/ssl/certs/11368.pem"
	I0918 17:48:10.687148  301185 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/11368.pem
	I0918 17:48:10.691394  301185 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Sep 18 16:44 /usr/share/ca-certificates/11368.pem
	I0918 17:48:10.691462  301185 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/11368.pem
	I0918 17:48:10.699420  301185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/11368.pem /etc/ssl/certs/51391683.0"
	I0918 17:48:10.710679  301185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/113682.pem && ln -fs /usr/share/ca-certificates/113682.pem /etc/ssl/certs/113682.pem"
	I0918 17:48:10.723356  301185 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/113682.pem
	I0918 17:48:10.727808  301185 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Sep 18 16:44 /usr/share/ca-certificates/113682.pem
	I0918 17:48:10.727873  301185 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/113682.pem
	I0918 17:48:10.736686  301185 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/113682.pem /etc/ssl/certs/3ec20f2e.0"
	I0918 17:48:10.748624  301185 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
	I0918 17:48:10.752827  301185 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
	I0918 17:48:10.752874  301185 kubeadm.go:392] StartCluster: {Name:kindnet-749287 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:kindnet-749287 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DN
SDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP:192.168.94.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: S
ocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 17:48:10.752932  301185 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0918 17:48:10.752979  301185 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0918 17:48:10.805536  301185 cri.go:89] found id: ""
	I0918 17:48:10.805607  301185 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0918 17:48:10.817663  301185 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0918 17:48:10.827867  301185 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
	I0918 17:48:10.827932  301185 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0918 17:48:10.839211  301185 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0918 17:48:10.839232  301185 kubeadm.go:157] found existing configuration files:
	
	I0918 17:48:10.839279  301185 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
	I0918 17:48:10.849278  301185 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/admin.conf: No such file or directory
	I0918 17:48:10.849353  301185 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
	I0918 17:48:10.863045  301185 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
	I0918 17:48:10.873346  301185 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/kubelet.conf: No such file or directory
	I0918 17:48:10.873403  301185 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
	I0918 17:48:10.883713  301185 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
	I0918 17:48:10.893477  301185 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/controller-manager.conf: No such file or directory
	I0918 17:48:10.893569  301185 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
	I0918 17:48:10.905372  301185 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
	I0918 17:48:10.918256  301185 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	grep: /etc/kubernetes/scheduler.conf: No such file or directory
	I0918 17:48:10.918318  301185 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
	I0918 17:48:10.932624  301185 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.34.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0918 17:48:11.007005  301185 kubeadm.go:310] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/6.8.0-1037-gcp\n", err: exit status 1
	I0918 17:48:11.082484  301185 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	W0918 17:48:10.800240  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:12.840855  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	I0918 17:48:12.819039  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:12.821766  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-ns.yaml
	I0918 17:48:12.821787  303479 ssh_runner.go:362] scp dashboard/dashboard-ns.yaml --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)
	I0918 17:48:12.821916  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:12.840192  303479 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
	I0918 17:48:12.840387  303479 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0918 17:48:12.841023  303479 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-diff-port-804544
	I0918 17:48:12.859407  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:12.863312  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:12.876767  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:12.895128  303479 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33107 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/default-k8s-diff-port-804544/id_rsa Username:docker}
	I0918 17:48:13.009746  303479 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:48:13.040757  303479 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 17:48:13.058076  303479 node_ready.go:35] waiting up to 6m0s for node "default-k8s-diff-port-804544" to be "Ready" ...
	I0918 17:48:13.060138  303479 addons.go:435] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0918 17:48:13.060160  303479 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1825 bytes)
	I0918 17:48:13.073655  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml
	I0918 17:48:13.073683  303479 ssh_runner.go:362] scp dashboard/dashboard-clusterrole.yaml --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)
	I0918 17:48:13.074780  303479 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0918 17:48:13.103159  303479 addons.go:435] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0918 17:48:13.103188  303479 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0918 17:48:13.119048  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml
	I0918 17:48:13.119087  303479 ssh_runner.go:362] scp dashboard/dashboard-clusterrolebinding.yaml --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)
	I0918 17:48:13.171368  303479 addons.go:435] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0918 17:48:13.171396  303479 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0918 17:48:13.173784  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-configmap.yaml
	I0918 17:48:13.173829  303479 ssh_runner.go:362] scp dashboard/dashboard-configmap.yaml --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)
	W0918 17:48:13.177176  303479 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8444/openapi/v2?timeout=32s": dial tcp [::1]:8444: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 17:48:13.177298  303479 retry.go:31] will retry after 228.838058ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error: error validating "/etc/kubernetes/addons/storage-provisioner.yaml": error validating data: failed to download openapi: Get "https://localhost:8444/openapi/v2?timeout=32s": dial tcp [::1]:8444: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	W0918 17:48:13.197958  303479 addons.go:461] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8444/openapi/v2?timeout=32s": dial tcp [::1]:8444: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 17:48:13.198004  303479 retry.go:31] will retry after 173.708642ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: Process exited with status 1
	stdout:
	
	stderr:
	error: error validating "/etc/kubernetes/addons/storageclass.yaml": error validating data: failed to download openapi: Get "https://localhost:8444/openapi/v2?timeout=32s": dial tcp [::1]:8444: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
	I0918 17:48:13.209723  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-dp.yaml
	I0918 17:48:13.209757  303479 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4201 bytes)
	I0918 17:48:13.215853  303479 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0918 17:48:13.244191  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-role.yaml
	I0918 17:48:13.244223  303479 ssh_runner.go:362] scp dashboard/dashboard-role.yaml --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)
	I0918 17:48:13.272195  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml
	I0918 17:48:13.272262  303479 ssh_runner.go:362] scp dashboard/dashboard-rolebinding.yaml --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)
	I0918 17:48:13.324103  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-sa.yaml
	I0918 17:48:13.324144  303479 ssh_runner.go:362] scp dashboard/dashboard-sa.yaml --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)
	I0918 17:48:13.355823  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-secret.yaml
	I0918 17:48:13.355851  303479 ssh_runner.go:362] scp dashboard/dashboard-secret.yaml --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)
	I0918 17:48:13.372553  303479 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml
	I0918 17:48:13.385672  303479 addons.go:435] installing /etc/kubernetes/addons/dashboard-svc.yaml
	I0918 17:48:13.385699  303479 ssh_runner.go:362] scp dashboard/dashboard-svc.yaml --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)
	I0918 17:48:13.407196  303479 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 17:48:13.417761  303479 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml
	I0918 17:48:14.976467  303479 node_ready.go:49] node "default-k8s-diff-port-804544" is "Ready"
	I0918 17:48:14.976516  303479 node_ready.go:38] duration metric: took 1.918393379s for node "default-k8s-diff-port-804544" to be "Ready" ...
	I0918 17:48:14.976535  303479 api_server.go:52] waiting for apiserver process to appear ...
	I0918 17:48:14.976596  303479 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:48:15.781565  303479 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (2.565669251s)
	I0918 17:48:15.781720  303479 addons.go:479] Verifying addon metrics-server=true in "default-k8s-diff-port-804544"
	I0918 17:48:15.781660  303479 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/storageclass.yaml: (2.409063519s)
	I0918 17:48:15.804486  303479 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply --force -f /etc/kubernetes/addons/storage-provisioner.yaml: (2.397254001s)
	I0918 17:48:15.804631  303479 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (2.386830376s)
	I0918 17:48:15.804676  303479 api_server.go:72] duration metric: took 3.043292091s to wait for apiserver process to appear ...
	I0918 17:48:15.804692  303479 api_server.go:88] waiting for apiserver healthz status ...
	I0918 17:48:15.804713  303479 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0918 17:48:15.806321  303479 out.go:179] * Some dashboard features require the metrics-server addon. To enable all features please run:
	
		minikube -p default-k8s-diff-port-804544 addons enable metrics-server
	
	I0918 17:48:15.807753  303479 out.go:179] * Enabled addons: metrics-server, default-storageclass, storage-provisioner, dashboard
	I0918 17:48:12.756800  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:13.255880  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:13.755895  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:14.256622  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:14.755852  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:15.256628  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:15.756594  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:16.255933  294960 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.34.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0918 17:48:16.366923  294960 kubeadm.go:1105] duration metric: took 4.710329155s to wait for elevateKubeSystemPrivileges
	I0918 17:48:16.366960  294960 kubeadm.go:394] duration metric: took 17.475951077s to StartCluster
	I0918 17:48:16.366980  294960 settings.go:142] acquiring lock: {Name:mk72fea03aefe901db9522a467405d86665fedd0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:16.367040  294960 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:48:16.369557  294960 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/kubeconfig: {Name:mkc67e4dc485ceae30e8dcb026fabd7289ace972 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:48:16.369825  294960 start.go:235] Will wait 15m0s for node &{Name: IP:192.168.103.2 Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:48:16.369843  294960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0918 17:48:16.370121  294960 addons.go:511] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubetail:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]
	I0918 17:48:16.370220  294960 addons.go:69] Setting storage-provisioner=true in profile "auto-749287"
	I0918 17:48:16.370242  294960 addons.go:238] Setting addon storage-provisioner=true in "auto-749287"
	I0918 17:48:16.370276  294960 host.go:66] Checking if "auto-749287" exists ...
	I0918 17:48:16.370455  294960 addons.go:69] Setting default-storageclass=true in profile "auto-749287"
	I0918 17:48:16.370518  294960 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "auto-749287"
	I0918 17:48:16.370547  294960 config.go:182] Loaded profile config "auto-749287": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:48:16.371004  294960 cli_runner.go:164] Run: docker container inspect auto-749287 --format={{.State.Status}}
	I0918 17:48:16.371391  294960 cli_runner.go:164] Run: docker container inspect auto-749287 --format={{.State.Status}}
	I0918 17:48:16.372337  294960 out.go:179] * Verifying Kubernetes components...
	I0918 17:48:16.373760  294960 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0918 17:48:16.401355  294960 addons.go:238] Setting addon default-storageclass=true in "auto-749287"
	I0918 17:48:16.401440  294960 host.go:66] Checking if "auto-749287" exists ...
	I0918 17:48:16.404478  294960 cli_runner.go:164] Run: docker container inspect auto-749287 --format={{.State.Status}}
	I0918 17:48:16.406486  294960 out.go:179]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0918 17:48:16.408022  294960 addons.go:435] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 17:48:16.408076  294960 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0918 17:48:16.408171  294960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" auto-749287
	I0918 17:48:16.440911  294960 addons.go:435] installing /etc/kubernetes/addons/storageclass.yaml
	I0918 17:48:16.440936  294960 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0918 17:48:16.441020  294960 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" auto-749287
	I0918 17:48:16.445952  294960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33092 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/auto-749287/id_rsa Username:docker}
	I0918 17:48:16.478355  294960 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33092 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/auto-749287/id_rsa Username:docker}
	I0918 17:48:16.502739  294960 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.103.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.34.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0918 17:48:16.553265  294960 ssh_runner.go:195] Run: sudo systemctl start kubelet
	I0918 17:48:16.596034  294960 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0918 17:48:16.625912  294960 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.34.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0918 17:48:16.799487  294960 start.go:976] {"host.minikube.internal": 192.168.103.1} host record injected into CoreDNS's ConfigMap
	I0918 17:48:16.803842  294960 node_ready.go:35] waiting up to 15m0s for node "auto-749287" to be "Ready" ...
	I0918 17:48:17.255399  294960 out.go:179] * Enabled addons: storage-provisioner, default-storageclass
	I0918 17:48:17.256805  294960 addons.go:514] duration metric: took 886.676709ms for enable addons: enabled=[storage-provisioner default-storageclass]
	I0918 17:48:17.305368  294960 kapi.go:214] "coredns" deployment in "kube-system" namespace and "auto-749287" context rescaled to 1 replicas
	W0918 17:48:15.308753  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:17.796291  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:19.796966  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	I0918 17:48:15.809096  303479 addons.go:514] duration metric: took 3.049012182s for enable addons: enabled=[metrics-server default-storageclass storage-provisioner dashboard]
	I0918 17:48:15.810139  303479 api_server.go:279] https://192.168.85.2:8444/healthz returned 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/storage-object-count-tracker-hook ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/start-system-namespaces-controller ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
	[+]poststarthook/start-legacy-token-tracking-controller ok
	[+]poststarthook/start-service-ip-repair-controllers ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/bootstrap-controller ok
	[+]poststarthook/start-kubernetes-service-cidr-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-status-local-available-controller ok
	[+]poststarthook/apiservice-status-remote-available-controller ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-discovery-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	W0918 17:48:15.810164  303479 api_server.go:103] status: https://192.168.85.2:8444/healthz returned error 500:
	[+]ping ok
	[+]log ok
	[+]etcd ok
	[+]poststarthook/start-apiserver-admission-initializer ok
	[+]poststarthook/generic-apiserver-start-informers ok
	[+]poststarthook/priority-and-fairness-config-consumer ok
	[+]poststarthook/priority-and-fairness-filter ok
	[+]poststarthook/storage-object-count-tracker-hook ok
	[+]poststarthook/start-apiextensions-informers ok
	[+]poststarthook/start-apiextensions-controllers ok
	[+]poststarthook/crd-informer-synced ok
	[+]poststarthook/start-system-namespaces-controller ok
	[+]poststarthook/start-cluster-authentication-info-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok
	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok
	[+]poststarthook/start-legacy-token-tracking-controller ok
	[+]poststarthook/start-service-ip-repair-controllers ok
	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld
	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld
	[+]poststarthook/priority-and-fairness-config-producer ok
	[+]poststarthook/bootstrap-controller ok
	[+]poststarthook/start-kubernetes-service-cidr-controller ok
	[+]poststarthook/aggregator-reload-proxy-client-cert ok
	[+]poststarthook/start-kube-aggregator-informers ok
	[+]poststarthook/apiservice-status-local-available-controller ok
	[+]poststarthook/apiservice-status-remote-available-controller ok
	[+]poststarthook/apiservice-registration-controller ok
	[+]poststarthook/apiservice-discovery-controller ok
	[+]poststarthook/kube-apiserver-autoregistration ok
	[+]autoregister-completion ok
	[+]poststarthook/apiservice-openapi-controller ok
	[+]poststarthook/apiservice-openapiv3-controller ok
	healthz check failed
	I0918 17:48:16.305662  303479 api_server.go:253] Checking apiserver healthz at https://192.168.85.2:8444/healthz ...
	I0918 17:48:16.311424  303479 api_server.go:279] https://192.168.85.2:8444/healthz returned 200:
	ok
	I0918 17:48:16.312703  303479 api_server.go:141] control plane version: v1.34.0
	I0918 17:48:16.312731  303479 api_server.go:131] duration metric: took 508.031161ms to wait for apiserver health ...
	I0918 17:48:16.312742  303479 system_pods.go:43] waiting for kube-system pods to appear ...
	I0918 17:48:16.318459  303479 system_pods.go:59] 9 kube-system pods found
	I0918 17:48:16.318495  303479 system_pods.go:61] "coredns-66bc5c9577-zfhpw" [6be0d1d2-f397-428d-9330-6bfe82a23504] Running
	I0918 17:48:16.318525  303479 system_pods.go:61] "etcd-default-k8s-diff-port-804544" [f1d11375-dbcd-4f9f-8341-a4c292acccb5] Running
	I0918 17:48:16.318531  303479 system_pods.go:61] "kindnet-prnkj" [991ae076-d3da-46c4-b2c5-95048010b581] Running
	I0918 17:48:16.318537  303479 system_pods.go:61] "kube-apiserver-default-k8s-diff-port-804544" [6b550354-3745-4458-8c6b-1fcdb6783518] Running
	I0918 17:48:16.318546  303479 system_pods.go:61] "kube-controller-manager-default-k8s-diff-port-804544" [dc2d14f1-44d3-4f76-8a39-46d9917be28e] Running
	I0918 17:48:16.318552  303479 system_pods.go:61] "kube-proxy-9k22b" [7db34416-66b2-4425-96f1-3f31b0e3e26a] Running
	I0918 17:48:16.318560  303479 system_pods.go:61] "kube-scheduler-default-k8s-diff-port-804544" [2b5f89ee-999d-4dff-9f1a-e820b66d3a4d] Running
	I0918 17:48:16.318570  303479 system_pods.go:61] "metrics-server-746fcd58dc-dhzlj" [ae0876dd-f568-4e2d-a39a-4502588d52ce] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0918 17:48:16.318583  303479 system_pods.go:61] "storage-provisioner" [a3395f9b-051b-40ac-aa5b-b067b9ac0f43] Running
	I0918 17:48:16.318598  303479 system_pods.go:74] duration metric: took 5.847933ms to wait for pod list to return data ...
	I0918 17:48:16.318610  303479 default_sa.go:34] waiting for default service account to be created ...
	I0918 17:48:16.321231  303479 default_sa.go:45] found service account: "default"
	I0918 17:48:16.321249  303479 default_sa.go:55] duration metric: took 2.633751ms for default service account to be created ...
	I0918 17:48:16.321258  303479 system_pods.go:116] waiting for k8s-apps to be running ...
	I0918 17:48:16.324472  303479 system_pods.go:86] 9 kube-system pods found
	I0918 17:48:16.324511  303479 system_pods.go:89] "coredns-66bc5c9577-zfhpw" [6be0d1d2-f397-428d-9330-6bfe82a23504] Running
	I0918 17:48:16.324520  303479 system_pods.go:89] "etcd-default-k8s-diff-port-804544" [f1d11375-dbcd-4f9f-8341-a4c292acccb5] Running
	I0918 17:48:16.324528  303479 system_pods.go:89] "kindnet-prnkj" [991ae076-d3da-46c4-b2c5-95048010b581] Running
	I0918 17:48:16.324534  303479 system_pods.go:89] "kube-apiserver-default-k8s-diff-port-804544" [6b550354-3745-4458-8c6b-1fcdb6783518] Running
	I0918 17:48:16.324540  303479 system_pods.go:89] "kube-controller-manager-default-k8s-diff-port-804544" [dc2d14f1-44d3-4f76-8a39-46d9917be28e] Running
	I0918 17:48:16.324545  303479 system_pods.go:89] "kube-proxy-9k22b" [7db34416-66b2-4425-96f1-3f31b0e3e26a] Running
	I0918 17:48:16.324551  303479 system_pods.go:89] "kube-scheduler-default-k8s-diff-port-804544" [2b5f89ee-999d-4dff-9f1a-e820b66d3a4d] Running
	I0918 17:48:16.324560  303479 system_pods.go:89] "metrics-server-746fcd58dc-dhzlj" [ae0876dd-f568-4e2d-a39a-4502588d52ce] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
	I0918 17:48:16.324566  303479 system_pods.go:89] "storage-provisioner" [a3395f9b-051b-40ac-aa5b-b067b9ac0f43] Running
	I0918 17:48:16.324576  303479 system_pods.go:126] duration metric: took 3.313137ms to wait for k8s-apps to be running ...
	I0918 17:48:16.324591  303479 system_svc.go:44] waiting for kubelet service to be running ....
	I0918 17:48:16.324643  303479 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:48:16.342265  303479 system_svc.go:56] duration metric: took 17.66309ms WaitForService to wait for kubelet
	I0918 17:48:16.342324  303479 kubeadm.go:578] duration metric: took 3.580940641s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:48:16.342346  303479 node_conditions.go:102] verifying NodePressure condition ...
	I0918 17:48:16.347375  303479 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0918 17:48:16.347404  303479 node_conditions.go:123] node cpu capacity is 8
	I0918 17:48:16.347418  303479 node_conditions.go:105] duration metric: took 5.06647ms to run NodePressure ...
	I0918 17:48:16.347434  303479 start.go:241] waiting for startup goroutines ...
	I0918 17:48:16.347445  303479 start.go:246] waiting for cluster config update ...
	I0918 17:48:16.347459  303479 start.go:255] writing updated cluster config ...
	I0918 17:48:16.347804  303479 ssh_runner.go:195] Run: rm -f paused
	I0918 17:48:16.354227  303479 pod_ready.go:37] extra waiting up to 4m0s for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
	I0918 17:48:16.361725  303479 pod_ready.go:83] waiting for pod "coredns-66bc5c9577-zfhpw" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:16.368055  303479 pod_ready.go:94] pod "coredns-66bc5c9577-zfhpw" is "Ready"
	I0918 17:48:16.368087  303479 pod_ready.go:86] duration metric: took 6.332886ms for pod "coredns-66bc5c9577-zfhpw" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:16.372036  303479 pod_ready.go:83] waiting for pod "etcd-default-k8s-diff-port-804544" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:16.379684  303479 pod_ready.go:94] pod "etcd-default-k8s-diff-port-804544" is "Ready"
	I0918 17:48:16.379716  303479 pod_ready.go:86] duration metric: took 7.659793ms for pod "etcd-default-k8s-diff-port-804544" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:16.384320  303479 pod_ready.go:83] waiting for pod "kube-apiserver-default-k8s-diff-port-804544" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:16.396454  303479 pod_ready.go:94] pod "kube-apiserver-default-k8s-diff-port-804544" is "Ready"
	I0918 17:48:16.396531  303479 pod_ready.go:86] duration metric: took 12.18252ms for pod "kube-apiserver-default-k8s-diff-port-804544" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:16.403337  303479 pod_ready.go:83] waiting for pod "kube-controller-manager-default-k8s-diff-port-804544" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:16.768835  303479 pod_ready.go:94] pod "kube-controller-manager-default-k8s-diff-port-804544" is "Ready"
	I0918 17:48:16.768865  303479 pod_ready.go:86] duration metric: took 365.469847ms for pod "kube-controller-manager-default-k8s-diff-port-804544" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:16.959453  303479 pod_ready.go:83] waiting for pod "kube-proxy-9k22b" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:17.359775  303479 pod_ready.go:94] pod "kube-proxy-9k22b" is "Ready"
	I0918 17:48:17.359802  303479 pod_ready.go:86] duration metric: took 400.244603ms for pod "kube-proxy-9k22b" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:17.558846  303479 pod_ready.go:83] waiting for pod "kube-scheduler-default-k8s-diff-port-804544" in "kube-system" namespace to be "Ready" or be gone ...
	W0918 17:48:19.565185  303479 pod_ready.go:104] pod "kube-scheduler-default-k8s-diff-port-804544" is not "Ready", error: <nil>
	W0918 17:48:18.807278  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:20.807490  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:22.297391  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:24.797737  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:22.064112  303479 pod_ready.go:104] pod "kube-scheduler-default-k8s-diff-port-804544" is not "Ready", error: <nil>
	W0918 17:48:24.064927  303479 pod_ready.go:104] pod "kube-scheduler-default-k8s-diff-port-804544" is not "Ready", error: <nil>
	W0918 17:48:23.307579  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:25.807708  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:27.296703  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:29.796316  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:26.564359  303479 pod_ready.go:104] pod "kube-scheduler-default-k8s-diff-port-804544" is not "Ready", error: <nil>
	W0918 17:48:28.564973  303479 pod_ready.go:104] pod "kube-scheduler-default-k8s-diff-port-804544" is not "Ready", error: <nil>
	W0918 17:48:28.307563  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:30.307705  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:32.308119  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:31.064606  303479 pod_ready.go:104] pod "kube-scheduler-default-k8s-diff-port-804544" is not "Ready", error: <nil>
	I0918 17:48:32.563662  303479 pod_ready.go:94] pod "kube-scheduler-default-k8s-diff-port-804544" is "Ready"
	I0918 17:48:32.563693  303479 pod_ready.go:86] duration metric: took 15.004823181s for pod "kube-scheduler-default-k8s-diff-port-804544" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:32.563708  303479 pod_ready.go:40] duration metric: took 16.209436272s for extra waiting for all "kube-system" pods having one of [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] labels to be "Ready" ...
	I0918 17:48:32.609590  303479 start.go:623] kubectl: 1.34.1, cluster: 1.34.0 (minor skew: 0)
	I0918 17:48:32.611647  303479 out.go:179] * Done! kubectl is now configured to use "default-k8s-diff-port-804544" cluster and "default" namespace by default
	W0918 17:48:31.796402  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:33.797246  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:34.807058  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:37.306875  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:36.296248  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:38.795957  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:39.306948  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:41.307149  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:40.796220  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:42.796286  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:44.796613  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:43.307372  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:45.307492  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:47.307593  294960 node_ready.go:57] node "auto-749287" has "Ready":"False" status (will retry)
	W0918 17:48:46.800485  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	W0918 17:48:49.297381  298506 pod_ready.go:104] pod "coredns-66bc5c9577-lqtmx" is not "Ready", error: <nil>
	I0918 17:48:49.796388  298506 pod_ready.go:94] pod "coredns-66bc5c9577-lqtmx" is "Ready"
	I0918 17:48:49.796423  298506 pod_ready.go:86] duration metric: took 41.005877011s for pod "coredns-66bc5c9577-lqtmx" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:49.799604  298506 pod_ready.go:83] waiting for pod "etcd-embed-certs-391175" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:49.804199  298506 pod_ready.go:94] pod "etcd-embed-certs-391175" is "Ready"
	I0918 17:48:49.804228  298506 pod_ready.go:86] duration metric: took 4.592544ms for pod "etcd-embed-certs-391175" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:49.806676  298506 pod_ready.go:83] waiting for pod "kube-apiserver-embed-certs-391175" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:49.811481  298506 pod_ready.go:94] pod "kube-apiserver-embed-certs-391175" is "Ready"
	I0918 17:48:49.811519  298506 pod_ready.go:86] duration metric: took 4.813309ms for pod "kube-apiserver-embed-certs-391175" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:49.813865  298506 pod_ready.go:83] waiting for pod "kube-controller-manager-embed-certs-391175" in "kube-system" namespace to be "Ready" or be gone ...
	I0918 17:48:49.994895  298506 pod_ready.go:94] pod "kube-controller-manager-embed-certs-391175" is "Ready"
	I0918 17:48:49.994945  298506 pod_ready.go:86] duration metric: took 181.051604ms for pod "kube-controller-manager-embed-certs-391175" in "kube-system" namespace to be "Ready" or be gone ...
	
	
	==> CRI-O <==
	Sep 18 17:48:34 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:34.212344633Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce,RepoTags:[registry.k8s.io/kube-proxy:v1.34.0],RepoDigests:[registry.k8s.io/kube-proxy@sha256:364da8a25c742d7a35e9635cb8cf42c1faf5b367760d0f9f9a75bdd1f9d52067 registry.k8s.io/kube-proxy@sha256:5f71731a5eadcf74f3997dfc159bf5ca36e48c3387c19082fc21871e0dbb19af],Size_:73138071,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=88d84b1d-b185-44c5-814a-c3cb9b4eab17 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:34 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:34.213096661Z" level=info msg="Checking image status: registry.k8s.io/kube-proxy:v1.34.0" id=50a3c9c5-5f03-41f1-8f1e-4cd460b34bba name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:34 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:34.213304006Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce,RepoTags:[registry.k8s.io/kube-proxy:v1.34.0],RepoDigests:[registry.k8s.io/kube-proxy@sha256:364da8a25c742d7a35e9635cb8cf42c1faf5b367760d0f9f9a75bdd1f9d52067 registry.k8s.io/kube-proxy@sha256:5f71731a5eadcf74f3997dfc159bf5ca36e48c3387c19082fc21871e0dbb19af],Size_:73138071,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=50a3c9c5-5f03-41f1-8f1e-4cd460b34bba name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:34 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:34.214252189Z" level=info msg="Creating container: kube-system/kube-proxy-9k22b/kube-proxy" id=f00195c8-3eee-40ff-9591-9f28619fef95 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 17:48:34 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:34.214388979Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 17:48:34 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:34.286009909Z" level=info msg="Created container b6f2f167bd56af9c24ebb913bc00789d71ac73ac920515deb77d7f2d1800d479: kube-system/kube-proxy-9k22b/kube-proxy" id=f00195c8-3eee-40ff-9591-9f28619fef95 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 17:48:34 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:34.286671522Z" level=info msg="Starting container: b6f2f167bd56af9c24ebb913bc00789d71ac73ac920515deb77d7f2d1800d479" id=d60de1a1-30ed-4309-8e65-769ccc5a4c15 name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 17:48:34 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:34.294432920Z" level=info msg="Started container" PID=1990 containerID=b6f2f167bd56af9c24ebb913bc00789d71ac73ac920515deb77d7f2d1800d479 description=kube-system/kube-proxy-9k22b/kube-proxy id=d60de1a1-30ed-4309-8e65-769ccc5a4c15 name=/runtime.v1.RuntimeService/StartContainer sandboxID=3a262d9e976cce605db881613707bda1f5b554e273425abc8508c029d2e06523
	Sep 18 17:48:35 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:35.314214275Z" level=info msg="Removing container: 4f38f518c9fddf92cc6307cf33a6cdf57bacd8cbb54f72ee502c9e7642c46bc2" id=aec6d9be-10d2-4165-b48a-815704187e7d name=/runtime.v1.RuntimeService/RemoveContainer
	Sep 18 17:48:35 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:35.332742574Z" level=info msg="Removed container 4f38f518c9fddf92cc6307cf33a6cdf57bacd8cbb54f72ee502c9e7642c46bc2: kube-system/kube-proxy-9k22b/kube-proxy" id=aec6d9be-10d2-4165-b48a-815704187e7d name=/runtime.v1.RuntimeService/RemoveContainer
	Sep 18 17:48:36 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:36.211828465Z" level=info msg="Checking image status: fake.domain/registry.k8s.io/echoserver:1.4" id=2e0c0ec3-a3de-41ad-afe6-a5f4cb32aaf2 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:36 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:36.212143650Z" level=info msg="Image fake.domain/registry.k8s.io/echoserver:1.4 not found" id=2e0c0ec3-a3de-41ad-afe6-a5f4cb32aaf2 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:36 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:36.212698719Z" level=info msg="Pulling image: fake.domain/registry.k8s.io/echoserver:1.4" id=0015949f-aa35-4b01-aed7-4368f1c05845 name=/runtime.v1.ImageService/PullImage
	Sep 18 17:48:36 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:36.260437566Z" level=info msg="Trying to access \"fake.domain/registry.k8s.io/echoserver:1.4\""
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.211121801Z" level=info msg="Checking image status: registry.k8s.io/echoserver:1.4" id=7aa249b3-fc9d-4c5b-9fd4-8f7b8d68ffc0 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.211372855Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7,RepoTags:[registry.k8s.io/echoserver:1.4],RepoDigests:[registry.k8s.io/echoserver@sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb],Size_:145080634,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=7aa249b3-fc9d-4c5b-9fd4-8f7b8d68ffc0 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.212899663Z" level=info msg="Checking image status: registry.k8s.io/echoserver:1.4" id=cebcce04-b217-4e86-ac47-5b2a5de2d2b2 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.213117727Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7,RepoTags:[registry.k8s.io/echoserver:1.4],RepoDigests:[registry.k8s.io/echoserver@sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb],Size_:145080634,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=cebcce04-b217-4e86-ac47-5b2a5de2d2b2 name=/runtime.v1.ImageService/ImageStatus
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.215006289Z" level=info msg="Creating container: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-rt24n/dashboard-metrics-scraper" id=40df8ed1-6bb5-447f-9adf-d0531b9fe7a0 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.215183237Z" level=warning msg="Allowed annotations are specified for workload []"
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.291332009Z" level=info msg="Created container c56b06de40b74a5884bca2cabb84e963b595ce8b89cc2fdbd8895e63aad1e1c9: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-rt24n/dashboard-metrics-scraper" id=40df8ed1-6bb5-447f-9adf-d0531b9fe7a0 name=/runtime.v1.RuntimeService/CreateContainer
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.292155238Z" level=info msg="Starting container: c56b06de40b74a5884bca2cabb84e963b595ce8b89cc2fdbd8895e63aad1e1c9" id=45d34636-597e-4252-9eba-4a9b62df9bd5 name=/runtime.v1.RuntimeService/StartContainer
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.299731113Z" level=info msg="Started container" PID=2054 containerID=c56b06de40b74a5884bca2cabb84e963b595ce8b89cc2fdbd8895e63aad1e1c9 description=kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-rt24n/dashboard-metrics-scraper id=45d34636-597e-4252-9eba-4a9b62df9bd5 name=/runtime.v1.RuntimeService/StartContainer sandboxID=f8347c6fd365a00c173b57cfaa0e4ed63989e1d70d689f0ecacc06532d68ca04
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.337058503Z" level=info msg="Removing container: c62c9325fcf0b096bf9d37ca785da310739168d0e9186a410c3a4e771125f041" id=441943d9-f903-4680-8e4b-aa998ae7f342 name=/runtime.v1.RuntimeService/RemoveContainer
	Sep 18 17:48:44 default-k8s-diff-port-804544 crio[554]: time="2025-09-18 17:48:44.353925066Z" level=info msg="Removed container c62c9325fcf0b096bf9d37ca785da310739168d0e9186a410c3a4e771125f041: kubernetes-dashboard/dashboard-metrics-scraper-6ffb444bf9-rt24n/dashboard-metrics-scraper" id=441943d9-f903-4680-8e4b-aa998ae7f342 name=/runtime.v1.RuntimeService/RemoveContainer
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                                      CREATED             STATE               NAME                        ATTEMPT             POD ID              POD
	c56b06de40b74       a90209bb39e3d7b5fc9daf60c17044ea969aaca0333d672d8c7a34c7446e7ff7                                           7 seconds ago       Exited              dashboard-metrics-scraper   2                   f8347c6fd365a       dashboard-metrics-scraper-6ffb444bf9-rt24n
	b6f2f167bd56a       df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce                                           17 seconds ago      Exited              kube-proxy                  3                   3a262d9e976cc       kube-proxy-9k22b
	045779b5e2ef0       docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93   23 seconds ago      Running             kubernetes-dashboard        0                   7c6e18c15de8f       kubernetes-dashboard-855c9754f9-svs5n
	d3ae5fa88c9ee       56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c                                           34 seconds ago      Running             busybox                     1                   8c9a1139ebde1       busybox
	e99e7002a8a79       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                           34 seconds ago      Exited              storage-provisioner         1                   ad899cd584001       storage-provisioner
	0b0b24b0019e2       52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969                                           34 seconds ago      Running             coredns                     1                   1d3b270bde844       coredns-66bc5c9577-zfhpw
	01a98143560b1       409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c                                           34 seconds ago      Running             kindnet-cni                 1                   fc348fd2133eb       kindnet-prnkj
	fb4df4429ab22       46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc                                           38 seconds ago      Running             kube-scheduler              1                   1c9c8e39da379       kube-scheduler-default-k8s-diff-port-804544
	9fea6b9ef6cfd       90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90                                           38 seconds ago      Running             kube-apiserver              1                   34e77b452d775       kube-apiserver-default-k8s-diff-port-804544
	e18934e7725a2       a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634                                           38 seconds ago      Running             kube-controller-manager     1                   261212d44c3b1       kube-controller-manager-default-k8s-diff-port-804544
	7e091ef510cce       5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115                                           38 seconds ago      Running             etcd                        1                   deb50b3382732       etcd-default-k8s-diff-port-804544
	
	
	==> coredns [0b0b24b0019e2ebe56a3b204ea6076643ad5804e3eafdcbaafaad2efe0e660d8] <==
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:40683->192.168.85.1:53: i/o timeout
	[INFO] 127.0.0.1:59989 - 10331 "HINFO IN 6100432509177264649.3868697612483183808. udp 57 false 512" - - 0 6.001019543s
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:39204->192.168.85.1:53: i/o timeout
	[INFO] 127.0.0.1:52230 - 55585 "HINFO IN 6100432509177264649.3868697612483183808. udp 57 false 512" - - 0 4.001375208s
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:59411->192.168.85.1:53: i/o timeout
	[INFO] 127.0.0.1:53244 - 26416 "HINFO IN 6100432509177264649.3868697612483183808. udp 57 false 512" - - 0 2.00059555s
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:34495->192.168.85.1:53: i/o timeout
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] 127.0.0.1:53673 - 65295 "HINFO IN 6100432509177264649.3868697612483183808. udp 57 false 512" - - 0 2.000243765s
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:57672->192.168.85.1:53: i/o timeout
	[INFO] 127.0.0.1:34810 - 36709 "HINFO IN 6100432509177264649.3868697612483183808. udp 57 false 512" - - 0 2.000313481s
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:39344->192.168.85.1:53: i/o timeout
	[INFO] 127.0.0.1:39272 - 58827 "HINFO IN 6100432509177264649.3868697612483183808. udp 57 false 512" - - 0 2.000270448s
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:51710->192.168.85.1:53: i/o timeout
	[INFO] plugin/ready: Still waiting on: "kubernetes"
	[INFO] 127.0.0.1:37247 - 4165 "HINFO IN 6100432509177264649.3868697612483183808. udp 57 false 512" - - 0 2.000804289s
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:37824->192.168.85.1:53: i/o timeout
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	[ERROR] plugin/kubernetes: Unhandled Error
	[ERROR] plugin/kubernetes: Unhandled Error
	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.32.3/tools/cache/reflector.go:251: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout
	[ERROR] plugin/kubernetes: Unhandled Error
	[INFO] 127.0.0.1:50960 - 292 "HINFO IN 6100432509177264649.3868697612483183808. udp 57 false 512" - - 0 2.000823745s
	[ERROR] plugin/errors: 2 6100432509177264649.3868697612483183808. HINFO: read udp 10.244.0.2:42411->192.168.85.1:53: i/o timeout
	
	
	==> describe nodes <==
	Name:               default-k8s-diff-port-804544
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=default-k8s-diff-port-804544
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=d76f9c2c3cf03cd59f809d143b4ae22edeee2596
	                    minikube.k8s.io/name=default-k8s-diff-port-804544
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2025_09_18T17_47_18_0700
	                    minikube.k8s.io/version=v1.37.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	Annotations:        node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Thu, 18 Sep 2025 17:47:15 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  default-k8s-diff-port-804544
	  AcquireTime:     <unset>
	  RenewTime:       Thu, 18 Sep 2025 17:48:50 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Thu, 18 Sep 2025 17:48:50 +0000   Thu, 18 Sep 2025 17:47:13 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Thu, 18 Sep 2025 17:48:50 +0000   Thu, 18 Sep 2025 17:47:13 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Thu, 18 Sep 2025 17:48:50 +0000   Thu, 18 Sep 2025 17:47:13 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Thu, 18 Sep 2025 17:48:50 +0000   Thu, 18 Sep 2025 17:47:33 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.85.2
	  Hostname:    default-k8s-diff-port-804544
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32863456Ki
	  pods:               110
	System Info:
	  Machine ID:                 2760dd99259b4246b783f886bcd8ffbb
	  System UUID:                d12e83b6-3b84-4281-86c4-52d39e59de37
	  Boot ID:                    a0fd5057-a565-49d7-b0e2-4d09783d05c4
	  Kernel Version:             6.8.0-1037-gcp
	  OS Image:                   Ubuntu 22.04.5 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.34.0
	  Kube-Proxy Version:         
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (12 in total)
	  Namespace                   Name                                                    CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                                    ------------  ----------  ---------------  -------------  ---
	  default                     busybox                                                 0 (0%)        0 (0%)      0 (0%)           0 (0%)         74s
	  kube-system                 coredns-66bc5c9577-zfhpw                                100m (1%)     0 (0%)      70Mi (0%)        170Mi (0%)     88s
	  kube-system                 etcd-default-k8s-diff-port-804544                       100m (1%)     0 (0%)      100Mi (0%)       0 (0%)         95s
	  kube-system                 kindnet-prnkj                                           100m (1%)     100m (1%)   50Mi (0%)        50Mi (0%)      89s
	  kube-system                 kube-apiserver-default-k8s-diff-port-804544             250m (3%)     0 (0%)      0 (0%)           0 (0%)         94s
	  kube-system                 kube-controller-manager-default-k8s-diff-port-804544    200m (2%)     0 (0%)      0 (0%)           0 (0%)         94s
	  kube-system                 kube-proxy-9k22b                                        0 (0%)        0 (0%)      0 (0%)           0 (0%)         89s
	  kube-system                 kube-scheduler-default-k8s-diff-port-804544             100m (1%)     0 (0%)      0 (0%)           0 (0%)         94s
	  kube-system                 metrics-server-746fcd58dc-dhzlj                         100m (1%)     0 (0%)      200Mi (0%)       0 (0%)         64s
	  kube-system                 storage-provisioner                                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         88s
	  kubernetes-dashboard        dashboard-metrics-scraper-6ffb444bf9-rt24n              0 (0%)        0 (0%)      0 (0%)           0 (0%)         32s
	  kubernetes-dashboard        kubernetes-dashboard-855c9754f9-svs5n                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         32s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (11%)  100m (1%)
	  memory             420Mi (1%)  220Mi (0%)
	  ephemeral-storage  0 (0%)      0 (0%)
	  hugepages-1Gi      0 (0%)      0 (0%)
	  hugepages-2Mi      0 (0%)      0 (0%)
	Events:
	  Type    Reason                   Age                From             Message
	  ----    ------                   ----               ----             -------
	  Normal  Starting                 88s                kube-proxy       
	  Normal  Starting                 94s                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  94s                kubelet          Node default-k8s-diff-port-804544 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    94s                kubelet          Node default-k8s-diff-port-804544 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     94s                kubelet          Node default-k8s-diff-port-804544 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           90s                node-controller  Node default-k8s-diff-port-804544 event: Registered Node default-k8s-diff-port-804544 in Controller
	  Normal  NodeReady                78s                kubelet          Node default-k8s-diff-port-804544 status is now: NodeReady
	  Normal  NodeHasNoDiskPressure    39s (x8 over 39s)  kubelet          Node default-k8s-diff-port-804544 status is now: NodeHasNoDiskPressure
	  Normal  Starting                 39s                kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  39s (x8 over 39s)  kubelet          Node default-k8s-diff-port-804544 status is now: NodeHasSufficientMemory
	  Normal  NodeHasSufficientPID     39s (x8 over 39s)  kubelet          Node default-k8s-diff-port-804544 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           33s                node-controller  Node default-k8s-diff-port-804544 event: Registered Node default-k8s-diff-port-804544 in Controller
	  Normal  Starting                 4s                 kubelet          Starting kubelet.
	  Normal  Starting                 3s                 kubelet          Starting kubelet.
	  Normal  Starting                 2s                 kubelet          Starting kubelet.
	  Normal  Starting                 2s                 kubelet          Starting kubelet.
	  Normal  Starting                 1s                 kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  1s                 kubelet          Node default-k8s-diff-port-804544 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    1s                 kubelet          Node default-k8s-diff-port-804544 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     1s                 kubelet          Node default-k8s-diff-port-804544 status is now: NodeHasSufficientPID
	
	
	==> dmesg <==
	[  +0.996474] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.505292] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.495250] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.999891] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.006265] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.993922] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.507054] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +1.501580] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.992816] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.507754] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +1.501603] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.991314] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.510025] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +1.501325] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.989128] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.511977] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +1.501358] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.987099] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.514401] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +1.501630] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +1.351251] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.500488] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +1.501327] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +1.000152] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	[  +0.500821] IPv4: martian destination 127.0.0.11 from 10.244.0.2, dev vethf69e6c71
	
	
	==> etcd [7e091ef510cceadafa5385da99f5eff3809bb5e8617ce07b0731f6a2b40ba600] <==
	{"level":"warn","ts":"2025-09-18T17:48:13.941860Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43106","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:13.955757Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43110","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:13.965766Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43126","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:13.974841Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43136","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:13.985322Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43150","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:13.995540Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43174","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.008557Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43194","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.017746Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43222","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.027158Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43232","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.037314Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43252","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.046182Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43266","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.058722Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43284","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.065318Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43302","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.077278Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43310","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.091664Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43322","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.102096Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43340","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.109846Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43356","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.118828Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43370","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.127542Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43384","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.135936Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43400","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.144631Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43420","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.156238Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43458","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.164660Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43474","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.173033Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43498","server-name":"","error":"EOF"}
	{"level":"warn","ts":"2025-09-18T17:48:14.227904Z","caller":"embed/config_logging.go:188","msg":"rejected connection on client endpoint","remote-addr":"127.0.0.1:43524","server-name":"","error":"EOF"}
	
	
	==> kernel <==
	 17:48:51 up  1:31,  0 users,  load average: 2.99, 2.98, 2.03
	Linux default-k8s-diff-port-804544 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.5 LTS"
	
	
	==> kindnet [01a98143560b1d4e791e8d53e9949f7722290664b9359d1fccebe62e3d8039a4] <==
	I0918 17:48:17.902958       1 main.go:109] connected to apiserver: https://10.96.0.1:443
	I0918 17:48:17.903199       1 main.go:139] hostIP = 192.168.85.2
	podIP = 192.168.85.2
	I0918 17:48:17.903393       1 main.go:148] setting mtu 1500 for CNI 
	I0918 17:48:17.903414       1 main.go:178] kindnetd IP family: "ipv4"
	I0918 17:48:17.903442       1 main.go:182] noMask IPv4 subnets: [10.244.0.0/16]
	time="2025-09-18T17:48:18Z" level=info msg="Created plugin 10-kube-network-policies (kindnetd, handles RunPodSandbox,RemovePodSandbox)"
	I0918 17:48:18.108099       1 controller.go:377] "Starting controller" name="kube-network-policies"
	I0918 17:48:18.108127       1 controller.go:381] "Waiting for informer caches to sync"
	I0918 17:48:18.108138       1 shared_informer.go:350] "Waiting for caches to sync" controller="kube-network-policies"
	I0918 17:48:18.108254       1 controller.go:390] nri plugin exited: failed to connect to NRI service: dial unix /var/run/nri/nri.sock: connect: no such file or directory
	E0918 17:48:48.109281       1 reflector.go:200] "Failed to watch" err="failed to list *v1.NetworkPolicy: Get \"https://10.96.0.1:443/apis/networking.k8s.io/v1/networkpolicies?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.NetworkPolicy"
	E0918 17:48:48.109530       1 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: Get \"https://10.96.0.1:443/api/v1/nodes?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.Node"
	E0918 17:48:48.110728       1 reflector.go:200] "Failed to watch" err="failed to list *v1.Pod: Get \"https://10.96.0.1:443/api/v1/pods?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.Pod"
	E0918 17:48:48.110853       1 reflector.go:200] "Failed to watch" err="failed to list *v1.Namespace: Get \"https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0\": dial tcp 10.96.0.1:443: i/o timeout" logger="UnhandledError" reflector="pkg/mod/k8s.io/client-go@v0.33.0/tools/cache/reflector.go:285" type="*v1.Namespace"
	
	
	==> kube-apiserver [9fea6b9ef6cfd7931a8802642fe88cac2d98c47ded9e858a83411e65b7192d54] <==
	I0918 17:48:15.586445       1 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0918 17:48:15.599451       1 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	I0918 17:48:15.608840       1 controller.go:667] quota admission added evaluator for: serviceaccounts
	I0918 17:48:15.670291       1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/kubernetes-dashboard" clusterIPs={"IPv4":"10.102.2.75"}
	I0918 17:48:15.685186       1 alloc.go:328] "allocated clusterIPs" service="kubernetes-dashboard/dashboard-metrics-scraper" clusterIPs={"IPv4":"10.103.69.231"}
	I0918 17:48:15.824941       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
	W0918 17:48:16.037421       1 handler_proxy.go:99] no RequestInfo found in the context
	E0918 17:48:16.037456       1 controller.go:113] "Unhandled Error" err="loading OpenAPI spec for \"v1beta1.metrics.k8s.io\" failed with: Error, could not get list of group versions for APIService" logger="UnhandledError"
	I0918 17:48:16.037468       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	W0918 17:48:16.037524       1 handler_proxy.go:99] no RequestInfo found in the context
	E0918 17:48:16.037594       1 controller.go:102] "Unhandled Error" err=<
		loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
		, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	 > logger="UnhandledError"
	I0918 17:48:16.038649       1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0918 17:48:18.898361       1 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0918 17:48:18.997319       1 controller.go:667] quota admission added evaluator for: endpoints
	I0918 17:48:19.049105       1 controller.go:667] quota admission added evaluator for: replicasets.apps
	I0918 17:48:19.098952       1 controller.go:667] quota admission added evaluator for: daemonsets.apps
	{"level":"warn","ts":"2025-09-18T17:48:49.984757Z","logger":"etcd-client","caller":"v3@v3.6.4/retry_interceptor.go:65","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0xc00159e960/127.0.0.1:2379","method":"/etcdserverpb.KV/Txn","attempt":0,"error":"rpc error: code = Canceled desc = context canceled"}
	E0918 17:48:49.985056       1 writers.go:123] "Unhandled Error" err="apiserver was unable to write a JSON response: http: Handler timeout" logger="UnhandledError"
	E0918 17:48:49.985112       1 status.go:71] "Unhandled Error" err="apiserver received an error that is not an metav1.Status: &errors.errorString{s:\"http: Handler timeout\"}: http: Handler timeout" logger="UnhandledError"
	E0918 17:48:49.985147       1 finisher.go:175] "Unhandled Error" err="FinishRequest: post-timeout activity - time-elapsed: 10.403µs, panicked: false, err: context canceled, panic-reason: <nil>" logger="UnhandledError"
	E0918 17:48:49.986889       1 writers.go:136] "Unhandled Error" err="apiserver was unable to write a fallback JSON response: http: Handler timeout" logger="UnhandledError"
	E0918 17:48:49.987032       1 timeout.go:140] "Post-timeout activity" logger="UnhandledError" timeElapsed="2.098058ms" method="POST" path="/api/v1/namespaces/default/events" result=null
	
	
	==> kube-controller-manager [e18934e7725a251323e6218ece37b7c0f10ad34d1495c2542dcd0673801977a6] <==
	I0918 17:48:18.444740       1 shared_informer.go:356] "Caches are synced" controller="job"
	I0918 17:48:18.444892       1 shared_informer.go:356] "Caches are synced" controller="resource_claim"
	I0918 17:48:18.444910       1 shared_informer.go:356] "Caches are synced" controller="legacy-service-account-token-cleaner"
	I0918 17:48:18.444920       1 shared_informer.go:356] "Caches are synced" controller="endpoint_slice_mirroring"
	I0918 17:48:18.444989       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-serving"
	I0918 17:48:18.444896       1 shared_informer.go:356] "Caches are synced" controller="endpoint"
	I0918 17:48:18.445146       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrapproving"
	I0918 17:48:18.445699       1 shared_informer.go:356] "Caches are synced" controller="bootstrap_signer"
	I0918 17:48:18.445713       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kubelet-client"
	I0918 17:48:18.446849       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-legacy-unknown"
	I0918 17:48:18.446883       1 shared_informer.go:356] "Caches are synced" controller="certificate-csrsigning-kube-apiserver-client"
	I0918 17:48:18.454203       1 shared_informer.go:356] "Caches are synced" controller="resource quota"
	I0918 17:48:18.463478       1 shared_informer.go:356] "Caches are synced" controller="resource quota"
	I0918 17:48:18.466654       1 shared_informer.go:356] "Caches are synced" controller="daemon sets"
	I0918 17:48:18.468987       1 shared_informer.go:356] "Caches are synced" controller="ReplicaSet"
	I0918 17:48:18.468997       1 shared_informer.go:356] "Caches are synced" controller="namespace"
	I0918 17:48:18.472384       1 shared_informer.go:356] "Caches are synced" controller="stateful set"
	I0918 17:48:18.476892       1 shared_informer.go:356] "Caches are synced" controller="cronjob"
	I0918 17:48:18.476958       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	I0918 17:48:18.477037       1 garbagecollector.go:154] "Garbage collector: all resource monitors have synced" logger="garbage-collector-controller"
	I0918 17:48:18.477047       1 garbagecollector.go:157] "Proceeding to collect garbage" logger="garbage-collector-controller"
	I0918 17:48:18.480811       1 shared_informer.go:356] "Caches are synced" controller="deployment"
	I0918 17:48:18.484750       1 shared_informer.go:356] "Caches are synced" controller="garbage collector"
	E0918 17:48:48.461016       1 resource_quota_controller.go:446] "Unhandled Error" err="unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: stale GroupVersion discovery: metrics.k8s.io/v1beta1" logger="UnhandledError"
	I0918 17:48:48.498513       1 garbagecollector.go:787] "failed to discover some groups" logger="garbage-collector-controller" groups="map[\"metrics.k8s.io/v1beta1\":\"stale GroupVersion discovery: metrics.k8s.io/v1beta1\"]"
	
	
	==> kube-proxy [b6f2f167bd56af9c24ebb913bc00789d71ac73ac920515deb77d7f2d1800d479] <==
	E0918 17:48:34.334941       1 run.go:72] "command failed" err="failed complete: too many open files"
	
	
	==> kube-scheduler [fb4df4429ab22ae76d58fc66db255e7b170cfda10f5b9590e86b28d4c64bb7ba] <==
	I0918 17:48:14.346047       1 serving.go:386] Generated self-signed cert in-memory
	I0918 17:48:15.405239       1 server.go:175] "Starting Kubernetes Scheduler" version="v1.34.0"
	I0918 17:48:15.405281       1 server.go:177] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0918 17:48:15.412673       1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
	I0918 17:48:15.412720       1 shared_informer.go:349] "Waiting for caches to sync" controller="RequestHeaderAuthRequestController"
	I0918 17:48:15.412775       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0918 17:48:15.412792       1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0918 17:48:15.412800       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
	I0918 17:48:15.412823       1 shared_informer.go:349] "Waiting for caches to sync" controller="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
	I0918 17:48:15.414385       1 secure_serving.go:211] Serving securely on 127.0.0.1:10259
	I0918 17:48:15.414472       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
	I0918 17:48:15.513164       1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
	I0918 17:48:15.513204       1 shared_informer.go:356] "Caches are synced" controller="RequestHeaderAuthRequestController"
	I0918 17:48:15.516839       1 shared_informer.go:356] "Caches are synced" controller="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
	
	
	==> kubelet <==
	Sep 18 17:48:50 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:50.943183    2781 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/cb802f2136fab5dc0a1abed4bdbe09fa-etc-ca-certificates\") pod \"kube-apiserver-default-k8s-diff-port-804544\" (UID: \"cb802f2136fab5dc0a1abed4bdbe09fa\") " pod="kube-system/kube-apiserver-default-k8s-diff-port-804544"
	Sep 18 17:48:50 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:50.943217    2781 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/cb802f2136fab5dc0a1abed4bdbe09fa-usr-local-share-ca-certificates\") pod \"kube-apiserver-default-k8s-diff-port-804544\" (UID: \"cb802f2136fab5dc0a1abed4bdbe09fa\") " pod="kube-system/kube-apiserver-default-k8s-diff-port-804544"
	Sep 18 17:48:50 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:50.943245    2781 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/cb802f2136fab5dc0a1abed4bdbe09fa-usr-share-ca-certificates\") pod \"kube-apiserver-default-k8s-diff-port-804544\" (UID: \"cb802f2136fab5dc0a1abed4bdbe09fa\") " pod="kube-system/kube-apiserver-default-k8s-diff-port-804544"
	Sep 18 17:48:50 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:50.943268    2781 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/2ad366f377326da39a8454b27551214b-k8s-certs\") pod \"kube-controller-manager-default-k8s-diff-port-804544\" (UID: \"2ad366f377326da39a8454b27551214b\") " pod="kube-system/kube-controller-manager-default-k8s-diff-port-804544"
	Sep 18 17:48:51 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:51.724470    2781 apiserver.go:52] "Watching apiserver"
	Sep 18 17:48:51 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:51.738766    2781 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
	Sep 18 17:48:51 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:51.749387    2781 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7db34416-66b2-4425-96f1-3f31b0e3e26a-lib-modules\") pod \"kube-proxy-9k22b\" (UID: \"7db34416-66b2-4425-96f1-3f31b0e3e26a\") " pod="kube-system/kube-proxy-9k22b"
	Sep 18 17:48:51 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:51.749572    2781 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/991ae076-d3da-46c4-b2c5-95048010b581-xtables-lock\") pod \"kindnet-prnkj\" (UID: \"991ae076-d3da-46c4-b2c5-95048010b581\") " pod="kube-system/kindnet-prnkj"
	Sep 18 17:48:51 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:51.749611    2781 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/991ae076-d3da-46c4-b2c5-95048010b581-lib-modules\") pod \"kindnet-prnkj\" (UID: \"991ae076-d3da-46c4-b2c5-95048010b581\") " pod="kube-system/kindnet-prnkj"
	Sep 18 17:48:51 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:51.749633    2781 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/7db34416-66b2-4425-96f1-3f31b0e3e26a-xtables-lock\") pod \"kube-proxy-9k22b\" (UID: \"7db34416-66b2-4425-96f1-3f31b0e3e26a\") " pod="kube-system/kube-proxy-9k22b"
	Sep 18 17:48:51 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:51.750165    2781 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-cfg\" (UniqueName: \"kubernetes.io/host-path/991ae076-d3da-46c4-b2c5-95048010b581-cni-cfg\") pod \"kindnet-prnkj\" (UID: \"991ae076-d3da-46c4-b2c5-95048010b581\") " pod="kube-system/kindnet-prnkj"
	Sep 18 17:48:51 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:51.750321    2781 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/a3395f9b-051b-40ac-aa5b-b067b9ac0f43-tmp\") pod \"storage-provisioner\" (UID: \"a3395f9b-051b-40ac-aa5b-b067b9ac0f43\") " pod="kube-system/storage-provisioner"
	Sep 18 17:48:51 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:51.794659    2781 kubelet.go:3219] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-default-k8s-diff-port-804544"
	Sep 18 17:48:51 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:51.795216    2781 kubelet.go:3219] "Creating a mirror pod for static pod" pod="kube-system/kube-scheduler-default-k8s-diff-port-804544"
	Sep 18 17:48:51 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:51.795274    2781 kubelet.go:3219] "Creating a mirror pod for static pod" pod="kube-system/etcd-default-k8s-diff-port-804544"
	Sep 18 17:48:51 default-k8s-diff-port-804544 kubelet[2781]: E0918 17:48:51.806554    2781 kubelet.go:3221] "Failed creating a mirror pod" err="pods \"kube-apiserver-default-k8s-diff-port-804544\" already exists" pod="kube-system/kube-apiserver-default-k8s-diff-port-804544"
	Sep 18 17:48:51 default-k8s-diff-port-804544 kubelet[2781]: E0918 17:48:51.809672    2781 kubelet.go:3221] "Failed creating a mirror pod" err="pods \"kube-scheduler-default-k8s-diff-port-804544\" already exists" pod="kube-system/kube-scheduler-default-k8s-diff-port-804544"
	Sep 18 17:48:51 default-k8s-diff-port-804544 kubelet[2781]: E0918 17:48:51.809855    2781 kubelet.go:3221] "Failed creating a mirror pod" err="pods \"etcd-default-k8s-diff-port-804544\" already exists" pod="kube-system/etcd-default-k8s-diff-port-804544"
	Sep 18 17:48:52 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:52.028919    2781 scope.go:117] "RemoveContainer" containerID="b6f2f167bd56af9c24ebb913bc00789d71ac73ac920515deb77d7f2d1800d479"
	Sep 18 17:48:52 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:52.029393    2781 scope.go:117] "RemoveContainer" containerID="e99e7002a8a797335f7b3236b606823af97173355233c4e25946e11640c87d0e"
	Sep 18 17:48:52 default-k8s-diff-port-804544 kubelet[2781]: I0918 17:48:52.030199    2781 scope.go:117] "RemoveContainer" containerID="c56b06de40b74a5884bca2cabb84e963b595ce8b89cc2fdbd8895e63aad1e1c9"
	Sep 18 17:48:52 default-k8s-diff-port-804544 kubelet[2781]: E0918 17:48:52.204102    2781 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host" image="fake.domain/registry.k8s.io/echoserver:1.4"
	Sep 18 17:48:52 default-k8s-diff-port-804544 kubelet[2781]: E0918 17:48:52.204183    2781 kuberuntime_image.go:43] "Failed to pull image" err="pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host" image="fake.domain/registry.k8s.io/echoserver:1.4"
	Sep 18 17:48:52 default-k8s-diff-port-804544 kubelet[2781]: E0918 17:48:52.204295    2781 kuberuntime_manager.go:1449] "Unhandled Error" err="container metrics-server start failed in pod metrics-server-746fcd58dc-dhzlj_kube-system(ae0876dd-f568-4e2d-a39a-4502588d52ce): ErrImagePull: pinging container registry fake.domain: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain: no such host" logger="UnhandledError"
	Sep 18 17:48:52 default-k8s-diff-port-804544 kubelet[2781]: E0918 17:48:52.205784    2781 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with ErrImagePull: \"pinging container registry fake.domain: Get \\\"https://fake.domain/v2/\\\": dial tcp: lookup fake.domain: no such host\"" pod="kube-system/metrics-server-746fcd58dc-dhzlj" podUID="ae0876dd-f568-4e2d-a39a-4502588d52ce"
	
	
	==> kubernetes-dashboard [045779b5e2ef0e177a700830e1ab49bf7050686bbb68ca072c0ba212a791b99b] <==
	2025/09/18 17:48:28 Using namespace: kubernetes-dashboard
	2025/09/18 17:48:28 Using in-cluster config to connect to apiserver
	2025/09/18 17:48:28 Using secret token for csrf signing
	2025/09/18 17:48:28 Initializing csrf token from kubernetes-dashboard-csrf secret
	2025/09/18 17:48:28 Starting overwatch
	
	
	==> storage-provisioner [e99e7002a8a797335f7b3236b606823af97173355233c4e25946e11640c87d0e] <==
	I0918 17:48:17.784866       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	F0918 17:48:47.789416       1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: i/o timeout
	

                                                
                                                
-- /stdout --
helpers_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-804544 -n default-k8s-diff-port-804544
helpers_test.go:269: (dbg) Run:  kubectl --context default-k8s-diff-port-804544 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:280: non-running pods: metrics-server-746fcd58dc-dhzlj
helpers_test.go:282: ======> post-mortem[TestStartStop/group/default-k8s-diff-port/serial/Pause]: describe non-running pods <======
helpers_test.go:285: (dbg) Run:  kubectl --context default-k8s-diff-port-804544 describe pod metrics-server-746fcd58dc-dhzlj
helpers_test.go:285: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-804544 describe pod metrics-server-746fcd58dc-dhzlj: exit status 1 (68.840568ms)

                                                
                                                
** stderr ** 
	Error from server (NotFound): pods "metrics-server-746fcd58dc-dhzlj" not found

                                                
                                                
** /stderr **
helpers_test.go:287: kubectl --context default-k8s-diff-port-804544 describe pod metrics-server-746fcd58dc-dhzlj: exit status 1
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/Pause (7.64s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (29.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p flannel-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=crio
net_test.go:112: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p flannel-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=crio: exit status 80 (29.119220032s)

                                                
                                                
-- stdout --
	* [flannel-749287] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=20370
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on user configuration
	* Using Docker driver with root privileges
	* Starting "flannel-749287" primary control-plane node in "flannel-749287" cluster
	* Pulling base image v0.0.48 ...
	* Stopping node "flannel-749287"  ...
	* Powering off "flannel-749287" via SSH ...
	* Deleting "flannel-749287" in docker ...
	* If you are still interested to make docker driver work. The following suggestions might help you get passed this issue:
	
		* - Prune unused docker images, volumes, networks and abandoned containers.
	
					docker system prune --volumes
	
		* - Restart your docker service
	
		* - Delete and recreate minikube cluster
			minikube delete
			minikube start --driver=docker
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:49:49.272274  334273 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:49:49.272545  334273 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:49:49.272554  334273 out.go:374] Setting ErrFile to fd 2...
	I0918 17:49:49.272558  334273 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:49:49.272760  334273 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:49:49.273308  334273 out.go:368] Setting JSON to false
	I0918 17:49:49.274637  334273 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":5540,"bootTime":1758212249,"procs":323,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 17:49:49.274721  334273 start.go:140] virtualization: kvm guest
	I0918 17:49:49.277274  334273 out.go:179] * [flannel-749287] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 17:49:49.278762  334273 notify.go:220] Checking for updates...
	I0918 17:49:49.278863  334273 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 17:49:49.280228  334273 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 17:49:49.281701  334273 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:49:49.283040  334273 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 17:49:49.284522  334273 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 17:49:49.285989  334273 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 17:49:49.287929  334273 config.go:182] Loaded profile config "calico-749287": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:49:49.288092  334273 config.go:182] Loaded profile config "custom-flannel-749287": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:49:49.288212  334273 config.go:182] Loaded profile config "enable-default-cni-749287": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:49:49.288333  334273 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 17:49:49.312658  334273 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 17:49:49.312775  334273 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:49:49.372955  334273 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:65 OomKillDisable:false NGoroutines:76 SystemTime:2025-09-18 17:49:49.360884104 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:49:49.373107  334273 docker.go:318] overlay module found
	I0918 17:49:49.375265  334273 out.go:179] * Using the docker driver based on user configuration
	I0918 17:49:49.376453  334273 start.go:304] selected driver: docker
	I0918 17:49:49.376477  334273 start.go:924] validating driver "docker" against <nil>
	I0918 17:49:49.376493  334273 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 17:49:49.377107  334273 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:49:49.439590  334273 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:64 OomKillDisable:false NGoroutines:76 SystemTime:2025-09-18 17:49:49.428522368 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:49:49.439760  334273 start_flags.go:327] no existing cluster config was found, will generate one from the flags 
	I0918 17:49:49.439969  334273 start_flags.go:992] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0918 17:49:49.441651  334273 out.go:179] * Using Docker driver with root privileges
	I0918 17:49:49.442911  334273 cni.go:84] Creating CNI manager for "flannel"
	I0918 17:49:49.442934  334273 start_flags.go:336] Found "Flannel" CNI - setting NetworkPlugin=cni
	I0918 17:49:49.443016  334273 start.go:348] cluster config:
	{Name:flannel-749287 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:flannel-749287 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: Netwo
rkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInte
rval:1m0s}
	I0918 17:49:49.444417  334273 out.go:179] * Starting "flannel-749287" primary control-plane node in "flannel-749287" cluster
	I0918 17:49:49.445646  334273 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 17:49:49.446916  334273 out.go:179] * Pulling base image v0.0.48 ...
	I0918 17:49:49.448062  334273 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:49:49.448110  334273 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
	I0918 17:49:49.448124  334273 cache.go:58] Caching tarball of preloaded images
	I0918 17:49:49.448220  334273 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 17:49:49.448241  334273 preload.go:172] Found /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0918 17:49:49.448253  334273 cache.go:61] Finished verifying existence of preloaded tar for v1.34.0 on crio
	I0918 17:49:49.448381  334273 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/flannel-749287/config.json ...
	I0918 17:49:49.448407  334273 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/flannel-749287/config.json: {Name:mk3b291fe812404aac4cb9ad241c02cc02bebb07 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 17:49:49.471197  334273 image.go:100] Found gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon, skipping pull
	I0918 17:49:49.471218  334273 cache.go:147] gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 exists in daemon, skipping load
	I0918 17:49:49.471235  334273 cache.go:232] Successfully downloaded all kic artifacts
	I0918 17:49:49.471258  334273 start.go:360] acquireMachinesLock for flannel-749287: {Name:mkfc8a4c00520e5762a1a453b7c30cf9c87d245c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:49:49.471362  334273 start.go:364] duration metric: took 79.83µs to acquireMachinesLock for "flannel-749287"
	I0918 17:49:49.471386  334273 start.go:93] Provisioning new machine with config: &{Name:flannel-749287 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:flannel-749287 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetCli
entPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:49:49.471446  334273 start.go:125] createHost starting for "" (driver="docker")
	I0918 17:49:49.473614  334273 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
	I0918 17:49:49.473826  334273 start.go:159] libmachine.API.Create for "flannel-749287" (driver="docker")
	I0918 17:49:49.473854  334273 client.go:168] LocalClient.Create starting
	I0918 17:49:49.473913  334273 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 17:49:49.473942  334273 main.go:141] libmachine: Decoding PEM data...
	I0918 17:49:49.473955  334273 main.go:141] libmachine: Parsing certificate...
	I0918 17:49:49.474017  334273 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 17:49:49.474042  334273 main.go:141] libmachine: Decoding PEM data...
	I0918 17:49:49.474053  334273 main.go:141] libmachine: Parsing certificate...
	I0918 17:49:49.474431  334273 cli_runner.go:164] Run: docker network inspect flannel-749287 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0918 17:49:49.494082  334273 cli_runner.go:211] docker network inspect flannel-749287 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0918 17:49:49.494161  334273 network_create.go:284] running [docker network inspect flannel-749287] to gather additional debugging logs...
	I0918 17:49:49.494183  334273 cli_runner.go:164] Run: docker network inspect flannel-749287
	W0918 17:49:49.512659  334273 cli_runner.go:211] docker network inspect flannel-749287 returned with exit code 1
	I0918 17:49:49.512690  334273 network_create.go:287] error running [docker network inspect flannel-749287]: docker network inspect flannel-749287: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network flannel-749287 not found
	I0918 17:49:49.512704  334273 network_create.go:289] output of [docker network inspect flannel-749287]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network flannel-749287 not found
	
	** /stderr **
	I0918 17:49:49.512803  334273 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:49:49.532771  334273 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-0aa191750de6 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:ba:9f:21:35:1a:93} reservation:<nil>}
	I0918 17:49:49.533488  334273 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-77e59dcbf5ad IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:ce:09:2e:38:93:7e} reservation:<nil>}
	I0918 17:49:49.534263  334273 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-0dae0480fa97 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:0e:53:b6:97:ee:5e} reservation:<nil>}
	I0918 17:49:49.534912  334273 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-f1115b16b8d2 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:92:53:a9:38:d4:75} reservation:<nil>}
	I0918 17:49:49.535393  334273 network.go:211] skipping subnet 192.168.85.0/24 that is taken: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName:br-e00e9986df5a IfaceIPv4:192.168.85.1 IfaceMTU:1500 IfaceMAC:5a:ed:b2:7f:58:b8} reservation:<nil>}
	I0918 17:49:49.536255  334273 network.go:206] using free private subnet 192.168.94.0/24: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001d8e6d0}
	I0918 17:49:49.536275  334273 network_create.go:124] attempt to create docker network flannel-749287 192.168.94.0/24 with gateway 192.168.94.1 and MTU of 1500 ...
	I0918 17:49:49.536325  334273 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.94.0/24 --gateway=192.168.94.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=flannel-749287 flannel-749287
	I0918 17:49:49.602765  334273 network_create.go:108] docker network flannel-749287 192.168.94.0/24 created
	I0918 17:49:49.602797  334273 kic.go:121] calculated static IP "192.168.94.2" for the "flannel-749287" container
	I0918 17:49:49.602867  334273 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 17:49:49.623560  334273 cli_runner.go:164] Run: docker volume create flannel-749287 --label name.minikube.sigs.k8s.io=flannel-749287 --label created_by.minikube.sigs.k8s.io=true
	I0918 17:49:49.644775  334273 oci.go:103] Successfully created a docker volume flannel-749287
	I0918 17:49:49.644860  334273 cli_runner.go:164] Run: docker run --rm --name flannel-749287-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=flannel-749287 --entrypoint /usr/bin/test -v flannel-749287:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 17:49:50.050310  334273 oci.go:107] Successfully prepared a docker volume flannel-749287
	I0918 17:49:50.050361  334273 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:49:50.050384  334273 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 17:49:50.050459  334273 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v flannel-749287:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 17:49:54.570418  334273 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v flannel-749287:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.519900965s)
	I0918 17:49:54.570467  334273 kic.go:203] duration metric: took 4.520078943s to extract preloaded images to volume ...
	W0918 17:49:54.570601  334273 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 17:49:54.570651  334273 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 17:49:54.570702  334273 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 17:49:54.659011  334273 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname flannel-749287 --name flannel-749287 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=flannel-749287 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=flannel-749287 --network flannel-749287 --ip 192.168.94.2 --volume flannel-749287:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 17:49:55.142004  334273 cli_runner.go:164] Run: docker container inspect flannel-749287 --format={{.State.Running}}
	I0918 17:49:55.167963  334273 cli_runner.go:164] Run: docker container inspect flannel-749287 --format={{.State.Status}}
	I0918 17:49:55.194290  334273 cli_runner.go:164] Run: docker exec flannel-749287 stat /var/lib/dpkg/alternatives/iptables
	I0918 17:49:55.260401  334273 oci.go:144] the created container "flannel-749287" has a running status.
	I0918 17:49:55.260445  334273 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/flannel-749287/id_rsa...
	I0918 17:49:55.424792  334273 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/flannel-749287/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 17:49:55.460723  334273 cli_runner.go:164] Run: docker container inspect flannel-749287 --format={{.State.Status}}
	I0918 17:49:55.490715  334273 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0918 17:49:55.490794  334273 kic_runner.go:114] Args: [docker exec --privileged flannel-749287 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0918 17:49:55.585930  334273 cli_runner.go:164] Run: docker container inspect flannel-749287 --format={{.State.Status}}
	I0918 17:49:55.605378  334273 machine.go:93] provisionDockerMachine start ...
	I0918 17:49:55.605597  334273 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287
	I0918 17:49:55.625865  334273 main.go:141] libmachine: Using SSH client type: native
	I0918 17:49:55.626201  334273 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33130 <nil> <nil>}
	I0918 17:49:55.626225  334273 main.go:141] libmachine: About to run SSH command:
	hostname
	I0918 17:49:55.783248  334273 main.go:141] libmachine: SSH cmd err, output: <nil>: flannel-749287
	
	I0918 17:49:55.783281  334273 ubuntu.go:182] provisioning hostname "flannel-749287"
	I0918 17:49:55.783347  334273 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287
	I0918 17:49:55.806825  334273 main.go:141] libmachine: Using SSH client type: native
	I0918 17:49:55.807138  334273 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33130 <nil> <nil>}
	I0918 17:49:55.807160  334273 main.go:141] libmachine: About to run SSH command:
	sudo hostname flannel-749287 && echo "flannel-749287" | sudo tee /etc/hostname
	I0918 17:49:55.972702  334273 main.go:141] libmachine: SSH cmd err, output: <nil>: flannel-749287
	
	I0918 17:49:55.972809  334273 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287
	I0918 17:49:55.994834  334273 main.go:141] libmachine: Using SSH client type: native
	I0918 17:49:55.995158  334273 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33130 <nil> <nil>}
	I0918 17:49:55.995188  334273 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\sflannel-749287' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 flannel-749287/g' /etc/hosts;
				else 
					echo '127.0.1.1 flannel-749287' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0918 17:49:56.138380  334273 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0918 17:49:56.138411  334273 ubuntu.go:188] set auth options {CertDir:/home/jenkins/minikube-integration/20370-7845/.minikube CaCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/20370-7845/.minikube}
	I0918 17:49:56.138460  334273 ubuntu.go:190] setting up certificates
	I0918 17:49:56.138471  334273 provision.go:84] configureAuth start
	I0918 17:49:56.138555  334273 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" flannel-749287
	I0918 17:49:56.158196  334273 provision.go:143] copyHostCerts
	I0918 17:49:56.158270  334273 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem, removing ...
	I0918 17:49:56.158284  334273 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem
	I0918 17:49:56.158347  334273 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/key.pem (1679 bytes)
	I0918 17:49:56.158430  334273 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem, removing ...
	I0918 17:49:56.158439  334273 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem
	I0918 17:49:56.158465  334273 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/ca.pem (1078 bytes)
	I0918 17:49:56.158687  334273 exec_runner.go:144] found /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem, removing ...
	I0918 17:49:56.158699  334273 exec_runner.go:203] rm: /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem
	I0918 17:49:56.158727  334273 exec_runner.go:151] cp: /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/20370-7845/.minikube/cert.pem (1123 bytes)
	I0918 17:49:56.158788  334273 provision.go:117] generating server cert: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca-key.pem org=jenkins.flannel-749287 san=[127.0.0.1 192.168.94.2 flannel-749287 localhost minikube]
	I0918 17:49:56.538280  334273 provision.go:177] copyRemoteCerts
	I0918 17:49:56.538346  334273 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0918 17:49:56.538401  334273 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287
	I0918 17:49:56.557973  334273 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33130 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/flannel-749287/id_rsa Username:docker}
	I0918 17:49:56.657453  334273 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
	I0918 17:49:56.688172  334273 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server.pem --> /etc/docker/server.pem (1212 bytes)
	I0918 17:49:56.717610  334273 ssh_runner.go:362] scp /home/jenkins/minikube-integration/20370-7845/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0918 17:49:56.744720  334273 provision.go:87] duration metric: took 606.233133ms to configureAuth
	I0918 17:49:56.744747  334273 ubuntu.go:206] setting minikube options for container-runtime
	I0918 17:49:56.744954  334273 config.go:182] Loaded profile config "flannel-749287": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:49:56.745085  334273 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287
	I0918 17:49:56.765539  334273 main.go:141] libmachine: Using SSH client type: native
	I0918 17:49:56.765823  334273 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x840140] 0x842e40 <nil>  [] 0s} 127.0.0.1 33130 <nil> <nil>}
	I0918 17:49:56.765849  334273 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0918 17:49:57.006233  334273 main.go:141] libmachine: SSH cmd err, output: Process exited with status 1: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	Job for crio.service failed because the control process exited with error code.
	See "systemctl status crio.service" and "journalctl -xeu crio.service" for details.
	
	I0918 17:49:57.006266  334273 ubuntu.go:208] Error setting container-runtime options during provisioning ssh command error:
	command : sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	err     : Process exited with status 1
	output  : 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	Job for crio.service failed because the control process exited with error code.
	See "systemctl status crio.service" and "journalctl -xeu crio.service" for details.
	I0918 17:49:57.006278  334273 machine.go:96] duration metric: took 1.400794841s to provisionDockerMachine
	I0918 17:49:57.006296  334273 client.go:171] duration metric: took 7.532433739s to LocalClient.Create
	I0918 17:49:59.007493  334273 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:49:59.007583  334273 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287
	I0918 17:49:59.025277  334273 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33130 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/flannel-749287/id_rsa Username:docker}
	I0918 17:49:59.118845  334273 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:49:59.123770  334273 start.go:128] duration metric: took 9.652310898s to createHost
	I0918 17:49:59.123793  334273 start.go:83] releasing machines lock for "flannel-749287", held for 9.652419671s
	W0918 17:49:59.123812  334273 start.go:714] error starting host: creating host: create: provisioning: ssh command error:
	command : sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	err     : Process exited with status 1
	output  : 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	Job for crio.service failed because the control process exited with error code.
	See "systemctl status crio.service" and "journalctl -xeu crio.service" for details.
	I0918 17:49:59.124194  334273 cli_runner.go:164] Run: docker container inspect flannel-749287 --format={{.State.Status}}
	I0918 17:49:59.144374  334273 stop.go:39] StopHost: flannel-749287
	W0918 17:49:59.144635  334273 register.go:133] "Stopping" was not found within the registered steps for "Initial Minikube Setup": [Initial Minikube Setup Selecting Driver Downloading Artifacts Starting Node Updating Driver Pulling Base Image Running on Localhost Local OS Release Creating Container Creating VM Running Remotely Preparing Kubernetes Generating certificates Booting control plane Configuring RBAC rules Configuring CNI Configuring Localhost Environment Verifying Kubernetes Enabling Addons Done]
	I0918 17:49:59.147159  334273 out.go:179] * Stopping node "flannel-749287"  ...
	I0918 17:49:59.148663  334273 cli_runner.go:164] Run: docker container inspect flannel-749287 --format={{.State.Status}}
	W0918 17:49:59.167494  334273 register.go:133] "PowerOff" was not found within the registered steps for "Initial Minikube Setup": [Initial Minikube Setup Selecting Driver Downloading Artifacts Starting Node Updating Driver Pulling Base Image Running on Localhost Local OS Release Creating Container Creating VM Running Remotely Preparing Kubernetes Generating certificates Booting control plane Configuring RBAC rules Configuring CNI Configuring Localhost Environment Verifying Kubernetes Enabling Addons Done]
	I0918 17:49:59.169461  334273 out.go:179] * Powering off "flannel-749287" via SSH ...
	I0918 17:49:59.170992  334273 cli_runner.go:164] Run: docker exec --privileged -t flannel-749287 /bin/bash -c "sudo init 0"
	I0918 17:50:00.244341  334273 cli_runner.go:164] Run: docker container inspect flannel-749287 --format={{.State.Status}}
	I0918 17:50:00.265095  334273 oci.go:667] container flannel-749287 status is Stopped
	I0918 17:50:00.265156  334273 oci.go:679] Successfully shutdown container flannel-749287
	I0918 17:50:00.265164  334273 stop.go:96] shutdown container: err=<nil>
	I0918 17:50:00.265201  334273 main.go:141] libmachine: Stopping "flannel-749287"...
	I0918 17:50:00.265291  334273 cli_runner.go:164] Run: docker container inspect flannel-749287 --format={{.State.Status}}
	I0918 17:50:00.286677  334273 stop.go:66] stop err: Machine "flannel-749287" is already stopped.
	I0918 17:50:00.286712  334273 stop.go:69] host is already stopped
	W0918 17:50:01.287746  334273 register.go:133] "PowerOff" was not found within the registered steps for "Initial Minikube Setup": [Initial Minikube Setup Selecting Driver Downloading Artifacts Starting Node Updating Driver Pulling Base Image Running on Localhost Local OS Release Creating Container Creating VM Running Remotely Preparing Kubernetes Generating certificates Booting control plane Configuring RBAC rules Configuring CNI Configuring Localhost Environment Verifying Kubernetes Enabling Addons Done]
	I0918 17:50:01.289853  334273 out.go:179] * Deleting "flannel-749287" in docker ...
	I0918 17:50:01.291358  334273 cli_runner.go:164] Run: docker container inspect -f {{.Id}} flannel-749287
	I0918 17:50:01.317546  334273 cli_runner.go:164] Run: docker container inspect flannel-749287 --format={{.State.Status}}
	I0918 17:50:01.340532  334273 cli_runner.go:164] Run: docker exec --privileged -t flannel-749287 /bin/bash -c "sudo init 0"
	W0918 17:50:01.360555  334273 cli_runner.go:211] docker exec --privileged -t flannel-749287 /bin/bash -c "sudo init 0" returned with exit code 1
	I0918 17:50:01.360585  334273 oci.go:659] error shutdown flannel-749287: docker exec --privileged -t flannel-749287 /bin/bash -c "sudo init 0": exit status 1
	stdout:
	
	stderr:
	Error response from daemon: container 662c79cce8f16dca7cf52fd51a39f16cac236780378301897940dd506471af46 is not running
	I0918 17:50:02.361730  334273 cli_runner.go:164] Run: docker container inspect flannel-749287 --format={{.State.Status}}
	I0918 17:50:02.382377  334273 oci.go:667] container flannel-749287 status is Stopped
	I0918 17:50:02.382404  334273 oci.go:679] Successfully shutdown container flannel-749287
	I0918 17:50:02.382448  334273 cli_runner.go:164] Run: docker rm -f -v flannel-749287
	I0918 17:50:02.412802  334273 cli_runner.go:164] Run: docker container inspect -f {{.Id}} flannel-749287
	W0918 17:50:02.432888  334273 cli_runner.go:211] docker container inspect -f {{.Id}} flannel-749287 returned with exit code 1
	I0918 17:50:02.432981  334273 cli_runner.go:164] Run: docker network inspect flannel-749287 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:50:02.455298  334273 cli_runner.go:164] Run: docker network rm flannel-749287
	W0918 17:50:02.617116  334273 out.go:285] ! StartHost failed, but will try again: creating host: create: provisioning: ssh command error:
	command : sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	err     : Process exited with status 1
	output  : 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	Job for crio.service failed because the control process exited with error code.
	See "systemctl status crio.service" and "journalctl -xeu crio.service" for details.
	
	! StartHost failed, but will try again: creating host: create: provisioning: ssh command error:
	command : sudo mkdir -p /etc/sysconfig && printf %s "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	err     : Process exited with status 1
	output  : 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	Job for crio.service failed because the control process exited with error code.
	See "systemctl status crio.service" and "journalctl -xeu crio.service" for details.
	
	I0918 17:50:02.617147  334273 start.go:729] Will try again in 5 seconds ...
	I0918 17:50:07.619614  334273 start.go:360] acquireMachinesLock for flannel-749287: {Name:mkfc8a4c00520e5762a1a453b7c30cf9c87d245c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0918 17:50:07.619730  334273 start.go:364] duration metric: took 71.211µs to acquireMachinesLock for "flannel-749287"
	I0918 17:50:07.619773  334273 start.go:93] Provisioning new machine with config: &{Name:flannel-749287 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:3072 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:flannel-749287 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetCli
entPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0918 17:50:07.619883  334273 start.go:125] createHost starting for "" (driver="docker")
	I0918 17:50:07.621930  334273 out.go:252] * Creating docker container (CPUs=2, Memory=3072MB) ...
	I0918 17:50:07.622065  334273 start.go:159] libmachine.API.Create for "flannel-749287" (driver="docker")
	I0918 17:50:07.622086  334273 client.go:168] LocalClient.Create starting
	I0918 17:50:07.622184  334273 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/ca.pem
	I0918 17:50:07.622224  334273 main.go:141] libmachine: Decoding PEM data...
	I0918 17:50:07.622238  334273 main.go:141] libmachine: Parsing certificate...
	I0918 17:50:07.622294  334273 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/20370-7845/.minikube/certs/cert.pem
	I0918 17:50:07.622313  334273 main.go:141] libmachine: Decoding PEM data...
	I0918 17:50:07.622325  334273 main.go:141] libmachine: Parsing certificate...
	I0918 17:50:07.622615  334273 cli_runner.go:164] Run: docker network inspect flannel-749287 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0918 17:50:07.641125  334273 cli_runner.go:211] docker network inspect flannel-749287 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0918 17:50:07.641188  334273 network_create.go:284] running [docker network inspect flannel-749287] to gather additional debugging logs...
	I0918 17:50:07.641206  334273 cli_runner.go:164] Run: docker network inspect flannel-749287
	W0918 17:50:07.659003  334273 cli_runner.go:211] docker network inspect flannel-749287 returned with exit code 1
	I0918 17:50:07.659034  334273 network_create.go:287] error running [docker network inspect flannel-749287]: docker network inspect flannel-749287: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network flannel-749287 not found
	I0918 17:50:07.659048  334273 network_create.go:289] output of [docker network inspect flannel-749287]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network flannel-749287 not found
	
	** /stderr **
	I0918 17:50:07.659148  334273 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0918 17:50:07.677948  334273 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-0aa191750de6 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:ba:9f:21:35:1a:93} reservation:<nil>}
	I0918 17:50:07.678429  334273 network.go:211] skipping subnet 192.168.58.0/24 that is taken: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName:br-77e59dcbf5ad IfaceIPv4:192.168.58.1 IfaceMTU:1500 IfaceMAC:ce:09:2e:38:93:7e} reservation:<nil>}
	I0918 17:50:07.679054  334273 network.go:211] skipping subnet 192.168.67.0/24 that is taken: &{IP:192.168.67.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.67.0/24 Gateway:192.168.67.1 ClientMin:192.168.67.2 ClientMax:192.168.67.254 Broadcast:192.168.67.255 IsPrivate:true Interface:{IfaceName:br-0dae0480fa97 IfaceIPv4:192.168.67.1 IfaceMTU:1500 IfaceMAC:0e:53:b6:97:ee:5e} reservation:<nil>}
	I0918 17:50:07.679542  334273 network.go:211] skipping subnet 192.168.76.0/24 that is taken: &{IP:192.168.76.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.76.0/24 Gateway:192.168.76.1 ClientMin:192.168.76.2 ClientMax:192.168.76.254 Broadcast:192.168.76.255 IsPrivate:true Interface:{IfaceName:br-f1115b16b8d2 IfaceIPv4:192.168.76.1 IfaceMTU:1500 IfaceMAC:92:53:a9:38:d4:75} reservation:<nil>}
	I0918 17:50:07.679962  334273 network.go:211] skipping subnet 192.168.85.0/24 that is taken: &{IP:192.168.85.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.85.0/24 Gateway:192.168.85.1 ClientMin:192.168.85.2 ClientMax:192.168.85.254 Broadcast:192.168.85.255 IsPrivate:true Interface:{IfaceName:br-e00e9986df5a IfaceIPv4:192.168.85.1 IfaceMTU:1500 IfaceMAC:5a:ed:b2:7f:58:b8} reservation:<nil>}
	I0918 17:50:07.681650  334273 network.go:209] skipping subnet 192.168.94.0/24 that is reserved: &{IP:192.168.94.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.94.0/24 Gateway:192.168.94.1 ClientMin:192.168.94.2 ClientMax:192.168.94.254 Broadcast:192.168.94.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:<nil>}
	I0918 17:50:07.682163  334273 network.go:211] skipping subnet 192.168.103.0/24 that is taken: &{IP:192.168.103.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.103.0/24 Gateway:192.168.103.1 ClientMin:192.168.103.2 ClientMax:192.168.103.254 Broadcast:192.168.103.255 IsPrivate:true Interface:{IfaceName:br-7066cc8889ed IfaceIPv4:192.168.103.1 IfaceMTU:1500 IfaceMAC:4a:99:2f:94:eb:ab} reservation:<nil>}
	I0918 17:50:07.682875  334273 network.go:206] using free private subnet 192.168.112.0/24: &{IP:192.168.112.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.112.0/24 Gateway:192.168.112.1 ClientMin:192.168.112.2 ClientMax:192.168.112.254 Broadcast:192.168.112.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000511450}
	I0918 17:50:07.682898  334273 network_create.go:124] attempt to create docker network flannel-749287 192.168.112.0/24 with gateway 192.168.112.1 and MTU of 1500 ...
	I0918 17:50:07.682955  334273 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.112.0/24 --gateway=192.168.112.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=flannel-749287 flannel-749287
	I0918 17:50:07.745331  334273 network_create.go:108] docker network flannel-749287 192.168.112.0/24 created
	I0918 17:50:07.745367  334273 kic.go:121] calculated static IP "192.168.112.2" for the "flannel-749287" container
	I0918 17:50:07.745440  334273 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0918 17:50:07.764544  334273 cli_runner.go:164] Run: docker volume create flannel-749287 --label name.minikube.sigs.k8s.io=flannel-749287 --label created_by.minikube.sigs.k8s.io=true
	I0918 17:50:07.782165  334273 oci.go:103] Successfully created a docker volume flannel-749287
	I0918 17:50:07.782254  334273 cli_runner.go:164] Run: docker run --rm --name flannel-749287-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=flannel-749287 --entrypoint /usr/bin/test -v flannel-749287:/var gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -d /var/lib
	I0918 17:50:08.325034  334273 oci.go:107] Successfully prepared a docker volume flannel-749287
	I0918 17:50:08.325075  334273 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
	I0918 17:50:08.325102  334273 kic.go:194] Starting extracting preloaded images to volume ...
	I0918 17:50:08.325166  334273 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v flannel-749287:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir
	I0918 17:50:13.055358  334273 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v flannel-749287:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 -I lz4 -xf /preloaded.tar -C /extractDir: (4.730138292s)
	I0918 17:50:13.055396  334273 kic.go:203] duration metric: took 4.730293283s to extract preloaded images to volume ...
	W0918 17:50:13.055489  334273 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	W0918 17:50:13.055553  334273 oci.go:252] Your kernel does not support CPU cfs period/quota or the cgroup is not mounted.
	I0918 17:50:13.055603  334273 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0918 17:50:13.125259  334273 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname flannel-749287 --name flannel-749287 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=flannel-749287 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=flannel-749287 --network flannel-749287 --ip 192.168.112.2 --volume flannel-749287:/var --security-opt apparmor=unconfined --memory=3072mb -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1
	I0918 17:50:13.427262  334273 cli_runner.go:164] Run: docker container inspect flannel-749287 --format={{.State.Running}}
	I0918 17:50:13.449838  334273 cli_runner.go:164] Run: docker container inspect flannel-749287 --format={{.State.Status}}
	I0918 17:50:13.471491  334273 cli_runner.go:164] Run: docker exec flannel-749287 stat /var/lib/dpkg/alternatives/iptables
	I0918 17:50:13.522724  334273 oci.go:144] the created container "flannel-749287" has a running status.
	I0918 17:50:13.522752  334273 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/20370-7845/.minikube/machines/flannel-749287/id_rsa...
	I0918 17:50:13.576626  334273 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/20370-7845/.minikube/machines/flannel-749287/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0918 17:50:13.897947  334273 cli_runner.go:164] Run: docker container inspect flannel-749287 --format={{.State.Status}}
	I0918 17:50:13.920209  334273 cli_runner.go:164] Run: docker inspect flannel-749287
	I0918 17:50:13.941169  334273 errors.go:84] Postmortem inspect ("docker inspect flannel-749287"): -- stdout --
	[
	    {
	        "Id": "a64ea646e18340f7ceaa7155afa42eb0b551c0b5f4f8e9e704d6d87d38efca4f",
	        "Created": "2025-09-18T17:50:13.145083983Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "exited",
	            "Running": false,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 0,
	            "ExitCode": 255,
	            "Error": "",
	            "StartedAt": "2025-09-18T17:50:13.187064868Z",
	            "FinishedAt": "2025-09-18T17:50:13.570516776Z"
	        },
	        "Image": "sha256:c6b5532e987b5b4f5fc9cb0336e378ed49c0542bad8cbfc564b71e977a6269de",
	        "ResolvConfPath": "/var/lib/docker/containers/a64ea646e18340f7ceaa7155afa42eb0b551c0b5f4f8e9e704d6d87d38efca4f/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/a64ea646e18340f7ceaa7155afa42eb0b551c0b5f4f8e9e704d6d87d38efca4f/hostname",
	        "HostsPath": "/var/lib/docker/containers/a64ea646e18340f7ceaa7155afa42eb0b551c0b5f4f8e9e704d6d87d38efca4f/hosts",
	        "LogPath": "/var/lib/docker/containers/a64ea646e18340f7ceaa7155afa42eb0b551c0b5f4f8e9e704d6d87d38efca4f/a64ea646e18340f7ceaa7155afa42eb0b551c0b5f4f8e9e704d6d87d38efca4f-json.log",
	        "Name": "/flannel-749287",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "flannel-749287:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "flannel-749287",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "private",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 3221225472,
	            "NanoCpus": 0,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 6442450944,
	            "MemorySwappiness": null,
	            "OomKillDisable": null,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "ID": "a64ea646e18340f7ceaa7155afa42eb0b551c0b5f4f8e9e704d6d87d38efca4f",
	                "LowerDir": "/var/lib/docker/overlay2/dbaec3160f3448df9db1cfe8bcecb73f91faddd42cf697267aa7be3c118fb507-init/diff:/var/lib/docker/overlay2/1fd2bbb67ab9e5bb8d4549665a1a228eadda56df39fee53908cd735ea16a4e10/diff",
	                "MergedDir": "/var/lib/docker/overlay2/dbaec3160f3448df9db1cfe8bcecb73f91faddd42cf697267aa7be3c118fb507/merged",
	                "UpperDir": "/var/lib/docker/overlay2/dbaec3160f3448df9db1cfe8bcecb73f91faddd42cf697267aa7be3c118fb507/diff",
	                "WorkDir": "/var/lib/docker/overlay2/dbaec3160f3448df9db1cfe8bcecb73f91faddd42cf697267aa7be3c118fb507/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "flannel-749287",
	                "Source": "/var/lib/docker/volumes/flannel-749287/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "flannel-749287",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "flannel-749287",
	                "name.minikube.sigs.k8s.io": "flannel-749287",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "",
	            "SandboxKey": "",
	            "Ports": {},
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "flannel-749287": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.112.2"
	                    },
	                    "Links": null,
	                    "Aliases": null,
	                    "MacAddress": "",
	                    "DriverOpts": null,
	                    "GwPriority": 0,
	                    "NetworkID": "a4f88c927cf19a470878ea41f494ec16162c714920c7d97b80d4beffb72de841",
	                    "EndpointID": "",
	                    "Gateway": "",
	                    "IPAddress": "",
	                    "IPPrefixLen": 0,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DNSNames": [
	                        "flannel-749287",
	                        "a64ea646e183"
	                    ]
	                }
	            }
	        }
	    }
	]
	
	-- /stdout --
	I0918 17:50:13.941254  334273 cli_runner.go:164] Run: docker logs --timestamps --details flannel-749287
	I0918 17:50:13.962610  334273 errors.go:91] Postmortem logs ("docker logs --timestamps --details flannel-749287"): -- stdout --
	2025-09-18T17:50:13.418622449Z  + userns=
	2025-09-18T17:50:13.418651361Z  + grep -Eqv '0[[:space:]]+0[[:space:]]+4294967295' /proc/self/uid_map
	2025-09-18T17:50:13.421238753Z  + validate_userns
	2025-09-18T17:50:13.421426134Z  + [[ -z '' ]]
	2025-09-18T17:50:13.421438071Z  + return
	2025-09-18T17:50:13.421441073Z  + configure_containerd
	2025-09-18T17:50:13.421443627Z  + local snapshotter=
	2025-09-18T17:50:13.421446244Z  + [[ -n '' ]]
	2025-09-18T17:50:13.421448654Z  + [[ -z '' ]]
	2025-09-18T17:50:13.421868494Z  ++ stat -f -c %T /kind
	2025-09-18T17:50:13.423233530Z  + container_filesystem=overlayfs
	2025-09-18T17:50:13.423248082Z  + [[ overlayfs == \z\f\s ]]
	2025-09-18T17:50:13.423251659Z  + [[ -n '' ]]
	2025-09-18T17:50:13.423254287Z  + configure_proxy
	2025-09-18T17:50:13.423256045Z  + mkdir -p /etc/systemd/system.conf.d/
	2025-09-18T17:50:13.429545252Z  + [[ ! -z '' ]]
	2025-09-18T17:50:13.429572363Z  + cat
	2025-09-18T17:50:13.431021981Z  + fix_mount
	2025-09-18T17:50:13.431043071Z  + echo 'INFO: ensuring we can execute mount/umount even with userns-remap'
	2025-09-18T17:50:13.431047063Z  INFO: ensuring we can execute mount/umount even with userns-remap
	2025-09-18T17:50:13.431552387Z  ++ which mount
	2025-09-18T17:50:13.433387106Z  ++ which umount
	2025-09-18T17:50:13.434465888Z  + chown root:root /usr/bin/mount /usr/bin/umount
	2025-09-18T17:50:13.442426934Z  ++ which mount
	2025-09-18T17:50:13.444288394Z  ++ which umount
	2025-09-18T17:50:13.446070838Z  + chmod -s /usr/bin/mount /usr/bin/umount
	2025-09-18T17:50:13.447728993Z  +++ which mount
	2025-09-18T17:50:13.448903195Z  ++ stat -f -c %T /usr/bin/mount
	2025-09-18T17:50:13.449964121Z  + [[ overlayfs == \a\u\f\s ]]
	2025-09-18T17:50:13.450005814Z  + echo 'INFO: remounting /sys read-only'
	2025-09-18T17:50:13.450029864Z  INFO: remounting /sys read-only
	2025-09-18T17:50:13.450033484Z  + mount -o remount,ro /sys
	2025-09-18T17:50:13.452432554Z  + echo 'INFO: making mounts shared'
	2025-09-18T17:50:13.452452686Z  INFO: making mounts shared
	2025-09-18T17:50:13.452456344Z  + mount --make-rshared /
	2025-09-18T17:50:13.454283530Z  + retryable_fix_cgroup
	2025-09-18T17:50:13.454703647Z  ++ seq 0 10
	2025-09-18T17:50:13.455636202Z  + for i in $(seq 0 10)
	2025-09-18T17:50:13.455651189Z  + fix_cgroup
	2025-09-18T17:50:13.456138815Z  + [[ -f /sys/fs/cgroup/cgroup.controllers ]]
	2025-09-18T17:50:13.456149881Z  + echo 'INFO: detected cgroup v2'
	2025-09-18T17:50:13.456153470Z  INFO: detected cgroup v2
	2025-09-18T17:50:13.456170540Z  + return
	2025-09-18T17:50:13.456173350Z  + return
	2025-09-18T17:50:13.456175874Z  + fix_machine_id
	2025-09-18T17:50:13.456178445Z  + echo 'INFO: clearing and regenerating /etc/machine-id'
	2025-09-18T17:50:13.456195473Z  INFO: clearing and regenerating /etc/machine-id
	2025-09-18T17:50:13.456198389Z  + rm -f /etc/machine-id
	2025-09-18T17:50:13.457129907Z  + systemd-machine-id-setup
	2025-09-18T17:50:13.460829930Z  Initializing machine ID from random generator.
	2025-09-18T17:50:13.463380338Z  + fix_product_name
	2025-09-18T17:50:13.463404045Z  + [[ -f /sys/class/dmi/id/product_name ]]
	2025-09-18T17:50:13.463407908Z  + echo 'INFO: faking /sys/class/dmi/id/product_name to be "kind"'
	2025-09-18T17:50:13.463410955Z  INFO: faking /sys/class/dmi/id/product_name to be "kind"
	2025-09-18T17:50:13.463414501Z  + echo kind
	2025-09-18T17:50:13.464713367Z  + mount -o ro,bind /kind/product_name /sys/class/dmi/id/product_name
	2025-09-18T17:50:13.466634558Z  + fix_product_uuid
	2025-09-18T17:50:13.466652974Z  + [[ ! -f /kind/product_uuid ]]
	2025-09-18T17:50:13.466656987Z  + cat /proc/sys/kernel/random/uuid
	2025-09-18T17:50:13.468393366Z  + [[ -f /sys/class/dmi/id/product_uuid ]]
	2025-09-18T17:50:13.468411446Z  + echo 'INFO: faking /sys/class/dmi/id/product_uuid to be random'
	2025-09-18T17:50:13.468414993Z  INFO: faking /sys/class/dmi/id/product_uuid to be random
	2025-09-18T17:50:13.468417651Z  + mount -o ro,bind /kind/product_uuid /sys/class/dmi/id/product_uuid
	2025-09-18T17:50:13.469905389Z  + [[ -f /sys/devices/virtual/dmi/id/product_uuid ]]
	2025-09-18T17:50:13.469922357Z  + echo 'INFO: faking /sys/devices/virtual/dmi/id/product_uuid as well'
	2025-09-18T17:50:13.469926230Z  INFO: faking /sys/devices/virtual/dmi/id/product_uuid as well
	2025-09-18T17:50:13.469929418Z  + mount -o ro,bind /kind/product_uuid /sys/devices/virtual/dmi/id/product_uuid
	2025-09-18T17:50:13.471927319Z  + select_iptables
	2025-09-18T17:50:13.471945135Z  + local mode num_legacy_lines num_nft_lines
	2025-09-18T17:50:13.473007275Z  ++ grep -c '^-'
	2025-09-18T17:50:13.476068966Z  ++ true
	2025-09-18T17:50:13.476356107Z  + num_legacy_lines=0
	2025-09-18T17:50:13.477283489Z  ++ grep -c '^-'
	2025-09-18T17:50:13.483239072Z  + num_nft_lines=6
	2025-09-18T17:50:13.483258339Z  + '[' 0 -ge 6 ']'
	2025-09-18T17:50:13.483262560Z  + mode=nft
	2025-09-18T17:50:13.483280565Z  + echo 'INFO: setting iptables to detected mode: nft'
	2025-09-18T17:50:13.483292906Z  INFO: setting iptables to detected mode: nft
	2025-09-18T17:50:13.483296288Z  + update-alternatives --set iptables /usr/sbin/iptables-nft
	2025-09-18T17:50:13.483376731Z  + echo 'retryable update-alternatives: --set iptables /usr/sbin/iptables-nft'
	2025-09-18T17:50:13.483383067Z  + local 'args=--set iptables /usr/sbin/iptables-nft'
	2025-09-18T17:50:13.483845287Z  ++ seq 0 15
	2025-09-18T17:50:13.484766526Z  + for i in $(seq 0 15)
	2025-09-18T17:50:13.484781331Z  + /usr/bin/update-alternatives --set iptables /usr/sbin/iptables-nft
	2025-09-18T17:50:13.485981146Z  + return
	2025-09-18T17:50:13.485993715Z  + update-alternatives --set ip6tables /usr/sbin/ip6tables-nft
	2025-09-18T17:50:13.486021270Z  + echo 'retryable update-alternatives: --set ip6tables /usr/sbin/ip6tables-nft'
	2025-09-18T17:50:13.486028250Z  + local 'args=--set ip6tables /usr/sbin/ip6tables-nft'
	2025-09-18T17:50:13.486477533Z  ++ seq 0 15
	2025-09-18T17:50:13.487681491Z  + for i in $(seq 0 15)
	2025-09-18T17:50:13.487697448Z  + /usr/bin/update-alternatives --set ip6tables /usr/sbin/ip6tables-nft
	2025-09-18T17:50:13.488672968Z  + return
	2025-09-18T17:50:13.488723161Z  + enable_network_magic
	2025-09-18T17:50:13.488739710Z  + local docker_embedded_dns_ip=127.0.0.11
	2025-09-18T17:50:13.488742026Z  + local docker_host_ip
	2025-09-18T17:50:13.489955689Z  ++ cut '-d ' -f1
	2025-09-18T17:50:13.490162887Z  ++ head -n1 /dev/fd/63
	2025-09-18T17:50:13.490200104Z  +++ timeout 5 getent ahostsv4 host.docker.internal
	2025-09-18T17:50:13.531023806Z  + docker_host_ip=
	2025-09-18T17:50:13.531048585Z  + [[ -z '' ]]
	2025-09-18T17:50:13.531739186Z  ++ ip -4 route show default
	2025-09-18T17:50:13.531859629Z  ++ cut '-d ' -f3
	2025-09-18T17:50:13.533977790Z  + docker_host_ip=192.168.112.1
	2025-09-18T17:50:13.534303165Z  + iptables-save
	2025-09-18T17:50:13.534713479Z  + iptables-restore
	2025-09-18T17:50:13.536979800Z  + sed -e 's/-d 127.0.0.11/-d 192.168.112.1/g' -e 's/-A OUTPUT \(.*\) -j DOCKER_OUTPUT/\0\n-A PREROUTING \1 -j DOCKER_OUTPUT/' -e 's/--to-source :53/--to-source 192.168.112.1:53/g' -e 's/p -j DNAT --to-destination 127.0.0.11/p --dport 53 -j DNAT --to-destination 127.0.0.11/g'
	2025-09-18T17:50:13.544974075Z  + cp /etc/resolv.conf /etc/resolv.conf.original
	2025-09-18T17:50:13.546891867Z  ++ sed -e s/127.0.0.11/192.168.112.1/g /etc/resolv.conf.original
	2025-09-18T17:50:13.548190298Z  + replaced='# Generated by Docker Engine.
	2025-09-18T17:50:13.548205980Z  # This file can be edited; Docker Engine will not make further changes once it
	2025-09-18T17:50:13.548209018Z  # has been modified.
	2025-09-18T17:50:13.548211055Z  
	2025-09-18T17:50:13.548212738Z  nameserver 192.168.112.1
	2025-09-18T17:50:13.548214548Z  search local us-east4-a.c.k8s-minikube.internal c.k8s-minikube.internal google.internal
	2025-09-18T17:50:13.548216425Z  options edns0 trust-ad ndots:0
	2025-09-18T17:50:13.548228223Z  
	2025-09-18T17:50:13.548229855Z  # Based on host file: '\''/etc/resolv.conf'\'' (internal resolver)
	2025-09-18T17:50:13.548231678Z  # ExtServers: [host(127.0.0.53)]
	2025-09-18T17:50:13.548233517Z  # Overrides: []
	2025-09-18T17:50:13.548235078Z  # Option ndots from: internal'
	2025-09-18T17:50:13.548236635Z  + [[ '' == '' ]]
	2025-09-18T17:50:13.548238214Z  + echo '# Generated by Docker Engine.
	2025-09-18T17:50:13.548239928Z  # This file can be edited; Docker Engine will not make further changes once it
	2025-09-18T17:50:13.548241595Z  # has been modified.
	2025-09-18T17:50:13.548243277Z  
	2025-09-18T17:50:13.548245861Z  nameserver 192.168.112.1
	2025-09-18T17:50:13.548248358Z  search local us-east4-a.c.k8s-minikube.internal c.k8s-minikube.internal google.internal
	2025-09-18T17:50:13.548250922Z  options edns0 trust-ad ndots:0
	2025-09-18T17:50:13.548253272Z  
	2025-09-18T17:50:13.548255335Z  # Based on host file: '\''/etc/resolv.conf'\'' (internal resolver)
	2025-09-18T17:50:13.548257056Z  # ExtServers: [host(127.0.0.53)]
	2025-09-18T17:50:13.548258736Z  # Overrides: []
	2025-09-18T17:50:13.548260338Z  # Option ndots from: internal'
	2025-09-18T17:50:13.548323683Z  + files_to_update=('/etc/kubernetes/manifests/etcd.yaml' '/etc/kubernetes/manifests/kube-apiserver.yaml' '/etc/kubernetes/manifests/kube-controller-manager.yaml' '/etc/kubernetes/manifests/kube-scheduler.yaml' '/etc/kubernetes/controller-manager.conf' '/etc/kubernetes/scheduler.conf' '/kind/kubeadm.conf' '/var/lib/kubelet/kubeadm-flags.env')
	2025-09-18T17:50:13.548356230Z  + local files_to_update
	2025-09-18T17:50:13.548363928Z  + local should_fix_certificate=false
	2025-09-18T17:50:13.549563412Z  ++ cut '-d ' -f1
	2025-09-18T17:50:13.549703462Z  ++ head -n1 /dev/fd/63
	2025-09-18T17:50:13.550193158Z  ++++ hostname
	2025-09-18T17:50:13.551051749Z  +++ timeout 5 getent ahostsv4 flannel-749287
	2025-09-18T17:50:13.553545681Z  + curr_ipv4=192.168.112.2
	2025-09-18T17:50:13.553560664Z  + echo 'INFO: Detected IPv4 address: 192.168.112.2'
	2025-09-18T17:50:13.553564401Z  INFO: Detected IPv4 address: 192.168.112.2
	2025-09-18T17:50:13.553567511Z  + '[' -f /kind/old-ipv4 ']'
	2025-09-18T17:50:13.553612573Z  + [[ -n 192.168.112.2 ]]
	2025-09-18T17:50:13.553623032Z  + echo -n 192.168.112.2
	2025-09-18T17:50:13.554868820Z  ++ cut '-d ' -f1
	2025-09-18T17:50:13.554928589Z  ++ head -n1 /dev/fd/63
	2025-09-18T17:50:13.555441693Z  ++++ hostname
	2025-09-18T17:50:13.556256144Z  +++ timeout 5 getent ahostsv6 flannel-749287
	2025-09-18T17:50:13.558836843Z  + curr_ipv6=
	2025-09-18T17:50:13.558849771Z  + echo 'INFO: Detected IPv6 address: '
	2025-09-18T17:50:13.558860174Z  INFO: Detected IPv6 address: 
	2025-09-18T17:50:13.558862210Z  + '[' -f /kind/old-ipv6 ']'
	2025-09-18T17:50:13.558863882Z  + [[ -n '' ]]
	2025-09-18T17:50:13.558865446Z  + false
	2025-09-18T17:50:13.559368899Z  ++ uname -a
	2025-09-18T17:50:13.560201536Z  + echo 'entrypoint completed: Linux flannel-749287 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux'
	2025-09-18T17:50:13.560210130Z  entrypoint completed: Linux flannel-749287 6.8.0-1037-gcp #39~22.04.1-Ubuntu SMP Thu Aug 21 17:29:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
	2025-09-18T17:50:13.560212267Z  + exec /sbin/init
	2025-09-18T17:50:13.567013406Z  systemd 249.11-0ubuntu3.16 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
	2025-09-18T17:50:13.567033942Z  Detected virtualization docker.
	2025-09-18T17:50:13.567037101Z  Detected architecture x86-64.
	2025-09-18T17:50:13.567108836Z  
	2025-09-18T17:50:13.567114559Z  Welcome to Ubuntu 22.04.5 LTS!
	2025-09-18T17:50:13.567118096Z  
	2025-09-18T17:50:13.567686945Z  Failed to create control group inotify object: Too many open files
	2025-09-18T17:50:13.567705013Z  Failed to allocate manager object: Too many open files
	2025-09-18T17:50:13.567709267Z  [!!!!!!] Failed to allocate manager object.
	2025-09-18T17:50:13.567712495Z  Exiting PID 1...
	
	-- /stdout --
	I0918 17:50:13.962700  334273 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:50:14.027981  334273 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:65 OomKillDisable:false NGoroutines:76 SystemTime:2025-09-18 17:50:14.017612558 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:50:14.028106  334273 errors.go:98] postmortem docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:65 OomKillDisable:false NGoroutines:76 SystemTime:2025-09-18 17:50:14.017612558 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux A
rchitecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:fals
e Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:50:14.028217  334273 network_create.go:284] running [docker network inspect flannel-749287] to gather additional debugging logs...
	I0918 17:50:14.028245  334273 cli_runner.go:164] Run: docker network inspect flannel-749287
	I0918 17:50:14.047386  334273 network_create.go:289] output of [docker network inspect flannel-749287]: -- stdout --
	[
	    {
	        "Name": "flannel-749287",
	        "Id": "a4f88c927cf19a470878ea41f494ec16162c714920c7d97b80d4beffb72de841",
	        "Created": "2025-09-18T17:50:07.698645215Z",
	        "Scope": "local",
	        "Driver": "bridge",
	        "EnableIPv4": true,
	        "EnableIPv6": false,
	        "IPAM": {
	            "Driver": "default",
	            "Options": {},
	            "Config": [
	                {
	                    "Subnet": "192.168.112.0/24",
	                    "Gateway": "192.168.112.1"
	                }
	            ]
	        },
	        "Internal": false,
	        "Attachable": false,
	        "Ingress": false,
	        "ConfigFrom": {
	            "Network": ""
	        },
	        "ConfigOnly": false,
	        "Containers": {},
	        "Options": {
	            "--icc": "",
	            "--ip-masq": "",
	            "com.docker.network.driver.mtu": "1500"
	        },
	        "Labels": {
	            "created_by.minikube.sigs.k8s.io": "true",
	            "name.minikube.sigs.k8s.io": "flannel-749287"
	        }
	    }
	]
	
	-- /stdout --
	I0918 17:50:14.047458  334273 client.go:171] duration metric: took 6.42536242s to LocalClient.Create
	I0918 17:50:16.047692  334273 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:50:16.047752  334273 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287
	W0918 17:50:16.067653  334273 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287 returned with exit code 1
	I0918 17:50:16.067782  334273 retry.go:31] will retry after 172.148135ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 17:50:16.240118  334273 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287
	W0918 17:50:16.258998  334273 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287 returned with exit code 1
	I0918 17:50:16.259150  334273 retry.go:31] will retry after 188.563017ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 17:50:16.448622  334273 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287
	W0918 17:50:16.469122  334273 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287 returned with exit code 1
	I0918 17:50:16.469229  334273 retry.go:31] will retry after 645.366242ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 17:50:17.115713  334273 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287
	W0918 17:50:17.144236  334273 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287 returned with exit code 1
	W0918 17:50:17.144424  334273 start.go:268] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	W0918 17:50:17.144447  334273 start.go:235] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 17:50:17.144526  334273 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0918 17:50:17.144575  334273 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287
	W0918 17:50:17.168422  334273 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287 returned with exit code 1
	I0918 17:50:17.168563  334273 retry.go:31] will retry after 355.988292ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 17:50:17.525731  334273 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287
	W0918 17:50:17.546755  334273 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287 returned with exit code 1
	I0918 17:50:17.546851  334273 retry.go:31] will retry after 358.638283ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 17:50:17.906455  334273 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287
	W0918 17:50:17.927848  334273 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287 returned with exit code 1
	I0918 17:50:17.927991  334273 retry.go:31] will retry after 369.06648ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 17:50:18.297558  334273 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287
	W0918 17:50:18.320765  334273 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" flannel-749287 returned with exit code 1
	W0918 17:50:18.320908  334273 start.go:283] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	W0918 17:50:18.320927  334273 start.go:240] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port
	I0918 17:50:18.320941  334273 start.go:128] duration metric: took 10.701045919s to createHost
	I0918 17:50:18.320954  334273 start.go:83] releasing machines lock for "flannel-749287", held for 10.701211639s
	W0918 17:50:18.321054  334273 out.go:285] * Failed to start docker container. Running "minikube delete -p flannel-749287" may fix it: creating host: create: creating: prepare kic ssh: container name "flannel-749287" state Stopped: log: 2025-09-18T17:50:13.567686945Z  Failed to create control group inotify object: Too many open files
	2025-09-18T17:50:13.567705013Z  Failed to allocate manager object: Too many open files
	2025-09-18T17:50:13.567709267Z  [!!!!!!] Failed to allocate manager object.
	2025-09-18T17:50:13.567712495Z  Exiting PID 1...: container exited unexpectedly
	* Failed to start docker container. Running "minikube delete -p flannel-749287" may fix it: creating host: create: creating: prepare kic ssh: container name "flannel-749287" state Stopped: log: 2025-09-18T17:50:13.567686945Z  Failed to create control group inotify object: Too many open files
	2025-09-18T17:50:13.567705013Z  Failed to allocate manager object: Too many open files
	2025-09-18T17:50:13.567709267Z  [!!!!!!] Failed to allocate manager object.
	2025-09-18T17:50:13.567712495Z  Exiting PID 1...: container exited unexpectedly
	W0918 17:50:18.321115  334273 out.go:308] 
	
	W0918 17:50:18.321150  334273 out.go:285] ! The minikube docker container exited unexpectedly.
	! The minikube docker container exited unexpectedly.
	I0918 17:50:18.324657  334273 out.go:179] * If you are still interested to make docker driver work. The following suggestions might help you get passed this issue:
	I0918 17:50:18.325917  334273 out.go:179] 
		
	I0918 17:50:18.327406  334273 out.go:179] * - Prune unused docker images, volumes, networks and abandoned containers.
	
					docker system prune --volumes
	I0918 17:50:18.328732  334273 out.go:179] 
		
	I0918 17:50:18.329977  334273 out.go:179] * - Restart your docker service
	I0918 17:50:18.331110  334273 out.go:179] 
		
	I0918 17:50:18.332644  334273 out.go:179] * - Delete and recreate minikube cluster
			minikube delete
			minikube start --driver=docker
	I0918 17:50:18.336061  334273 out.go:203] 
	W0918 17:50:18.337593  334273 out.go:285] X Exiting due to GUEST_PROVISION_EXIT_UNEXPECTED: Failed to start host: creating host: create: creating: prepare kic ssh: container name "flannel-749287" state Stopped: log: 2025-09-18T17:50:13.567686945Z  Failed to create control group inotify object: Too many open files
	2025-09-18T17:50:13.567705013Z  Failed to allocate manager object: Too many open files
	2025-09-18T17:50:13.567709267Z  [!!!!!!] Failed to allocate manager object.
	2025-09-18T17:50:13.567712495Z  Exiting PID 1...: container exited unexpectedly
	X Exiting due to GUEST_PROVISION_EXIT_UNEXPECTED: Failed to start host: creating host: create: creating: prepare kic ssh: container name "flannel-749287" state Stopped: log: 2025-09-18T17:50:13.567686945Z  Failed to create control group inotify object: Too many open files
	2025-09-18T17:50:13.567705013Z  Failed to allocate manager object: Too many open files
	2025-09-18T17:50:13.567709267Z  [!!!!!!] Failed to allocate manager object.
	2025-09-18T17:50:13.567712495Z  Exiting PID 1...: container exited unexpectedly
	I0918 17:50:18.338834  334273 out.go:203] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 80
--- FAIL: TestNetworkPlugins/group/flannel/Start (29.14s)

                                                
                                    

Test pass (280/323)

Order passed test Duration
3 TestDownloadOnly/v1.28.0/json-events 5.56
4 TestDownloadOnly/v1.28.0/preload-exists 0
8 TestDownloadOnly/v1.28.0/LogsDuration 0.07
9 TestDownloadOnly/v1.28.0/DeleteAll 0.21
10 TestDownloadOnly/v1.28.0/DeleteAlwaysSucceeds 0.13
12 TestDownloadOnly/v1.34.0/json-events 4.3
13 TestDownloadOnly/v1.34.0/preload-exists 0
17 TestDownloadOnly/v1.34.0/LogsDuration 0.06
18 TestDownloadOnly/v1.34.0/DeleteAll 0.21
19 TestDownloadOnly/v1.34.0/DeleteAlwaysSucceeds 0.13
20 TestDownloadOnlyKic 1.16
21 TestBinaryMirror 0.8
22 TestOffline 66.59
25 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.05
26 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.05
27 TestAddons/Setup 143.58
31 TestAddons/serial/GCPAuth/Namespaces 0.12
32 TestAddons/serial/GCPAuth/FakeCredentials 9.51
35 TestAddons/parallel/Registry 14.61
36 TestAddons/parallel/RegistryCreds 0.69
38 TestAddons/parallel/InspektorGadget 5.32
39 TestAddons/parallel/MetricsServer 5.67
41 TestAddons/parallel/CSI 53.96
42 TestAddons/parallel/Headlamp 16.51
43 TestAddons/parallel/CloudSpanner 5.51
44 TestAddons/parallel/LocalPath 9.2
45 TestAddons/parallel/NvidiaDevicePlugin 5.52
46 TestAddons/parallel/Yakd 10.69
47 TestAddons/parallel/AmdGpuDevicePlugin 5.52
48 TestAddons/StoppedEnableDisable 16.59
49 TestCertOptions 28.52
50 TestCertExpiration 219.07
52 TestForceSystemdFlag 28.59
53 TestForceSystemdEnv 24.64
55 TestKVMDriverInstallOrUpdate 0.64
59 TestErrorSpam/setup 21.19
60 TestErrorSpam/start 0.63
61 TestErrorSpam/status 0.91
62 TestErrorSpam/pause 1.49
63 TestErrorSpam/unpause 1.5
64 TestErrorSpam/stop 2.58
67 TestFunctional/serial/CopySyncFile 0
68 TestFunctional/serial/StartWithProxy 38.82
69 TestFunctional/serial/AuditLog 0
70 TestFunctional/serial/SoftStart 6.58
71 TestFunctional/serial/KubeContext 0.04
72 TestFunctional/serial/KubectlGetPods 0.08
75 TestFunctional/serial/CacheCmd/cache/add_remote 3.05
76 TestFunctional/serial/CacheCmd/cache/add_local 1.02
77 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.05
78 TestFunctional/serial/CacheCmd/cache/list 0.05
79 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.3
80 TestFunctional/serial/CacheCmd/cache/cache_reload 1.75
81 TestFunctional/serial/CacheCmd/cache/delete 0.1
82 TestFunctional/serial/MinikubeKubectlCmd 0.11
83 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.1
84 TestFunctional/serial/ExtraConfig 41.03
85 TestFunctional/serial/ComponentHealth 0.07
86 TestFunctional/serial/LogsCmd 1.41
87 TestFunctional/serial/LogsFileCmd 1.43
88 TestFunctional/serial/InvalidService 4.53
90 TestFunctional/parallel/ConfigCmd 0.35
91 TestFunctional/parallel/DashboardCmd 7.94
92 TestFunctional/parallel/DryRun 0.39
93 TestFunctional/parallel/InternationalLanguage 0.18
94 TestFunctional/parallel/StatusCmd 1.05
99 TestFunctional/parallel/AddonsCmd 0.18
100 TestFunctional/parallel/PersistentVolumeClaim 25.22
102 TestFunctional/parallel/SSHCmd 0.61
103 TestFunctional/parallel/CpCmd 1.81
104 TestFunctional/parallel/MySQL 16.24
105 TestFunctional/parallel/FileSync 0.27
106 TestFunctional/parallel/CertSync 1.6
110 TestFunctional/parallel/NodeLabels 0.06
112 TestFunctional/parallel/NonActiveRuntimeDisabled 0.54
114 TestFunctional/parallel/License 0.25
116 TestFunctional/parallel/ProfileCmd/profile_not_create 0.45
117 TestFunctional/parallel/ProfileCmd/profile_list 0.43
118 TestFunctional/parallel/MountCmd/any-port 8.7
119 TestFunctional/parallel/ProfileCmd/profile_json_output 0.44
121 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.4
122 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
124 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 8.22
125 TestFunctional/parallel/MountCmd/specific-port 2.07
126 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.09
127 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
131 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
132 TestFunctional/parallel/MountCmd/VerifyCleanup 1.74
133 TestFunctional/parallel/Version/short 0.06
134 TestFunctional/parallel/Version/components 0.54
135 TestFunctional/parallel/ImageCommands/ImageListShort 0.25
136 TestFunctional/parallel/ImageCommands/ImageListTable 0.23
137 TestFunctional/parallel/ImageCommands/ImageListJson 0.23
138 TestFunctional/parallel/ImageCommands/ImageListYaml 0.26
139 TestFunctional/parallel/ImageCommands/ImageBuild 4.49
140 TestFunctional/parallel/ImageCommands/Setup 0.46
141 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 2.51
142 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 0.89
143 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 1.05
144 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.52
145 TestFunctional/parallel/ImageCommands/ImageRemove 0.53
146 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 0.77
147 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.66
148 TestFunctional/parallel/UpdateContextCmd/no_changes 0.13
149 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.13
150 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.13
151 TestFunctional/parallel/ServiceCmd/List 1.69
152 TestFunctional/parallel/ServiceCmd/JSONOutput 1.69
156 TestFunctional/delete_echo-server_images 0.04
157 TestFunctional/delete_my-image_image 0.02
158 TestFunctional/delete_minikube_cached_images 0.02
163 TestMultiControlPlane/serial/StartCluster 135.99
164 TestMultiControlPlane/serial/DeployApp 6.17
165 TestMultiControlPlane/serial/PingHostFromPods 1.08
167 TestMultiControlPlane/serial/NodeLabels 0.06
168 TestMultiControlPlane/serial/HAppyAfterClusterStart 0.74
171 TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop 0.54
173 TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart 0.74
177 TestMultiControlPlane/serial/StopCluster 35.56
182 TestJSONOutput/start/Command 39.58
183 TestJSONOutput/start/Audit 0
185 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
186 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
188 TestJSONOutput/pause/Command 0.72
189 TestJSONOutput/pause/Audit 0
191 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
192 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
194 TestJSONOutput/unpause/Command 0.62
195 TestJSONOutput/unpause/Audit 0
197 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
198 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
200 TestJSONOutput/stop/Command 6.1
201 TestJSONOutput/stop/Audit 0
203 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
204 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
205 TestErrorJSONOutput 0.21
207 TestKicCustomNetwork/create_custom_network 29.62
208 TestKicCustomNetwork/use_default_bridge_network 22.8
209 TestKicExistingNetwork 23.16
210 TestKicCustomSubnet 24.79
211 TestKicStaticIP 24.62
212 TestMainNoArgs 0.05
213 TestMinikubeProfile 45.9
216 TestMountStart/serial/StartWithMountFirst 5.31
217 TestMountStart/serial/VerifyMountFirst 0.26
218 TestMountStart/serial/StartWithMountSecond 5.44
219 TestMountStart/serial/VerifyMountSecond 0.26
220 TestMountStart/serial/DeleteFirst 1.69
221 TestMountStart/serial/VerifyMountPostDelete 0.26
222 TestMountStart/serial/Stop 1.19
223 TestMountStart/serial/RestartStopped 7.36
224 TestMountStart/serial/VerifyMountPostStop 0.26
227 TestMultiNode/serial/FreshStart2Nodes 122.3
228 TestMultiNode/serial/DeployApp2Nodes 4.58
229 TestMultiNode/serial/PingHostFrom2Pods 0.75
230 TestMultiNode/serial/AddNode 26.75
231 TestMultiNode/serial/MultiNodeLabels 0.06
232 TestMultiNode/serial/ProfileList 0.64
233 TestMultiNode/serial/CopyFile 9.45
234 TestMultiNode/serial/StopNode 2.26
235 TestMultiNode/serial/StartAfterStop 7.51
236 TestMultiNode/serial/RestartKeepsNodes 77.52
237 TestMultiNode/serial/DeleteNode 5.27
238 TestMultiNode/serial/StopMultiNode 28.68
239 TestMultiNode/serial/RestartMultiNode 50.35
240 TestMultiNode/serial/ValidateNameConflict 23.5
245 TestPreload 109.82
247 TestScheduledStopUnix 97.89
250 TestInsufficientStorage 9.35
251 TestRunningBinaryUpgrade 52.93
253 TestKubernetesUpgrade 321.25
254 TestMissingContainerUpgrade 92.5
255 TestStoppedBinaryUpgrade/Setup 0.7
256 TestStoppedBinaryUpgrade/Upgrade 65.11
257 TestStoppedBinaryUpgrade/MinikubeLogs 1.04
266 TestPause/serial/Start 48.16
268 TestNoKubernetes/serial/StartNoK8sWithVersion 0.08
269 TestNoKubernetes/serial/StartWithK8s 25.1
270 TestNoKubernetes/serial/StartWithStopK8s 24.45
271 TestPause/serial/SecondStartNoReconfiguration 6.57
279 TestNetworkPlugins/group/false 3.12
280 TestPause/serial/Pause 0.68
284 TestPause/serial/VerifyStatus 0.33
285 TestPause/serial/Unpause 0.64
286 TestPause/serial/PauseAgain 0.69
287 TestPause/serial/DeletePaused 2.74
288 TestPause/serial/VerifyDeletedResources 15.37
289 TestNoKubernetes/serial/Start 6.49
290 TestNoKubernetes/serial/VerifyK8sNotRunning 0.31
291 TestNoKubernetes/serial/ProfileList 1.66
292 TestNoKubernetes/serial/Stop 1.46
293 TestNoKubernetes/serial/StartNoArgs 8.14
294 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.29
296 TestStartStop/group/old-k8s-version/serial/FirstStart 50.43
298 TestStartStop/group/no-preload/serial/FirstStart 81.77
299 TestStartStop/group/old-k8s-version/serial/DeployApp 10.29
300 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 0.94
301 TestStartStop/group/old-k8s-version/serial/Stop 16.21
302 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.17
303 TestStartStop/group/old-k8s-version/serial/SecondStart 141.64
304 TestStartStop/group/no-preload/serial/DeployApp 8.29
305 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 0.93
306 TestStartStop/group/no-preload/serial/Stop 16.72
307 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.17
308 TestStartStop/group/no-preload/serial/SecondStart 45.98
310 TestStartStop/group/embed-certs/serial/FirstStart 70.02
311 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 6.01
312 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.07
313 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.23
314 TestStartStop/group/no-preload/serial/Pause 2.72
316 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 39.75
318 TestStartStop/group/newest-cni/serial/FirstStart 28.84
319 TestStartStop/group/embed-certs/serial/DeployApp 8.27
320 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 6
321 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 0.9
322 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 5.08
323 TestStartStop/group/embed-certs/serial/Stop 18.23
324 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 9.31
325 TestStartStop/group/newest-cni/serial/DeployApp 0
326 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 0.79
327 TestStartStop/group/newest-cni/serial/Stop 2.42
328 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.26
329 TestStartStop/group/old-k8s-version/serial/Pause 2.84
330 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.19
331 TestStartStop/group/newest-cni/serial/SecondStart 12.18
332 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 0.91
333 TestNetworkPlugins/group/auto/Start 73.32
334 TestStartStop/group/default-k8s-diff-port/serial/Stop 16.98
335 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
336 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
337 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.23
338 TestStartStop/group/newest-cni/serial/Pause 2.66
339 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.2
340 TestStartStop/group/embed-certs/serial/SecondStart 56.63
341 TestNetworkPlugins/group/kindnet/Start 70.88
342 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.28
343 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 27.9
344 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 6.01
345 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 6.07
346 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.22
348 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 6.01
349 TestNetworkPlugins/group/calico/Start 49.76
350 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.11
351 TestNetworkPlugins/group/auto/KubeletFlags 0.29
352 TestNetworkPlugins/group/auto/NetCatPod 10.36
353 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.25
354 TestStartStop/group/embed-certs/serial/Pause 2.84
355 TestNetworkPlugins/group/custom-flannel/Start 55.3
356 TestNetworkPlugins/group/kindnet/ControllerPod 6.01
357 TestNetworkPlugins/group/auto/DNS 0.15
358 TestNetworkPlugins/group/auto/Localhost 0.12
359 TestNetworkPlugins/group/auto/HairPin 0.12
360 TestNetworkPlugins/group/kindnet/KubeletFlags 0.28
361 TestNetworkPlugins/group/kindnet/NetCatPod 9.24
362 TestNetworkPlugins/group/kindnet/DNS 0.16
363 TestNetworkPlugins/group/kindnet/Localhost 0.13
364 TestNetworkPlugins/group/kindnet/HairPin 0.14
365 TestNetworkPlugins/group/enable-default-cni/Start 96.25
366 TestNetworkPlugins/group/calico/ControllerPod 6.01
368 TestNetworkPlugins/group/calico/KubeletFlags 0.35
369 TestNetworkPlugins/group/calico/NetCatPod 11.22
370 TestNetworkPlugins/group/calico/DNS 0.15
371 TestNetworkPlugins/group/calico/Localhost 0.12
372 TestNetworkPlugins/group/calico/HairPin 0.15
373 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.28
374 TestNetworkPlugins/group/custom-flannel/NetCatPod 8.2
375 TestNetworkPlugins/group/custom-flannel/DNS 0.14
376 TestNetworkPlugins/group/custom-flannel/Localhost 0.12
377 TestNetworkPlugins/group/custom-flannel/HairPin 0.12
378 TestNetworkPlugins/group/bridge/Start 62.34
379 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.27
380 TestNetworkPlugins/group/enable-default-cni/NetCatPod 9.18
381 TestNetworkPlugins/group/enable-default-cni/DNS 0.13
382 TestNetworkPlugins/group/enable-default-cni/Localhost 0.11
383 TestNetworkPlugins/group/enable-default-cni/HairPin 0.11
384 TestNetworkPlugins/group/bridge/KubeletFlags 0.29
385 TestNetworkPlugins/group/bridge/NetCatPod 9.18
386 TestNetworkPlugins/group/bridge/DNS 0.13
387 TestNetworkPlugins/group/bridge/Localhost 0.12
388 TestNetworkPlugins/group/bridge/HairPin 0.12
x
+
TestDownloadOnly/v1.28.0/json-events (5.56s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-744716 --force --alsologtostderr --kubernetes-version=v1.28.0 --container-runtime=crio --driver=docker  --container-runtime=crio
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-744716 --force --alsologtostderr --kubernetes-version=v1.28.0 --container-runtime=crio --driver=docker  --container-runtime=crio: (5.561928343s)
--- PASS: TestDownloadOnly/v1.28.0/json-events (5.56s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.0/preload-exists
I0918 16:38:13.519153   11368 preload.go:131] Checking if preload exists for k8s version v1.28.0 and runtime crio
I0918 16:38:13.519239   11368 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-cri-o-overlay-amd64.tar.lz4
--- PASS: TestDownloadOnly/v1.28.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.0/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-744716
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-744716: exit status 85 (64.858374ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────┬─────────┬─────────┬─────────────────────┬──────────┐
	│ COMMAND │                                                                                   ARGS                                                                                    │       PROFILE        │  USER   │ VERSION │     START TIME      │ END TIME │
	├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────┼─────────┼─────────┼─────────────────────┼──────────┤
	│ start   │ -o=json --download-only -p download-only-744716 --force --alsologtostderr --kubernetes-version=v1.28.0 --container-runtime=crio --driver=docker  --container-runtime=crio │ download-only-744716 │ jenkins │ v1.37.0 │ 18 Sep 25 16:38 UTC │          │
	└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────┴─────────┴─────────┴─────────────────────┴──────────┘
	
	
	==> Last Start <==
	Log file created at: 2025/09/18 16:38:07
	Running on machine: ubuntu-20-agent-4
	Binary: Built with gc go1.24.6 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0918 16:38:07.996629   11380 out.go:360] Setting OutFile to fd 1 ...
	I0918 16:38:07.997295   11380 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:38:07.997306   11380 out.go:374] Setting ErrFile to fd 2...
	I0918 16:38:07.997310   11380 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:38:07.997525   11380 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	W0918 16:38:07.997648   11380 root.go:314] Error reading config file at /home/jenkins/minikube-integration/20370-7845/.minikube/config/config.json: open /home/jenkins/minikube-integration/20370-7845/.minikube/config/config.json: no such file or directory
	I0918 16:38:07.998161   11380 out.go:368] Setting JSON to true
	I0918 16:38:07.999002   11380 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":1239,"bootTime":1758212249,"procs":204,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 16:38:07.999094   11380 start.go:140] virtualization: kvm guest
	I0918 16:38:08.001483   11380 out.go:99] [download-only-744716] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	W0918 16:38:08.001623   11380 preload.go:293] Failed to list preload files: open /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball: no such file or directory
	I0918 16:38:08.001666   11380 notify.go:220] Checking for updates...
	I0918 16:38:08.003209   11380 out.go:171] MINIKUBE_LOCATION=20370
	I0918 16:38:08.004891   11380 out.go:171] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 16:38:08.006562   11380 out.go:171] KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 16:38:08.011221   11380 out.go:171] MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 16:38:08.012995   11380 out.go:171] MINIKUBE_BIN=out/minikube-linux-amd64
	W0918 16:38:08.015538   11380 out.go:336] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0918 16:38:08.016400   11380 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 16:38:08.040881   11380 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 16:38:08.040953   11380 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:38:08.468859   11380 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:30 OomKillDisable:false NGoroutines:64 SystemTime:2025-09-18 16:38:08.458095375 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:38:08.468970   11380 docker.go:318] overlay module found
	I0918 16:38:08.470988   11380 out.go:99] Using the docker driver based on user configuration
	I0918 16:38:08.471022   11380 start.go:304] selected driver: docker
	I0918 16:38:08.471028   11380 start.go:924] validating driver "docker" against <nil>
	I0918 16:38:08.471131   11380 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:38:08.535033   11380 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:30 OomKillDisable:false NGoroutines:64 SystemTime:2025-09-18 16:38:08.521115196 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:38:08.535262   11380 start_flags.go:327] no existing cluster config was found, will generate one from the flags 
	I0918 16:38:08.535923   11380 start_flags.go:410] Using suggested 8000MB memory alloc based on sys=32093MB, container=32093MB
	I0918 16:38:08.536136   11380 start_flags.go:974] Wait components to verify : map[apiserver:true system_pods:true]
	I0918 16:38:08.537989   11380 out.go:171] Using Docker driver with root privileges
	I0918 16:38:08.539162   11380 cni.go:84] Creating CNI manager for ""
	I0918 16:38:08.539219   11380 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0918 16:38:08.539230   11380 start_flags.go:336] Found "CNI" CNI - setting NetworkPlugin=cni
	I0918 16:38:08.539291   11380 start.go:348] cluster config:
	{Name:download-only-744716 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:8000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.0 ClusterName:download-only-744716 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS
ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:38:08.540587   11380 out.go:99] Starting "download-only-744716" primary control-plane node in "download-only-744716" cluster
	I0918 16:38:08.540607   11380 cache.go:123] Beginning downloading kic base image for docker with crio
	I0918 16:38:08.541958   11380 out.go:99] Pulling base image v0.0.48 ...
	I0918 16:38:08.542001   11380 preload.go:131] Checking if preload exists for k8s version v1.28.0 and runtime crio
	I0918 16:38:08.542149   11380 image.go:81] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local docker daemon
	I0918 16:38:08.561984   11380 cache.go:152] Downloading gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 to local cache
	I0918 16:38:08.562217   11380 image.go:65] Checking for gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 in local cache directory
	I0918 16:38:08.562347   11380 image.go:150] Writing gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 to local cache
	I0918 16:38:08.567182   11380 preload.go:118] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.0/preloaded-images-k8s-v18-v1.28.0-cri-o-overlay-amd64.tar.lz4
	I0918 16:38:08.567211   11380 cache.go:58] Caching tarball of preloaded images
	I0918 16:38:08.567372   11380 preload.go:131] Checking if preload exists for k8s version v1.28.0 and runtime crio
	I0918 16:38:08.569523   11380 out.go:99] Downloading Kubernetes v1.28.0 preload ...
	I0918 16:38:08.569550   11380 preload.go:236] getting checksum for preloaded-images-k8s-v18-v1.28.0-cri-o-overlay-amd64.tar.lz4 ...
	I0918 16:38:08.607269   11380 download.go:108] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.0/preloaded-images-k8s-v18-v1.28.0-cri-o-overlay-amd64.tar.lz4?checksum=md5:72bc7f8573f574c02d8c9a9b3496176b -> /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-cri-o-overlay-amd64.tar.lz4
	I0918 16:38:11.858998   11380 preload.go:247] saving checksum for preloaded-images-k8s-v18-v1.28.0-cri-o-overlay-amd64.tar.lz4 ...
	I0918 16:38:11.859086   11380 preload.go:254] verifying checksum of /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.0-cri-o-overlay-amd64.tar.lz4 ...
	I0918 16:38:12.098689   11380 cache.go:155] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 as a tarball
	I0918 16:38:12.841873   11380 cache.go:61] Finished verifying existence of preloaded tar for v1.28.0 on crio
	I0918 16:38:12.842204   11380 profile.go:143] Saving config to /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/download-only-744716/config.json ...
	I0918 16:38:12.842238   11380 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/download-only-744716/config.json: {Name:mk5fd37d373abc7f15b703dcdc3203fe001ad0ca Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0918 16:38:12.842393   11380 preload.go:131] Checking if preload exists for k8s version v1.28.0 and runtime crio
	I0918 16:38:12.843068   11380 download.go:108] Downloading: https://dl.k8s.io/release/v1.28.0/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.0/bin/linux/amd64/kubectl.sha256 -> /home/jenkins/minikube-integration/20370-7845/.minikube/cache/linux/amd64/v1.28.0/kubectl
	
	
	* The control-plane node download-only-744716 host does not exist
	  To start a cluster, run: "minikube start -p download-only-744716"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.28.0/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.0/DeleteAll (0.21s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-amd64 delete --all
--- PASS: TestDownloadOnly/v1.28.0/DeleteAll (0.21s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-amd64 delete -p download-only-744716
--- PASS: TestDownloadOnly/v1.28.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                    
x
+
TestDownloadOnly/v1.34.0/json-events (4.3s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.34.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-056544 --force --alsologtostderr --kubernetes-version=v1.34.0 --container-runtime=crio --driver=docker  --container-runtime=crio
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-056544 --force --alsologtostderr --kubernetes-version=v1.34.0 --container-runtime=crio --driver=docker  --container-runtime=crio: (4.296861869s)
--- PASS: TestDownloadOnly/v1.34.0/json-events (4.30s)

                                                
                                    
x
+
TestDownloadOnly/v1.34.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.34.0/preload-exists
I0918 16:38:18.224289   11368 preload.go:131] Checking if preload exists for k8s version v1.34.0 and runtime crio
I0918 16:38:18.224328   11368 preload.go:146] Found local preload: /home/jenkins/minikube-integration/20370-7845/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.34.0-cri-o-overlay-amd64.tar.lz4
--- PASS: TestDownloadOnly/v1.34.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.34.0/LogsDuration (0.06s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.34.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-056544
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-056544: exit status 85 (60.663799ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	┌─────────┬───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────────────────┬─────────┬─────────┬─────────────────────┬─────────────────────┐
	│ COMMAND │                                                                                   ARGS                                                                                    │       PROFILE        │  USER   │ VERSION │     START TIME      │      END TIME       │
	├─────────┼───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┼──────────────────────┼─────────┼─────────┼─────────────────────┼─────────────────────┤
	│ start   │ -o=json --download-only -p download-only-744716 --force --alsologtostderr --kubernetes-version=v1.28.0 --container-runtime=crio --driver=docker  --container-runtime=crio │ download-only-744716 │ jenkins │ v1.37.0 │ 18 Sep 25 16:38 UTC │                     │
	│ delete  │ --all                                                                                                                                                                     │ minikube             │ jenkins │ v1.37.0 │ 18 Sep 25 16:38 UTC │ 18 Sep 25 16:38 UTC │
	│ delete  │ -p download-only-744716                                                                                                                                                   │ download-only-744716 │ jenkins │ v1.37.0 │ 18 Sep 25 16:38 UTC │ 18 Sep 25 16:38 UTC │
	│ start   │ -o=json --download-only -p download-only-056544 --force --alsologtostderr --kubernetes-version=v1.34.0 --container-runtime=crio --driver=docker  --container-runtime=crio │ download-only-056544 │ jenkins │ v1.37.0 │ 18 Sep 25 16:38 UTC │                     │
	└─────────┴───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴──────────────────────┴─────────┴─────────┴─────────────────────┴─────────────────────┘
	
	
	==> Last Start <==
	Log file created at: 2025/09/18 16:38:13
	Running on machine: ubuntu-20-agent-4
	Binary: Built with gc go1.24.6 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0918 16:38:13.966095   11729 out.go:360] Setting OutFile to fd 1 ...
	I0918 16:38:13.966202   11729 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:38:13.966208   11729 out.go:374] Setting ErrFile to fd 2...
	I0918 16:38:13.966212   11729 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:38:13.966408   11729 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 16:38:13.966874   11729 out.go:368] Setting JSON to true
	I0918 16:38:13.967656   11729 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":1245,"bootTime":1758212249,"procs":174,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 16:38:13.967746   11729 start.go:140] virtualization: kvm guest
	I0918 16:38:13.969854   11729 out.go:99] [download-only-056544] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 16:38:13.969987   11729 notify.go:220] Checking for updates...
	I0918 16:38:13.971279   11729 out.go:171] MINIKUBE_LOCATION=20370
	I0918 16:38:13.972757   11729 out.go:171] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 16:38:13.974038   11729 out.go:171] KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 16:38:13.975371   11729 out.go:171] MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 16:38:13.976867   11729 out.go:171] MINIKUBE_BIN=out/minikube-linux-amd64
	W0918 16:38:13.979402   11729 out.go:336] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0918 16:38:13.979644   11729 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 16:38:14.002277   11729 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 16:38:14.002381   11729 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:38:14.058715   11729 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:26 OomKillDisable:false NGoroutines:52 SystemTime:2025-09-18 16:38:14.048934058 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:38:14.058811   11729 docker.go:318] overlay module found
	I0918 16:38:14.060662   11729 out.go:99] Using the docker driver based on user configuration
	I0918 16:38:14.060691   11729 start.go:304] selected driver: docker
	I0918 16:38:14.060698   11729 start.go:924] validating driver "docker" against <nil>
	I0918 16:38:14.060795   11729 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:38:14.117795   11729 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:26 OomKillDisable:false NGoroutines:52 SystemTime:2025-09-18 16:38:14.108370087 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:38:14.117945   11729 start_flags.go:327] no existing cluster config was found, will generate one from the flags 
	I0918 16:38:14.118454   11729 start_flags.go:410] Using suggested 8000MB memory alloc based on sys=32093MB, container=32093MB
	I0918 16:38:14.118625   11729 start_flags.go:974] Wait components to verify : map[apiserver:true system_pods:true]
	I0918 16:38:14.120441   11729 out.go:171] Using Docker driver with root privileges
	
	
	* The control-plane node download-only-056544 host does not exist
	  To start a cluster, run: "minikube start -p download-only-056544"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.34.0/LogsDuration (0.06s)

                                                
                                    
x
+
TestDownloadOnly/v1.34.0/DeleteAll (0.21s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.34.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-amd64 delete --all
--- PASS: TestDownloadOnly/v1.34.0/DeleteAll (0.21s)

                                                
                                    
x
+
TestDownloadOnly/v1.34.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.34.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-amd64 delete -p download-only-056544
--- PASS: TestDownloadOnly/v1.34.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                    
x
+
TestDownloadOnlyKic (1.16s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:232: (dbg) Run:  out/minikube-linux-amd64 start --download-only -p download-docker-967460 --alsologtostderr --driver=docker  --container-runtime=crio
helpers_test.go:175: Cleaning up "download-docker-967460" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p download-docker-967460
--- PASS: TestDownloadOnlyKic (1.16s)

                                                
                                    
x
+
TestBinaryMirror (0.8s)

                                                
                                                
=== RUN   TestBinaryMirror
I0918 16:38:20.049694   11368 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.34.0/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.34.0/bin/linux/amd64/kubectl.sha256
aaa_download_only_test.go:314: (dbg) Run:  out/minikube-linux-amd64 start --download-only -p binary-mirror-108304 --alsologtostderr --binary-mirror http://127.0.0.1:33603 --driver=docker  --container-runtime=crio
helpers_test.go:175: Cleaning up "binary-mirror-108304" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p binary-mirror-108304
--- PASS: TestBinaryMirror (0.80s)

                                                
                                    
x
+
TestOffline (66.59s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-linux-amd64 start -p offline-crio-262361 --alsologtostderr -v=1 --memory=3072 --wait=true --driver=docker  --container-runtime=crio
aab_offline_test.go:55: (dbg) Done: out/minikube-linux-amd64 start -p offline-crio-262361 --alsologtostderr -v=1 --memory=3072 --wait=true --driver=docker  --container-runtime=crio: (1m4.161017924s)
helpers_test.go:175: Cleaning up "offline-crio-262361" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p offline-crio-262361
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p offline-crio-262361: (2.431049161s)
--- PASS: TestOffline (66.59s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.05s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:1000: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p addons-294579
addons_test.go:1000: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable dashboard -p addons-294579: exit status 85 (50.901881ms)

                                                
                                                
-- stdout --
	* Profile "addons-294579" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-294579"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.05s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.05s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:1011: (dbg) Run:  out/minikube-linux-amd64 addons disable dashboard -p addons-294579
addons_test.go:1011: (dbg) Non-zero exit: out/minikube-linux-amd64 addons disable dashboard -p addons-294579: exit status 85 (49.250538ms)

                                                
                                                
-- stdout --
	* Profile "addons-294579" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-294579"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.05s)

                                                
                                    
x
+
TestAddons/Setup (143.58s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:108: (dbg) Run:  out/minikube-linux-amd64 start -p addons-294579 --wait=true --memory=4096 --alsologtostderr --addons=registry --addons=registry-creds --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher
addons_test.go:108: (dbg) Done: out/minikube-linux-amd64 start -p addons-294579 --wait=true --memory=4096 --alsologtostderr --addons=registry --addons=registry-creds --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=docker  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher: (2m23.578895594s)
--- PASS: TestAddons/Setup (143.58s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.12s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:630: (dbg) Run:  kubectl --context addons-294579 create ns new-namespace
addons_test.go:644: (dbg) Run:  kubectl --context addons-294579 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.12s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/FakeCredentials (9.51s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/FakeCredentials
addons_test.go:675: (dbg) Run:  kubectl --context addons-294579 create -f testdata/busybox.yaml
addons_test.go:682: (dbg) Run:  kubectl --context addons-294579 create sa gcp-auth-test
addons_test.go:688: (dbg) TestAddons/serial/GCPAuth/FakeCredentials: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:352: "busybox" [7fdf62f6-f048-4634-97c6-ededd8667d4d] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "busybox" [7fdf62f6-f048-4634-97c6-ededd8667d4d] Running
addons_test.go:688: (dbg) TestAddons/serial/GCPAuth/FakeCredentials: integration-test=busybox healthy within 9.004108949s
addons_test.go:694: (dbg) Run:  kubectl --context addons-294579 exec busybox -- /bin/sh -c "printenv GOOGLE_APPLICATION_CREDENTIALS"
addons_test.go:706: (dbg) Run:  kubectl --context addons-294579 describe sa gcp-auth-test
addons_test.go:744: (dbg) Run:  kubectl --context addons-294579 exec busybox -- /bin/sh -c "printenv GOOGLE_CLOUD_PROJECT"
--- PASS: TestAddons/serial/GCPAuth/FakeCredentials (9.51s)

                                                
                                    
x
+
TestAddons/parallel/Registry (14.61s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:382: registry stabilized in 29.017284ms
addons_test.go:384: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:352: "registry-66898fdd98-smmbw" [09f9a63e-d06a-4049-a31e-60537f65d737] Running
addons_test.go:384: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.00352726s
addons_test.go:387: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:352: "registry-proxy-ksqpq" [04fa5c90-d967-43b0-80a3-6906c0905306] Running
addons_test.go:387: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.003810909s
addons_test.go:392: (dbg) Run:  kubectl --context addons-294579 delete po -l run=registry-test --now
addons_test.go:397: (dbg) Run:  kubectl --context addons-294579 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:397: (dbg) Done: kubectl --context addons-294579 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (3.735015348s)
addons_test.go:411: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 ip
2025/09/18 16:41:16 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:1053: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (14.61s)

                                                
                                    
x
+
TestAddons/parallel/RegistryCreds (0.69s)

                                                
                                                
=== RUN   TestAddons/parallel/RegistryCreds
=== PAUSE TestAddons/parallel/RegistryCreds

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/RegistryCreds
addons_test.go:323: registry-creds stabilized in 3.497441ms
addons_test.go:325: (dbg) Run:  out/minikube-linux-amd64 addons configure registry-creds -f ./testdata/addons_testconfig.json -p addons-294579
addons_test.go:332: (dbg) Run:  kubectl --context addons-294579 -n kube-system get secret -o yaml
addons_test.go:1053: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 addons disable registry-creds --alsologtostderr -v=1
--- PASS: TestAddons/parallel/RegistryCreds (0.69s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (5.32s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:823: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:352: "gadget-pztwm" [3e3dec64-0e1a-4289-9828-ff5f58b94ad5] Running
addons_test.go:823: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.003838525s
addons_test.go:1053: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 addons disable inspektor-gadget --alsologtostderr -v=1
--- PASS: TestAddons/parallel/InspektorGadget (5.32s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.67s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
I0918 16:41:08.250007   11368 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
addons_test.go:455: metrics-server stabilized in 2.866696ms
I0918 16:41:08.253843   11368 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0918 16:41:08.253868   11368 kapi.go:107] duration metric: took 3.881618ms to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
addons_test.go:457: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:352: "metrics-server-85b7d694d7-v5wc5" [8478dbc1-e162-487c-840a-8aaf78d27e7f] Running
addons_test.go:457: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.003824566s
addons_test.go:463: (dbg) Run:  kubectl --context addons-294579 top pods -n kube-system
addons_test.go:1053: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.67s)

                                                
                                    
x
+
TestAddons/parallel/CSI (53.96s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:549: csi-hostpath-driver pods stabilized in 3.890981ms
addons_test.go:552: (dbg) Run:  kubectl --context addons-294579 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:557: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:562: (dbg) Run:  kubectl --context addons-294579 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:567: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:352: "task-pv-pod" [3c14bcd0-61af-4674-8962-0f34947bac82] Pending
helpers_test.go:352: "task-pv-pod" [3c14bcd0-61af-4674-8962-0f34947bac82] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:352: "task-pv-pod" [3c14bcd0-61af-4674-8962-0f34947bac82] Running
addons_test.go:567: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 13.003107934s
addons_test.go:572: (dbg) Run:  kubectl --context addons-294579 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:577: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:427: (dbg) Run:  kubectl --context addons-294579 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:427: (dbg) Run:  kubectl --context addons-294579 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:582: (dbg) Run:  kubectl --context addons-294579 delete pod task-pv-pod
addons_test.go:588: (dbg) Run:  kubectl --context addons-294579 delete pvc hpvc
addons_test.go:594: (dbg) Run:  kubectl --context addons-294579 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:599: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:604: (dbg) Run:  kubectl --context addons-294579 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:609: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:352: "task-pv-pod-restore" [3e061b11-4c81-47df-9aa1-3fd6bd6e48ac] Pending
helpers_test.go:352: "task-pv-pod-restore" [3e061b11-4c81-47df-9aa1-3fd6bd6e48ac] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:352: "task-pv-pod-restore" [3e061b11-4c81-47df-9aa1-3fd6bd6e48ac] Running
addons_test.go:609: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 8.003204611s
addons_test.go:614: (dbg) Run:  kubectl --context addons-294579 delete pod task-pv-pod-restore
addons_test.go:618: (dbg) Run:  kubectl --context addons-294579 delete pvc hpvc-restore
addons_test.go:622: (dbg) Run:  kubectl --context addons-294579 delete volumesnapshot new-snapshot-demo
addons_test.go:1053: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 addons disable volumesnapshots --alsologtostderr -v=1
addons_test.go:1053: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:1053: (dbg) Done: out/minikube-linux-amd64 -p addons-294579 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.565683938s)
--- PASS: TestAddons/parallel/CSI (53.96s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (16.51s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:808: (dbg) Run:  out/minikube-linux-amd64 addons enable headlamp -p addons-294579 --alsologtostderr -v=1
addons_test.go:813: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:352: "headlamp-85f8f8dc54-fkdp9" [b2651b33-8ccf-4ba0-937b-6cfbd5266056] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:352: "headlamp-85f8f8dc54-fkdp9" [b2651b33-8ccf-4ba0-937b-6cfbd5266056] Running / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:352: "headlamp-85f8f8dc54-fkdp9" [b2651b33-8ccf-4ba0-937b-6cfbd5266056] Running
addons_test.go:813: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 10.003823722s
addons_test.go:1053: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 addons disable headlamp --alsologtostderr -v=1
addons_test.go:1053: (dbg) Done: out/minikube-linux-amd64 -p addons-294579 addons disable headlamp --alsologtostderr -v=1: (5.746241514s)
--- PASS: TestAddons/parallel/Headlamp (16.51s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.51s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:840: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:352: "cloud-spanner-emulator-85f6b7fc65-nglpl" [ff1a990b-28d7-460d-aa4e-88f81281a634] Running
addons_test.go:840: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.007204923s
addons_test.go:1053: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 addons disable cloud-spanner --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CloudSpanner (5.51s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (9.2s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:949: (dbg) Run:  kubectl --context addons-294579 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:955: (dbg) Run:  kubectl --context addons-294579 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:959: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:402: (dbg) Run:  kubectl --context addons-294579 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:962: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:352: "test-local-path" [fa17de05-2cc0-45c0-ac5f-ae4e2af8ea99] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "test-local-path" [fa17de05-2cc0-45c0-ac5f-ae4e2af8ea99] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:352: "test-local-path" [fa17de05-2cc0-45c0-ac5f-ae4e2af8ea99] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:962: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 3.002971705s
addons_test.go:967: (dbg) Run:  kubectl --context addons-294579 get pvc test-pvc -o=json
addons_test.go:976: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 ssh "cat /opt/local-path-provisioner/pvc-af5ddb96-f8f1-4029-9edb-8cb4d84b099c_default_test-pvc/file1"
addons_test.go:988: (dbg) Run:  kubectl --context addons-294579 delete pod test-local-path
addons_test.go:992: (dbg) Run:  kubectl --context addons-294579 delete pvc test-pvc
addons_test.go:1053: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 addons disable storage-provisioner-rancher --alsologtostderr -v=1
--- PASS: TestAddons/parallel/LocalPath (9.20s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (5.52s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:1025: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:352: "nvidia-device-plugin-daemonset-v5mmk" [ed85f4e8-a497-4873-bd68-46c7aeac578a] Running
addons_test.go:1025: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 5.003977582s
addons_test.go:1053: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 addons disable nvidia-device-plugin --alsologtostderr -v=1
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (5.52s)

                                                
                                    
x
+
TestAddons/parallel/Yakd (10.69s)

                                                
                                                
=== RUN   TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Yakd
addons_test.go:1047: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:352: "yakd-dashboard-5ff678cb9-xl54r" [b33150e9-ea95-4cd7-83b7-37b82f3a2bcf] Running
addons_test.go:1047: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 5.00387396s
addons_test.go:1053: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 addons disable yakd --alsologtostderr -v=1
addons_test.go:1053: (dbg) Done: out/minikube-linux-amd64 -p addons-294579 addons disable yakd --alsologtostderr -v=1: (5.681539095s)
--- PASS: TestAddons/parallel/Yakd (10.69s)

                                                
                                    
x
+
TestAddons/parallel/AmdGpuDevicePlugin (5.52s)

                                                
                                                
=== RUN   TestAddons/parallel/AmdGpuDevicePlugin
=== PAUSE TestAddons/parallel/AmdGpuDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/AmdGpuDevicePlugin
addons_test.go:1038: (dbg) TestAddons/parallel/AmdGpuDevicePlugin: waiting 6m0s for pods matching "name=amd-gpu-device-plugin" in namespace "kube-system" ...
helpers_test.go:352: "amd-gpu-device-plugin-zl2hz" [82885ec9-ef4a-448f-8993-c59a1da8720e] Running
addons_test.go:1038: (dbg) TestAddons/parallel/AmdGpuDevicePlugin: name=amd-gpu-device-plugin healthy within 5.003681443s
addons_test.go:1053: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 addons disable amd-gpu-device-plugin --alsologtostderr -v=1
--- PASS: TestAddons/parallel/AmdGpuDevicePlugin (5.52s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (16.59s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:172: (dbg) Run:  out/minikube-linux-amd64 stop -p addons-294579
addons_test.go:172: (dbg) Done: out/minikube-linux-amd64 stop -p addons-294579: (16.340153661s)
addons_test.go:176: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p addons-294579
addons_test.go:180: (dbg) Run:  out/minikube-linux-amd64 addons disable dashboard -p addons-294579
addons_test.go:185: (dbg) Run:  out/minikube-linux-amd64 addons disable gvisor -p addons-294579
--- PASS: TestAddons/StoppedEnableDisable (16.59s)

                                                
                                    
x
+
TestCertOptions (28.52s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-amd64 start -p cert-options-982610 --memory=3072 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=crio
cert_options_test.go:49: (dbg) Done: out/minikube-linux-amd64 start -p cert-options-982610 --memory=3072 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=crio: (25.538124088s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-amd64 -p cert-options-982610 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-982610 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-amd64 ssh -p cert-options-982610 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-982610" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p cert-options-982610
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p cert-options-982610: (2.357380485s)
--- PASS: TestCertOptions (28.52s)

                                                
                                    
x
+
TestCertExpiration (219.07s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-amd64 start -p cert-expiration-824668 --memory=3072 --cert-expiration=3m --driver=docker  --container-runtime=crio
cert_options_test.go:123: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-824668 --memory=3072 --cert-expiration=3m --driver=docker  --container-runtime=crio: (27.828679096s)
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-amd64 start -p cert-expiration-824668 --memory=3072 --cert-expiration=8760h --driver=docker  --container-runtime=crio
cert_options_test.go:131: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-824668 --memory=3072 --cert-expiration=8760h --driver=docker  --container-runtime=crio: (8.854684069s)
helpers_test.go:175: Cleaning up "cert-expiration-824668" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p cert-expiration-824668
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p cert-expiration-824668: (2.38601936s)
--- PASS: TestCertExpiration (219.07s)

                                                
                                    
x
+
TestForceSystemdFlag (28.59s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-amd64 start -p force-systemd-flag-459122 --memory=3072 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=crio
docker_test.go:91: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-flag-459122 --memory=3072 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=crio: (25.814846319s)
docker_test.go:132: (dbg) Run:  out/minikube-linux-amd64 -p force-systemd-flag-459122 ssh "cat /etc/crio/crio.conf.d/02-crio.conf"
helpers_test.go:175: Cleaning up "force-systemd-flag-459122" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p force-systemd-flag-459122
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-flag-459122: (2.485115525s)
--- PASS: TestForceSystemdFlag (28.59s)

                                                
                                    
x
+
TestForceSystemdEnv (24.64s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-amd64 start -p force-systemd-env-534554 --memory=3072 --alsologtostderr -v=5 --driver=docker  --container-runtime=crio
docker_test.go:155: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-env-534554 --memory=3072 --alsologtostderr -v=5 --driver=docker  --container-runtime=crio: (22.236950386s)
helpers_test.go:175: Cleaning up "force-systemd-env-534554" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p force-systemd-env-534554
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-env-534554: (2.405905678s)
--- PASS: TestForceSystemdEnv (24.64s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0.64s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
=== PAUSE TestKVMDriverInstallOrUpdate

                                                
                                                

                                                
                                                
=== CONT  TestKVMDriverInstallOrUpdate
I0918 17:43:05.657665   11368 install.go:66] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0918 17:43:05.657832   11368 install.go:138] Validating docker-machine-driver-kvm2, PATH=/tmp/TestKVMDriverInstallOrUpdate1994721475/001:/home/jenkins/workspace/Docker_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0918 17:43:05.687522   11368 install.go:163] /tmp/TestKVMDriverInstallOrUpdate1994721475/001/docker-machine-driver-kvm2 version is 1.1.1
W0918 17:43:05.687577   11368 install.go:76] docker-machine-driver-kvm2: docker-machine-driver-kvm2 is version 1.1.1, want 1.37.0
W0918 17:43:05.687697   11368 out.go:176] [unset outFile]: * Downloading driver docker-machine-driver-kvm2:
I0918 17:43:05.687747   11368 download.go:108] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.37.0/docker-machine-driver-kvm2-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.37.0/docker-machine-driver-kvm2-amd64.sha256 -> /tmp/TestKVMDriverInstallOrUpdate1994721475/001/docker-machine-driver-kvm2
I0918 17:43:06.156416   11368 install.go:138] Validating docker-machine-driver-kvm2, PATH=/tmp/TestKVMDriverInstallOrUpdate1994721475/001:/home/jenkins/workspace/Docker_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin
I0918 17:43:06.172651   11368 install.go:163] /tmp/TestKVMDriverInstallOrUpdate1994721475/001/docker-machine-driver-kvm2 version is 1.37.0
--- PASS: TestKVMDriverInstallOrUpdate (0.64s)

                                                
                                    
x
+
TestErrorSpam/setup (21.19s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-amd64 start -p nospam-285830 -n=1 --memory=3072 --wait=false --log_dir=/tmp/nospam-285830 --driver=docker  --container-runtime=crio
error_spam_test.go:81: (dbg) Done: out/minikube-linux-amd64 start -p nospam-285830 -n=1 --memory=3072 --wait=false --log_dir=/tmp/nospam-285830 --driver=docker  --container-runtime=crio: (21.191033601s)
--- PASS: TestErrorSpam/setup (21.19s)

                                                
                                    
x
+
TestErrorSpam/start (0.63s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:206: Cleaning up 1 logfile(s) ...
error_spam_test.go:149: (dbg) Run:  out/minikube-linux-amd64 -p nospam-285830 --log_dir /tmp/nospam-285830 start --dry-run
error_spam_test.go:149: (dbg) Run:  out/minikube-linux-amd64 -p nospam-285830 --log_dir /tmp/nospam-285830 start --dry-run
error_spam_test.go:172: (dbg) Run:  out/minikube-linux-amd64 -p nospam-285830 --log_dir /tmp/nospam-285830 start --dry-run
--- PASS: TestErrorSpam/start (0.63s)

                                                
                                    
x
+
TestErrorSpam/status (0.91s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:206: Cleaning up 0 logfile(s) ...
error_spam_test.go:149: (dbg) Run:  out/minikube-linux-amd64 -p nospam-285830 --log_dir /tmp/nospam-285830 status
error_spam_test.go:149: (dbg) Run:  out/minikube-linux-amd64 -p nospam-285830 --log_dir /tmp/nospam-285830 status
error_spam_test.go:172: (dbg) Run:  out/minikube-linux-amd64 -p nospam-285830 --log_dir /tmp/nospam-285830 status
--- PASS: TestErrorSpam/status (0.91s)

                                                
                                    
x
+
TestErrorSpam/pause (1.49s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:206: Cleaning up 0 logfile(s) ...
error_spam_test.go:149: (dbg) Run:  out/minikube-linux-amd64 -p nospam-285830 --log_dir /tmp/nospam-285830 pause
error_spam_test.go:149: (dbg) Run:  out/minikube-linux-amd64 -p nospam-285830 --log_dir /tmp/nospam-285830 pause
error_spam_test.go:172: (dbg) Run:  out/minikube-linux-amd64 -p nospam-285830 --log_dir /tmp/nospam-285830 pause
--- PASS: TestErrorSpam/pause (1.49s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.5s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:206: Cleaning up 0 logfile(s) ...
error_spam_test.go:149: (dbg) Run:  out/minikube-linux-amd64 -p nospam-285830 --log_dir /tmp/nospam-285830 unpause
error_spam_test.go:149: (dbg) Run:  out/minikube-linux-amd64 -p nospam-285830 --log_dir /tmp/nospam-285830 unpause
error_spam_test.go:172: (dbg) Run:  out/minikube-linux-amd64 -p nospam-285830 --log_dir /tmp/nospam-285830 unpause
--- PASS: TestErrorSpam/unpause (1.50s)

                                                
                                    
x
+
TestErrorSpam/stop (2.58s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:206: Cleaning up 0 logfile(s) ...
error_spam_test.go:149: (dbg) Run:  out/minikube-linux-amd64 -p nospam-285830 --log_dir /tmp/nospam-285830 stop
error_spam_test.go:149: (dbg) Done: out/minikube-linux-amd64 -p nospam-285830 --log_dir /tmp/nospam-285830 stop: (2.395060019s)
error_spam_test.go:149: (dbg) Run:  out/minikube-linux-amd64 -p nospam-285830 --log_dir /tmp/nospam-285830 stop
error_spam_test.go:172: (dbg) Run:  out/minikube-linux-amd64 -p nospam-285830 --log_dir /tmp/nospam-285830 stop
--- PASS: TestErrorSpam/stop (2.58s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1860: local sync path: /home/jenkins/minikube-integration/20370-7845/.minikube/files/etc/test/nested/copy/11368/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (38.82s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2239: (dbg) Run:  out/minikube-linux-amd64 start -p functional-366930 --memory=4096 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=crio
functional_test.go:2239: (dbg) Done: out/minikube-linux-amd64 start -p functional-366930 --memory=4096 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=crio: (38.817161311s)
--- PASS: TestFunctional/serial/StartWithProxy (38.82s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (6.58s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
I0918 16:45:30.337592   11368 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
functional_test.go:674: (dbg) Run:  out/minikube-linux-amd64 start -p functional-366930 --alsologtostderr -v=8
functional_test.go:674: (dbg) Done: out/minikube-linux-amd64 start -p functional-366930 --alsologtostderr -v=8: (6.578590382s)
functional_test.go:678: soft start took 6.579463901s for "functional-366930" cluster.
I0918 16:45:36.916623   11368 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
--- PASS: TestFunctional/serial/SoftStart (6.58s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.04s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:696: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.04s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.08s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:711: (dbg) Run:  kubectl --context functional-366930 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.08s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (3.05s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1064: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 cache add registry.k8s.io/pause:3.1
functional_test.go:1064: (dbg) Done: out/minikube-linux-amd64 -p functional-366930 cache add registry.k8s.io/pause:3.1: (1.069912457s)
functional_test.go:1064: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 cache add registry.k8s.io/pause:3.3
functional_test.go:1064: (dbg) Done: out/minikube-linux-amd64 -p functional-366930 cache add registry.k8s.io/pause:3.3: (1.000786398s)
functional_test.go:1064: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 cache add registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (3.05s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.02s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1092: (dbg) Run:  docker build -t minikube-local-cache-test:functional-366930 /tmp/TestFunctionalserialCacheCmdcacheadd_local3409659823/001
functional_test.go:1104: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 cache add minikube-local-cache-test:functional-366930
functional_test.go:1109: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 cache delete minikube-local-cache-test:functional-366930
functional_test.go:1098: (dbg) Run:  docker rmi minikube-local-cache-test:functional-366930
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.02s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1117: (dbg) Run:  out/minikube-linux-amd64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.05s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.05s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1125: (dbg) Run:  out/minikube-linux-amd64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.05s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.3s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1139: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.30s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (1.75s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1162: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh sudo crictl rmi registry.k8s.io/pause:latest
functional_test.go:1168: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1168: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-366930 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (281.935619ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1173: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 cache reload
functional_test.go:1178: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (1.75s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.1s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1187: (dbg) Run:  out/minikube-linux-amd64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1187: (dbg) Run:  out/minikube-linux-amd64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.10s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:731: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 kubectl -- --context functional-366930 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.11s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.1s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:756: (dbg) Run:  out/kubectl --context functional-366930 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.10s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (41.03s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:772: (dbg) Run:  out/minikube-linux-amd64 start -p functional-366930 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
E0918 16:45:45.076712   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 16:45:45.083144   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 16:45:45.094594   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 16:45:45.116026   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 16:45:45.157451   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 16:45:45.238884   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 16:45:45.400422   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 16:45:45.722101   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 16:45:46.363941   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 16:45:47.645757   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 16:45:50.208686   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 16:45:55.330156   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 16:46:05.571728   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
functional_test.go:772: (dbg) Done: out/minikube-linux-amd64 start -p functional-366930 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (41.029384341s)
functional_test.go:776: restart took 41.029553364s for "functional-366930" cluster.
I0918 16:46:24.590856   11368 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
--- PASS: TestFunctional/serial/ExtraConfig (41.03s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:825: (dbg) Run:  kubectl --context functional-366930 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:840: etcd phase: Running
functional_test.go:850: etcd status: Ready
functional_test.go:840: kube-apiserver phase: Running
functional_test.go:850: kube-apiserver status: Ready
functional_test.go:840: kube-controller-manager phase: Running
functional_test.go:850: kube-controller-manager status: Ready
functional_test.go:840: kube-scheduler phase: Running
functional_test.go:850: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.07s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.41s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1251: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 logs
E0918 16:46:26.053008   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
functional_test.go:1251: (dbg) Done: out/minikube-linux-amd64 -p functional-366930 logs: (1.411039106s)
--- PASS: TestFunctional/serial/LogsCmd (1.41s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.43s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1265: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 logs --file /tmp/TestFunctionalserialLogsFileCmd2115709884/001/logs.txt
functional_test.go:1265: (dbg) Done: out/minikube-linux-amd64 -p functional-366930 logs --file /tmp/TestFunctionalserialLogsFileCmd2115709884/001/logs.txt: (1.433122692s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.43s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (4.53s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2326: (dbg) Run:  kubectl --context functional-366930 apply -f testdata/invalidsvc.yaml
functional_test.go:2340: (dbg) Run:  out/minikube-linux-amd64 service invalid-svc -p functional-366930
functional_test.go:2340: (dbg) Non-zero exit: out/minikube-linux-amd64 service invalid-svc -p functional-366930: exit status 115 (329.092078ms)

                                                
                                                
-- stdout --
	┌───────────┬─────────────┬─────────────┬───────────────────────────┐
	│ NAMESPACE │    NAME     │ TARGET PORT │            URL            │
	├───────────┼─────────────┼─────────────┼───────────────────────────┤
	│ default   │ invalid-svc │ 80          │ http://192.168.49.2:32548 │
	└───────────┴─────────────┴─────────────┴───────────────────────────┘
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2332: (dbg) Run:  kubectl --context functional-366930 delete -f testdata/invalidsvc.yaml
functional_test.go:2332: (dbg) Done: kubectl --context functional-366930 delete -f testdata/invalidsvc.yaml: (1.017858854s)
--- PASS: TestFunctional/serial/InvalidService (4.53s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.35s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1214: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 config unset cpus
functional_test.go:1214: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 config get cpus
functional_test.go:1214: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-366930 config get cpus: exit status 14 (73.117268ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1214: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 config set cpus 2
functional_test.go:1214: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 config get cpus
functional_test.go:1214: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 config unset cpus
functional_test.go:1214: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 config get cpus
functional_test.go:1214: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-366930 config get cpus: exit status 14 (53.641429ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.35s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (7.94s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:920: (dbg) daemon: [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-366930 --alsologtostderr -v=1]
functional_test.go:925: (dbg) stopping [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-366930 --alsologtostderr -v=1] ...
helpers_test.go:525: unable to kill pid 51011: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (7.94s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:989: (dbg) Run:  out/minikube-linux-amd64 start -p functional-366930 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=crio
functional_test.go:989: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-366930 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=crio: exit status 23 (161.890194ms)

                                                
                                                
-- stdout --
	* [functional-366930] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=20370
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 16:46:33.885245   48260 out.go:360] Setting OutFile to fd 1 ...
	I0918 16:46:33.885476   48260 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:46:33.885484   48260 out.go:374] Setting ErrFile to fd 2...
	I0918 16:46:33.885488   48260 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:46:33.885742   48260 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 16:46:33.886190   48260 out.go:368] Setting JSON to false
	I0918 16:46:33.887316   48260 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":1745,"bootTime":1758212249,"procs":217,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 16:46:33.887413   48260 start.go:140] virtualization: kvm guest
	I0918 16:46:33.889787   48260 out.go:179] * [functional-366930] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 16:46:33.891462   48260 notify.go:220] Checking for updates...
	I0918 16:46:33.891521   48260 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 16:46:33.892927   48260 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 16:46:33.894542   48260 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 16:46:33.895847   48260 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 16:46:33.897254   48260 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 16:46:33.898540   48260 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 16:46:33.900313   48260 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:46:33.901045   48260 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 16:46:33.927016   48260 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 16:46:33.927107   48260 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:46:33.989605   48260 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:37 OomKillDisable:false NGoroutines:56 SystemTime:2025-09-18 16:46:33.979003508 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:46:33.989744   48260 docker.go:318] overlay module found
	I0918 16:46:33.991546   48260 out.go:179] * Using the docker driver based on existing profile
	I0918 16:46:33.992858   48260 start.go:304] selected driver: docker
	I0918 16:46:33.992879   48260 start.go:924] validating driver "docker" against &{Name:functional-366930 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:functional-366930 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p Mou
ntUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:46:33.992962   48260 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 16:46:33.994640   48260 out.go:203] 
	W0918 16:46:33.995816   48260 out.go:285] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0918 16:46:33.997566   48260 out.go:203] 

                                                
                                                
** /stderr **
functional_test.go:1006: (dbg) Run:  out/minikube-linux-amd64 start -p functional-366930 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
--- PASS: TestFunctional/parallel/DryRun (0.39s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1035: (dbg) Run:  out/minikube-linux-amd64 start -p functional-366930 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=crio
functional_test.go:1035: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-366930 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=crio: exit status 23 (176.333011ms)

                                                
                                                
-- stdout --
	* [functional-366930] minikube v1.37.0 sur Ubuntu 22.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=20370
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 16:46:34.009460   48349 out.go:360] Setting OutFile to fd 1 ...
	I0918 16:46:34.009709   48349 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:46:34.009720   48349 out.go:374] Setting ErrFile to fd 2...
	I0918 16:46:34.009725   48349 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 16:46:34.010043   48349 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 16:46:34.010475   48349 out.go:368] Setting JSON to false
	I0918 16:46:34.011383   48349 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":1745,"bootTime":1758212249,"procs":215,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 16:46:34.011477   48349 start.go:140] virtualization: kvm guest
	I0918 16:46:34.013609   48349 out.go:179] * [functional-366930] minikube v1.37.0 sur Ubuntu 22.04 (kvm/amd64)
	I0918 16:46:34.015307   48349 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 16:46:34.015304   48349 notify.go:220] Checking for updates...
	I0918 16:46:34.018136   48349 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 16:46:34.019577   48349 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 16:46:34.024182   48349 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 16:46:34.025687   48349 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 16:46:34.026979   48349 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 16:46:34.028779   48349 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 16:46:34.029373   48349 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 16:46:34.055400   48349 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 16:46:34.055594   48349 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 16:46:34.118215   48349 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:37 OomKillDisable:false NGoroutines:56 SystemTime:2025-09-18 16:46:34.106642739 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 16:46:34.118381   48349 docker.go:318] overlay module found
	I0918 16:46:34.123697   48349 out.go:179] * Utilisation du pilote docker basé sur le profil existant
	I0918 16:46:34.125633   48349 start.go:304] selected driver: docker
	I0918 16:46:34.125653   48349 start.go:924] validating driver "docker" against &{Name:functional-366930 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.48@sha256:7171c97a51623558720f8e5878e4f4637da093e2f2ed589997bedc6c1549b2b1 Memory:4096 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.34.0 ClusterName:functional-366930 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerN
ames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.34.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s MountString: Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p Mou
ntUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false DisableCoreDNSLog:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0918 16:46:34.125852   48349 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 16:46:34.127830   48349 out.go:203] 
	W0918 16:46:34.129523   48349 out.go:285] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0918 16:46:34.131075   48349 out.go:203] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (1.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:869: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 status
functional_test.go:875: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:887: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (1.05s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1695: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 addons list
functional_test.go:1707: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (25.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:50: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:352: "storage-provisioner" [209ea155-52fd-4a0f-aa19-3a5cdfb9ad2f] Running
functional_test_pvc_test.go:50: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 6.003569647s
functional_test_pvc_test.go:55: (dbg) Run:  kubectl --context functional-366930 get storageclass -o=json
functional_test_pvc_test.go:75: (dbg) Run:  kubectl --context functional-366930 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:82: (dbg) Run:  kubectl --context functional-366930 get pvc myclaim -o=json
functional_test_pvc_test.go:131: (dbg) Run:  kubectl --context functional-366930 apply -f testdata/storage-provisioner/pod.yaml
I0918 16:46:40.493168   11368 detect.go:223] nested VM detected
functional_test_pvc_test.go:140: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 6m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:352: "sp-pod" [6734172f-64a2-4a45-90fe-f2718900469b] Pending
helpers_test.go:352: "sp-pod" [6734172f-64a2-4a45-90fe-f2718900469b] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:352: "sp-pod" [6734172f-64a2-4a45-90fe-f2718900469b] Running
functional_test_pvc_test.go:140: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 11.003337973s
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-366930 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:112: (dbg) Run:  kubectl --context functional-366930 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:131: (dbg) Run:  kubectl --context functional-366930 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:140: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 6m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:352: "sp-pod" [1dd7a73f-ebaa-4883-9016-0ed80403dca7] Pending
helpers_test.go:352: "sp-pod" [1dd7a73f-ebaa-4883-9016-0ed80403dca7] Running
functional_test_pvc_test.go:140: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 7.003114439s
functional_test_pvc_test.go:120: (dbg) Run:  kubectl --context functional-366930 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (25.22s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.61s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1730: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "echo hello"
functional_test.go:1747: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.61s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (1.81s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh -n functional-366930 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 cp functional-366930:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd204858507/001/cp-test.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh -n functional-366930 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh -n functional-366930 "sudo cat /tmp/does/not/exist/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.81s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (16.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1798: (dbg) Run:  kubectl --context functional-366930 replace --force -f testdata/mysql.yaml
functional_test.go:1804: (dbg) TestFunctional/parallel/MySQL: waiting 10m0s for pods matching "app=mysql" in namespace "default" ...
helpers_test.go:352: "mysql-5bb876957f-drvbw" [b412b7d4-f3bc-4f67-87b1-55f91d44f269] Pending / Ready:ContainersNotReady (containers with unready status: [mysql]) / ContainersReady:ContainersNotReady (containers with unready status: [mysql])
helpers_test.go:352: "mysql-5bb876957f-drvbw" [b412b7d4-f3bc-4f67-87b1-55f91d44f269] Running
functional_test.go:1804: (dbg) TestFunctional/parallel/MySQL: app=mysql healthy within 14.003578746s
functional_test.go:1812: (dbg) Run:  kubectl --context functional-366930 exec mysql-5bb876957f-drvbw -- mysql -ppassword -e "show databases;"
functional_test.go:1812: (dbg) Non-zero exit: kubectl --context functional-366930 exec mysql-5bb876957f-drvbw -- mysql -ppassword -e "show databases;": exit status 1 (116.26552ms)

                                                
                                                
** stderr ** 
	mysql: [Warning] Using a password on the command line interface can be insecure.
	ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
	command terminated with exit code 1

                                                
                                                
** /stderr **
I0918 16:47:10.281645   11368 retry.go:31] will retry after 586.466879ms: exit status 1
functional_test.go:1812: (dbg) Run:  kubectl --context functional-366930 exec mysql-5bb876957f-drvbw -- mysql -ppassword -e "show databases;"
functional_test.go:1812: (dbg) Non-zero exit: kubectl --context functional-366930 exec mysql-5bb876957f-drvbw -- mysql -ppassword -e "show databases;": exit status 1 (110.705933ms)

                                                
                                                
** stderr ** 
	mysql: [Warning] Using a password on the command line interface can be insecure.
	ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
	command terminated with exit code 1

                                                
                                                
** /stderr **
I0918 16:47:10.979455   11368 retry.go:31] will retry after 1.144773136s: exit status 1
functional_test.go:1812: (dbg) Run:  kubectl --context functional-366930 exec mysql-5bb876957f-drvbw -- mysql -ppassword -e "show databases;"
E0918 16:48:28.937226   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 16:50:45.076454   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 16:51:12.778985   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 16:55:45.076470   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
--- PASS: TestFunctional/parallel/MySQL (16.24s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1934: Checking for existence of /etc/test/nested/copy/11368/hosts within VM
functional_test.go:1936: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "sudo cat /etc/test/nested/copy/11368/hosts"
functional_test.go:1941: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (1.6s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1977: Checking for existence of /etc/ssl/certs/11368.pem within VM
functional_test.go:1978: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "sudo cat /etc/ssl/certs/11368.pem"
functional_test.go:1977: Checking for existence of /usr/share/ca-certificates/11368.pem within VM
functional_test.go:1978: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "sudo cat /usr/share/ca-certificates/11368.pem"
functional_test.go:1977: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1978: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:2004: Checking for existence of /etc/ssl/certs/113682.pem within VM
functional_test.go:2005: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "sudo cat /etc/ssl/certs/113682.pem"
functional_test.go:2004: Checking for existence of /usr/share/ca-certificates/113682.pem within VM
functional_test.go:2005: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "sudo cat /usr/share/ca-certificates/113682.pem"
functional_test.go:2004: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:2005: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (1.60s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:234: (dbg) Run:  kubectl --context functional-366930 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.54s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2032: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "sudo systemctl is-active docker"
functional_test.go:2032: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-366930 ssh "sudo systemctl is-active docker": exit status 1 (274.881403ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
functional_test.go:2032: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "sudo systemctl is-active containerd"
functional_test.go:2032: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-366930 ssh "sudo systemctl is-active containerd": exit status 1 (267.732364ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.54s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2293: (dbg) Run:  out/minikube-linux-amd64 license
--- PASS: TestFunctional/parallel/License (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1285: (dbg) Run:  out/minikube-linux-amd64 profile lis
functional_test.go:1290: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.45s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.43s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1325: (dbg) Run:  out/minikube-linux-amd64 profile list
functional_test.go:1330: Took "369.442012ms" to run "out/minikube-linux-amd64 profile list"
functional_test.go:1339: (dbg) Run:  out/minikube-linux-amd64 profile list -l
functional_test.go:1344: Took "56.640477ms" to run "out/minikube-linux-amd64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.43s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (8.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-366930 /tmp/TestFunctionalparallelMountCmdany-port1909979238/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1758213993431277302" to /tmp/TestFunctionalparallelMountCmdany-port1909979238/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1758213993431277302" to /tmp/TestFunctionalparallelMountCmdany-port1909979238/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1758213993431277302" to /tmp/TestFunctionalparallelMountCmdany-port1909979238/001/test-1758213993431277302
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-366930 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (304.883386ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
I0918 16:46:33.736553   11368 retry.go:31] will retry after 427.285016ms: exit status 1
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Sep 18 16:46 created-by-test
-rw-r--r-- 1 docker docker 24 Sep 18 16:46 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Sep 18 16:46 test-1758213993431277302
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh cat /mount-9p/test-1758213993431277302
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-366930 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:352: "busybox-mount" [28b09871-225a-46b0-8fa6-ede283977be4] Pending
helpers_test.go:352: "busybox-mount" [28b09871-225a-46b0-8fa6-ede283977be4] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:352: "busybox-mount" [28b09871-225a-46b0-8fa6-ede283977be4] Pending / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:352: "busybox-mount" [28b09871-225a-46b0-8fa6-ede283977be4] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 6.003808626s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-366930 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-366930 /tmp/TestFunctionalparallelMountCmdany-port1909979238/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (8.70s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.44s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1376: (dbg) Run:  out/minikube-linux-amd64 profile list -o json
functional_test.go:1381: Took "374.947665ms" to run "out/minikube-linux-amd64 profile list -o json"
functional_test.go:1389: (dbg) Run:  out/minikube-linux-amd64 profile list -o json --light
functional_test.go:1394: Took "61.862652ms" to run "out/minikube-linux-amd64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.44s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.4s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-amd64 -p functional-366930 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-amd64 -p functional-366930 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-amd64 -p functional-366930 tunnel --alsologtostderr] ...
helpers_test.go:525: unable to kill pid 48863: os: process already finished
helpers_test.go:519: unable to terminate pid 48598: os: process already finished
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-amd64 -p functional-366930 tunnel --alsologtostderr] ...
helpers_test.go:507: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.40s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-amd64 -p functional-366930 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-366930 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:352: "nginx-svc" [f947991a-438e-4a4e-bb42-85876557de6a] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:352: "nginx-svc" [f947991a-438e-4a4e-bb42-85876557de6a] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 8.003659123s
I0918 16:46:42.850820   11368 kapi.go:150] Service nginx-svc in namespace default found.
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (8.22s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (2.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-366930 /tmp/TestFunctionalparallelMountCmdspecific-port2862320406/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-366930 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (291.110199ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
I0918 16:46:42.418194   11368 retry.go:31] will retry after 669.681863ms: exit status 1
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-366930 /tmp/TestFunctionalparallelMountCmdspecific-port2862320406/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-366930 ssh "sudo umount -f /mount-9p": exit status 1 (287.936089ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-amd64 -p functional-366930 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-366930 /tmp/TestFunctionalparallelMountCmdspecific-port2862320406/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (2.07s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-366930 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.96.3.94 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-amd64 -p functional-366930 tunnel --alsologtostderr] ...
functional_test_tunnel_test.go:437: failed to stop process: signal: terminated
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (1.74s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-366930 /tmp/TestFunctionalparallelMountCmdVerifyCleanup1686017765/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-366930 /tmp/TestFunctionalparallelMountCmdVerifyCleanup1686017765/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-366930 /tmp/TestFunctionalparallelMountCmdVerifyCleanup1686017765/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-366930 ssh "findmnt -T" /mount1: exit status 1 (400.288314ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
I0918 16:46:44.596366   11368 retry.go:31] will retry after 472.063085ms: exit status 1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-amd64 mount -p functional-366930 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-366930 /tmp/TestFunctionalparallelMountCmdVerifyCleanup1686017765/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:507: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-366930 /tmp/TestFunctionalparallelMountCmdVerifyCleanup1686017765/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:507: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-366930 /tmp/TestFunctionalparallelMountCmdVerifyCleanup1686017765/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:507: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (1.74s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2261: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 version --short
--- PASS: TestFunctional/parallel/Version/short (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.54s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2275: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 version -o=json --components
--- PASS: TestFunctional/parallel/Version/components (0.54s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:276: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image ls --format short --alsologtostderr
functional_test.go:281: (dbg) Stdout: out/minikube-linux-amd64 -p functional-366930 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.10.1
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.34.0
registry.k8s.io/kube-proxy:v1.34.0
registry.k8s.io/kube-controller-manager:v1.34.0
registry.k8s.io/kube-apiserver:v1.34.0
registry.k8s.io/etcd:3.6.4-0
registry.k8s.io/coredns/coredns:v1.12.1
localhost/minikube-local-cache-test:functional-366930
localhost/kicbase/echo-server:functional-366930
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/kindest/kindnetd:v20250512-df8de77b
functional_test.go:284: (dbg) Stderr: out/minikube-linux-amd64 -p functional-366930 image ls --format short --alsologtostderr:
I0918 16:47:00.008844   54121 out.go:360] Setting OutFile to fd 1 ...
I0918 16:47:00.009158   54121 out.go:408] TERM=,COLORTERM=, which probably does not support color
I0918 16:47:00.009171   54121 out.go:374] Setting ErrFile to fd 2...
I0918 16:47:00.009179   54121 out.go:408] TERM=,COLORTERM=, which probably does not support color
I0918 16:47:00.009546   54121 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
I0918 16:47:00.010379   54121 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
I0918 16:47:00.010532   54121 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
I0918 16:47:00.011082   54121 cli_runner.go:164] Run: docker container inspect functional-366930 --format={{.State.Status}}
I0918 16:47:00.033269   54121 ssh_runner.go:195] Run: systemctl --version
I0918 16:47:00.033332   54121 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-366930
I0918 16:47:00.054846   54121 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32778 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/functional-366930/id_rsa Username:docker}
I0918 16:47:00.153029   54121 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:276: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image ls --format table --alsologtostderr
functional_test.go:281: (dbg) Stdout: out/minikube-linux-amd64 -p functional-366930 image ls --format table --alsologtostderr:
┌─────────────────────────────────────────┬────────────────────┬───────────────┬────────┐
│                  IMAGE                  │        TAG         │   IMAGE ID    │  SIZE  │
├─────────────────────────────────────────┼────────────────────┼───────────────┼────────┤
│ docker.io/library/nginx                 │ alpine             │ 4a86014ec6994 │ 53.9MB │
│ docker.io/library/nginx                 │ latest             │ 41f689c209100 │ 197MB  │
│ gcr.io/k8s-minikube/storage-provisioner │ v5                 │ 6e38f40d628db │ 31.5MB │
│ localhost/minikube-local-cache-test     │ functional-366930  │ d2d84b605df60 │ 3.33kB │
│ registry.k8s.io/etcd                    │ 3.6.4-0            │ 5f1f5298c888d │ 196MB  │
│ registry.k8s.io/kube-scheduler          │ v1.34.0            │ 46169d968e920 │ 53.8MB │
│ registry.k8s.io/pause                   │ 3.10.1             │ cd073f4c5f6a8 │ 742kB  │
│ registry.k8s.io/coredns/coredns         │ v1.12.1            │ 52546a367cc9e │ 76.1MB │
│ docker.io/kindest/kindnetd              │ v20250512-df8de77b │ 409467f978b4a │ 109MB  │
│ gcr.io/k8s-minikube/busybox             │ 1.28.4-glibc       │ 56cc512116c8f │ 4.63MB │
│ gcr.io/k8s-minikube/busybox             │ latest             │ beae173ccac6a │ 1.46MB │
│ registry.k8s.io/kube-controller-manager │ v1.34.0            │ a0af72f2ec6d6 │ 76MB   │
│ registry.k8s.io/kube-proxy              │ v1.34.0            │ df0860106674d │ 73.1MB │
│ registry.k8s.io/pause                   │ 3.3                │ 0184c1613d929 │ 686kB  │
│ registry.k8s.io/pause                   │ latest             │ 350b164e7ae1d │ 247kB  │
│ docker.io/library/mysql                 │ 5.7                │ 5107333e08a87 │ 520MB  │
│ localhost/kicbase/echo-server           │ functional-366930  │ 9056ab77afb8e │ 4.94MB │
│ localhost/my-image                      │ functional-366930  │ d51e4d8a2531f │ 1.47MB │
│ registry.k8s.io/kube-apiserver          │ v1.34.0            │ 90550c43ad2bc │ 89.1MB │
│ registry.k8s.io/pause                   │ 3.1                │ da86e6ba6ca19 │ 747kB  │
└─────────────────────────────────────────┴────────────────────┴───────────────┴────────┘
functional_test.go:284: (dbg) Stderr: out/minikube-linux-amd64 -p functional-366930 image ls --format table --alsologtostderr:
I0918 16:47:05.220424   54965 out.go:360] Setting OutFile to fd 1 ...
I0918 16:47:05.220686   54965 out.go:408] TERM=,COLORTERM=, which probably does not support color
I0918 16:47:05.220696   54965 out.go:374] Setting ErrFile to fd 2...
I0918 16:47:05.220701   54965 out.go:408] TERM=,COLORTERM=, which probably does not support color
I0918 16:47:05.220922   54965 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
I0918 16:47:05.221520   54965 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
I0918 16:47:05.221634   54965 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
I0918 16:47:05.222048   54965 cli_runner.go:164] Run: docker container inspect functional-366930 --format={{.State.Status}}
I0918 16:47:05.241476   54965 ssh_runner.go:195] Run: systemctl --version
I0918 16:47:05.241545   54965 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-366930
I0918 16:47:05.261664   54965 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32778 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/functional-366930/id_rsa Username:docker}
I0918 16:47:05.354539   54965 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:276: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image ls --format json --alsologtostderr
functional_test.go:281: (dbg) Stdout: out/minikube-linux-amd64 -p functional-366930 image ls --format json --alsologtostderr:
[{"id":"56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e","gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998"],"repoTags":["gcr.io/k8s-minikube/busybox:1.28.4-glibc"],"size":"4631262"},{"id":"6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562","repoDigests":["gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944","gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f"],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"31470524"},{"id":"9056ab77afb8e18e04303f11000a9d31b3f16b74c59475b899ae1b342d328d30","repoDigests":["localhost/kicbase/echo-server@sha256:d3d0b737c6413dcf7b9393d61285525048f2d10a0aae68296150078d379c30cf"],"repoTags":["localhost/kicbase/echo-server:functional-366930"
],"size":"4943877"},{"id":"90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90","repoDigests":["registry.k8s.io/kube-apiserver@sha256:495d3253a47a9a64a62041d518678c8b101fb628488e729d9f52ddff7cf82a86","registry.k8s.io/kube-apiserver@sha256:fe86fe2f64021df8efa1a939a290bc21c8c128c66fc00ebbb6b5dea4c7a06812"],"repoTags":["registry.k8s.io/kube-apiserver:v1.34.0"],"size":"89050097"},{"id":"a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634","repoDigests":["registry.k8s.io/kube-controller-manager@sha256:82ea603ed3cce63f9f870f22299741e0011318391cf722dd924a1d5a9f8ce6f6","registry.k8s.io/kube-controller-manager@sha256:f8ba6c082136e2c85ce71628c59c6574ca4b67f162911cb200c0a51a5b9bff81"],"repoTags":["registry.k8s.io/kube-controller-manager:v1.34.0"],"size":"76004183"},{"id":"07655ddf2eebe5d250f7a72c25f638b27126805d61779741b4e62e69ba080558","repoDigests":["docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93","docker.io/kubernetesui/dashboard@sha2
56:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029"],"repoTags":[],"size":"249229937"},{"id":"df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce","repoDigests":["registry.k8s.io/kube-proxy@sha256:364da8a25c742d7a35e9635cb8cf42c1faf5b367760d0f9f9a75bdd1f9d52067","registry.k8s.io/kube-proxy@sha256:5f71731a5eadcf74f3997dfc159bf5ca36e48c3387c19082fc21871e0dbb19af"],"repoTags":["registry.k8s.io/kube-proxy:v1.34.0"],"size":"73138071"},{"id":"cd073f4c5f6a8e9dc6f3125ba00cf60819cae95c1ec84a1f146ee4a9cf9e803f","repoDigests":["registry.k8s.io/pause@sha256:278fb9dbcca9518083ad1e11276933a2e96f23de604a3a08cc3c80002767d24c","registry.k8s.io/pause@sha256:e5b941ef8f71de54dc3a13398226c269ba217d06650a21bd3afcf9d890cf1f41"],"repoTags":["registry.k8s.io/pause:3.10.1"],"size":"742092"},{"id":"115053965e86b2df4d78af78d7951b8644839d20a03820c6df59a261103315f7","repoDigests":["docker.io/kubernetesui/metrics-scraper@sha256:43227e8286fd379ee0415a5e2156a9439c4056807e3caa38e1dd413b0644807a","docker.io/kubern
etesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"],"repoTags":[],"size":"43824855"},{"id":"5107333e08a87b836d48ff7528b1e84b9c86781cc9f1748bbc1b8c42a870d933","repoDigests":["docker.io/library/mysql@sha256:4bc6bc963e6d8443453676cae56536f4b8156d78bae03c0145cbe47c2aad73bb","docker.io/library/mysql@sha256:dab0a802b44617303694fb17d166501de279c3031ddeb28c56ecf7fcab5ef0da"],"repoTags":["docker.io/library/mysql:5.7"],"size":"519571821"},{"id":"52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969","repoDigests":["registry.k8s.io/coredns/coredns@sha256:4f7a57135719628cf2070c5e3cbde64b013e90d4c560c5ecbf14004181f91998","registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c"],"repoTags":["registry.k8s.io/coredns/coredns:v1.12.1"],"size":"76103547"},{"id":"5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115","repoDigests":["registry.k8s.io/etcd@sha256:71170330936954286be203a7737459f2838dd71cc79f8ffaac9154
8a9e079b8f","registry.k8s.io/etcd@sha256:e36c081683425b5b3bc1425bc508b37e7107bb65dfa9367bf5a80125d431fa19"],"repoTags":["registry.k8s.io/etcd:3.6.4-0"],"size":"195976448"},{"id":"da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e","repoDigests":["registry.k8s.io/pause@sha256:84805ddcaaae94434d8eacb7e843f549ec1da0cd277787b97ad9d9ac2cea929e"],"repoTags":["registry.k8s.io/pause:3.1"],"size":"746911"},{"id":"0184c1613d92931126feb4c548e5da11015513b9e4c104e7305ee8b53b50a9da","repoDigests":["registry.k8s.io/pause@sha256:1000de19145c53d83aab989956fa8fca08dcbcc5b0208bdc193517905e6ccd04"],"repoTags":["registry.k8s.io/pause:3.3"],"size":"686139"},{"id":"409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c","repoDigests":["docker.io/kindest/kindnetd@sha256:07a4b3fe0077a0ae606cc0a200fc25a28fa64dcc30b8d311b461089969449f9a","docker.io/kindest/kindnetd@sha256:7a9c9fa59dd517cdc2c82eef1e51392524dd285e9cf7cb5a851c49f294d6cd11"],"repoTags":["docker.io/kindest/kindnetd:v20250512-df8de77b"],"size":"109379
124"},{"id":"ebeecf9e9cfc4e642a2e15f9d0b2d4634f93336cfc6cca28a05ac53a572f6068","repoDigests":["docker.io/library/5a1630b7c8a928d1e061e040ae6b5c5defb80a6a541577cfed558e81685d33ef-tmp@sha256:836979d46074efa68bee5b8d6af94b6673b979fc2a3fc028f1e3990bec3de5ba"],"repoTags":[],"size":"1465612"},{"id":"beae173ccac6ad749f76713cf4440fe3d21d1043fe616dfbe30775815d1d0f6a","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:62ffc2ed7554e4c6d360bce40bbcf196573dd27c4ce080641a2c59867e732dee","gcr.io/k8s-minikube/busybox@sha256:ca5ae90100d50772da31f3b5016209e25ad61972404e2ccd83d44f10dee7e79b"],"repoTags":["gcr.io/k8s-minikube/busybox:latest"],"size":"1462480"},{"id":"d2d84b605df60aa9de7514912ee3beaa16c70c48adfd8118d1b1ded7943de9aa","repoDigests":["localhost/minikube-local-cache-test@sha256:34f628f68d2f576f0d55fa3aa53a8e4b1433942c65e82613ed28f7169cbe4a93"],"repoTags":["localhost/minikube-local-cache-test:functional-366930"],"size":"3330"},{"id":"d51e4d8a2531f6568924042cedb4835b8c9ce303a5b9b7c09032854155a74af1","repoDigests":["loc
alhost/my-image@sha256:0e7d1debc40eeb9707f6fc0608cb4143416e225f0fc2a2e607ad1783019dccda"],"repoTags":["localhost/my-image:functional-366930"],"size":"1468194"},{"id":"46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc","repoDigests":["registry.k8s.io/kube-scheduler@sha256:31b77e40d737b6d3e3b19b4afd681c9362aef06353075895452fc9a41fe34140","registry.k8s.io/kube-scheduler@sha256:8fbe6d18415c8af9b31e177f6e444985f3a87349e083fe6eadd36753dddb17ff"],"repoTags":["registry.k8s.io/kube-scheduler:v1.34.0"],"size":"53844823"},{"id":"350b164e7ae1dcddeffadd65c76226c9b6dc5553f5179153fb0e36b78f2a5e06","repoDigests":["registry.k8s.io/pause@sha256:5bcb06ed43da4a16c6e6e33898eb0506e940bd66822659ecf0a898bbb0da7cb9"],"repoTags":["registry.k8s.io/pause:latest"],"size":"247077"},{"id":"4a86014ec6994761b7f3118cf47e4b4fd6bac15fc6fa262c4f356386bbc0e9d9","repoDigests":["docker.io/library/nginx@sha256:42a516af16b852e33b7682d5ef8acbd5d13fe08fecadc7ed98605ba5e3b26ab8","docker.io/library/nginx@sha256:60e48a050b6408d0c5dd59b98b6e
36bf0937a0bbe99304e3e9c0e63b7563443a"],"repoTags":["docker.io/library/nginx:alpine"],"size":"53949946"},{"id":"41f689c209100e6cadf3ce7fdd02035e90dbd1d586716bf8fc6ea55c365b2d81","repoDigests":["docker.io/library/nginx@sha256:27637a97e3d1d0518adc2a877b60db3779970f19474b6e586ddcbc2d5500e285","docker.io/library/nginx@sha256:d5f28ef21aabddd098f3dbc21fe5b7a7d7a184720bc07da0b6c9b9820e97f25e"],"repoTags":["docker.io/library/nginx:latest"],"size":"196550530"}]
functional_test.go:284: (dbg) Stderr: out/minikube-linux-amd64 -p functional-366930 image ls --format json --alsologtostderr:
I0918 16:47:04.997494   54913 out.go:360] Setting OutFile to fd 1 ...
I0918 16:47:04.997797   54913 out.go:408] TERM=,COLORTERM=, which probably does not support color
I0918 16:47:04.997808   54913 out.go:374] Setting ErrFile to fd 2...
I0918 16:47:04.997813   54913 out.go:408] TERM=,COLORTERM=, which probably does not support color
I0918 16:47:04.998049   54913 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
I0918 16:47:04.998646   54913 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
I0918 16:47:04.998762   54913 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
I0918 16:47:04.999162   54913 cli_runner.go:164] Run: docker container inspect functional-366930 --format={{.State.Status}}
I0918 16:47:05.019903   54913 ssh_runner.go:195] Run: systemctl --version
I0918 16:47:05.019958   54913 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-366930
I0918 16:47:05.037518   54913 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32778 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/functional-366930/id_rsa Username:docker}
I0918 16:47:05.130494   54913 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:276: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image ls --format yaml --alsologtostderr
functional_test.go:281: (dbg) Stdout: out/minikube-linux-amd64 -p functional-366930 image ls --format yaml --alsologtostderr:
- id: 07655ddf2eebe5d250f7a72c25f638b27126805d61779741b4e62e69ba080558
repoDigests:
- docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93
- docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029
repoTags: []
size: "249229937"
- id: 115053965e86b2df4d78af78d7951b8644839d20a03820c6df59a261103315f7
repoDigests:
- docker.io/kubernetesui/metrics-scraper@sha256:43227e8286fd379ee0415a5e2156a9439c4056807e3caa38e1dd413b0644807a
- docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c
repoTags: []
size: "43824855"
- id: 4a86014ec6994761b7f3118cf47e4b4fd6bac15fc6fa262c4f356386bbc0e9d9
repoDigests:
- docker.io/library/nginx@sha256:42a516af16b852e33b7682d5ef8acbd5d13fe08fecadc7ed98605ba5e3b26ab8
- docker.io/library/nginx@sha256:60e48a050b6408d0c5dd59b98b6e36bf0937a0bbe99304e3e9c0e63b7563443a
repoTags:
- docker.io/library/nginx:alpine
size: "53949946"
- id: 56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
- gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "4631262"
- id: 52546a367cc9e0d924aa3b190596a9167fa6e53245023b5b5baf0f07e5443969
repoDigests:
- registry.k8s.io/coredns/coredns@sha256:4f7a57135719628cf2070c5e3cbde64b013e90d4c560c5ecbf14004181f91998
- registry.k8s.io/coredns/coredns@sha256:e8c262566636e6bc340ece6473b0eed193cad045384401529721ddbe6463d31c
repoTags:
- registry.k8s.io/coredns/coredns:v1.12.1
size: "76103547"
- id: 90550c43ad2bcfd11fcd5fd27d2eac5a7ca823be1308884b33dd816ec169be90
repoDigests:
- registry.k8s.io/kube-apiserver@sha256:495d3253a47a9a64a62041d518678c8b101fb628488e729d9f52ddff7cf82a86
- registry.k8s.io/kube-apiserver@sha256:fe86fe2f64021df8efa1a939a290bc21c8c128c66fc00ebbb6b5dea4c7a06812
repoTags:
- registry.k8s.io/kube-apiserver:v1.34.0
size: "89050097"
- id: 5f1f5298c888daa46c4409ff4cefe5ca9d16e479419f94cdb5f5d5563dac0115
repoDigests:
- registry.k8s.io/etcd@sha256:71170330936954286be203a7737459f2838dd71cc79f8ffaac91548a9e079b8f
- registry.k8s.io/etcd@sha256:e36c081683425b5b3bc1425bc508b37e7107bb65dfa9367bf5a80125d431fa19
repoTags:
- registry.k8s.io/etcd:3.6.4-0
size: "195976448"
- id: df0860106674df871eebbd01fede90c764bf472f5b97eca7e945761292e9b0ce
repoDigests:
- registry.k8s.io/kube-proxy@sha256:364da8a25c742d7a35e9635cb8cf42c1faf5b367760d0f9f9a75bdd1f9d52067
- registry.k8s.io/kube-proxy@sha256:5f71731a5eadcf74f3997dfc159bf5ca36e48c3387c19082fc21871e0dbb19af
repoTags:
- registry.k8s.io/kube-proxy:v1.34.0
size: "73138071"
- id: cd073f4c5f6a8e9dc6f3125ba00cf60819cae95c1ec84a1f146ee4a9cf9e803f
repoDigests:
- registry.k8s.io/pause@sha256:278fb9dbcca9518083ad1e11276933a2e96f23de604a3a08cc3c80002767d24c
- registry.k8s.io/pause@sha256:e5b941ef8f71de54dc3a13398226c269ba217d06650a21bd3afcf9d890cf1f41
repoTags:
- registry.k8s.io/pause:3.10.1
size: "742092"
- id: 0184c1613d92931126feb4c548e5da11015513b9e4c104e7305ee8b53b50a9da
repoDigests:
- registry.k8s.io/pause@sha256:1000de19145c53d83aab989956fa8fca08dcbcc5b0208bdc193517905e6ccd04
repoTags:
- registry.k8s.io/pause:3.3
size: "686139"
- id: 350b164e7ae1dcddeffadd65c76226c9b6dc5553f5179153fb0e36b78f2a5e06
repoDigests:
- registry.k8s.io/pause@sha256:5bcb06ed43da4a16c6e6e33898eb0506e940bd66822659ecf0a898bbb0da7cb9
repoTags:
- registry.k8s.io/pause:latest
size: "247077"
- id: 409467f978b4a30fe717012736557d637f66371452c3b279c02b943b367a141c
repoDigests:
- docker.io/kindest/kindnetd@sha256:07a4b3fe0077a0ae606cc0a200fc25a28fa64dcc30b8d311b461089969449f9a
- docker.io/kindest/kindnetd@sha256:7a9c9fa59dd517cdc2c82eef1e51392524dd285e9cf7cb5a851c49f294d6cd11
repoTags:
- docker.io/kindest/kindnetd:v20250512-df8de77b
size: "109379124"
- id: 41f689c209100e6cadf3ce7fdd02035e90dbd1d586716bf8fc6ea55c365b2d81
repoDigests:
- docker.io/library/nginx@sha256:27637a97e3d1d0518adc2a877b60db3779970f19474b6e586ddcbc2d5500e285
- docker.io/library/nginx@sha256:d5f28ef21aabddd098f3dbc21fe5b7a7d7a184720bc07da0b6c9b9820e97f25e
repoTags:
- docker.io/library/nginx:latest
size: "196550530"
- id: da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e
repoDigests:
- registry.k8s.io/pause@sha256:84805ddcaaae94434d8eacb7e843f549ec1da0cd277787b97ad9d9ac2cea929e
repoTags:
- registry.k8s.io/pause:3.1
size: "746911"
- id: 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
- gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "31470524"
- id: 9056ab77afb8e18e04303f11000a9d31b3f16b74c59475b899ae1b342d328d30
repoDigests:
- localhost/kicbase/echo-server@sha256:d3d0b737c6413dcf7b9393d61285525048f2d10a0aae68296150078d379c30cf
repoTags:
- localhost/kicbase/echo-server:functional-366930
size: "4943877"
- id: d2d84b605df60aa9de7514912ee3beaa16c70c48adfd8118d1b1ded7943de9aa
repoDigests:
- localhost/minikube-local-cache-test@sha256:34f628f68d2f576f0d55fa3aa53a8e4b1433942c65e82613ed28f7169cbe4a93
repoTags:
- localhost/minikube-local-cache-test:functional-366930
size: "3330"
- id: a0af72f2ec6d628152b015a46d4074df8f77d5b686978987c70f48b8c7660634
repoDigests:
- registry.k8s.io/kube-controller-manager@sha256:82ea603ed3cce63f9f870f22299741e0011318391cf722dd924a1d5a9f8ce6f6
- registry.k8s.io/kube-controller-manager@sha256:f8ba6c082136e2c85ce71628c59c6574ca4b67f162911cb200c0a51a5b9bff81
repoTags:
- registry.k8s.io/kube-controller-manager:v1.34.0
size: "76004183"
- id: 46169d968e9203e8b10debaf898210fe11c94b5864c351ea0f6fcf621f659bdc
repoDigests:
- registry.k8s.io/kube-scheduler@sha256:31b77e40d737b6d3e3b19b4afd681c9362aef06353075895452fc9a41fe34140
- registry.k8s.io/kube-scheduler@sha256:8fbe6d18415c8af9b31e177f6e444985f3a87349e083fe6eadd36753dddb17ff
repoTags:
- registry.k8s.io/kube-scheduler:v1.34.0
size: "53844823"

                                                
                                                
functional_test.go:284: (dbg) Stderr: out/minikube-linux-amd64 -p functional-366930 image ls --format yaml --alsologtostderr:
I0918 16:47:00.262255   54169 out.go:360] Setting OutFile to fd 1 ...
I0918 16:47:00.262578   54169 out.go:408] TERM=,COLORTERM=, which probably does not support color
I0918 16:47:00.262589   54169 out.go:374] Setting ErrFile to fd 2...
I0918 16:47:00.262596   54169 out.go:408] TERM=,COLORTERM=, which probably does not support color
I0918 16:47:00.262831   54169 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
I0918 16:47:00.263650   54169 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
I0918 16:47:00.263756   54169 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
I0918 16:47:00.264145   54169 cli_runner.go:164] Run: docker container inspect functional-366930 --format={{.State.Status}}
I0918 16:47:00.287161   54169 ssh_runner.go:195] Run: systemctl --version
I0918 16:47:00.287234   54169 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-366930
I0918 16:47:00.308801   54169 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32778 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/functional-366930/id_rsa Username:docker}
I0918 16:47:00.406663   54169 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (4.49s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:323: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 ssh pgrep buildkitd
functional_test.go:323: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-366930 ssh pgrep buildkitd: exit status 1 (275.97123ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:330: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image build -t localhost/my-image:functional-366930 testdata/build --alsologtostderr
functional_test.go:330: (dbg) Done: out/minikube-linux-amd64 -p functional-366930 image build -t localhost/my-image:functional-366930 testdata/build --alsologtostderr: (3.929332444s)
functional_test.go:335: (dbg) Stdout: out/minikube-linux-amd64 -p functional-366930 image build -t localhost/my-image:functional-366930 testdata/build --alsologtostderr:
STEP 1/3: FROM gcr.io/k8s-minikube/busybox
STEP 2/3: RUN true
--> ebeecf9e9cf
STEP 3/3: ADD content.txt /
COMMIT localhost/my-image:functional-366930
--> d51e4d8a253
Successfully tagged localhost/my-image:functional-366930
d51e4d8a2531f6568924042cedb4835b8c9ce303a5b9b7c09032854155a74af1
functional_test.go:338: (dbg) Stderr: out/minikube-linux-amd64 -p functional-366930 image build -t localhost/my-image:functional-366930 testdata/build --alsologtostderr:
I0918 16:47:00.791898   54354 out.go:360] Setting OutFile to fd 1 ...
I0918 16:47:00.792043   54354 out.go:408] TERM=,COLORTERM=, which probably does not support color
I0918 16:47:00.792051   54354 out.go:374] Setting ErrFile to fd 2...
I0918 16:47:00.792055   54354 out.go:408] TERM=,COLORTERM=, which probably does not support color
I0918 16:47:00.792240   54354 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
I0918 16:47:00.793043   54354 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
I0918 16:47:00.793901   54354 config.go:182] Loaded profile config "functional-366930": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
I0918 16:47:00.794280   54354 cli_runner.go:164] Run: docker container inspect functional-366930 --format={{.State.Status}}
I0918 16:47:00.813327   54354 ssh_runner.go:195] Run: systemctl --version
I0918 16:47:00.813392   54354 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-366930
I0918 16:47:00.831586   54354 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32778 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/functional-366930/id_rsa Username:docker}
I0918 16:47:00.925549   54354 build_images.go:161] Building image from path: /tmp/build.2542727175.tar
I0918 16:47:00.925635   54354 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0918 16:47:00.937520   54354 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.2542727175.tar
I0918 16:47:00.941449   54354 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.2542727175.tar: stat -c "%s %y" /var/lib/minikube/build/build.2542727175.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.2542727175.tar': No such file or directory
I0918 16:47:00.941484   54354 ssh_runner.go:362] scp /tmp/build.2542727175.tar --> /var/lib/minikube/build/build.2542727175.tar (3072 bytes)
I0918 16:47:00.971236   54354 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.2542727175
I0918 16:47:00.982448   54354 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.2542727175 -xf /var/lib/minikube/build/build.2542727175.tar
I0918 16:47:01.012023   54354 crio.go:315] Building image: /var/lib/minikube/build/build.2542727175
I0918 16:47:01.012125   54354 ssh_runner.go:195] Run: sudo podman build -t localhost/my-image:functional-366930 /var/lib/minikube/build/build.2542727175 --cgroup-manager=cgroupfs
Trying to pull gcr.io/k8s-minikube/busybox:latest...
Getting image source signatures
Copying blob sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa
Copying blob sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa
Copying config sha256:beae173ccac6ad749f76713cf4440fe3d21d1043fe616dfbe30775815d1d0f6a
Writing manifest to image destination
Storing signatures
I0918 16:47:04.640058   54354 ssh_runner.go:235] Completed: sudo podman build -t localhost/my-image:functional-366930 /var/lib/minikube/build/build.2542727175 --cgroup-manager=cgroupfs: (3.627901749s)
I0918 16:47:04.640132   54354 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.2542727175
I0918 16:47:04.649698   54354 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.2542727175.tar
I0918 16:47:04.659055   54354 build_images.go:217] Built localhost/my-image:functional-366930 from /tmp/build.2542727175.tar
I0918 16:47:04.659094   54354 build_images.go:133] succeeded building to: functional-366930
I0918 16:47:04.659100   54354 build_images.go:134] failed building to: 
functional_test.go:466: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (4.49s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (0.46s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:357: (dbg) Run:  docker pull kicbase/echo-server:1.0
functional_test.go:362: (dbg) Run:  docker tag kicbase/echo-server:1.0 kicbase/echo-server:functional-366930
--- PASS: TestFunctional/parallel/ImageCommands/Setup (0.46s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (2.51s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:370: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image load --daemon kicbase/echo-server:functional-366930 --alsologtostderr
functional_test.go:370: (dbg) Done: out/minikube-linux-amd64 -p functional-366930 image load --daemon kicbase/echo-server:functional-366930 --alsologtostderr: (2.27887857s)
functional_test.go:466: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (2.51s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (0.89s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:380: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image load --daemon kicbase/echo-server:functional-366930 --alsologtostderr
functional_test.go:466: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (0.89s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:250: (dbg) Run:  docker pull kicbase/echo-server:latest
functional_test.go:255: (dbg) Run:  docker tag kicbase/echo-server:latest kicbase/echo-server:functional-366930
functional_test.go:260: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image load --daemon kicbase/echo-server:functional-366930 --alsologtostderr
2025/09/18 16:46:50 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
functional_test.go:466: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (1.05s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.52s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:395: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image save kicbase/echo-server:functional-366930 /home/jenkins/workspace/Docker_Linux_crio_integration/echo-server-save.tar --alsologtostderr
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.52s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.53s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:407: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image rm kicbase/echo-server:functional-366930 --alsologtostderr
I0918 16:46:52.234940   11368 detect.go:223] nested VM detected
functional_test.go:466: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.53s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.77s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:424: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image load /home/jenkins/workspace/Docker_Linux_crio_integration/echo-server-save.tar --alsologtostderr
functional_test.go:466: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.77s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.66s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:434: (dbg) Run:  docker rmi kicbase/echo-server:functional-366930
functional_test.go:439: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 image save --daemon kicbase/echo-server:functional-366930 --alsologtostderr
functional_test.go:447: (dbg) Run:  docker image inspect localhost/kicbase/echo-server:functional-366930
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.66s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2124: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2124: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 update-context --alsologtostderr -v=2
E0918 16:47:07.015313   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2124: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (1.69s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1469: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 service list
functional_test.go:1469: (dbg) Done: out/minikube-linux-amd64 -p functional-366930 service list: (1.692833714s)
--- PASS: TestFunctional/parallel/ServiceCmd/List (1.69s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (1.69s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1499: (dbg) Run:  out/minikube-linux-amd64 -p functional-366930 service list -o json
functional_test.go:1499: (dbg) Done: out/minikube-linux-amd64 -p functional-366930 service list -o json: (1.692285098s)
functional_test.go:1504: Took "1.692376891s" to run "out/minikube-linux-amd64 -p functional-366930 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (1.69s)

                                                
                                    
x
+
TestFunctional/delete_echo-server_images (0.04s)

                                                
                                                
=== RUN   TestFunctional/delete_echo-server_images
functional_test.go:205: (dbg) Run:  docker rmi -f kicbase/echo-server:1.0
functional_test.go:205: (dbg) Run:  docker rmi -f kicbase/echo-server:functional-366930
--- PASS: TestFunctional/delete_echo-server_images (0.04s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:213: (dbg) Run:  docker rmi -f localhost/my-image:functional-366930
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:221: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-366930
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StartCluster (135.99s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StartCluster
ha_test.go:101: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 start --ha --memory 3072 --wait true --alsologtostderr -v 5 --driver=docker  --container-runtime=crio
ha_test.go:101: (dbg) Done: out/minikube-linux-amd64 -p ha-078118 start --ha --memory 3072 --wait true --alsologtostderr -v 5 --driver=docker  --container-runtime=crio: (2m15.27681212s)
ha_test.go:107: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5
--- PASS: TestMultiControlPlane/serial/StartCluster (135.99s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DeployApp (6.17s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DeployApp
ha_test.go:128: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:133: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- rollout status deployment/busybox
ha_test.go:133: (dbg) Done: out/minikube-linux-amd64 -p ha-078118 kubectl -- rollout status deployment/busybox: (4.212340616s)
ha_test.go:140: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:163: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:171: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- exec busybox-7b57f96db7-95578 -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- exec busybox-7b57f96db7-bzrv2 -- nslookup kubernetes.io
ha_test.go:171: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- exec busybox-7b57f96db7-t7rzr -- nslookup kubernetes.io
ha_test.go:181: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- exec busybox-7b57f96db7-95578 -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- exec busybox-7b57f96db7-bzrv2 -- nslookup kubernetes.default
ha_test.go:181: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- exec busybox-7b57f96db7-t7rzr -- nslookup kubernetes.default
ha_test.go:189: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- exec busybox-7b57f96db7-95578 -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- exec busybox-7b57f96db7-bzrv2 -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- exec busybox-7b57f96db7-t7rzr -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiControlPlane/serial/DeployApp (6.17s)

                                                
                                    
x
+
TestMultiControlPlane/serial/PingHostFromPods (1.08s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/PingHostFromPods
ha_test.go:199: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:207: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- exec busybox-7b57f96db7-95578 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- exec busybox-7b57f96db7-95578 -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- exec busybox-7b57f96db7-bzrv2 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- exec busybox-7b57f96db7-bzrv2 -- sh -c "ping -c 1 192.168.49.1"
ha_test.go:207: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- exec busybox-7b57f96db7-t7rzr -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
ha_test.go:218: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 kubectl -- exec busybox-7b57f96db7-t7rzr -- sh -c "ping -c 1 192.168.49.1"
--- PASS: TestMultiControlPlane/serial/PingHostFromPods (1.08s)

                                                
                                    
x
+
TestMultiControlPlane/serial/NodeLabels (0.06s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/NodeLabels
ha_test.go:255: (dbg) Run:  kubectl --context ha-078118 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiControlPlane/serial/NodeLabels (0.06s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterClusterStart (0.74s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterClusterStart (0.74s)

                                                
                                    
x
+
TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.54s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:392: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.54s)

                                                
                                    
x
+
TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.74s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.74s)

                                                
                                    
x
+
TestMultiControlPlane/serial/StopCluster (35.56s)

                                                
                                                
=== RUN   TestMultiControlPlane/serial/StopCluster
ha_test.go:533: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 stop --alsologtostderr -v 5
ha_test.go:533: (dbg) Done: out/minikube-linux-amd64 -p ha-078118 stop --alsologtostderr -v 5: (35.463176587s)
ha_test.go:539: (dbg) Run:  out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5
ha_test.go:539: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-078118 status --alsologtostderr -v 5: exit status 7 (99.54609ms)

                                                
                                                
-- stdout --
	ha-078118
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-078118-m02
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	ha-078118-m04
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:03:57.491576   98882 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:03:57.491686   98882 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:03:57.491690   98882 out.go:374] Setting ErrFile to fd 2...
	I0918 17:03:57.491694   98882 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:03:57.491892   98882 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:03:57.492041   98882 out.go:368] Setting JSON to false
	I0918 17:03:57.492070   98882 mustload.go:65] Loading cluster: ha-078118
	I0918 17:03:57.492238   98882 notify.go:220] Checking for updates...
	I0918 17:03:57.492442   98882 config.go:182] Loaded profile config "ha-078118": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:03:57.492460   98882 status.go:174] checking status of ha-078118 ...
	I0918 17:03:57.492896   98882 cli_runner.go:164] Run: docker container inspect ha-078118 --format={{.State.Status}}
	I0918 17:03:57.511274   98882 status.go:371] ha-078118 host status = "Stopped" (err=<nil>)
	I0918 17:03:57.511317   98882 status.go:384] host is not running, skipping remaining checks
	I0918 17:03:57.511327   98882 status.go:176] ha-078118 status: &{Name:ha-078118 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:03:57.511361   98882 status.go:174] checking status of ha-078118-m02 ...
	I0918 17:03:57.511649   98882 cli_runner.go:164] Run: docker container inspect ha-078118-m02 --format={{.State.Status}}
	I0918 17:03:57.528891   98882 status.go:371] ha-078118-m02 host status = "Stopped" (err=<nil>)
	I0918 17:03:57.528911   98882 status.go:384] host is not running, skipping remaining checks
	I0918 17:03:57.528919   98882 status.go:176] ha-078118-m02 status: &{Name:ha-078118-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:03:57.528943   98882 status.go:174] checking status of ha-078118-m04 ...
	I0918 17:03:57.529175   98882 cli_runner.go:164] Run: docker container inspect ha-078118-m04 --format={{.State.Status}}
	I0918 17:03:57.546907   98882 status.go:371] ha-078118-m04 host status = "Stopped" (err=<nil>)
	I0918 17:03:57.546946   98882 status.go:384] host is not running, skipping remaining checks
	I0918 17:03:57.546952   98882 status.go:176] ha-078118-m04 status: &{Name:ha-078118-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiControlPlane/serial/StopCluster (35.56s)

                                                
                                    
x
+
TestJSONOutput/start/Command (39.58s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 start -p json-output-512050 --output=json --user=testUser --memory=3072 --wait=true --driver=docker  --container-runtime=crio
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 start -p json-output-512050 --output=json --user=testUser --memory=3072 --wait=true --driver=docker  --container-runtime=crio: (39.582710576s)
--- PASS: TestJSONOutput/start/Command (39.58s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.72s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 pause -p json-output-512050 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.72s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.62s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 unpause -p json-output-512050 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.62s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (6.1s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 stop -p json-output-512050 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 stop -p json-output-512050 --output=json --user=testUser: (6.103917883s)
--- PASS: TestJSONOutput/stop/Command (6.10s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.21s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-amd64 start -p json-output-error-298072 --memory=3072 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p json-output-error-298072 --memory=3072 --output=json --wait=true --driver=fail: exit status 56 (67.279311ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"4a3122eb-c86b-4312-a32a-1bbf8ced3548","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-298072] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"6ec1fe57-61c4-4321-b655-43917940592d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=20370"}}
	{"specversion":"1.0","id":"522c1c38-fab9-465d-99ce-35c94e36adce","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"224a9166-80d0-48ef-ac8a-7de8ef984fdb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig"}}
	{"specversion":"1.0","id":"b8efb2fa-5da3-409b-94f5-b09c0189ab76","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube"}}
	{"specversion":"1.0","id":"7c84d251-510a-46c7-9a50-23487a07ee4c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}
	{"specversion":"1.0","id":"0f26071b-3db0-4cc7-bd56-235b612e8302","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"e7e9f7da-5124-43cc-8cd4-b0fadf467656","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/amd64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-298072" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p json-output-error-298072
--- PASS: TestErrorJSONOutput (0.21s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (29.62s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-amd64 start -p docker-network-554824 --network=
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-554824 --network=: (27.517222081s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-554824" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p docker-network-554824
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-554824: (2.078822005s)
--- PASS: TestKicCustomNetwork/create_custom_network (29.62s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (22.8s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-amd64 start -p docker-network-014850 --network=bridge
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-014850 --network=bridge: (20.838733885s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-014850" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p docker-network-014850
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-014850: (1.946151654s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (22.80s)

                                                
                                    
x
+
TestKicExistingNetwork (23.16s)

                                                
                                                
=== RUN   TestKicExistingNetwork
I0918 17:28:52.920117   11368 cli_runner.go:164] Run: docker network inspect existing-network --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0918 17:28:52.938795   11368 cli_runner.go:211] docker network inspect existing-network --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0918 17:28:52.938903   11368 network_create.go:284] running [docker network inspect existing-network] to gather additional debugging logs...
I0918 17:28:52.938933   11368 cli_runner.go:164] Run: docker network inspect existing-network
W0918 17:28:52.958257   11368 cli_runner.go:211] docker network inspect existing-network returned with exit code 1
I0918 17:28:52.958293   11368 network_create.go:287] error running [docker network inspect existing-network]: docker network inspect existing-network: exit status 1
stdout:
[]

                                                
                                                
stderr:
Error response from daemon: network existing-network not found
I0918 17:28:52.958313   11368 network_create.go:289] output of [docker network inspect existing-network]: -- stdout --
[]

                                                
                                                
-- /stdout --
** stderr ** 
Error response from daemon: network existing-network not found

                                                
                                                
** /stderr **
I0918 17:28:52.958525   11368 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0918 17:28:52.977605   11368 network.go:211] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName:br-0aa191750de6 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:ba:9f:21:35:1a:93} reservation:<nil>}
I0918 17:28:52.978135   11368 network.go:206] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001cad040}
I0918 17:28:52.978188   11368 network_create.go:124] attempt to create docker network existing-network 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...
I0918 17:28:52.978261   11368 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=existing-network existing-network
I0918 17:28:53.036555   11368 network_create.go:108] docker network existing-network 192.168.58.0/24 created
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-amd64 start -p existing-network-581164 --network=existing-network
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-amd64 start -p existing-network-581164 --network=existing-network: (21.082832844s)
helpers_test.go:175: Cleaning up "existing-network-581164" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p existing-network-581164
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p existing-network-581164: (1.928388729s)
I0918 17:29:16.066091   11368 cli_runner.go:164] Run: docker network ls --filter=label=existing-network --format {{.Name}}
--- PASS: TestKicExistingNetwork (23.16s)

                                                
                                    
x
+
TestKicCustomSubnet (24.79s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p custom-subnet-342646 --subnet=192.168.60.0/24
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p custom-subnet-342646 --subnet=192.168.60.0/24: (22.653489031s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-342646 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-342646" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p custom-subnet-342646
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p custom-subnet-342646: (2.111947708s)
--- PASS: TestKicCustomSubnet (24.79s)

                                                
                                    
x
+
TestKicStaticIP (24.62s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-amd64 start -p static-ip-384608 --static-ip=192.168.200.200
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-amd64 start -p static-ip-384608 --static-ip=192.168.200.200: (22.372895541s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-amd64 -p static-ip-384608 ip
helpers_test.go:175: Cleaning up "static-ip-384608" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p static-ip-384608
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p static-ip-384608: (2.112973781s)
--- PASS: TestKicStaticIP (24.62s)

                                                
                                    
x
+
TestMainNoArgs (0.05s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:70: (dbg) Run:  out/minikube-linux-amd64
--- PASS: TestMainNoArgs (0.05s)

                                                
                                    
x
+
TestMinikubeProfile (45.9s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-amd64 start -p first-586291 --driver=docker  --container-runtime=crio
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p first-586291 --driver=docker  --container-runtime=crio: (19.389808922s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-amd64 start -p second-599973 --driver=docker  --container-runtime=crio
E0918 17:30:45.076467   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p second-599973 --driver=docker  --container-runtime=crio: (20.610287399s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-amd64 profile first-586291
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-amd64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-amd64 profile second-599973
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-amd64 profile list -ojson
helpers_test.go:175: Cleaning up "second-599973" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p second-599973
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p second-599973: (2.337332732s)
helpers_test.go:175: Cleaning up "first-586291" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p first-586291
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p first-586291: (2.382871204s)
--- PASS: TestMinikubeProfile (45.90s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (5.31s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:118: (dbg) Run:  out/minikube-linux-amd64 start -p mount-start-1-195762 --memory=3072 --mount-string /tmp/TestMountStartserial1332703375/001:/minikube-host --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=crio
mount_start_test.go:118: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-1-195762 --memory=3072 --mount-string /tmp/TestMountStartserial1332703375/001:/minikube-host --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=crio: (4.306198842s)
--- PASS: TestMountStart/serial/StartWithMountFirst (5.31s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.26s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:134: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-1-195762 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.26s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (5.44s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:118: (dbg) Run:  out/minikube-linux-amd64 start -p mount-start-2-209570 --memory=3072 --mount-string /tmp/TestMountStartserial1332703375/001:/minikube-host --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=crio
mount_start_test.go:118: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-209570 --memory=3072 --mount-string /tmp/TestMountStartserial1332703375/001:/minikube-host --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=crio: (4.442068437s)
--- PASS: TestMountStart/serial/StartWithMountSecond (5.44s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.26s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:134: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-2-209570 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.26s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.69s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-amd64 delete -p mount-start-1-195762 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-amd64 delete -p mount-start-1-195762 --alsologtostderr -v=5: (1.684932076s)
--- PASS: TestMountStart/serial/DeleteFirst (1.69s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.26s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:134: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-2-209570 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.26s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.19s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:196: (dbg) Run:  out/minikube-linux-amd64 stop -p mount-start-2-209570
mount_start_test.go:196: (dbg) Done: out/minikube-linux-amd64 stop -p mount-start-2-209570: (1.191463073s)
--- PASS: TestMountStart/serial/Stop (1.19s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (7.36s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:207: (dbg) Run:  out/minikube-linux-amd64 start -p mount-start-2-209570
mount_start_test.go:207: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-209570: (6.360565124s)
--- PASS: TestMountStart/serial/RestartStopped (7.36s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.26s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:134: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-2-209570 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.26s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (122.3s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-219620 --wait=true --memory=3072 --nodes=2 -v=5 --alsologtostderr --driver=docker  --container-runtime=crio
E0918 17:31:32.216985   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
multinode_test.go:96: (dbg) Done: out/minikube-linux-amd64 start -p multinode-219620 --wait=true --memory=3072 --nodes=2 -v=5 --alsologtostderr --driver=docker  --container-runtime=crio: (2m1.833585667s)
multinode_test.go:102: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (122.30s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (4.58s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-219620 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:498: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-219620 -- rollout status deployment/busybox
multinode_test.go:498: (dbg) Done: out/minikube-linux-amd64 kubectl -p multinode-219620 -- rollout status deployment/busybox: (3.121908442s)
multinode_test.go:505: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-219620 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:528: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-219620 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:536: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-219620 -- exec busybox-7b57f96db7-nn4lv -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-219620 -- exec busybox-7b57f96db7-wbqpl -- nslookup kubernetes.io
multinode_test.go:546: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-219620 -- exec busybox-7b57f96db7-nn4lv -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-219620 -- exec busybox-7b57f96db7-wbqpl -- nslookup kubernetes.default
multinode_test.go:554: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-219620 -- exec busybox-7b57f96db7-nn4lv -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-219620 -- exec busybox-7b57f96db7-wbqpl -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (4.58s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.75s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-219620 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:572: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-219620 -- exec busybox-7b57f96db7-nn4lv -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-219620 -- exec busybox-7b57f96db7-nn4lv -- sh -c "ping -c 1 192.168.67.1"
multinode_test.go:572: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-219620 -- exec busybox-7b57f96db7-wbqpl -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:583: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-219620 -- exec busybox-7b57f96db7-wbqpl -- sh -c "ping -c 1 192.168.67.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (0.75s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (26.75s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run:  out/minikube-linux-amd64 node add -p multinode-219620 -v=5 --alsologtostderr
multinode_test.go:121: (dbg) Done: out/minikube-linux-amd64 node add -p multinode-219620 -v=5 --alsologtostderr: (26.111706486s)
multinode_test.go:127: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (26.75s)

                                                
                                    
x
+
TestMultiNode/serial/MultiNodeLabels (0.06s)

                                                
                                                
=== RUN   TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run:  kubectl --context multinode-219620 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiNode/serial/MultiNodeLabels (0.06s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.64s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.64s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (9.45s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 status --output json --alsologtostderr
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 cp testdata/cp-test.txt multinode-219620:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 cp multinode-219620:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2378979026/001/cp-test_multinode-219620.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 cp multinode-219620:/home/docker/cp-test.txt multinode-219620-m02:/home/docker/cp-test_multinode-219620_multinode-219620-m02.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620-m02 "sudo cat /home/docker/cp-test_multinode-219620_multinode-219620-m02.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 cp multinode-219620:/home/docker/cp-test.txt multinode-219620-m03:/home/docker/cp-test_multinode-219620_multinode-219620-m03.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620-m03 "sudo cat /home/docker/cp-test_multinode-219620_multinode-219620-m03.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 cp testdata/cp-test.txt multinode-219620-m02:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 cp multinode-219620-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2378979026/001/cp-test_multinode-219620-m02.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 cp multinode-219620-m02:/home/docker/cp-test.txt multinode-219620:/home/docker/cp-test_multinode-219620-m02_multinode-219620.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620 "sudo cat /home/docker/cp-test_multinode-219620-m02_multinode-219620.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 cp multinode-219620-m02:/home/docker/cp-test.txt multinode-219620-m03:/home/docker/cp-test_multinode-219620-m02_multinode-219620-m03.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620-m03 "sudo cat /home/docker/cp-test_multinode-219620-m02_multinode-219620-m03.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 cp testdata/cp-test.txt multinode-219620-m03:/home/docker/cp-test.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 cp multinode-219620-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile2378979026/001/cp-test_multinode-219620-m03.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 cp multinode-219620-m03:/home/docker/cp-test.txt multinode-219620:/home/docker/cp-test_multinode-219620-m03_multinode-219620.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620 "sudo cat /home/docker/cp-test_multinode-219620-m03_multinode-219620.txt"
helpers_test.go:573: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 cp multinode-219620-m03:/home/docker/cp-test.txt multinode-219620-m02:/home/docker/cp-test_multinode-219620-m03_multinode-219620-m02.txt
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:551: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 ssh -n multinode-219620-m02 "sudo cat /home/docker/cp-test_multinode-219620-m03_multinode-219620-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (9.45s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.26s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 node stop m03
multinode_test.go:248: (dbg) Done: out/minikube-linux-amd64 -p multinode-219620 node stop m03: (1.29499404s)
multinode_test.go:254: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-219620 status: exit status 7 (478.598248ms)

                                                
                                                
-- stdout --
	multinode-219620
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-219620-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-219620-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:261: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-219620 status --alsologtostderr: exit status 7 (484.437299ms)

                                                
                                                
-- stdout --
	multinode-219620
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-219620-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-219620-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:34:01.629867  165755 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:34:01.630577  165755 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:34:01.630658  165755 out.go:374] Setting ErrFile to fd 2...
	I0918 17:34:01.630672  165755 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:34:01.631142  165755 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:34:01.631771  165755 out.go:368] Setting JSON to false
	I0918 17:34:01.631805  165755 mustload.go:65] Loading cluster: multinode-219620
	I0918 17:34:01.631949  165755 notify.go:220] Checking for updates...
	I0918 17:34:01.632254  165755 config.go:182] Loaded profile config "multinode-219620": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:34:01.632279  165755 status.go:174] checking status of multinode-219620 ...
	I0918 17:34:01.632789  165755 cli_runner.go:164] Run: docker container inspect multinode-219620 --format={{.State.Status}}
	I0918 17:34:01.653808  165755 status.go:371] multinode-219620 host status = "Running" (err=<nil>)
	I0918 17:34:01.653854  165755 host.go:66] Checking if "multinode-219620" exists ...
	I0918 17:34:01.654217  165755 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-219620
	I0918 17:34:01.673666  165755 host.go:66] Checking if "multinode-219620" exists ...
	I0918 17:34:01.673893  165755 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:34:01.673935  165755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-219620
	I0918 17:34:01.692360  165755 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32898 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/multinode-219620/id_rsa Username:docker}
	I0918 17:34:01.786133  165755 ssh_runner.go:195] Run: systemctl --version
	I0918 17:34:01.790901  165755 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:34:01.802861  165755 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:34:01.859425  165755 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:51 OomKillDisable:false NGoroutines:65 SystemTime:2025-09-18 17:34:01.84931801 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[ma
p[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:34:01.859979  165755 kubeconfig.go:125] found "multinode-219620" server: "https://192.168.67.2:8443"
	I0918 17:34:01.860007  165755 api_server.go:166] Checking apiserver status ...
	I0918 17:34:01.860050  165755 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0918 17:34:01.872063  165755 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1406/cgroup
	W0918 17:34:01.882184  165755 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1406/cgroup: Process exited with status 1
	stdout:
	
	stderr:
	I0918 17:34:01.882244  165755 ssh_runner.go:195] Run: ls
	I0918 17:34:01.885630  165755 api_server.go:253] Checking apiserver healthz at https://192.168.67.2:8443/healthz ...
	I0918 17:34:01.889753  165755 api_server.go:279] https://192.168.67.2:8443/healthz returned 200:
	ok
	I0918 17:34:01.889776  165755 status.go:463] multinode-219620 apiserver status = Running (err=<nil>)
	I0918 17:34:01.889785  165755 status.go:176] multinode-219620 status: &{Name:multinode-219620 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:34:01.889827  165755 status.go:174] checking status of multinode-219620-m02 ...
	I0918 17:34:01.890061  165755 cli_runner.go:164] Run: docker container inspect multinode-219620-m02 --format={{.State.Status}}
	I0918 17:34:01.907822  165755 status.go:371] multinode-219620-m02 host status = "Running" (err=<nil>)
	I0918 17:34:01.907863  165755 host.go:66] Checking if "multinode-219620-m02" exists ...
	I0918 17:34:01.908203  165755 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-219620-m02
	I0918 17:34:01.925399  165755 host.go:66] Checking if "multinode-219620-m02" exists ...
	I0918 17:34:01.925742  165755 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0918 17:34:01.925794  165755 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-219620-m02
	I0918 17:34:01.944118  165755 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32903 SSHKeyPath:/home/jenkins/minikube-integration/20370-7845/.minikube/machines/multinode-219620-m02/id_rsa Username:docker}
	I0918 17:34:02.037672  165755 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0918 17:34:02.049447  165755 status.go:176] multinode-219620-m02 status: &{Name:multinode-219620-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:34:02.049480  165755 status.go:174] checking status of multinode-219620-m03 ...
	I0918 17:34:02.049742  165755 cli_runner.go:164] Run: docker container inspect multinode-219620-m03 --format={{.State.Status}}
	I0918 17:34:02.067738  165755 status.go:371] multinode-219620-m03 host status = "Stopped" (err=<nil>)
	I0918 17:34:02.067761  165755 status.go:384] host is not running, skipping remaining checks
	I0918 17:34:02.067767  165755 status.go:176] multinode-219620-m03 status: &{Name:multinode-219620-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.26s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (7.51s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 node start m03 -v=5 --alsologtostderr
multinode_test.go:282: (dbg) Done: out/minikube-linux-amd64 -p multinode-219620 node start m03 -v=5 --alsologtostderr: (6.833888131s)
multinode_test.go:290: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 status -v=5 --alsologtostderr
multinode_test.go:306: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (7.51s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (77.52s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-219620
multinode_test.go:321: (dbg) Run:  out/minikube-linux-amd64 stop -p multinode-219620
E0918 17:34:35.286576   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
multinode_test.go:321: (dbg) Done: out/minikube-linux-amd64 stop -p multinode-219620: (31.466012501s)
multinode_test.go:326: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-219620 --wait=true -v=5 --alsologtostderr
multinode_test.go:326: (dbg) Done: out/minikube-linux-amd64 start -p multinode-219620 --wait=true -v=5 --alsologtostderr: (45.948677373s)
multinode_test.go:331: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-219620
--- PASS: TestMultiNode/serial/RestartKeepsNodes (77.52s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (5.27s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 node delete m03
E0918 17:35:28.145662   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
multinode_test.go:416: (dbg) Done: out/minikube-linux-amd64 -p multinode-219620 node delete m03: (4.674510719s)
multinode_test.go:422: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 status --alsologtostderr
multinode_test.go:436: (dbg) Run:  kubectl get nodes
multinode_test.go:444: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (5.27s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (28.68s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 stop
E0918 17:35:45.076691   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
multinode_test.go:345: (dbg) Done: out/minikube-linux-amd64 -p multinode-219620 stop: (28.511249817s)
multinode_test.go:351: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-219620 status: exit status 7 (86.63026ms)

                                                
                                                
-- stdout --
	multinode-219620
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-219620-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:358: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 status --alsologtostderr
multinode_test.go:358: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-219620 status --alsologtostderr: exit status 7 (84.905124ms)

                                                
                                                
-- stdout --
	multinode-219620
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-219620-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:36:01.008922  175905 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:36:01.009174  175905 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:36:01.009183  175905 out.go:374] Setting ErrFile to fd 2...
	I0918 17:36:01.009187  175905 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:36:01.009398  175905 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:36:01.009588  175905 out.go:368] Setting JSON to false
	I0918 17:36:01.009620  175905 mustload.go:65] Loading cluster: multinode-219620
	I0918 17:36:01.009776  175905 notify.go:220] Checking for updates...
	I0918 17:36:01.010069  175905 config.go:182] Loaded profile config "multinode-219620": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:36:01.010088  175905 status.go:174] checking status of multinode-219620 ...
	I0918 17:36:01.010680  175905 cli_runner.go:164] Run: docker container inspect multinode-219620 --format={{.State.Status}}
	I0918 17:36:01.029312  175905 status.go:371] multinode-219620 host status = "Stopped" (err=<nil>)
	I0918 17:36:01.029334  175905 status.go:384] host is not running, skipping remaining checks
	I0918 17:36:01.029341  175905 status.go:176] multinode-219620 status: &{Name:multinode-219620 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0918 17:36:01.029366  175905 status.go:174] checking status of multinode-219620-m02 ...
	I0918 17:36:01.029633  175905 cli_runner.go:164] Run: docker container inspect multinode-219620-m02 --format={{.State.Status}}
	I0918 17:36:01.048108  175905 status.go:371] multinode-219620-m02 host status = "Stopped" (err=<nil>)
	I0918 17:36:01.048159  175905 status.go:384] host is not running, skipping remaining checks
	I0918 17:36:01.048176  175905 status.go:176] multinode-219620-m02 status: &{Name:multinode-219620-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (28.68s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (50.35s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-219620 --wait=true -v=5 --alsologtostderr --driver=docker  --container-runtime=crio
E0918 17:36:32.217293   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
multinode_test.go:376: (dbg) Done: out/minikube-linux-amd64 start -p multinode-219620 --wait=true -v=5 --alsologtostderr --driver=docker  --container-runtime=crio: (49.74622725s)
multinode_test.go:382: (dbg) Run:  out/minikube-linux-amd64 -p multinode-219620 status --alsologtostderr
multinode_test.go:396: (dbg) Run:  kubectl get nodes
multinode_test.go:404: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/RestartMultiNode (50.35s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (23.5s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-219620
multinode_test.go:464: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-219620-m02 --driver=docker  --container-runtime=crio
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p multinode-219620-m02 --driver=docker  --container-runtime=crio: exit status 14 (68.644682ms)

                                                
                                                
-- stdout --
	* [multinode-219620-m02] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=20370
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-219620-m02' is duplicated with machine name 'multinode-219620-m02' in profile 'multinode-219620'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-219620-m03 --driver=docker  --container-runtime=crio
multinode_test.go:472: (dbg) Done: out/minikube-linux-amd64 start -p multinode-219620-m03 --driver=docker  --container-runtime=crio: (20.734802375s)
multinode_test.go:479: (dbg) Run:  out/minikube-linux-amd64 node add -p multinode-219620
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-linux-amd64 node add -p multinode-219620: exit status 80 (284.374991ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-219620 as [worker]
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-219620-m03 already exists in multinode-219620-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:484: (dbg) Run:  out/minikube-linux-amd64 delete -p multinode-219620-m03
multinode_test.go:484: (dbg) Done: out/minikube-linux-amd64 delete -p multinode-219620-m03: (2.361340304s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (23.50s)

                                                
                                    
x
+
TestPreload (109.82s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:43: (dbg) Run:  out/minikube-linux-amd64 start -p test-preload-923681 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.32.0
preload_test.go:43: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-923681 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.32.0: (47.837889601s)
preload_test.go:51: (dbg) Run:  out/minikube-linux-amd64 -p test-preload-923681 image pull gcr.io/k8s-minikube/busybox
preload_test.go:51: (dbg) Done: out/minikube-linux-amd64 -p test-preload-923681 image pull gcr.io/k8s-minikube/busybox: (2.257289515s)
preload_test.go:57: (dbg) Run:  out/minikube-linux-amd64 stop -p test-preload-923681
preload_test.go:57: (dbg) Done: out/minikube-linux-amd64 stop -p test-preload-923681: (5.905636108s)
preload_test.go:65: (dbg) Run:  out/minikube-linux-amd64 start -p test-preload-923681 --memory=3072 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=crio
preload_test.go:65: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-923681 --memory=3072 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=crio: (51.168321883s)
preload_test.go:70: (dbg) Run:  out/minikube-linux-amd64 -p test-preload-923681 image list
helpers_test.go:175: Cleaning up "test-preload-923681" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p test-preload-923681
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p test-preload-923681: (2.42547512s)
--- PASS: TestPreload (109.82s)

                                                
                                    
x
+
TestScheduledStopUnix (97.89s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-amd64 start -p scheduled-stop-799518 --memory=3072 --driver=docker  --container-runtime=crio
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-amd64 start -p scheduled-stop-799518 --memory=3072 --driver=docker  --container-runtime=crio: (21.493846831s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-799518 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-amd64 status --format={{.TimeToStop}} -p scheduled-stop-799518 -n scheduled-stop-799518
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-799518 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
I0918 17:39:30.786333   11368 retry.go:31] will retry after 102.776µs: open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/scheduled-stop-799518/pid: no such file or directory
I0918 17:39:30.787516   11368 retry.go:31] will retry after 207.372µs: open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/scheduled-stop-799518/pid: no such file or directory
I0918 17:39:30.788663   11368 retry.go:31] will retry after 152.692µs: open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/scheduled-stop-799518/pid: no such file or directory
I0918 17:39:30.789813   11368 retry.go:31] will retry after 356.633µs: open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/scheduled-stop-799518/pid: no such file or directory
I0918 17:39:30.790939   11368 retry.go:31] will retry after 502.275µs: open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/scheduled-stop-799518/pid: no such file or directory
I0918 17:39:30.792095   11368 retry.go:31] will retry after 431.021µs: open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/scheduled-stop-799518/pid: no such file or directory
I0918 17:39:30.793188   11368 retry.go:31] will retry after 1.643897ms: open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/scheduled-stop-799518/pid: no such file or directory
I0918 17:39:30.795429   11368 retry.go:31] will retry after 1.691381ms: open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/scheduled-stop-799518/pid: no such file or directory
I0918 17:39:30.797637   11368 retry.go:31] will retry after 3.679032ms: open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/scheduled-stop-799518/pid: no such file or directory
I0918 17:39:30.801881   11368 retry.go:31] will retry after 4.313417ms: open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/scheduled-stop-799518/pid: no such file or directory
I0918 17:39:30.807126   11368 retry.go:31] will retry after 6.928481ms: open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/scheduled-stop-799518/pid: no such file or directory
I0918 17:39:30.815077   11368 retry.go:31] will retry after 9.253346ms: open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/scheduled-stop-799518/pid: no such file or directory
I0918 17:39:30.825338   11368 retry.go:31] will retry after 7.496778ms: open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/scheduled-stop-799518/pid: no such file or directory
I0918 17:39:30.833594   11368 retry.go:31] will retry after 9.764363ms: open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/scheduled-stop-799518/pid: no such file or directory
I0918 17:39:30.843867   11368 retry.go:31] will retry after 22.296828ms: open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/scheduled-stop-799518/pid: no such file or directory
I0918 17:39:30.867146   11368 retry.go:31] will retry after 52.082962ms: open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/scheduled-stop-799518/pid: no such file or directory
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-799518 --cancel-scheduled
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-799518 -n scheduled-stop-799518
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-amd64 status -p scheduled-stop-799518
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-799518 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-amd64 status -p scheduled-stop-799518
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p scheduled-stop-799518: exit status 7 (68.378538ms)

                                                
                                                
-- stdout --
	scheduled-stop-799518
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-799518 -n scheduled-stop-799518
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-799518 -n scheduled-stop-799518: exit status 7 (68.877761ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-799518" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p scheduled-stop-799518
E0918 17:40:45.078708   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p scheduled-stop-799518: (5.007725485s)
--- PASS: TestScheduledStopUnix (97.89s)

                                                
                                    
x
+
TestInsufficientStorage (9.35s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-amd64 start -p insufficient-storage-839774 --memory=3072 --output=json --wait=true --driver=docker  --container-runtime=crio
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p insufficient-storage-839774 --memory=3072 --output=json --wait=true --driver=docker  --container-runtime=crio: exit status 26 (6.918129207s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"e056c39f-003c-4b2a-8b60-1a748f186afa","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-839774] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"d23ff60c-de0c-4efc-8f49-4c2c1470ab1a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=20370"}}
	{"specversion":"1.0","id":"c131ed42-44e1-4371-bd5d-21bdbea9b9c1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"464d790b-55b1-4c85-aed6-8c317c4f518c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig"}}
	{"specversion":"1.0","id":"381922f0-4a03-44ec-b304-1f66c88f9472","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube"}}
	{"specversion":"1.0","id":"12678a4b-2ea9-4f6f-9013-d6a2dea81f1c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}
	{"specversion":"1.0","id":"8950b8e1-34b3-43a3-aa27-ddc9ab12ee00","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"a743869e-d9e0-4b6b-b264-40a4229fa1db","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"0396b790-747f-4233-9c3e-1f22c156edc8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"01ff0aad-e6a1-4d3f-abb3-ce62f404a1f4","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"2b6c408e-bc7c-47df-b106-df09af72911a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"f062e7b6-9d0c-44d3-bf18-2c54a2c41f86","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"insufficient-storage-839774\" primary control-plane node in \"insufficient-storage-839774\" cluster","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"d1e9ede0-aad1-4303-aee9-e4eeaf92d85a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image v0.0.48 ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"316d8cb8-f41f-4841-ba04-8e1bd20c904d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=3072MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"29e00390-c7ca-402a-b24f-7daff6fcfcb0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-amd64 status -p insufficient-storage-839774 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-839774 --output=json --layout=cluster: exit status 7 (279.269594ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-839774","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=3072MB) ...","BinaryVersion":"v1.37.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-839774","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0918 17:40:53.955604  198031 status.go:458] kubeconfig endpoint: get endpoint: "insufficient-storage-839774" does not appear in /home/jenkins/minikube-integration/20370-7845/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-amd64 status -p insufficient-storage-839774 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-839774 --output=json --layout=cluster: exit status 7 (270.595118ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-839774","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.37.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-839774","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0918 17:40:54.228064  198136 status.go:458] kubeconfig endpoint: get endpoint: "insufficient-storage-839774" does not appear in /home/jenkins/minikube-integration/20370-7845/kubeconfig
	E0918 17:40:54.239229  198136 status.go:258] unable to read event log: stat: stat /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/insufficient-storage-839774/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-839774" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p insufficient-storage-839774
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p insufficient-storage-839774: (1.877107064s)
--- PASS: TestInsufficientStorage (9.35s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (52.93s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run:  /tmp/minikube-v1.32.0.1902778937 start -p running-upgrade-617791 --memory=3072 --vm-driver=docker  --container-runtime=crio
version_upgrade_test.go:120: (dbg) Done: /tmp/minikube-v1.32.0.1902778937 start -p running-upgrade-617791 --memory=3072 --vm-driver=docker  --container-runtime=crio: (24.536958179s)
version_upgrade_test.go:130: (dbg) Run:  out/minikube-linux-amd64 start -p running-upgrade-617791 --memory=3072 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:130: (dbg) Done: out/minikube-linux-amd64 start -p running-upgrade-617791 --memory=3072 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (25.388119496s)
helpers_test.go:175: Cleaning up "running-upgrade-617791" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p running-upgrade-617791
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p running-upgrade-617791: (2.487990254s)
--- PASS: TestRunningBinaryUpgrade (52.93s)

                                                
                                    
x
+
TestKubernetesUpgrade (321.25s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-375279 --memory=3072 --kubernetes-version=v1.28.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:222: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-375279 --memory=3072 --kubernetes-version=v1.28.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (43.572699669s)
version_upgrade_test.go:227: (dbg) Run:  out/minikube-linux-amd64 stop -p kubernetes-upgrade-375279
version_upgrade_test.go:227: (dbg) Done: out/minikube-linux-amd64 stop -p kubernetes-upgrade-375279: (2.496255216s)
version_upgrade_test.go:232: (dbg) Run:  out/minikube-linux-amd64 -p kubernetes-upgrade-375279 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-linux-amd64 -p kubernetes-upgrade-375279 status --format={{.Host}}: exit status 7 (110.864509ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-375279 --memory=3072 --kubernetes-version=v1.34.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:243: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-375279 --memory=3072 --kubernetes-version=v1.34.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (4m25.520469304s)
version_upgrade_test.go:248: (dbg) Run:  kubectl --context kubernetes-upgrade-375279 version --output=json
version_upgrade_test.go:267: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:269: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-375279 --memory=3072 --kubernetes-version=v1.28.0 --driver=docker  --container-runtime=crio
version_upgrade_test.go:269: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p kubernetes-upgrade-375279 --memory=3072 --kubernetes-version=v1.28.0 --driver=docker  --container-runtime=crio: exit status 106 (79.385827ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-375279] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=20370
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.34.0 cluster to v1.28.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.28.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-375279
	    minikube start -p kubernetes-upgrade-375279 --kubernetes-version=v1.28.0
	    
	    2) Create a second cluster with Kubernetes 1.28.0, by running:
	    
	    minikube start -p kubernetes-upgrade-3752792 --kubernetes-version=v1.28.0
	    
	    3) Use the existing cluster at version Kubernetes 1.34.0, by running:
	    
	    minikube start -p kubernetes-upgrade-375279 --kubernetes-version=v1.34.0
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:273: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:275: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-375279 --memory=3072 --kubernetes-version=v1.34.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:275: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-375279 --memory=3072 --kubernetes-version=v1.34.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (6.088260505s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-375279" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p kubernetes-upgrade-375279
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p kubernetes-upgrade-375279: (3.309119537s)
--- PASS: TestKubernetesUpgrade (321.25s)

                                                
                                    
x
+
TestMissingContainerUpgrade (92.5s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:309: (dbg) Run:  /tmp/minikube-v1.32.0.823766646 start -p missing-upgrade-163312 --memory=3072 --driver=docker  --container-runtime=crio
version_upgrade_test.go:309: (dbg) Done: /tmp/minikube-v1.32.0.823766646 start -p missing-upgrade-163312 --memory=3072 --driver=docker  --container-runtime=crio: (46.295891867s)
version_upgrade_test.go:318: (dbg) Run:  docker stop missing-upgrade-163312
version_upgrade_test.go:318: (dbg) Done: docker stop missing-upgrade-163312: (1.742882655s)
version_upgrade_test.go:323: (dbg) Run:  docker rm missing-upgrade-163312
version_upgrade_test.go:329: (dbg) Run:  out/minikube-linux-amd64 start -p missing-upgrade-163312 --memory=3072 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:329: (dbg) Done: out/minikube-linux-amd64 start -p missing-upgrade-163312 --memory=3072 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (41.38901245s)
helpers_test.go:175: Cleaning up "missing-upgrade-163312" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p missing-upgrade-163312
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p missing-upgrade-163312: (2.462210033s)
--- PASS: TestMissingContainerUpgrade (92.50s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (0.7s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (0.70s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (65.11s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run:  /tmp/minikube-v1.32.0.3228272864 start -p stopped-upgrade-489065 --memory=3072 --vm-driver=docker  --container-runtime=crio
E0918 17:41:32.217666   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
version_upgrade_test.go:183: (dbg) Done: /tmp/minikube-v1.32.0.3228272864 start -p stopped-upgrade-489065 --memory=3072 --vm-driver=docker  --container-runtime=crio: (46.301050769s)
version_upgrade_test.go:192: (dbg) Run:  /tmp/minikube-v1.32.0.3228272864 -p stopped-upgrade-489065 stop
version_upgrade_test.go:192: (dbg) Done: /tmp/minikube-v1.32.0.3228272864 -p stopped-upgrade-489065 stop: (1.91587975s)
version_upgrade_test.go:198: (dbg) Run:  out/minikube-linux-amd64 start -p stopped-upgrade-489065 --memory=3072 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:198: (dbg) Done: out/minikube-linux-amd64 start -p stopped-upgrade-489065 --memory=3072 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (16.890000476s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (65.11s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (1.04s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run:  out/minikube-linux-amd64 logs -p stopped-upgrade-489065
version_upgrade_test.go:206: (dbg) Done: out/minikube-linux-amd64 logs -p stopped-upgrade-489065: (1.042790879s)
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (1.04s)

                                                
                                    
x
+
TestPause/serial/Start (48.16s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-amd64 start -p pause-944541 --memory=3072 --install-addons=false --wait=all --driver=docker  --container-runtime=crio
pause_test.go:80: (dbg) Done: out/minikube-linux-amd64 start -p pause-944541 --memory=3072 --install-addons=false --wait=all --driver=docker  --container-runtime=crio: (48.15693402s)
--- PASS: TestPause/serial/Start (48.16s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.08s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:85: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-646894 --no-kubernetes --kubernetes-version=v1.28.0 --driver=docker  --container-runtime=crio
no_kubernetes_test.go:85: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p NoKubernetes-646894 --no-kubernetes --kubernetes-version=v1.28.0 --driver=docker  --container-runtime=crio: exit status 14 (78.697958ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-646894] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=20370
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.08s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (25.1s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:97: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-646894 --memory=3072 --alsologtostderr -v=5 --driver=docker  --container-runtime=crio
no_kubernetes_test.go:97: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-646894 --memory=3072 --alsologtostderr -v=5 --driver=docker  --container-runtime=crio: (24.747800369s)
no_kubernetes_test.go:202: (dbg) Run:  out/minikube-linux-amd64 -p NoKubernetes-646894 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (25.10s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (24.45s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:114: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-646894 --no-kubernetes --memory=3072 --alsologtostderr -v=5 --driver=docker  --container-runtime=crio
no_kubernetes_test.go:114: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-646894 --no-kubernetes --memory=3072 --alsologtostderr -v=5 --driver=docker  --container-runtime=crio: (22.126198455s)
no_kubernetes_test.go:202: (dbg) Run:  out/minikube-linux-amd64 -p NoKubernetes-646894 status -o json
no_kubernetes_test.go:202: (dbg) Non-zero exit: out/minikube-linux-amd64 -p NoKubernetes-646894 status -o json: exit status 2 (295.482991ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-646894","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:126: (dbg) Run:  out/minikube-linux-amd64 delete -p NoKubernetes-646894
no_kubernetes_test.go:126: (dbg) Done: out/minikube-linux-amd64 delete -p NoKubernetes-646894: (2.027602705s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (24.45s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (6.57s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-amd64 start -p pause-944541 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
pause_test.go:92: (dbg) Done: out/minikube-linux-amd64 start -p pause-944541 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (6.553322953s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (6.57s)

                                                
                                    
x
+
TestNetworkPlugins/group/false (3.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false
net_test.go:246: (dbg) Run:  out/minikube-linux-amd64 start -p false-749287 --memory=3072 --alsologtostderr --cni=false --driver=docker  --container-runtime=crio
net_test.go:246: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p false-749287 --memory=3072 --alsologtostderr --cni=false --driver=docker  --container-runtime=crio: exit status 14 (160.869408ms)

                                                
                                                
-- stdout --
	* [false-749287] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=20370
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on user configuration
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0918 17:42:58.956952  231422 out.go:360] Setting OutFile to fd 1 ...
	I0918 17:42:58.957250  231422 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:42:58.957260  231422 out.go:374] Setting ErrFile to fd 2...
	I0918 17:42:58.957266  231422 out.go:408] TERM=,COLORTERM=, which probably does not support color
	I0918 17:42:58.957455  231422 root.go:338] Updating PATH: /home/jenkins/minikube-integration/20370-7845/.minikube/bin
	I0918 17:42:58.957948  231422 out.go:368] Setting JSON to false
	I0918 17:42:58.959228  231422 start.go:130] hostinfo: {"hostname":"ubuntu-20-agent-4","uptime":5130,"bootTime":1758212249,"procs":302,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"22.04","kernelVersion":"6.8.0-1037-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0918 17:42:58.959296  231422 start.go:140] virtualization: kvm guest
	I0918 17:42:58.961610  231422 out.go:179] * [false-749287] minikube v1.37.0 on Ubuntu 22.04 (kvm/amd64)
	I0918 17:42:58.963226  231422 out.go:179]   - MINIKUBE_LOCATION=20370
	I0918 17:42:58.963223  231422 notify.go:220] Checking for updates...
	I0918 17:42:58.966314  231422 out.go:179]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0918 17:42:58.968074  231422 out.go:179]   - KUBECONFIG=/home/jenkins/minikube-integration/20370-7845/kubeconfig
	I0918 17:42:58.969325  231422 out.go:179]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/20370-7845/.minikube
	I0918 17:42:58.970644  231422 out.go:179]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0918 17:42:58.971837  231422 out.go:179]   - MINIKUBE_FORCE_SYSTEMD=
	I0918 17:42:58.973665  231422 config.go:182] Loaded profile config "NoKubernetes-646894": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v0.0.0
	I0918 17:42:58.973795  231422 config.go:182] Loaded profile config "kubernetes-upgrade-375279": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:42:58.973941  231422 config.go:182] Loaded profile config "pause-944541": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
	I0918 17:42:58.974072  231422 driver.go:421] Setting default libvirt URI to qemu:///system
	I0918 17:42:58.998212  231422 docker.go:123] docker version: linux-28.4.0:Docker Engine - Community
	I0918 17:42:58.998363  231422 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0918 17:42:59.056736  231422 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:65 OomKillDisable:false NGoroutines:77 SystemTime:2025-09-18 17:42:59.046107132 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:6.8.0-1037-gcp OperatingSystem:Ubuntu 22.04.5 LTS OSType:linux Architecture:
x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[::1/128 127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33652178944 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-4 Labels:[] ExperimentalBuild:false ServerVersion:28.4.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:05044ec0a9a75232cad458027ca83437aae3f4da Expected:} RuncCommit:{ID:v1.2.5-0-g59923ef Expected:} InitCommit:{ID:de40ad0 Expected:} SecurityOptions:[name=apparmor name=seccomp,profile=builtin name=cgroupns] ProductLicense: Warnings:<nil> ServerErrors:[] ClientInfo:{Debug:false Plugins:[m
ap[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.27.0] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.39.2] map[Name:model Path:/usr/libexec/docker/cli-plugins/docker-model SchemaVersion:0.1.0 ShortDescription:Docker Model Runner (EXPERIMENTAL) Vendor:Docker Inc. Version:v0.1.39] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0918 17:42:59.056832  231422 docker.go:318] overlay module found
	I0918 17:42:59.058617  231422 out.go:179] * Using the docker driver based on user configuration
	I0918 17:42:59.059964  231422 start.go:304] selected driver: docker
	I0918 17:42:59.059980  231422 start.go:924] validating driver "docker" against <nil>
	I0918 17:42:59.059990  231422 start.go:935] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0918 17:42:59.061734  231422 out.go:203] 
	W0918 17:42:59.063166  231422 out.go:285] X Exiting due to MK_USAGE: The "crio" container runtime requires CNI
	X Exiting due to MK_USAGE: The "crio" container runtime requires CNI
	I0918 17:42:59.064398  231422 out.go:203] 

                                                
                                                
** /stderr **
net_test.go:88: 
----------------------- debugLogs start: false-749287 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: false-749287

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: false-749287

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: false-749287

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: false-749287

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: false-749287

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: false-749287

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: false-749287

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: false-749287

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: false-749287

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: false-749287

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: false-749287

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "false-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "false-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "false-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "false-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "false-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "false-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "false-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "false-749287" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "false-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "false-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "false-749287" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 18 Sep 2025 17:42:52 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: cluster_info
server: https://192.168.85.2:8443
name: NoKubernetes-646894
- cluster:
certificate-authority: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 18 Sep 2025 17:41:53 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: cluster_info
server: https://192.168.76.2:8443
name: kubernetes-upgrade-375279
- cluster:
certificate-authority: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 18 Sep 2025 17:42:59 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: cluster_info
server: https://192.168.103.2:8443
name: pause-944541
contexts:
- context:
cluster: NoKubernetes-646894
extensions:
- extension:
last-update: Thu, 18 Sep 2025 17:42:52 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: context_info
namespace: default
user: NoKubernetes-646894
name: NoKubernetes-646894
- context:
cluster: kubernetes-upgrade-375279
user: kubernetes-upgrade-375279
name: kubernetes-upgrade-375279
- context:
cluster: pause-944541
extensions:
- extension:
last-update: Thu, 18 Sep 2025 17:42:59 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: context_info
namespace: default
user: pause-944541
name: pause-944541
current-context: pause-944541
kind: Config
users:
- name: NoKubernetes-646894
user:
client-certificate: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/NoKubernetes-646894/client.crt
client-key: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/NoKubernetes-646894/client.key
- name: kubernetes-upgrade-375279
user:
client-certificate: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kubernetes-upgrade-375279/client.crt
client-key: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kubernetes-upgrade-375279/client.key
- name: pause-944541
user:
client-certificate: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/pause-944541/client.crt
client-key: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/pause-944541/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: false-749287

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "false-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-749287"

                                                
                                                
----------------------- debugLogs end: false-749287 [took: 2.79350097s] --------------------------------
helpers_test.go:175: Cleaning up "false-749287" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p false-749287
--- PASS: TestNetworkPlugins/group/false (3.12s)

                                                
                                    
x
+
TestPause/serial/Pause (0.68s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-amd64 pause -p pause-944541 --alsologtostderr -v=5
--- PASS: TestPause/serial/Pause (0.68s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.33s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-amd64 status -p pause-944541 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p pause-944541 --output=json --layout=cluster: exit status 2 (327.487449ms)

                                                
                                                
-- stdout --
	{"Name":"pause-944541","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 7 containers in: kube-system, kubernetes-dashboard, istio-operator","BinaryVersion":"v1.37.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-944541","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.33s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.64s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-amd64 unpause -p pause-944541 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.64s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (0.69s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-amd64 pause -p pause-944541 --alsologtostderr -v=5
--- PASS: TestPause/serial/PauseAgain (0.69s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (2.74s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-amd64 delete -p pause-944541 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-amd64 delete -p pause-944541 --alsologtostderr -v=5: (2.735583854s)
--- PASS: TestPause/serial/DeletePaused (2.74s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (15.37s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
pause_test.go:142: (dbg) Done: out/minikube-linux-amd64 profile list --output json: (15.296992366s)
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-944541
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-944541: exit status 1 (20.860598ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-944541: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (15.37s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (6.49s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:138: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-646894 --no-kubernetes --memory=3072 --alsologtostderr -v=5 --driver=docker  --container-runtime=crio
no_kubernetes_test.go:138: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-646894 --no-kubernetes --memory=3072 --alsologtostderr -v=5 --driver=docker  --container-runtime=crio: (6.494264282s)
--- PASS: TestNoKubernetes/serial/Start (6.49s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.31s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:149: (dbg) Run:  out/minikube-linux-amd64 ssh -p NoKubernetes-646894 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:149: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-646894 "sudo systemctl is-active --quiet service kubelet": exit status 1 (313.835176ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.31s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (1.66s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:171: (dbg) Run:  out/minikube-linux-amd64 profile list
no_kubernetes_test.go:181: (dbg) Run:  out/minikube-linux-amd64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (1.66s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.46s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:160: (dbg) Run:  out/minikube-linux-amd64 stop -p NoKubernetes-646894
no_kubernetes_test.go:160: (dbg) Done: out/minikube-linux-amd64 stop -p NoKubernetes-646894: (1.456747387s)
--- PASS: TestNoKubernetes/serial/Stop (1.46s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (8.14s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:193: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-646894 --driver=docker  --container-runtime=crio
no_kubernetes_test.go:193: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-646894 --driver=docker  --container-runtime=crio: (8.136725236s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (8.14s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.29s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:149: (dbg) Run:  out/minikube-linux-amd64 ssh -p NoKubernetes-646894 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:149: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-646894 "sudo systemctl is-active --quiet service kubelet": exit status 1 (289.217859ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.29s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (50.43s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run:  out/minikube-linux-amd64 start -p old-k8s-version-525513 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.28.0
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-525513 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.28.0: (50.425639922s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (50.43s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (81.77s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run:  out/minikube-linux-amd64 start -p no-preload-779453 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-779453 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0: (1m21.769923078s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (81.77s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (10.29s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:194: (dbg) Run:  kubectl --context old-k8s-version-525513 create -f testdata/busybox.yaml
start_stop_delete_test.go:194: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:352: "busybox" [0b039d9b-6db6-410f-ad5a-a658b6750d63] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "busybox" [0b039d9b-6db6-410f-ad5a-a658b6750d63] Running
start_stop_delete_test.go:194: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 10.003545211s
start_stop_delete_test.go:194: (dbg) Run:  kubectl --context old-k8s-version-525513 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (10.29s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.94s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p old-k8s-version-525513 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:213: (dbg) Run:  kubectl --context old-k8s-version-525513 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.94s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (16.21s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:226: (dbg) Run:  out/minikube-linux-amd64 stop -p old-k8s-version-525513 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-amd64 stop -p old-k8s-version-525513 --alsologtostderr -v=3: (16.209479555s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (16.21s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.17s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-525513 -n old-k8s-version-525513
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-525513 -n old-k8s-version-525513: exit status 7 (67.578151ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p old-k8s-version-525513 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.17s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (141.64s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run:  out/minikube-linux-amd64 start -p old-k8s-version-525513 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.28.0
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-525513 --memory=3072 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.28.0: (2m21.321046214s)
start_stop_delete_test.go:260: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-525513 -n old-k8s-version-525513
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (141.64s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (8.29s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:194: (dbg) Run:  kubectl --context no-preload-779453 create -f testdata/busybox.yaml
start_stop_delete_test.go:194: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:352: "busybox" [4ecacdeb-1e35-4f17-9ab1-3e7318b64707] Pending
helpers_test.go:352: "busybox" [4ecacdeb-1e35-4f17-9ab1-3e7318b64707] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "busybox" [4ecacdeb-1e35-4f17-9ab1-3e7318b64707] Running
start_stop_delete_test.go:194: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 8.004179664s
start_stop_delete_test.go:194: (dbg) Run:  kubectl --context no-preload-779453 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (8.29s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.93s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p no-preload-779453 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:213: (dbg) Run:  kubectl --context no-preload-779453 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.93s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (16.72s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:226: (dbg) Run:  out/minikube-linux-amd64 stop -p no-preload-779453 --alsologtostderr -v=3
E0918 17:45:45.077054   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/addons-294579/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-amd64 stop -p no-preload-779453 --alsologtostderr -v=3: (16.721320481s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (16.72s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.17s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-779453 -n no-preload-779453
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-779453 -n no-preload-779453: exit status 7 (65.552143ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p no-preload-779453 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.17s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (45.98s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run:  out/minikube-linux-amd64 start -p no-preload-779453 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-779453 --memory=3072 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0: (45.650228406s)
start_stop_delete_test.go:260: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-779453 -n no-preload-779453
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (45.98s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (70.02s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run:  out/minikube-linux-amd64 start -p embed-certs-391175 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0
E0918 17:46:32.217788   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-391175 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0: (1m10.015579892s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (70.02s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-twxt6" [878adbbb-fd2b-4655-92d8-52e5c5934b48] Running
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-twxt6" [878adbbb-fd2b-4655-92d8-52e5c5934b48] Running / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-twxt6" [878adbbb-fd2b-4655-92d8-52e5c5934b48] Running
start_stop_delete_test.go:272: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004097091s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.07s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:285: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-twxt6" [878adbbb-fd2b-4655-92d8-52e5c5934b48] Running
start_stop_delete_test.go:285: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.004190676s
start_stop_delete_test.go:289: (dbg) Run:  kubectl --context no-preload-779453 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.07s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run:  out/minikube-linux-amd64 -p no-preload-779453 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250512-df8de77b
start_stop_delete_test.go:302: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.23s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (2.72s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 pause -p no-preload-779453 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-779453 -n no-preload-779453
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-779453 -n no-preload-779453: exit status 2 (313.957068ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-779453 -n no-preload-779453
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-779453 -n no-preload-779453: exit status 2 (307.198803ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 unpause -p no-preload-779453 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-779453 -n no-preload-779453
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-779453 -n no-preload-779453
--- PASS: TestStartStop/group/no-preload/serial/Pause (2.72s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (39.75s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run:  out/minikube-linux-amd64 start -p default-k8s-diff-port-804544 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-diff-port-804544 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0: (39.752190221s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (39.75s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (28.84s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:184: (dbg) Run:  out/minikube-linux-amd64 start -p newest-cni-956166 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0
start_stop_delete_test.go:184: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-956166 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0: (28.840013398s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (28.84s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (8.27s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:194: (dbg) Run:  kubectl --context embed-certs-391175 create -f testdata/busybox.yaml
start_stop_delete_test.go:194: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:352: "busybox" [a2cef76c-6098-46db-88e8-5f701aa75fb6] Pending
helpers_test.go:352: "busybox" [a2cef76c-6098-46db-88e8-5f701aa75fb6] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "busybox" [a2cef76c-6098-46db-88e8-5f701aa75fb6] Running
start_stop_delete_test.go:194: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 8.004064106s
start_stop_delete_test.go:194: (dbg) Run:  kubectl --context embed-certs-391175 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (8.27s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-8694d4445c-9rqj4" [5652af16-37d4-4d9a-aa22-e19a7ecfbd77] Running / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
start_stop_delete_test.go:272: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003170405s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.00s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.9s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-391175 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:213: (dbg) Run:  kubectl --context embed-certs-391175 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.90s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.08s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:285: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-8694d4445c-9rqj4" [5652af16-37d4-4d9a-aa22-e19a7ecfbd77] Running / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
start_stop_delete_test.go:285: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.004098579s
start_stop_delete_test.go:289: (dbg) Run:  kubectl --context old-k8s-version-525513 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.08s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (18.23s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:226: (dbg) Run:  out/minikube-linux-amd64 stop -p embed-certs-391175 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-amd64 stop -p embed-certs-391175 --alsologtostderr -v=3: (18.227890937s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (18.23s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (9.31s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:194: (dbg) Run:  kubectl --context default-k8s-diff-port-804544 create -f testdata/busybox.yaml
start_stop_delete_test.go:194: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:352: "busybox" [94d5093b-c76f-4983-bdec-98f7277029c7] Pending
helpers_test.go:352: "busybox" [94d5093b-c76f-4983-bdec-98f7277029c7] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:352: "busybox" [94d5093b-c76f-4983-bdec-98f7277029c7] Running
start_stop_delete_test.go:194: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 9.004166395s
start_stop_delete_test.go:194: (dbg) Run:  kubectl --context default-k8s-diff-port-804544 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (9.31s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.79s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p newest-cni-956166 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:209: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.79s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (2.42s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:226: (dbg) Run:  out/minikube-linux-amd64 stop -p newest-cni-956166 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-amd64 stop -p newest-cni-956166 --alsologtostderr -v=3: (2.422426647s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (2.42s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.26s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run:  out/minikube-linux-amd64 -p old-k8s-version-525513 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250512-df8de77b
start_stop_delete_test.go:302: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20230511-dc714da8
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.26s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (2.84s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 pause -p old-k8s-version-525513 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-525513 -n old-k8s-version-525513
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-525513 -n old-k8s-version-525513: exit status 2 (332.501516ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-525513 -n old-k8s-version-525513
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-525513 -n old-k8s-version-525513: exit status 2 (312.983487ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 unpause -p old-k8s-version-525513 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-525513 -n old-k8s-version-525513
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-525513 -n old-k8s-version-525513
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (2.84s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-956166 -n newest-cni-956166
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-956166 -n newest-cni-956166: exit status 7 (82.739144ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p newest-cni-956166 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.19s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (12.18s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run:  out/minikube-linux-amd64 start -p newest-cni-956166 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-956166 --memory=3072 --alsologtostderr --wait=apiserver,system_pods,default_sa --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0: (11.815834412s)
start_stop_delete_test.go:260: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-956166 -n newest-cni-956166
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (12.18s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.91s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:203: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-diff-port-804544 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:213: (dbg) Run:  kubectl --context default-k8s-diff-port-804544 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.91s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (73.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p auto-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p auto-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=crio: (1m13.322892142s)
--- PASS: TestNetworkPlugins/group/auto/Start (73.32s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (16.98s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:226: (dbg) Run:  out/minikube-linux-amd64 stop -p default-k8s-diff-port-804544 --alsologtostderr -v=3
start_stop_delete_test.go:226: (dbg) Done: out/minikube-linux-amd64 stop -p default-k8s-diff-port-804544 --alsologtostderr -v=3: (16.983539934s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (16.98s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:271: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:282: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run:  out/minikube-linux-amd64 -p newest-cni-956166 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250512-df8de77b
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.23s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (2.66s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 pause -p newest-cni-956166 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-956166 -n newest-cni-956166
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-956166 -n newest-cni-956166: exit status 2 (328.227749ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-956166 -n newest-cni-956166
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-956166 -n newest-cni-956166: exit status 2 (321.371989ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 unpause -p newest-cni-956166 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-956166 -n newest-cni-956166
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-956166 -n newest-cni-956166
--- PASS: TestStartStop/group/newest-cni/serial/Pause (2.66s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-391175 -n embed-certs-391175
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-391175 -n embed-certs-391175: exit status 7 (79.993526ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p embed-certs-391175 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (56.63s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run:  out/minikube-linux-amd64 start -p embed-certs-391175 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-391175 --memory=3072 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0: (56.276011694s)
start_stop_delete_test.go:260: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-391175 -n embed-certs-391175
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (56.63s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (70.88s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p kindnet-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p kindnet-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=crio: (1m10.876635669s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (70.88s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.28s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:237: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-804544 -n default-k8s-diff-port-804544
start_stop_delete_test.go:237: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-804544 -n default-k8s-diff-port-804544: exit status 7 (118.504878ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:237: status error: exit status 7 (may be ok)
start_stop_delete_test.go:244: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p default-k8s-diff-port-804544 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.28s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (27.9s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:254: (dbg) Run:  out/minikube-linux-amd64 start -p default-k8s-diff-port-804544 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0
start_stop_delete_test.go:254: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-diff-port-804544 --memory=3072 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.34.0: (27.579395552s)
start_stop_delete_test.go:260: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-804544 -n default-k8s-diff-port-804544
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (27.90s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-svs5n" [c1a7e0ee-453c-4d4b-91f9-14a082cb058b] Running
start_stop_delete_test.go:272: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004219832s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (6.07s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:285: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-svs5n" [c1a7e0ee-453c-4d4b-91f9-14a082cb058b] Running
start_stop_delete_test.go:285: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.003478166s
start_stop_delete_test.go:289: (dbg) Run:  kubectl --context default-k8s-diff-port-804544 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (6.07s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.22s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run:  out/minikube-linux-amd64 -p default-k8s-diff-port-804544 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250512-df8de77b
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.22s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:272: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-n4ssg" [e93f01a4-e324-4cd2-9cf6-f159f3f36d51] Running
start_stop_delete_test.go:272: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.004582744s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (49.76s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p calico-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p calico-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=crio: (49.761367902s)
--- PASS: TestNetworkPlugins/group/calico/Start (49.76s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.11s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:285: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:352: "kubernetes-dashboard-855c9754f9-n4ssg" [e93f01a4-e324-4cd2-9cf6-f159f3f36d51] Running
start_stop_delete_test.go:285: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.007105836s
start_stop_delete_test.go:289: (dbg) Run:  kubectl --context embed-certs-391175 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.11s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p auto-749287 "pgrep -a kubelet"
I0918 17:49:01.078434   11368 config.go:182] Loaded profile config "auto-749287": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (10.36s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-749287 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-w9wth" [da232263-c111-4e20-baa0-410771368718] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-w9wth" [da232263-c111-4e20-baa0-410771368718] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 10.00399513s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (10.36s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.25s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:302: (dbg) Run:  out/minikube-linux-amd64 -p embed-certs-391175 image list --format=json
start_stop_delete_test.go:302: Found non-minikube image: kindest/kindnetd:v20250512-df8de77b
start_stop_delete_test.go:302: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.25s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (2.84s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 pause -p embed-certs-391175 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-391175 -n embed-certs-391175
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-391175 -n embed-certs-391175: exit status 2 (309.712716ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-391175 -n embed-certs-391175
start_stop_delete_test.go:309: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-391175 -n embed-certs-391175: exit status 2 (303.9448ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:309: status error: exit status 2 (may be ok)
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 unpause -p embed-certs-391175 --alsologtostderr -v=1
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-391175 -n embed-certs-391175
start_stop_delete_test.go:309: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-391175 -n embed-certs-391175
--- PASS: TestStartStop/group/embed-certs/serial/Pause (2.84s)
E0918 17:50:28.775445   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/no-preload-779453/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:50:28.781821   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/no-preload-779453/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:50:28.793324   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/no-preload-779453/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:50:28.815406   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/no-preload-779453/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:50:28.856870   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/no-preload-779453/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:50:28.938450   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/no-preload-779453/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:50:29.099993   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/no-preload-779453/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:50:29.422009   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/no-preload-779453/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:50:30.064067   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/no-preload-779453/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (55.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p custom-flannel-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p custom-flannel-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=crio: (55.303176965s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (55.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:352: "kindnet-tdg2m" [6593f174-ee18-4061-9d54-e0abadbee73e] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 6.003778967s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-749287 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-749287 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.12s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-749287 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.12s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p kindnet-749287 "pgrep -a kubelet"
I0918 17:49:16.997422   11368 config.go:182] Loaded profile config "kindnet-749287": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (9.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-749287 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-2l6bb" [97363e97-c6a8-4ec5-9606-5135cc783392] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-2l6bb" [97363e97-c6a8-4ec5-9606-5135cc783392] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 9.004091221s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (9.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.16s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-749287 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-749287 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.13s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-749287 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (96.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p enable-default-cni-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=crio
E0918 17:49:41.245770   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/old-k8s-version-525513/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:49:41.252179   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/old-k8s-version-525513/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:49:41.263715   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/old-k8s-version-525513/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:49:41.285142   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/old-k8s-version-525513/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:49:41.327174   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/old-k8s-version-525513/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:49:41.409075   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/old-k8s-version-525513/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:49:41.570429   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/old-k8s-version-525513/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:49:41.892376   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/old-k8s-version-525513/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:49:42.534473   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/old-k8s-version-525513/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
E0918 17:49:43.817482   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/old-k8s-version-525513/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p enable-default-cni-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=crio: (1m36.251154882s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (96.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:352: "calico-node-s77pm" [7bf4c3e4-8387-4a69-b5c3-feaff2cc7809] Running / Ready:ContainersNotReady (containers with unready status: [calico-node]) / ContainersReady:ContainersNotReady (containers with unready status: [calico-node])
helpers_test.go:352: "calico-node-s77pm" [7bf4c3e4-8387-4a69-b5c3-feaff2cc7809] Running
E0918 17:49:51.502722   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/old-k8s-version-525513/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 6.004021107s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.35s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p calico-749287 "pgrep -a kubelet"
I0918 17:49:52.004131   11368 config.go:182] Loaded profile config "calico-749287": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.35s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (11.22s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-749287 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-slv4m" [20d0de28-df84-4674-8e78-a0db2406a98b] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-slv4m" [20d0de28-df84-4674-8e78-a0db2406a98b] Running
E0918 17:50:01.744370   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/old-k8s-version-525513/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 11.003549747s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (11.22s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-749287 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-749287 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.12s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-749287 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p custom-flannel-749287 "pgrep -a kubelet"
I0918 17:50:04.322390   11368 config.go:182] Loaded profile config "custom-flannel-749287": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (8.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-749287 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-4qhdz" [1bbbb51f-f9b3-4315-b275-020cb182776c] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-4qhdz" [1bbbb51f-f9b3-4315-b275-020cb182776c] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 8.004483862s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (8.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-749287 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-749287 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.12s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-749287 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.12s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (62.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p bridge-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p bridge-749287 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=crio: (1m2.336999735s)
--- PASS: TestNetworkPlugins/group/bridge/Start (62.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p enable-default-cni-749287 "pgrep -a kubelet"
I0918 17:51:09.180254   11368 config.go:182] Loaded profile config "enable-default-cni-749287": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-749287 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-gnsj4" [c7ac48b9-74ac-4906-88c4-bec68eb8fd52] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
E0918 17:51:09.753959   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/no-preload-779453/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
helpers_test.go:352: "netcat-cd4db9dbf-gnsj4" [c7ac48b9-74ac-4906-88c4-bec68eb8fd52] Running
E0918 17:51:15.288213   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 9.004124571s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-749287 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.13s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.11s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-749287 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.11s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.11s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-749287 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.11s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p bridge-749287 "pgrep -a kubelet"
I0918 17:51:26.906625   11368 config.go:182] Loaded profile config "bridge-749287": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.34.0
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (9.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-749287 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:352: "netcat-cd4db9dbf-d6td8" [7860a1b9-b5a4-4448-a7b1-fc53f5c10c78] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:352: "netcat-cd4db9dbf-d6td8" [7860a1b9-b5a4-4448-a7b1-fc53f5c10c78] Running
E0918 17:51:32.217687   11368 cert_rotation.go:172] "Loading client cert failed" err="open /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/functional-366930/client.crt: no such file or directory" logger="tls-transport-cache.UnhandledError" key="key"
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 9.003419003s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (9.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-749287 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.13s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-749287 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.12s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-749287 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.12s)

                                                
                                    

Test skip (27/323)

x
+
TestDownloadOnly/v1.28.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.28.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.28.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.0/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.28.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.34.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.34.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.34.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.34.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.34.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.34.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.34.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.34.0/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.34.0/kubectl (0.00s)

                                                
                                    
x
+
TestAddons/serial/Volcano (0.27s)

                                                
                                                
=== RUN   TestAddons/serial/Volcano
addons_test.go:850: skipping: crio not supported
addons_test.go:1053: (dbg) Run:  out/minikube-linux-amd64 -p addons-294579 addons disable volcano --alsologtostderr -v=1
--- SKIP: TestAddons/serial/Volcano (0.27s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/RealCredentials (0s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/RealCredentials
addons_test.go:763: skipping GCPAuth addon test until 'Permission "artifactregistry.repositories.downloadArtifacts" denied on resource "projects/k8s-minikube/locations/us/repositories/test-artifacts" (or it may not exist)' issue is resolved
--- SKIP: TestAddons/serial/GCPAuth/RealCredentials (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:483: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerFlags (0s)

                                                
                                                
=== RUN   TestDockerFlags
docker_test.go:41: skipping: only runs with docker container runtime, currently testing crio
--- SKIP: TestDockerFlags (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with crio true linux amd64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:114: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:178: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DockerEnv
functional_test.go:478: only validate docker env with docker container runtime, currently testing crio
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:565: only validate podman env with docker container runtime, currently testing crio
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestFunctionalNewestKubernetes (0s)

                                                
                                                
=== RUN   TestFunctionalNewestKubernetes
functional_test.go:82: 
--- SKIP: TestFunctionalNewestKubernetes (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild (0s)

                                                
                                                
=== RUN   TestImageBuild
image_test.go:33: 
--- SKIP: TestImageBuild (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestSkaffold (0s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing crio container runtime
--- SKIP: TestSkaffold (0.00s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.16s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:101: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-079896" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p disable-driver-mounts-079896
--- SKIP: TestStartStop/group/disable-driver-mounts (0.16s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet (3.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet
net_test.go:93: Skipping the test as crio container runtimes requires CNI
panic.go:636: 
----------------------- debugLogs start: kubenet-749287 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-749287

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: kubenet-749287

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-749287

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: kubenet-749287

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: kubenet-749287

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: kubenet-749287

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: kubenet-749287

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: kubenet-749287

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: kubenet-749287

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: kubenet-749287

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: kubenet-749287

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "kubenet-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "kubenet-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "kubenet-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "kubenet-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "kubenet-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "kubenet-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "kubenet-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "kubenet-749287" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "kubenet-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "kubenet-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "kubenet-749287" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 18 Sep 2025 17:42:52 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: cluster_info
server: https://192.168.85.2:8443
name: NoKubernetes-646894
- cluster:
certificate-authority: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 18 Sep 2025 17:41:53 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: cluster_info
server: https://192.168.76.2:8443
name: kubernetes-upgrade-375279
- cluster:
certificate-authority: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 18 Sep 2025 17:42:40 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: cluster_info
server: https://192.168.103.2:8443
name: pause-944541
contexts:
- context:
cluster: NoKubernetes-646894
extensions:
- extension:
last-update: Thu, 18 Sep 2025 17:42:52 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: context_info
namespace: default
user: NoKubernetes-646894
name: NoKubernetes-646894
- context:
cluster: kubernetes-upgrade-375279
user: kubernetes-upgrade-375279
name: kubernetes-upgrade-375279
- context:
cluster: pause-944541
extensions:
- extension:
last-update: Thu, 18 Sep 2025 17:42:40 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: context_info
namespace: default
user: pause-944541
name: pause-944541
current-context: NoKubernetes-646894
kind: Config
users:
- name: NoKubernetes-646894
user:
client-certificate: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/NoKubernetes-646894/client.crt
client-key: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/NoKubernetes-646894/client.key
- name: kubernetes-upgrade-375279
user:
client-certificate: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kubernetes-upgrade-375279/client.crt
client-key: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kubernetes-upgrade-375279/client.key
- name: pause-944541
user:
client-certificate: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/pause-944541/client.crt
client-key: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/pause-944541/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: kubenet-749287

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "kubenet-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-749287"

                                                
                                                
----------------------- debugLogs end: kubenet-749287 [took: 3.096698094s] --------------------------------
helpers_test.go:175: Cleaning up "kubenet-749287" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p kubenet-749287
--- SKIP: TestNetworkPlugins/group/kubenet (3.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (3.51s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:636: 
----------------------- debugLogs start: cilium-749287 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-749287

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-749287

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-749287

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-749287

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-749287

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-749287

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-749287

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-749287

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-749287

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-749287

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-749287

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-749287" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-749287

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-749287

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-749287

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-749287

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-749287" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-749287" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 18 Sep 2025 17:42:52 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: cluster_info
server: https://192.168.85.2:8443
name: NoKubernetes-646894
- cluster:
certificate-authority: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 18 Sep 2025 17:41:53 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: cluster_info
server: https://192.168.76.2:8443
name: kubernetes-upgrade-375279
- cluster:
certificate-authority: /home/jenkins/minikube-integration/20370-7845/.minikube/ca.crt
extensions:
- extension:
last-update: Thu, 18 Sep 2025 17:42:59 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: cluster_info
server: https://192.168.103.2:8443
name: pause-944541
contexts:
- context:
cluster: NoKubernetes-646894
extensions:
- extension:
last-update: Thu, 18 Sep 2025 17:42:52 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: context_info
namespace: default
user: NoKubernetes-646894
name: NoKubernetes-646894
- context:
cluster: kubernetes-upgrade-375279
user: kubernetes-upgrade-375279
name: kubernetes-upgrade-375279
- context:
cluster: pause-944541
extensions:
- extension:
last-update: Thu, 18 Sep 2025 17:42:59 UTC
provider: minikube.sigs.k8s.io
version: v1.37.0
name: context_info
namespace: default
user: pause-944541
name: pause-944541
current-context: pause-944541
kind: Config
users:
- name: NoKubernetes-646894
user:
client-certificate: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/NoKubernetes-646894/client.crt
client-key: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/NoKubernetes-646894/client.key
- name: kubernetes-upgrade-375279
user:
client-certificate: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kubernetes-upgrade-375279/client.crt
client-key: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/kubernetes-upgrade-375279/client.key
- name: pause-944541
user:
client-certificate: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/pause-944541/client.crt
client-key: /home/jenkins/minikube-integration/20370-7845/.minikube/profiles/pause-944541/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-749287

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-749287" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-749287"

                                                
                                                
----------------------- debugLogs end: cilium-749287 [took: 3.352996204s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-749287" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p cilium-749287
--- SKIP: TestNetworkPlugins/group/cilium (3.51s)

                                                
                                    
Copied to clipboard