=== RUN   TestFunctional/parallel/ServiceCmd

=== PAUSE TestFunctional/parallel/ServiceCmd

=== CONT  TestFunctional/parallel/ServiceCmd

functional_test.go:1432: (dbg) Run:  kubectl --context functional-20220531173104-2108 create deployment hello-node --image=k8s.gcr.io/echoserver:1.8

=== CONT  TestFunctional/parallel/ServiceCmd

functional_test.go:1438: (dbg) Run:  kubectl --context functional-20220531173104-2108 expose deployment hello-node --type=NodePort --port=8080

functional_test.go:1438: (dbg) Done: kubectl --context functional-20220531173104-2108 expose deployment hello-node --type=NodePort --port=8080: (1.7943778s)

functional_test.go:1443: (dbg) TestFunctional/parallel/ServiceCmd: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...

helpers_test.go:342: "hello-node-54fbb85-c6cbz" [cb26a5f8-1d38-4f26-a335-6c49185e047a] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver])

=== CONT  TestFunctional/parallel/ServiceCmd

helpers_test.go:342: "hello-node-54fbb85-c6cbz" [cb26a5f8-1d38-4f26-a335-6c49185e047a] Running

=== CONT  TestFunctional/parallel/ServiceCmd

functional_test.go:1443: (dbg) TestFunctional/parallel/ServiceCmd: app=hello-node healthy within 12.085074s

functional_test.go:1448: (dbg) Run:  out/minikube-windows-amd64.exe -p functional-20220531173104-2108 service list

=== CONT  TestFunctional/parallel/ServiceCmd

functional_test.go:1448: (dbg) Done: out/minikube-windows-amd64.exe -p functional-20220531173104-2108 service list: (6.8622051s)

functional_test.go:1462: (dbg) Run:  out/minikube-windows-amd64.exe -p functional-20220531173104-2108 service --namespace=default --https --url hello-node

functional_test.go:1391: Failed to sent interrupt to proc not supported by windows

=== CONT  TestFunctional/parallel/ServiceCmd

functional_test.go:1462: (dbg) Non-zero exit: out/minikube-windows-amd64.exe -p functional-20220531173104-2108 service --namespace=default --https --url hello-node: exit status 1 (33m42.3573256s)

-- stdout --

	https://127.0.0.1:51551

-- /stdout --

** stderr ** 

	! Because you are using a Docker driver on windows, the terminal needs to be open to run it.

** /stderr **

functional_test.go:1464: failed to get service url. args "out/minikube-windows-amd64.exe -p functional-20220531173104-2108 service --namespace=default --https --url hello-node" : exit status 1

functional_test.go:1401: service test failed - dumping debug information

functional_test.go:1402: -----------------------service failure post-mortem--------------------------------

functional_test.go:1405: (dbg) Run:  kubectl --context functional-20220531173104-2108 describe po hello-node

functional_test.go:1409: hello-node pod describe:

Name:         hello-node-54fbb85-c6cbz

Namespace:    default

Priority:     0

Node:         functional-20220531173104-2108/192.168.49.2

Start Time:   Tue, 31 May 2022 17:37:02 +0000

Labels:       app=hello-node

pod-template-hash=54fbb85

Annotations:  <none>

Status:       Running

IP:           172.17.0.6

IPs:

IP:           172.17.0.6

Controlled By:  ReplicaSet/hello-node-54fbb85

Containers:

echoserver:

Container ID:   docker://6adb5fb1de30080d3ea7a23717d2cf5cedc66e5a49250f40c68daf17e777c836

Image:          k8s.gcr.io/echoserver:1.8

Image ID:       docker-pullable://k8s.gcr.io/echoserver@sha256:cb3386f863f6a4b05f33c191361723f9d5927ac287463b1bea633bf859475969

Port:           <none>

Host Port:      <none>

State:          Running

Started:      Tue, 31 May 2022 17:37:06 +0000

Ready:          True

Restart Count:  0

Environment:    <none>

Mounts:

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-wfj6f (ro)

Conditions:

Type              Status

Initialized       True 

Ready             True 

ContainersReady   True 

PodScheduled      True 

Volumes:

kube-api-access-wfj6f:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

QoS Class:                   BestEffort

Node-Selectors:              <none>

Tolerations:                 node.kubernetes.io/not-ready:NoExecute for 300s

node.kubernetes.io/unreachable:NoExecute for 300s

Events:

Type    Reason     Age        From                                     Message

----    ------     ----       ----                                     -------

Normal  Scheduled  <unknown>                                           Successfully assigned default/hello-node-54fbb85-c6cbz to functional-20220531173104-2108

Normal  Pulling    33m        kubelet, functional-20220531173104-2108  Pulling image "k8s.gcr.io/echoserver:1.8"

Normal  Pulled     33m        kubelet, functional-20220531173104-2108  Successfully pulled image "k8s.gcr.io/echoserver:1.8" in 517.5097ms

Normal  Created    33m        kubelet, functional-20220531173104-2108  Created container echoserver

Normal  Started    33m        kubelet, functional-20220531173104-2108  Started container echoserver

Name:         hello-node-connect-74cf8bc446-5wbb6

Namespace:    default

Priority:     0

Node:         functional-20220531173104-2108/192.168.49.2

Start Time:   Tue, 31 May 2022 17:36:37 +0000

Labels:       app=hello-node-connect

pod-template-hash=74cf8bc446

Annotations:  <none>

Status:       Running

IP:           172.17.0.5

IPs:

IP:           172.17.0.5

Controlled By:  ReplicaSet/hello-node-connect-74cf8bc446

Containers:

echoserver:

Container ID:   docker://1182335c773e478c9890bdd83b406b436f7adcf53e8f4d349c0688be8bb65ef9

Image:          k8s.gcr.io/echoserver:1.8

Image ID:       docker-pullable://k8s.gcr.io/echoserver@sha256:cb3386f863f6a4b05f33c191361723f9d5927ac287463b1bea633bf859475969

Port:           <none>

Host Port:      <none>

State:          Running

Started:      Tue, 31 May 2022 17:37:06 +0000

Ready:          True

Restart Count:  0

Environment:    <none>

Mounts:

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-tf44x (ro)

Conditions:

Type              Status

Initialized       True 

Ready             True 

ContainersReady   True 

PodScheduled      True 

Volumes:

kube-api-access-tf44x:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

QoS Class:                   BestEffort

Node-Selectors:              <none>

Tolerations:                 node.kubernetes.io/not-ready:NoExecute for 300s

node.kubernetes.io/unreachable:NoExecute for 300s

Events:

Type    Reason     Age        From                                     Message

----    ------     ----       ----                                     -------

Normal  Scheduled  <unknown>                                           Successfully assigned default/hello-node-connect-74cf8bc446-5wbb6 to functional-20220531173104-2108

Normal  Pulling    34m        kubelet, functional-20220531173104-2108  Pulling image "k8s.gcr.io/echoserver:1.8"

Normal  Pulled     33m        kubelet, functional-20220531173104-2108  Successfully pulled image "k8s.gcr.io/echoserver:1.8" in 23.0353974s

Normal  Created    33m        kubelet, functional-20220531173104-2108  Created container echoserver

Normal  Started    33m        kubelet, functional-20220531173104-2108  Started container echoserver

functional_test.go:1411: (dbg) Run:  kubectl --context functional-20220531173104-2108 logs -l app=hello-node

functional_test.go:1415: hello-node logs:

functional_test.go:1417: (dbg) Run:  kubectl --context functional-20220531173104-2108 describe svc hello-node

functional_test.go:1421: hello-node svc describe:

Name:                     hello-node

Namespace:                default

Labels:                   app=hello-node

Annotations:              <none>

Selector:                 app=hello-node

Type:                     NodePort

IP:                       10.99.219.246

Port:                     <unset>  8080/TCP

TargetPort:               8080/TCP

NodePort:                 <unset>  30045/TCP

Endpoints:                172.17.0.6:8080

Session Affinity:         None

External Traffic Policy:  Cluster

Events:                   <none>

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestFunctional/parallel/ServiceCmd]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect functional-20220531173104-2108

helpers_test.go:231: (dbg) Done: docker inspect functional-20220531173104-2108: (1.035364s)

helpers_test.go:235: (dbg) docker inspect functional-20220531173104-2108:

-- stdout --

	[

	    {

	        "Id": "ac9800570c9ffae9b635aac2624d98b3eb69b6a125527175288721176f4e2ea2",

	        "Created": "2022-05-31T17:31:57.5400252Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 20855,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2022-05-31T17:31:58.5923319Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:aedbaa58534633065a66af6f01ba15f6c7dc1b8a285b6938f9d04325ceab9ed4",

	        "ResolvConfPath": "/var/lib/docker/containers/ac9800570c9ffae9b635aac2624d98b3eb69b6a125527175288721176f4e2ea2/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/ac9800570c9ffae9b635aac2624d98b3eb69b6a125527175288721176f4e2ea2/hostname",

	        "HostsPath": "/var/lib/docker/containers/ac9800570c9ffae9b635aac2624d98b3eb69b6a125527175288721176f4e2ea2/hosts",

	        "LogPath": "/var/lib/docker/containers/ac9800570c9ffae9b635aac2624d98b3eb69b6a125527175288721176f4e2ea2/ac9800570c9ffae9b635aac2624d98b3eb69b6a125527175288721176f4e2ea2-json.log",

	        "Name": "/functional-20220531173104-2108",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "functional-20220531173104-2108:/var",

	                "/lib/modules:/lib/modules:ro"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "functional-20220531173104-2108",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8441/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 4194304000,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 4194304000,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/0baaca0513be4bf258a1f50e3173d958d093976d0a3a9664ac04d87ab09e3671-init/diff:/var/lib/docker/overlay2/42ebd8012a176a6c9bc83a2b81ffb1eb5c8e01d5410cb5d59346522bbaddf2cc/diff:/var/lib/docker/overlay2/59dce173ea661e9679f479af711a101ab0e97afb60abfd3c5b7a199b5c3e2b3b/diff:/var/lib/docker/overlay2/0328b60a223ca9f8bab93e6b86106d8b64d16fa559a56e88abbdee372b3b6a70/diff:/var/lib/docker/overlay2/b781f2620a052ee02138337819bde18c09122be2f20b7cfefaf7688f18d0c559/diff:/var/lib/docker/overlay2/af966c145b90b1748180b9ffcb1521d6fa9914e1d0ca582b239123591ffd1527/diff:/var/lib/docker/overlay2/5cd2b511f6f3bc93855ed77b5510ca4c67426eea433ccda53ea8e864342a413e/diff:/var/lib/docker/overlay2/f896d291d0c004470c3e38ea0d3be8e2b2a48ea36d45662c40fe3e105cbf4dec/diff:/var/lib/docker/overlay2/9e8994dcf5b1692245d5e40982d040298bfa7f7977892cf4be8ba3697f2c1283/diff:/var/lib/docker/overlay2/a7da4130c1b629e2a737b34701c6d4dfe6c48f92771856a887e06a1edc5456f8/diff:/var/lib/docker/overlay2/4c2573

4b9c8459489256b5f70dbb446897b9510d1cf9187e903f845ffa2a7ec2/diff:/var/lib/docker/overlay2/5c6cef49a0d0d1a36777fa7e0955ecdffb41ce354b7984f232e9cd51916416f7/diff:/var/lib/docker/overlay2/b79c799ed97edb702ed4c4ccb55ef9c645ae162e30e8f297ca5dd1152c29de41/diff:/var/lib/docker/overlay2/c84b7bc7c79ffdedf2d1265e21eec011dc3215811fb0569f7eb7d6b9aec884e8/diff:/var/lib/docker/overlay2/df8e2c3af362fd04ee17cb8d67105cf489427b2ae7cec77b79a2778e6c8c0234/diff:/var/lib/docker/overlay2/e56e356f8425868b31ada978267de73f074f211985ff1849ece7ab8341c33bae/diff:/var/lib/docker/overlay2/82c032066e83d3297742c83dd29132974e9db73a0b0b0a8edd3bcbbdb29cd53c/diff:/var/lib/docker/overlay2/15532131f3e6d0b2faf705733b06ae0c869147f2ca9592e3a80b6eaadad23544/diff:/var/lib/docker/overlay2/73fa456f504732f46cbe49368167247ca47b3099a6a75a7023ba16e7f598aee5/diff:/var/lib/docker/overlay2/e5635e020aadcc8dd1e5e3cd2eaa45cb97147f47bf406211fc61d7cbfc531193/diff:/var/lib/docker/overlay2/40b76b3249d3f7a8a737e2db80ebc1ed3b76d59724641217e8aae414ad832781/diff:/var/lib/d

ocker/overlay2/50ea2ce78d4fe52f626b2755a14f71a3c4f9b5a4f929646d9200876bdb1652c1/diff:/var/lib/docker/overlay2/d0a6e94d1f4aa73824d39c6e655bc4bdcd6568cea821b5d0f71174591c9cbbb3/diff:/var/lib/docker/overlay2/20c8fbe37a8c89a03b7bffe8cbc507e888cd5886f86f43b551d6a09fee1ce5e7/diff:/var/lib/docker/overlay2/48942b31cfe24e44c65a8be1785cd90488444f8c420a79b72a123034b01dd3f8/diff:/var/lib/docker/overlay2/c90124ab97e02facd949bfbd45815d6d73a40303b47ba4a4bc035788f5ee2dc3/diff:/var/lib/docker/overlay2/38c82aeabee1c8f46551413ecabb24f2f22680bb623f79e40c751558747a03f5/diff:/var/lib/docker/overlay2/4fa8894d1c1d773bc2e0511f273eab03fb7b8be7489eab5cd3eb57cc0d12e855/diff:/var/lib/docker/overlay2/23319fcddb47e50928e2044bac662de8153728f3a2eefa9c6ad5a5f413efec88/diff:/var/lib/docker/overlay2/b7ecd073b5b747c21ecbd1ca61887899f7e227fac3e383e24f868549b7929d74/diff:/var/lib/docker/overlay2/29a5674b4bbabfd07c4ce0b2a8b84ce98af380bf984043a4a9a6cd0743e4630c/diff:/var/lib/docker/overlay2/86a10266979ed72dc4372ade724e64741de35702626642ba60a15cca143

3682e/diff:/var/lib/docker/overlay2/03a1af7f82f1cb2b6eadbd1f13c8e9f6ca281ef3a8968d6aa45d284f286aefca/diff:/var/lib/docker/overlay2/f36cce4566278d24128326f8ef6ea446884c0c6941ccdb763ddf936e178afbff/diff:/var/lib/docker/overlay2/e54a2a61ba3597af53ec65a822821ffca97788e4b1dbfeedf98bf4d12e78973d/diff:/var/lib/docker/overlay2/dd54a25b898b0d7952f0bcb99a0450ee3d6b4269599e9355b4ae5e0c540c2caa/diff:/var/lib/docker/overlay2/ae6c1d1e9e79e03382217f21886420e3118a3f18f7c44f76c19262a84a43e219/diff:/var/lib/docker/overlay2/82faa00f86c1fa99063466464f71cdd6d510aa3e45c6c43301b2119b5bd5285a/diff:/var/lib/docker/overlay2/9f54999972b485642f042b9ed4d00316be0a1d35c060e619aca79b1583180446/diff:/var/lib/docker/overlay2/b467240c20564ba44d0946c716cf18ab5be973b43b02c37ee3ddd8f94502f41b/diff:/var/lib/docker/overlay2/21217d4ff1c5cf81dd53cfd831e0961189fb9f86812e1f53843f0022383345e6/diff",

	                "MergedDir": "/var/lib/docker/overlay2/0baaca0513be4bf258a1f50e3173d958d093976d0a3a9664ac04d87ab09e3671/merged",

	                "UpperDir": "/var/lib/docker/overlay2/0baaca0513be4bf258a1f50e3173d958d093976d0a3a9664ac04d87ab09e3671/diff",

	                "WorkDir": "/var/lib/docker/overlay2/0baaca0513be4bf258a1f50e3173d958d093976d0a3a9664ac04d87ab09e3671/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "volume",

	                "Name": "functional-20220531173104-2108",

	                "Source": "/var/lib/docker/volumes/functional-20220531173104-2108/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            },

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            }

	        ],

	        "Config": {

	            "Hostname": "functional-20220531173104-2108",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8441/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "functional-20220531173104-2108",

	                "name.minikube.sigs.k8s.io": "functional-20220531173104-2108",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "8f5ec6b3a98d73d85b19c3e80da3877e22e400bd553323f9d3272184e546a351",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "51287"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "51288"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "51289"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "51285"

	                    }

	                ],

	                "8441/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "51286"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/8f5ec6b3a98d",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "functional-20220531173104-2108": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "ac9800570c9f",

	                        "functional-20220531173104-2108"

	                    ],

	                    "NetworkID": "740a4157baec428672fe430eeb2c354ea9bd01fcc4b0eff5f0aed585a405d7f0",

	                    "EndpointID": "566335ecd16642ab3b131d5b72b708a374c0c8614edea0f8a954ac95c28b18bc",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.Host}} -p functional-20220531173104-2108 -n functional-20220531173104-2108

helpers_test.go:239: (dbg) Done: out/minikube-windows-amd64.exe status --format={{.Host}} -p functional-20220531173104-2108 -n functional-20220531173104-2108: (6.4055546s)

helpers_test.go:244: <<< TestFunctional/parallel/ServiceCmd FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestFunctional/parallel/ServiceCmd]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-windows-amd64.exe -p functional-20220531173104-2108 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-windows-amd64.exe -p functional-20220531173104-2108 logs -n 25: (8.3837397s)

helpers_test.go:252: TestFunctional/parallel/ServiceCmd logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |----------------|-----------------------------------------------------------------------------------------------------|--------------------------------|-------------------|----------------|---------------------|---------------------|

	|    Command     |                                                Args                                                 |            Profile             |       User        |    Version     |     Start Time      |      End Time       |

	|----------------|-----------------------------------------------------------------------------------------------------|--------------------------------|-------------------|----------------|---------------------|---------------------|

	| image          | functional-20220531173104-2108 image load --daemon                                                  | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:38 GMT | 31 May 22 17:38 GMT |

	|                | gcr.io/google-containers/addon-resizer:functional-20220531173104-2108                               |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108                                                                      | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:38 GMT | 31 May 22 17:38 GMT |

	|                | image ls                                                                                            |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108 image load --daemon                                                  | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:38 GMT | 31 May 22 17:38 GMT |

	|                | gcr.io/google-containers/addon-resizer:functional-20220531173104-2108                               |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108                                                                      | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:38 GMT | 31 May 22 17:38 GMT |

	|                | image ls                                                                                            |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108 image load --daemon                                                  | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:38 GMT | 31 May 22 17:38 GMT |

	|                | gcr.io/google-containers/addon-resizer:functional-20220531173104-2108                               |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108                                                                      | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:38 GMT | 31 May 22 17:39 GMT |

	|                | image ls                                                                                            |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108 image save                                                           | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:39 GMT | 31 May 22 17:39 GMT |

	|                | gcr.io/google-containers/addon-resizer:functional-20220531173104-2108                               |                                |                   |                |                     |                     |

	|                | C:\jenkins\workspace\Docker_Windows_integration\addon-resizer-save.tar                              |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108 image rm                                                             | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:39 GMT | 31 May 22 17:39 GMT |

	|                | gcr.io/google-containers/addon-resizer:functional-20220531173104-2108                               |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108                                                                      | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:39 GMT | 31 May 22 17:39 GMT |

	|                | image ls                                                                                            |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108 image load                                                           | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:39 GMT | 31 May 22 17:39 GMT |

	|                | C:\jenkins\workspace\Docker_Windows_integration\addon-resizer-save.tar                              |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108                                                                      | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:39 GMT | 31 May 22 17:39 GMT |

	|                | image ls                                                                                            |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108 image save --daemon                                                  | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:39 GMT | 31 May 22 17:39 GMT |

	|                | gcr.io/google-containers/addon-resizer:functional-20220531173104-2108                               |                                |                   |                |                     |                     |

	| cp             | functional-20220531173104-2108                                                                      | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:39 GMT | 31 May 22 17:40 GMT |

	|                | cp testdata\cp-test.txt                                                                             |                                |                   |                |                     |                     |

	|                | /home/docker/cp-test.txt                                                                            |                                |                   |                |                     |                     |

	| ssh            | functional-20220531173104-2108                                                                      | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:40 GMT | 31 May 22 17:40 GMT |

	|                | ssh -n                                                                                              |                                |                   |                |                     |                     |

	|                | functional-20220531173104-2108                                                                      |                                |                   |                |                     |                     |

	|                | sudo cat                                                                                            |                                |                   |                |                     |                     |

	|                | /home/docker/cp-test.txt                                                                            |                                |                   |                |                     |                     |

	| cp             | functional-20220531173104-2108 cp functional-20220531173104-2108:/home/docker/cp-test.txt           | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:40 GMT | 31 May 22 17:40 GMT |

	|                | C:\Users\jenkins.minikube7\AppData\Local\Temp\TestFunctionalparallelCpCmd2199164473\001\cp-test.txt |                                |                   |                |                     |                     |

	| ssh            | functional-20220531173104-2108                                                                      | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:40 GMT | 31 May 22 17:40 GMT |

	|                | ssh -n                                                                                              |                                |                   |                |                     |                     |

	|                | functional-20220531173104-2108                                                                      |                                |                   |                |                     |                     |

	|                | sudo cat                                                                                            |                                |                   |                |                     |                     |

	|                | /home/docker/cp-test.txt                                                                            |                                |                   |                |                     |                     |

	| update-context | functional-20220531173104-2108                                                                      | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:40 GMT | 31 May 22 17:40 GMT |

	|                | update-context                                                                                      |                                |                   |                |                     |                     |

	|                | --alsologtostderr -v=2                                                                              |                                |                   |                |                     |                     |

	| update-context | functional-20220531173104-2108                                                                      | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:40 GMT | 31 May 22 17:40 GMT |

	|                | update-context                                                                                      |                                |                   |                |                     |                     |

	|                | --alsologtostderr -v=2                                                                              |                                |                   |                |                     |                     |

	| update-context | functional-20220531173104-2108                                                                      | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:40 GMT | 31 May 22 17:40 GMT |

	|                | update-context                                                                                      |                                |                   |                |                     |                     |

	|                | --alsologtostderr -v=2                                                                              |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108                                                                      | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:40 GMT | 31 May 22 17:40 GMT |

	|                | image ls --format yaml                                                                              |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108                                                                      | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:40 GMT | 31 May 22 17:40 GMT |

	|                | image ls --format table                                                                             |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108                                                                      | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:40 GMT | 31 May 22 17:40 GMT |

	|                | image ls --format json                                                                              |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108                                                                      | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:40 GMT | 31 May 22 17:40 GMT |

	|                | image ls --format short                                                                             |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108 image build -t                                                       | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:40 GMT | 31 May 22 17:40 GMT |

	|                | localhost/my-image:functional-20220531173104-2108                                                   |                                |                   |                |                     |                     |

	|                | testdata\build                                                                                      |                                |                   |                |                     |                     |

	| image          | functional-20220531173104-2108                                                                      | functional-20220531173104-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 17:40 GMT | 31 May 22 17:41 GMT |

	|                | image ls                                                                                            |                                |                   |                |                     |                     |

	|----------------|-----------------------------------------------------------------------------------------------------|--------------------------------|-------------------|----------------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2022/05/31 17:37:21

	Running on machine: minikube7

	Binary: Built with gc go1.18.2 for windows/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0531 17:37:21.384219    6484 out.go:296] Setting OutFile to fd 716 ...

	I0531 17:37:21.440222    6484 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0531 17:37:21.440222    6484 out.go:309] Setting ErrFile to fd 644...

	I0531 17:37:21.440222    6484 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0531 17:37:21.452218    6484 out.go:303] Setting JSON to false

	I0531 17:37:21.454218    6484 start.go:115] hostinfo: {"hostname":"minikube7","uptime":76911,"bootTime":1653941730,"procs":159,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19044 Build 19044","kernelVersion":"10.0.19044 Build 19044","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f66ed2ea-6c04-4a6b-8eea-b2fb0953e990"}

	W0531 17:37:21.454218    6484 start.go:123] gopshost.Virtualization returned error: not implemented yet

	I0531 17:37:21.471229    6484 out.go:177] * [functional-20220531173104-2108] minikube v1.26.0-beta.1 on Microsoft Windows 10 Enterprise N 10.0.19044 Build 19044

	I0531 17:37:21.480227    6484 out.go:177]   - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I0531 17:37:21.483217    6484 out.go:177]   - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	I0531 17:37:21.486235    6484 out.go:177]   - MINIKUBE_LOCATION=14079

	I0531 17:37:21.487219    6484 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0531 17:37:21.487219    6484 config.go:178] Loaded profile config "functional-20220531173104-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.6

	I0531 17:37:21.487219    6484 driver.go:358] Setting default libvirt URI to qemu:///system

	I0531 17:37:24.141487    6484 docker.go:137] docker version: linux-20.10.14

	I0531 17:37:24.150854    6484 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0531 17:37:26.278518    6484 cli_runner.go:217] Completed: docker system info --format "{{json .}}": (2.1274722s)

	I0531 17:37:26.279048    6484 info.go:265] docker info: {ID:JKWR:L4LW:XYJC:G6AI:GZFU:RUGW:CCH6:OD2M:V572:4FTB:B7YC:DTUC Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:58 OomKillDisable:true NGoroutines:52 SystemTime:2022-05-31 17:37:25.201793 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_6

4 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,p

rofile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc.

Version:v0.17.0]] Warnings:<nil>}}

	I0531 17:37:26.284116    6484 out.go:177] * Using the docker driver based on existing profile

	I0531 17:37:26.288089    6484 start.go:284] selected driver: docker

	I0531 17:37:26.288089    6484 start.go:806] validating driver "docker" against &{Name:functional-20220531173104-2108 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.6 ClusterName:functional-20220531173104-2108 Namespace:de

fault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.23.6 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false regis

try:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}

	I0531 17:37:26.288376    6484 start.go:817] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0531 17:37:26.310470    6484 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0531 17:37:28.402370    6484 cli_runner.go:217] Completed: docker system info --format "{{json .}}": (2.0918897s)

	I0531 17:37:28.402370    6484 info.go:265] docker info: {ID:JKWR:L4LW:XYJC:G6AI:GZFU:RUGW:CCH6:OD2M:V572:4FTB:B7YC:DTUC Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:58 OomKillDisable:true NGoroutines:52 SystemTime:2022-05-31 17:37:27.3595171 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_

64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,

profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc.

Version:v0.17.0]] Warnings:<nil>}}

	I0531 17:37:28.447389    6484 cni.go:95] Creating CNI manager for ""

	I0531 17:37:28.447389    6484 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0531 17:37:28.447389    6484 start_flags.go:306] config:

	{Name:functional-20220531173104-2108 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.6 ClusterName:functional-20220531173104-2108 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clust

er.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.23.6 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false helm-tiller:false ingress:false ingress-dns:false istio:false istio-provisioner:false kong:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true s

torage-provisioner-gluster:false volumesnapshots:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}

	I0531 17:37:28.453380    6484 out.go:177] * dry-run validation complete!

	* 

	* ==> Docker <==

	* -- Logs begin at Tue 2022-05-31 17:31:59 UTC, end at Tue 2022-05-31 18:11:18 UTC. --

	May 31 17:32:16 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:32:16.680751800Z" level=info msg="API listen on [::]:2376"

	May 31 17:32:16 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:32:16.689768600Z" level=info msg="API listen on /var/run/docker.sock"

	May 31 17:33:14 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:33:14.642799700Z" level=info msg="ignoring event" container=98e3aa1f1296f25e41ca656952022f984ab049f068d93686284c38a494fe3b39 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:33:14 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:33:14.808182700Z" level=info msg="ignoring event" container=315f694ed7ff001175914f292f26e0bca8bf0ec3c19f5e4695b56a660e7ab976 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:19 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:19.487805300Z" level=info msg="ignoring event" container=aa7f15a988995a6fa85f719ea833d5b834d26e7aa2b3844d38192e27a15c9ab0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:19 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:19.487884500Z" level=info msg="ignoring event" container=af4786384c492cf1a455f410500e518d7d0e4decde59c579559a2f79cf287bf1 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:19 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:19.690452400Z" level=info msg="ignoring event" container=3c1115c1305583de691cab3c9af45e5287db0a3529ea517c35eff4767491efcc module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:19 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:19.801212900Z" level=info msg="ignoring event" container=77a3b3590b9aa46cda285fc13f0eb69864570d411f836d6635490284cbb8ffd3 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:19 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:19.888831400Z" level=info msg="ignoring event" container=bfa84a2ffd228f119df433c7266b611f44398bcf0f75764f7b83026b9c5f073d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:19 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:19.888902300Z" level=info msg="ignoring event" container=d2010d6f19be0c00b1b23922145e44466896613cc54c9dabe18f1743990c7946 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:19 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:19.889046400Z" level=info msg="ignoring event" container=2ddc1a898dfb6bdfa2192a1ad55421e8c06adb5f1ec25dc0c4c4cfac116e88af module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:19 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:19.991434500Z" level=info msg="ignoring event" container=909e135e054cc30a8071e17a4ae073838e8cbee380ac575ae832c3eed81d8053 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:19 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:19.991967100Z" level=info msg="ignoring event" container=9aaae8d9608b86439288c99b679a5d80ea4c92244bd1e99fa17b6d9a0825a80a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:19 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:19.992448000Z" level=info msg="ignoring event" container=bbd1baa4cb2a56e436e609efae295f3b7f3554e405c09ef8cd71a2e20875eb05 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:20 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:20.101148100Z" level=info msg="ignoring event" container=ddadbb8af8f59dd7bcbbc6f541cc9add1879600b98260c585bee87b63a3f2176 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:21 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:21.394548300Z" level=info msg="ignoring event" container=f808f562e4c468a2ac3b7b9648e0ed31f46e15deb3cd95cfa099880a3f3edaa9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:21 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:21.587607700Z" level=info msg="ignoring event" container=b10946ca0bcfbc6e53ac9f0da0b7eecc81faf3ff2d465ba20619ae8b54d19491 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:24 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:24.497971500Z" level=info msg="ignoring event" container=796c188ab0cbbbbdb1748c7ca3ec638f0b548aef6e16807e83b55ec33a0828a4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:24 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:24.598114300Z" level=info msg="ignoring event" container=c93090aa25350595a9d466ede333b6ee67fbad25ebd223b99a43e6b2c0d3ca85 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:34 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:34.111579800Z" level=info msg="ignoring event" container=fe506de671ae7fba5dffae696c3cd7d1e1a52f3732f1c738ce0eb93a0bf53f5e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:35:34 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:35:34.309193700Z" level=info msg="ignoring event" container=f9286f1960b88854b2e86df970d569d11daa22334f7fef143f0e936f6cd145d3 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:37:01 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:37:01.088956500Z" level=info msg="ignoring event" container=e63bea6377f2a0a0cc3ee701649c463d8c75818970630810f7ea0f4f37715b75 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:37:02 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:37:02.806372400Z" level=info msg="ignoring event" container=23b52b71894a503bdc65ed36c95f8a20ef3e2bc39d1b744966749997165ada3f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:40:55 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:40:55.794817100Z" level=info msg="ignoring event" container=831ef2e56aa65c62d7c5c41f2db658df0122503be11bdf7e0a17fe28cd5822b1 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 17:40:56 functional-20220531173104-2108 dockerd[510]: time="2022-05-31T17:40:56.349511900Z" level=info msg="Layer sha256:8d988d9cbd4c3812fb85f3c741a359985602af139e727005f4d4471ac42f9d1a cleaned up"

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                           CREATED             STATE               NAME                      ATTEMPT             POD ID

	0b5ccd9823932       mysql@sha256:7e99b2b8d5bca914ef31059858210f57b009c40375d647f0d4d65ecd01d6b1d5                   31 minutes ago      Running             mysql                     0                   333834c1cb3d8

	3289072c6c844       nginx@sha256:2bcabc23b45489fb0885d69a06ba1d648aeda973fae7bb981bafbb884165e514                   34 minutes ago      Running             myfrontend                0                   00208e1f542a1

	6adb5fb1de300       k8s.gcr.io/echoserver@sha256:cb3386f863f6a4b05f33c191361723f9d5927ac287463b1bea633bf859475969   34 minutes ago      Running             echoserver                0                   7ef50adfd038f

	1182335c773e4       k8s.gcr.io/echoserver@sha256:cb3386f863f6a4b05f33c191361723f9d5927ac287463b1bea633bf859475969   34 minutes ago      Running             echoserver                0                   768d4e79d18b3

	835617a7dc034       nginx@sha256:a74534e76ee1121d418fa7394ca930eb67440deda413848bc67c68138535b989                   35 minutes ago      Running             nginx                     0                   104acaf228231

	0e1ed68a43faa       a4ca41631cc7a                                                                                   35 minutes ago      Running             coredns                   1                   44909b59d356f

	a24e38366a7b4       6e38f40d628db                                                                                   35 minutes ago      Running             storage-provisioner       2                   37cc42c5630cd

	fedfb55afc4b2       8fa62c12256df                                                                                   35 minutes ago      Running             kube-apiserver            0                   d3e5c39f666c8

	adf0898fd4ff8       595f327f224a4                                                                                   35 minutes ago      Running             kube-scheduler            1                   d06ea92e30a2c

	ad11c3777c4ed       4c03754524064                                                                                   35 minutes ago      Running             kube-proxy                1                   d59f78b47d67b

	c93090aa25350       6e38f40d628db                                                                                   35 minutes ago      Exited              storage-provisioner       1                   37cc42c5630cd

	7eb1fdcb70879       25f8c7f3da61c                                                                                   35 minutes ago      Running             etcd                      1                   0d14dc606fc5b

	67bdd1b22c523       df7b72818ad2e                                                                                   35 minutes ago      Running             kube-controller-manager   1                   b60f69cbd7b19

	796c188ab0cbb       a4ca41631cc7a                                                                                   38 minutes ago      Exited              coredns                   0                   bfa84a2ffd228

	909e135e054cc       4c03754524064                                                                                   38 minutes ago      Exited              kube-proxy                0                   aa7f15a988995

	ddadbb8af8f59       df7b72818ad2e                                                                                   38 minutes ago      Exited              kube-controller-manager   0                   d2010d6f19be0

	f808f562e4c46       595f327f224a4                                                                                   38 minutes ago      Exited              kube-scheduler            0                   9aaae8d9608b8

	77a3b3590b9aa       25f8c7f3da61c                                                                                   38 minutes ago      Exited              etcd                      0                   bbd1baa4cb2a5

	* 

	* ==> coredns [0e1ed68a43fa] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = c23ed519c17e71ee396ed052e6209e94

	CoreDNS-1.8.6

	linux/amd64, go1.17.1, 13a9191

	* 

	* ==> coredns [796c188ab0cb] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7

	CoreDNS-1.8.6

	linux/amd64, go1.17.1, 13a9191

	[INFO] Reloading

	[INFO] plugin/health: Going into lameduck mode for 5s

	[INFO] plugin/reload: Running configuration MD5 = c23ed519c17e71ee396ed052e6209e94

	[INFO] Reloading complete

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	* 

	* ==> describe nodes <==

	* Name:               functional-20220531173104-2108

	Roles:              control-plane,master

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=functional-20220531173104-2108

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=bd46569bd7cb517fcad2e704abdebd2826bd8454

	                    minikube.k8s.io/name=functional-20220531173104-2108

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2022_05_31T17_32_50_0700

	                    minikube.k8s.io/version=v1.26.0-beta.1

	                    node-role.kubernetes.io/control-plane=

	                    node-role.kubernetes.io/master=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Tue, 31 May 2022 17:32:44 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  functional-20220531173104-2108

	  AcquireTime:     <unset>

	  RenewTime:       Tue, 31 May 2022 18:11:11 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Tue, 31 May 2022 18:06:36 +0000   Tue, 31 May 2022 17:32:41 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Tue, 31 May 2022 18:06:36 +0000   Tue, 31 May 2022 17:32:41 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Tue, 31 May 2022 18:06:36 +0000   Tue, 31 May 2022 17:32:41 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Tue, 31 May 2022 18:06:36 +0000   Tue, 31 May 2022 17:33:01 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.49.2

	  Hostname:    functional-20220531173104-2108

	Capacity:

	  cpu:                16

	  ephemeral-storage:  263174212Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             52638988Ki

	  pods:               110

	Allocatable:

	  cpu:                16

	  ephemeral-storage:  263174212Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             52638988Ki

	  pods:               110

	System Info:

	  Machine ID:                 bfc82849fe6e4a6a9236307a23a8b5f1

	  System UUID:                bfc82849fe6e4a6a9236307a23a8b5f1

	  Boot ID:                    99d8680c-6839-4c5e-a5fa-8740ef80d5ef

	  Kernel Version:             5.10.102.1-microsoft-standard-WSL2

	  OS Image:                   Ubuntu 20.04.4 LTS

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://20.10.16

	  Kubelet Version:            v1.23.6

	  Kube-Proxy Version:         v1.23.6

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (12 in total)

	  Namespace                   Name                                                      CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                                      ------------  ----------  ---------------  -------------  ---

	  default                     hello-node-54fbb85-c6cbz                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         34m

	  default                     hello-node-connect-74cf8bc446-5wbb6                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         34m

	  default                     mysql-b87c45988-hqk85                                     600m (3%!)(MISSING)     700m (4%!)(MISSING)   512Mi (0%!)(MISSING)       700Mi (1%!)(MISSING)     31m

	  default                     nginx-svc                                                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         35m

	  default                     sp-pod                                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         34m

	  kube-system                 coredns-64897985d-9zl57                                   100m (0%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (0%!)(MISSING)     38m

	  kube-system                 etcd-functional-20220531173104-2108                       100m (0%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         38m

	  kube-system                 kube-apiserver-functional-20220531173104-2108             250m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         35m

	  kube-system                 kube-controller-manager-functional-20220531173104-2108    200m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         38m

	  kube-system                 kube-proxy-sc9l4                                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         38m

	  kube-system                 kube-scheduler-functional-20220531173104-2108             100m (0%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         38m

	  kube-system                 storage-provisioner                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         38m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                1350m (8%!)(MISSING)  700m (4%!)(MISSING)

	  memory             682Mi (1%!)(MISSING)  870Mi (1%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                From        Message

	  ----    ------                   ----               ----        -------

	  Normal  Starting                 35m                kube-proxy  

	  Normal  Starting                 38m                kube-proxy  

	  Normal  NodeHasNoDiskPressure    38m (x7 over 38m)  kubelet     Node functional-20220531173104-2108 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     38m (x7 over 38m)  kubelet     Node functional-20220531173104-2108 status is now: NodeHasSufficientPID

	  Normal  NodeHasSufficientMemory  38m (x8 over 38m)  kubelet     Node functional-20220531173104-2108 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    38m                kubelet     Node functional-20220531173104-2108 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     38m                kubelet     Node functional-20220531173104-2108 status is now: NodeHasSufficientPID

	  Normal  NodeHasSufficientMemory  38m                kubelet     Node functional-20220531173104-2108 status is now: NodeHasSufficientMemory

	  Normal  Starting                 38m                kubelet     Starting kubelet.

	  Normal  NodeAllocatableEnforced  38m                kubelet     Updated Node Allocatable limit across pods

	  Normal  NodeReady                38m                kubelet     Node functional-20220531173104-2108 status is now: NodeReady

	  Normal  Starting                 35m                kubelet     Starting kubelet.

	  Normal  NodeHasSufficientMemory  35m (x2 over 35m)  kubelet     Node functional-20220531173104-2108 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    35m (x2 over 35m)  kubelet     Node functional-20220531173104-2108 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     35m (x2 over 35m)  kubelet     Node functional-20220531173104-2108 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  35m                kubelet     Updated Node Allocatable limit across pods

	* 

	* ==> dmesg <==

	* [May31 17:46] WSL2: Performing memory compaction.

	[May31 17:47] WSL2: Performing memory compaction.

	[May31 17:48] WSL2: Performing memory compaction.

	[May31 17:49] WSL2: Performing memory compaction.

	[May31 17:50] WSL2: Performing memory compaction.

	[May31 17:51] WSL2: Performing memory compaction.

	[May31 17:52] WSL2: Performing memory compaction.

	[May31 17:53] WSL2: Performing memory compaction.

	[May31 17:54] WSL2: Performing memory compaction.

	[May31 17:55] WSL2: Performing memory compaction.

	[May31 17:56] WSL2: Performing memory compaction.

	[May31 17:57] WSL2: Performing memory compaction.

	[May31 17:58] WSL2: Performing memory compaction.

	[May31 17:59] WSL2: Performing memory compaction.

	[May31 18:00] WSL2: Performing memory compaction.

	[May31 18:01] WSL2: Performing memory compaction.

	[May31 18:02] WSL2: Performing memory compaction.

	[May31 18:03] WSL2: Performing memory compaction.

	[May31 18:04] WSL2: Performing memory compaction.

	[May31 18:05] WSL2: Performing memory compaction.

	[May31 18:06] WSL2: Performing memory compaction.

	[May31 18:07] WSL2: Performing memory compaction.

	[May31 18:08] WSL2: Performing memory compaction.

	[May31 18:09] WSL2: Performing memory compaction.

	[May31 18:10] WSL2: Performing memory compaction.

	* 

	* ==> etcd [77a3b3590b9a] <==

	* {"level":"warn","ts":"2022-05-31T17:33:09.698Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"106.7221ms","expected-duration":"100ms","prefix":"","request":"header:<ID:8128013381219972195 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/pods/kube-system/coredns-64897985d-9zl57\" mod_revision:437 > success:<request_put:<key:\"/registry/pods/kube-system/coredns-64897985d-9zl57\" value_size:4559 >> failure:<request_range:<key:\"/registry/pods/kube-system/coredns-64897985d-9zl57\" > >>","response":"size:16"}

	{"level":"info","ts":"2022-05-31T17:33:09.785Z","caller":"traceutil/trace.go:171","msg":"trace[2132922401] linearizableReadLoop","detail":"{readStateIndex:478; appliedIndex:477; }","duration":"195.0218ms","start":"2022-05-31T17:33:09.590Z","end":"2022-05-31T17:33:09.785Z","steps":["trace[2132922401] 'read index received'  (duration: 745.1µs)","trace[2132922401] 'applied index is now lower than readState.Index'  (duration: 194.2719ms)"],"step_count":2}

	{"level":"warn","ts":"2022-05-31T17:33:09.785Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"195.2333ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/functional-20220531173104-2108\" ","response":"range_response_count:1 size:4510"}

	{"level":"info","ts":"2022-05-31T17:33:09.785Z","caller":"traceutil/trace.go:171","msg":"trace[59375942] range","detail":"{range_begin:/registry/minions/functional-20220531173104-2108; range_end:; response_count:1; response_revision:465; }","duration":"195.2987ms","start":"2022-05-31T17:33:09.590Z","end":"2022-05-31T17:33:09.785Z","steps":["trace[59375942] 'agreement among raft nodes before linearized reading'  (duration: 195.1802ms)"],"step_count":1}

	{"level":"info","ts":"2022-05-31T17:33:09.786Z","caller":"traceutil/trace.go:171","msg":"trace[2120425565] transaction","detail":"{read_only:false; response_revision:465; number_of_response:1; }","duration":"197.5044ms","start":"2022-05-31T17:33:09.588Z","end":"2022-05-31T17:33:09.786Z","steps":["trace[2120425565] 'compare'  (duration: 106.451ms)"],"step_count":1}

	{"level":"warn","ts":"2022-05-31T17:33:11.008Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"106.1085ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}

	{"level":"warn","ts":"2022-05-31T17:33:11.008Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"106.4847ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/coredns-64897985d-9zl57\" ","response":"range_response_count:1 size:4454"}

	{"level":"info","ts":"2022-05-31T17:33:11.008Z","caller":"traceutil/trace.go:171","msg":"trace[576033879] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:480; }","duration":"106.2849ms","start":"2022-05-31T17:33:10.902Z","end":"2022-05-31T17:33:11.008Z","steps":["trace[576033879] 'agreement among raft nodes before linearized reading'  (duration: 61.1456ms)","trace[576033879] 'range keys from in-memory index tree'  (duration: 44.9423ms)"],"step_count":2}

	{"level":"info","ts":"2022-05-31T17:33:11.009Z","caller":"traceutil/trace.go:171","msg":"trace[126526605] range","detail":"{range_begin:/registry/pods/kube-system/coredns-64897985d-9zl57; range_end:; response_count:1; response_revision:480; }","duration":"106.5717ms","start":"2022-05-31T17:33:10.902Z","end":"2022-05-31T17:33:11.008Z","steps":["trace[126526605] 'agreement among raft nodes before linearized reading'  (duration: 61.3689ms)","trace[126526605] 'range keys from in-memory index tree'  (duration: 45.0854ms)"],"step_count":2}

	{"level":"warn","ts":"2022-05-31T17:33:11.008Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"106.4246ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2022-05-31T17:33:11.009Z","caller":"traceutil/trace.go:171","msg":"trace[773953843] range","detail":"{range_begin:/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath; range_end:; response_count:0; response_revision:480; }","duration":"106.805ms","start":"2022-05-31T17:33:10.902Z","end":"2022-05-31T17:33:11.009Z","steps":["trace[773953843] 'agreement among raft nodes before linearized reading'  (duration: 61.3958ms)","trace[773953843] 'range keys from in-memory index tree'  (duration: 45.017ms)"],"step_count":2}

	{"level":"warn","ts":"2022-05-31T17:33:11.239Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"130.5692ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/functional-20220531173104-2108\" ","response":"range_response_count:1 size:4510"}

	{"level":"info","ts":"2022-05-31T17:33:11.239Z","caller":"traceutil/trace.go:171","msg":"trace[1737174060] range","detail":"{range_begin:/registry/minions/functional-20220531173104-2108; range_end:; response_count:1; response_revision:483; }","duration":"130.8705ms","start":"2022-05-31T17:33:11.109Z","end":"2022-05-31T17:33:11.239Z","steps":["trace[1737174060] 'agreement among raft nodes before linearized reading'  (duration: 84.0218ms)","trace[1737174060] 'range keys from in-memory index tree'  (duration: 46.5054ms)"],"step_count":2}

	{"level":"info","ts":"2022-05-31T17:33:11.239Z","caller":"traceutil/trace.go:171","msg":"trace[986926177] transaction","detail":"{read_only:false; response_revision:484; number_of_response:1; }","duration":"123.4756ms","start":"2022-05-31T17:33:11.116Z","end":"2022-05-31T17:33:11.239Z","steps":["trace[986926177] 'process raft request'  (duration: 76.6828ms)","trace[986926177] 'compare'  (duration: 46.242ms)"],"step_count":2}

	{"level":"info","ts":"2022-05-31T17:33:11.604Z","caller":"traceutil/trace.go:171","msg":"trace[1288232695] linearizableReadLoop","detail":"{readStateIndex:499; appliedIndex:499; }","duration":"101.8248ms","start":"2022-05-31T17:33:11.502Z","end":"2022-05-31T17:33:11.604Z","steps":["trace[1288232695] 'read index received'  (duration: 101.8156ms)","trace[1288232695] 'applied index is now lower than readState.Index'  (duration: 6.1µs)"],"step_count":2}

	{"level":"warn","ts":"2022-05-31T17:33:11.604Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"102.1533ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/kube-scheduler-functional-20220531173104-2108\" ","response":"range_response_count:1 size:4203"}

	{"level":"info","ts":"2022-05-31T17:33:11.604Z","caller":"traceutil/trace.go:171","msg":"trace[206237108] range","detail":"{range_begin:/registry/pods/kube-system/kube-scheduler-functional-20220531173104-2108; range_end:; response_count:1; response_revision:486; }","duration":"102.3019ms","start":"2022-05-31T17:33:11.502Z","end":"2022-05-31T17:33:11.604Z","steps":["trace[206237108] 'agreement among raft nodes before linearized reading'  (duration: 102.032ms)"],"step_count":1}

	{"level":"info","ts":"2022-05-31T17:35:19.286Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}

	{"level":"info","ts":"2022-05-31T17:35:19.286Z","caller":"embed/etcd.go:367","msg":"closing etcd server","name":"functional-20220531173104-2108","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"]}

	WARNING: 2022/05/31 17:35:19 [core] grpc: addrConn.createTransport failed to connect to {127.0.0.1:2379 127.0.0.1:2379 <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused". Reconnecting...

	WARNING: 2022/05/31 17:35:19 [core] grpc: addrConn.createTransport failed to connect to {192.168.49.2:2379 192.168.49.2:2379 <nil> 0 <nil>}. Err: connection error: desc = "transport: Error while dialing dial tcp 192.168.49.2:2379: connect: connection refused". Reconnecting...

	{"level":"info","ts":"2022-05-31T17:35:19.298Z","caller":"etcdserver/server.go:1438","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"aec36adc501070cc","current-leader-member-id":"aec36adc501070cc"}

	{"level":"info","ts":"2022-05-31T17:35:19.401Z","caller":"embed/etcd.go:562","msg":"stopping serving peer traffic","address":"192.168.49.2:2380"}

	{"level":"info","ts":"2022-05-31T17:35:19.403Z","caller":"embed/etcd.go:567","msg":"stopped serving peer traffic","address":"192.168.49.2:2380"}

	{"level":"info","ts":"2022-05-31T17:35:19.403Z","caller":"embed/etcd.go:369","msg":"closed etcd server","name":"functional-20220531173104-2108","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"]}

	* 

	* ==> etcd [7eb1fdcb7087] <==

	* {"level":"warn","ts":"2022-05-31T17:40:13.131Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"723.7071ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}

	{"level":"warn","ts":"2022-05-31T17:40:13.130Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.7340478s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2022-05-31T17:40:13.131Z","caller":"traceutil/trace.go:171","msg":"trace[114366969] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:946; }","duration":"2.7347865s","start":"2022-05-31T17:40:10.396Z","end":"2022-05-31T17:40:13.131Z","steps":["trace[114366969] 'range keys from in-memory index tree'  (duration: 2.7339633s)"],"step_count":1}

	{"level":"warn","ts":"2022-05-31T17:40:13.131Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-05-31T17:40:10.396Z","time spent":"2.7348276s","remote":"127.0.0.1:36182","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "}

	{"level":"info","ts":"2022-05-31T17:40:13.131Z","caller":"traceutil/trace.go:171","msg":"trace[1235275351] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:948; }","duration":"723.7702ms","start":"2022-05-31T17:40:12.407Z","end":"2022-05-31T17:40:13.131Z","steps":["trace[1235275351] 'agreement among raft nodes before linearized reading'  (duration: 723.6897ms)"],"step_count":1}

	{"level":"warn","ts":"2022-05-31T17:40:13.131Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-05-31T17:40:12.407Z","time spent":"724.0601ms","remote":"127.0.0.1:36182","response type":"/etcdserverpb.KV/Range","request count":0,"request size":18,"response count":0,"response size":29,"request content":"key:\"/registry/health\" "}

	{"level":"warn","ts":"2022-05-31T17:40:13.131Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"2.0242807s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/default\" ","response":"range_response_count:1 size:343"}

	{"level":"info","ts":"2022-05-31T17:40:13.131Z","caller":"traceutil/trace.go:171","msg":"trace[1654666654] range","detail":"{range_begin:/registry/namespaces/default; range_end:; response_count:1; response_revision:948; }","duration":"2.0246224s","start":"2022-05-31T17:40:11.107Z","end":"2022-05-31T17:40:13.131Z","steps":["trace[1654666654] 'agreement among raft nodes before linearized reading'  (duration: 2.0240912s)"],"step_count":1}

	{"level":"warn","ts":"2022-05-31T17:40:13.131Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-05-31T17:40:11.107Z","time spent":"2.0246833s","remote":"127.0.0.1:36098","response type":"/etcdserverpb.KV/Range","request count":0,"request size":30,"response count":1,"response size":367,"request content":"key:\"/registry/namespaces/default\" "}

	{"level":"warn","ts":"2022-05-31T17:40:13.130Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"3.3309698s","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" ","response":"range_response_count:1 size:1133"}

	{"level":"info","ts":"2022-05-31T17:40:13.132Z","caller":"traceutil/trace.go:171","msg":"trace[756194152] range","detail":"{range_begin:/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath; range_end:; response_count:1; response_revision:946; }","duration":"3.3321347s","start":"2022-05-31T17:40:09.799Z","end":"2022-05-31T17:40:13.131Z","steps":["trace[756194152] 'range keys from in-memory index tree'  (duration: 3.3308663s)"],"step_count":1}

	{"level":"warn","ts":"2022-05-31T17:40:13.132Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2022-05-31T17:40:09.799Z","time spent":"3.3321908s","remote":"127.0.0.1:36100","response type":"/etcdserverpb.KV/Range","request count":0,"request size":67,"response count":1,"response size":1157,"request content":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" "}

	{"level":"info","ts":"2022-05-31T17:45:36.047Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":974}

	{"level":"info","ts":"2022-05-31T17:45:36.048Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":974,"took":"1.166ms"}

	{"level":"info","ts":"2022-05-31T17:50:36.063Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1183}

	{"level":"info","ts":"2022-05-31T17:50:36.064Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":1183,"took":"715.4µs"}

	{"level":"info","ts":"2022-05-31T17:55:36.080Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1393}

	{"level":"info","ts":"2022-05-31T17:55:36.081Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":1393,"took":"821.6µs"}

	{"level":"info","ts":"2022-05-31T17:56:11.306Z","caller":"traceutil/trace.go:171","msg":"trace[1260663686] transaction","detail":"{read_only:false; response_revision:1628; number_of_response:1; }","duration":"109.2685ms","start":"2022-05-31T17:56:11.196Z","end":"2022-05-31T17:56:11.305Z","steps":["trace[1260663686] 'process raft request'  (duration: 83.9453ms)","trace[1260663686] 'compare'  (duration: 25.0457ms)"],"step_count":2}

	{"level":"info","ts":"2022-05-31T18:00:36.113Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1603}

	{"level":"info","ts":"2022-05-31T18:00:36.114Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":1603,"took":"652.6µs"}

	{"level":"info","ts":"2022-05-31T18:05:36.130Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1813}

	{"level":"info","ts":"2022-05-31T18:05:36.131Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":1813,"took":"682.1µs"}

	{"level":"info","ts":"2022-05-31T18:10:36.144Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":2023}

	{"level":"info","ts":"2022-05-31T18:10:36.145Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":2023,"took":"613.2µs"}

	* 

	* ==> kernel <==

	*  18:11:20 up 59 min,  0 users,  load average: 0.21, 0.28, 0.44

	Linux functional-20220531173104-2108 5.10.102.1-microsoft-standard-WSL2 #1 SMP Wed Mar 2 00:30:59 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.4 LTS"

	* 

	* ==> kube-apiserver [fedfb55afc4b] <==

	* Trace[1631072592]: ---"Listing from storage done" 1290ms (17:39:42.603)

	Trace[1631072592]: [1.2911037s] [1.2911037s] END

	{"level":"warn","ts":"2022-05-31T17:40:12.397Z","logger":"etcd-client","caller":"v3/retry_interceptor.go:62","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0xc002b6c000/#initially=[https://127.0.0.1:2379]","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = context deadline exceeded"}

	I0531 17:40:13.132369       1 trace.go:205] Trace[1101327824]: "Create" url:/api/v1/namespaces/kube-system/events,user-agent:kubelet/v1.23.6 (linux/amd64) kubernetes/ad33385,audit-id:38759316-3673-4f68-a8bb-151eb07d43f1,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (31-May-2022 17:40:12.413) (total time: 718ms):

	Trace[1101327824]: ---"Object stored in database" 718ms (17:40:13.132)

	Trace[1101327824]: [718.4759ms] [718.4759ms] END

	I0531 17:40:13.132425       1 trace.go:205] Trace[207720524]: "GuaranteedUpdate etcd3" type:*coordination.Lease (31-May-2022 17:40:10.605) (total time: 2526ms):

	Trace[207720524]: ---"Transaction committed" 2525ms (17:40:13.132)

	Trace[207720524]: [2.5264065s] [2.5264065s] END

	I0531 17:40:13.132630       1 trace.go:205] Trace[1666363601]: "List etcd3" key:/pods/default,resourceVersion:,resourceVersionMatch:,limit:0,continue: (31-May-2022 17:40:10.313) (total time: 2819ms):

	Trace[1666363601]: [2.8192399s] [2.8192399s] END

	I0531 17:40:13.132645       1 trace.go:205] Trace[1788252629]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/functional-20220531173104-2108,user-agent:kubelet/v1.23.6 (linux/amd64) kubernetes/ad33385,audit-id:5e81e9b7-91c0-4fe0-ba53-09a8d12ac490,client:192.168.49.2,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (31-May-2022 17:40:10.605) (total time: 2526ms):

	Trace[1788252629]: ---"Object stored in database" 2526ms (17:40:13.132)

	Trace[1788252629]: [2.5268845s] [2.5268845s] END

	I0531 17:40:13.132811       1 trace.go:205] Trace[1040422210]: "Get" url:/api/v1/namespaces/default,user-agent:kube-apiserver/v1.23.6 (linux/amd64) kubernetes/ad33385,audit-id:19943911-f674-4af8-93b9-4d946f70dd89,client:127.0.0.1,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (31-May-2022 17:40:11.106) (total time: 2026ms):

	Trace[1040422210]: ---"About to write a response" 2026ms (17:40:13.132)

	Trace[1040422210]: [2.0264395s] [2.0264395s] END

	I0531 17:40:13.133466       1 trace.go:205] Trace[2858733]: "List" url:/api/v1/namespaces/default/pods,user-agent:e2e-windows-amd64.exe/v0.0.0 (windows/amd64) kubernetes/$Format,audit-id:bd4a9a02-c598-413a-a8b1-29a42f138d4c,client:192.168.49.1,accept:application/json, */*,protocol:HTTP/2.0 (31-May-2022 17:40:10.313) (total time: 2820ms):

	Trace[2858733]: ---"Listing from storage done" 2819ms (17:40:13.132)

	Trace[2858733]: [2.8201283s] [2.8201283s] END

	I0531 17:40:13.132820       1 trace.go:205] Trace[393344095]: "Get" url:/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath,user-agent:storage-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,audit-id:7cb2b9e1-3040-4a1b-98d0-2da211d49607,client:192.168.49.2,accept:application/json, */*,protocol:HTTP/2.0 (31-May-2022 17:40:09.798) (total time: 3333ms):

	Trace[393344095]: ---"About to write a response" 3333ms (17:40:13.132)

	Trace[393344095]: [3.333828s] [3.333828s] END

	W0531 17:51:52.489350       1 watcher.go:229] watch chan error: etcdserver: mvcc: required revision has been compacted

	W0531 18:07:46.407468       1 watcher.go:229] watch chan error: etcdserver: mvcc: required revision has been compacted

	* 

	* ==> kube-controller-manager [67bdd1b22c52] <==

	* I0531 17:35:52.586194       1 shared_informer.go:247] Caches are synced for deployment 

	I0531 17:35:52.586612       1 shared_informer.go:247] Caches are synced for crt configmap 

	I0531 17:35:52.587022       1 shared_informer.go:247] Caches are synced for stateful set 

	I0531 17:35:52.587048       1 shared_informer.go:247] Caches are synced for namespace 

	I0531 17:35:52.587492       1 shared_informer.go:247] Caches are synced for ReplicaSet 

	I0531 17:35:52.587073       1 shared_informer.go:247] Caches are synced for TTL 

	I0531 17:35:52.590485       1 shared_informer.go:247] Caches are synced for GC 

	I0531 17:35:52.591621       1 shared_informer.go:247] Caches are synced for expand 

	I0531 17:35:52.592161       1 shared_informer.go:240] Waiting for caches to sync for garbage collector

	I0531 17:35:52.593009       1 shared_informer.go:247] Caches are synced for certificate-csrapproving 

	I0531 17:35:52.593195       1 shared_informer.go:247] Caches are synced for PV protection 

	I0531 17:35:52.625116       1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator 

	I0531 17:35:52.625668       1 shared_informer.go:247] Caches are synced for attach detach 

	I0531 17:35:52.691797       1 shared_informer.go:247] Caches are synced for resource quota 

	I0531 17:35:52.717799       1 shared_informer.go:247] Caches are synced for resource quota 

	I0531 17:35:53.193618       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0531 17:35:53.216601       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0531 17:35:53.216751       1 garbagecollector.go:155] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0531 17:36:28.124977       1 event.go:294] "Event occurred" object="default/myclaim" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="waiting for a volume to be created, either by external provisioner \"k8s.io/minikube-hostpath\" or manually created by system administrator"

	I0531 17:36:37.487272       1 event.go:294] "Event occurred" object="default/hello-node-connect" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set hello-node-connect-74cf8bc446 to 1"

	I0531 17:36:37.689199       1 event.go:294] "Event occurred" object="default/hello-node-connect-74cf8bc446" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: hello-node-connect-74cf8bc446-5wbb6"

	I0531 17:37:01.384489       1 event.go:294] "Event occurred" object="default/hello-node" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set hello-node-54fbb85 to 1"

	I0531 17:37:02.485730       1 event.go:294] "Event occurred" object="default/hello-node-54fbb85" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: hello-node-54fbb85-c6cbz"

	I0531 17:39:27.189379       1 event.go:294] "Event occurred" object="default/mysql" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set mysql-b87c45988 to 1"

	I0531 17:39:27.287705       1 event.go:294] "Event occurred" object="default/mysql-b87c45988" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: mysql-b87c45988-hqk85"

	* 

	* ==> kube-controller-manager [ddadbb8af8f5] <==

	* I0531 17:33:02.393030       1 shared_informer.go:247] Caches are synced for taint 

	I0531 17:33:02.393461       1 node_lifecycle_controller.go:1397] Initializing eviction metric for zone: 

	W0531 17:33:02.393579       1 node_lifecycle_controller.go:1012] Missing timestamp for Node functional-20220531173104-2108. Assuming now as a timestamp.

	I0531 17:33:02.393654       1 node_lifecycle_controller.go:1213] Controller detected that zone  is now in state Normal.

	I0531 17:33:02.393994       1 taint_manager.go:187] "Starting NoExecuteTaintManager"

	I0531 17:33:02.394783       1 event.go:294] "Event occurred" object="functional-20220531173104-2108" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node functional-20220531173104-2108 event: Registered Node functional-20220531173104-2108 in Controller"

	I0531 17:33:02.394971       1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator 

	I0531 17:33:02.489977       1 range_allocator.go:374] Set node functional-20220531173104-2108 PodCIDR to [10.244.0.0/24]

	I0531 17:33:02.492251       1 shared_informer.go:247] Caches are synced for resource quota 

	I0531 17:33:02.496977       1 shared_informer.go:247] Caches are synced for disruption 

	I0531 17:33:02.497081       1 disruption.go:371] Sending events to api server.

	I0531 17:33:02.503283       1 shared_informer.go:240] Waiting for caches to sync for garbage collector

	I0531 17:33:02.509448       1 shared_informer.go:247] Caches are synced for stateful set 

	I0531 17:33:02.584994       1 shared_informer.go:247] Caches are synced for resource quota 

	I0531 17:33:02.594681       1 shared_informer.go:247] Caches are synced for service account 

	I0531 17:33:02.595225       1 shared_informer.go:247] Caches are synced for namespace 

	I0531 17:33:02.889741       1 event.go:294] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-64897985d to 2"

	I0531 17:33:02.985790       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0531 17:33:02.987849       1 shared_informer.go:247] Caches are synced for garbage collector 

	I0531 17:33:02.987963       1 garbagecollector.go:155] Garbage collector: all resource monitors have synced. Proceeding to collect garbage

	I0531 17:33:02.995082       1 event.go:294] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-sc9l4"

	I0531 17:33:03.193258       1 event.go:294] "Event occurred" object="kube-system/coredns-64897985d" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-64897985d-ct8qm"

	I0531 17:33:03.295205       1 event.go:294] "Event occurred" object="kube-system/coredns-64897985d" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-64897985d-9zl57"

	I0531 17:33:04.423418       1 event.go:294] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set coredns-64897985d to 1"

	I0531 17:33:04.599470       1 event.go:294] "Event occurred" object="kube-system/coredns-64897985d" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: coredns-64897985d-ct8qm"

	* 

	* ==> kube-proxy [909e135e054c] <==

	* E0531 17:33:06.103431       1 proxier.go:647] "Failed to read builtin modules file, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" err="open /lib/modules/5.10.102.1-microsoft-standard-WSL2/modules.builtin: no such file or directory" filePath="/lib/modules/5.10.102.1-microsoft-standard-WSL2/modules.builtin"

	I0531 17:33:06.106486       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="ip_vs"

	I0531 17:33:06.110222       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="ip_vs_rr"

	I0531 17:33:06.189907       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="ip_vs_wrr"

	I0531 17:33:06.195133       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="ip_vs_sh"

	I0531 17:33:06.198664       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="nf_conntrack"

	I0531 17:33:06.327073       1 node.go:163] Successfully retrieved node IP: 192.168.49.2

	I0531 17:33:06.327259       1 server_others.go:138] "Detected node IP" address="192.168.49.2"

	I0531 17:33:06.327392       1 server_others.go:561] "Unknown proxy mode, assuming iptables proxy" proxyMode=""

	I0531 17:33:06.688869       1 server_others.go:206] "Using iptables Proxier"

	I0531 17:33:06.689291       1 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4

	I0531 17:33:06.689740       1 server_others.go:214] "Creating dualStackProxier for iptables"

	I0531 17:33:06.689814       1 server_others.go:491] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6"

	I0531 17:33:06.692445       1 server.go:656] "Version info" version="v1.23.6"

	I0531 17:33:06.696163       1 config.go:317] "Starting service config controller"

	I0531 17:33:06.696291       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0531 17:33:06.696737       1 config.go:226] "Starting endpoint slice config controller"

	I0531 17:33:06.696756       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I0531 17:33:06.797135       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0531 17:33:06.797221       1 shared_informer.go:247] Caches are synced for service config 

	* 

	* ==> kube-proxy [ad11c3777c4e] <==

	* I0531 17:35:24.098053       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="ip_vs_rr"

	I0531 17:35:24.101813       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="ip_vs_wrr"

	I0531 17:35:24.104508       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="ip_vs_sh"

	I0531 17:35:24.107448       1 proxier.go:657] "Failed to load kernel module with modprobe, you can ignore this message when kube-proxy is running inside container without mounting /lib/modules" moduleName="nf_conntrack"

	E0531 17:35:24.185240       1 node.go:152] Failed to retrieve node info: Get "https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20220531173104-2108": dial tcp 192.168.49.2:8441: connect: connection refused

	E0531 17:35:25.227143       1 node.go:152] Failed to retrieve node info: Get "https://control-plane.minikube.internal:8441/api/v1/nodes/functional-20220531173104-2108": dial tcp 192.168.49.2:8441: connect: connection refused

	I0531 17:35:33.386904       1 node.go:163] Successfully retrieved node IP: 192.168.49.2

	I0531 17:35:33.387082       1 server_others.go:138] "Detected node IP" address="192.168.49.2"

	I0531 17:35:33.387156       1 server_others.go:561] "Unknown proxy mode, assuming iptables proxy" proxyMode=""

	I0531 17:35:33.805882       1 server_others.go:206] "Using iptables Proxier"

	I0531 17:35:33.806008       1 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4

	I0531 17:35:33.806021       1 server_others.go:214] "Creating dualStackProxier for iptables"

	I0531 17:35:33.806044       1 server_others.go:491] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6"

	I0531 17:35:33.806489       1 server.go:656] "Version info" version="v1.23.6"

	I0531 17:35:33.807519       1 config.go:317] "Starting service config controller"

	I0531 17:35:33.807537       1 shared_informer.go:240] Waiting for caches to sync for service config

	I0531 17:35:33.807580       1 config.go:226] "Starting endpoint slice config controller"

	I0531 17:35:33.807585       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config

	I0531 17:35:33.908774       1 shared_informer.go:247] Caches are synced for endpoint slice config 

	I0531 17:35:33.908937       1 shared_informer.go:247] Caches are synced for service config 

	W0531 17:35:34.187163       1 reflector.go:442] k8s.io/client-go/informers/factory.go:134: watch of *v1.Service ended with: very short watch: k8s.io/client-go/informers/factory.go:134: Unexpected watch close - watch lasted less than a second and no items received

	W0531 17:35:34.187246       1 reflector.go:442] k8s.io/client-go/informers/factory.go:134: watch of *v1.EndpointSlice ended with: very short watch: k8s.io/client-go/informers/factory.go:134: Unexpected watch close - watch lasted less than a second and no items received

	E0531 17:35:34.187323       1 event_broadcaster.go:262] Unable to write event: 'Post "https://control-plane.minikube.internal:8441/apis/events.k8s.io/v1/namespaces/default/events": unexpected EOF' (may retry after sleeping)

	W0531 17:35:35.389226       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8441/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=586": dial tcp 192.168.49.2:8441: connect: connection refused

	E0531 17:35:35.389399       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8441/api/v1/services?labelSelector=%!s(MISSING)ervice.kubernetes.io%!F(MISSING)headless%!C(MISSING)%!s(MISSING)ervice.kubernetes.io%!F(MISSING)service-proxy-name&resourceVersion=586": dial tcp 192.168.49.2:8441: connect: connection refused

	* 

	* ==> kube-scheduler [adf0898fd4ff] <==

	* E0531 17:35:39.190312       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W0531 17:35:39.190431       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0531 17:35:39.190512       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W0531 17:35:39.190547       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0531 17:35:39.190726       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	W0531 17:35:39.191107       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0531 17:35:39.191011       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W0531 17:35:39.190885       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0531 17:35:39.191304       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0531 17:35:39.191378       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0531 17:35:39.191418       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0531 17:35:39.191448       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0531 17:35:39.191508       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: unknown (get nodes)

	E0531 17:35:39.191561       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: unknown (get pods)

	W0531 17:35:39.191747       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0531 17:35:39.191747       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0531 17:35:39.190596       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0531 17:35:39.287970       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0531 17:35:39.191321       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0531 17:35:39.191420       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0531 17:35:39.190556       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0531 17:35:39.288095       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0531 17:35:39.191783       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W0531 17:35:39.295870       1 reflector.go:324] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0531 17:35:39.296068       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	* 

	* ==> kube-scheduler [f808f562e4c4] <==

	* W0531 17:32:45.288186       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0531 17:32:45.288296       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W0531 17:32:45.288300       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	W0531 17:32:45.288524       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0531 17:32:45.288540       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0531 17:32:45.288552       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W0531 17:32:45.589835       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0531 17:32:45.589984       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W0531 17:32:45.702471       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0531 17:32:45.702598       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W0531 17:32:45.731493       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0531 17:32:45.731611       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0531 17:32:45.741158       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0531 17:32:45.741325       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W0531 17:32:45.807409       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0531 17:32:45.807526       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W0531 17:32:45.829957       1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0531 17:32:45.830093       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0531 17:32:47.002641       1 reflector.go:324] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0531 17:32:47.002772       1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0531 17:32:47.087448       1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system"

	I0531 17:32:51.587983       1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 

	I0531 17:35:19.631143       1 configmap_cafile_content.go:222] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I0531 17:35:19.631934       1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"

	I0531 17:35:19.632617       1 secure_serving.go:311] Stopped listening on 127.0.0.1:10259

	* 

	* ==> kubelet <==

	* -- Logs begin at Tue 2022-05-31 17:31:59 UTC, end at Tue 2022-05-31 18:11:20 UTC. --

	May 31 17:37:05 functional-20220531173104-2108 kubelet[6055]: I0531 17:37:05.105444    6055 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlwfx\" (UniqueName: \"kubernetes.io/projected/b31211e5-01d1-4a06-9d69-72182ab83802-kube-api-access-mlwfx\") pod \"sp-pod\" (UID: \"b31211e5-01d1-4a06-9d69-72182ab83802\") " pod="default/sp-pod"

	May 31 17:37:05 functional-20220531173104-2108 kubelet[6055]: I0531 17:37:05.287672    6055 docker_sandbox.go:402] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/hello-node-54fbb85-c6cbz through plugin: invalid network status for"

	May 31 17:37:05 functional-20220531173104-2108 kubelet[6055]: I0531 17:37:05.287695    6055 pod_container_deletor.go:79] "Container not found in pod's containers" containerID="7ef50adfd038f2286f21035755a0bc0609a23b76236474e8b4d00792eecf0d76"

	May 31 17:37:05 functional-20220531173104-2108 kubelet[6055]: I0531 17:37:05.906126    6055 kubelet_volumes.go:160] "Cleaned up orphaned pod volumes dir" podUID=21fd3f05-62fb-433b-8773-6875c87575ce path="/var/lib/kubelet/pods/21fd3f05-62fb-433b-8773-6875c87575ce/volumes"

	May 31 17:37:06 functional-20220531173104-2108 kubelet[6055]: I0531 17:37:06.305829    6055 docker_sandbox.go:402] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/hello-node-54fbb85-c6cbz through plugin: invalid network status for"

	May 31 17:37:07 functional-20220531173104-2108 kubelet[6055]: I0531 17:37:07.129839    6055 pod_container_deletor.go:79] "Container not found in pod's containers" containerID="00208e1f542a1644bacc9fc2e4e3d6cce48255de697dfc5e59ad362f05793ffb"

	May 31 17:37:07 functional-20220531173104-2108 kubelet[6055]: I0531 17:37:07.130189    6055 docker_sandbox.go:402] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/sp-pod through plugin: invalid network status for"

	May 31 17:37:07 functional-20220531173104-2108 kubelet[6055]: I0531 17:37:07.139575    6055 docker_sandbox.go:402] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/hello-node-connect-74cf8bc446-5wbb6 through plugin: invalid network status for"

	May 31 17:37:08 functional-20220531173104-2108 kubelet[6055]: I0531 17:37:08.207787    6055 docker_sandbox.go:402] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/hello-node-connect-74cf8bc446-5wbb6 through plugin: invalid network status for"

	May 31 17:37:08 functional-20220531173104-2108 kubelet[6055]: I0531 17:37:08.219427    6055 docker_sandbox.go:402] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/hello-node-54fbb85-c6cbz through plugin: invalid network status for"

	May 31 17:37:08 functional-20220531173104-2108 kubelet[6055]: I0531 17:37:08.233119    6055 docker_sandbox.go:402] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/sp-pod through plugin: invalid network status for"

	May 31 17:37:09 functional-20220531173104-2108 kubelet[6055]: I0531 17:37:09.634733    6055 docker_sandbox.go:402] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/sp-pod through plugin: invalid network status for"

	May 31 17:39:27 functional-20220531173104-2108 kubelet[6055]: I0531 17:39:27.296674    6055 topology_manager.go:200] "Topology Admit Handler"

	May 31 17:39:27 functional-20220531173104-2108 kubelet[6055]: I0531 17:39:27.489435    6055 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47pdt\" (UniqueName: \"kubernetes.io/projected/f511a394-30ea-40ce-9841-29501af6ecf7-kube-api-access-47pdt\") pod \"mysql-b87c45988-hqk85\" (UID: \"f511a394-30ea-40ce-9841-29501af6ecf7\") " pod="default/mysql-b87c45988-hqk85"

	May 31 17:39:29 functional-20220531173104-2108 kubelet[6055]: I0531 17:39:29.228606    6055 pod_container_deletor.go:79] "Container not found in pod's containers" containerID="333834c1cb3d8874bb9a5260ff5c49ec9c421df7d40510d4994f747cf7b71ec7"

	May 31 17:39:29 functional-20220531173104-2108 kubelet[6055]: I0531 17:39:29.228681    6055 docker_sandbox.go:402] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/mysql-b87c45988-hqk85 through plugin: invalid network status for"

	May 31 17:39:30 functional-20220531173104-2108 kubelet[6055]: I0531 17:39:30.248557    6055 docker_sandbox.go:402] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/mysql-b87c45988-hqk85 through plugin: invalid network status for"

	May 31 17:40:13 functional-20220531173104-2108 kubelet[6055]: I0531 17:40:13.811273    6055 docker_sandbox.go:402] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for default/mysql-b87c45988-hqk85 through plugin: invalid network status for"

	May 31 17:40:32 functional-20220531173104-2108 kubelet[6055]: W0531 17:40:32.493500    6055 sysinfo.go:203] Nodes topology is not available, providing CPU topology

	May 31 17:45:32 functional-20220531173104-2108 kubelet[6055]: W0531 17:45:32.497023    6055 sysinfo.go:203] Nodes topology is not available, providing CPU topology

	May 31 17:50:32 functional-20220531173104-2108 kubelet[6055]: W0531 17:50:32.501018    6055 sysinfo.go:203] Nodes topology is not available, providing CPU topology

	May 31 17:55:32 functional-20220531173104-2108 kubelet[6055]: W0531 17:55:32.501239    6055 sysinfo.go:203] Nodes topology is not available, providing CPU topology

	May 31 18:00:32 functional-20220531173104-2108 kubelet[6055]: W0531 18:00:32.500643    6055 sysinfo.go:203] Nodes topology is not available, providing CPU topology

	May 31 18:05:32 functional-20220531173104-2108 kubelet[6055]: W0531 18:05:32.502294    6055 sysinfo.go:203] Nodes topology is not available, providing CPU topology

	May 31 18:10:32 functional-20220531173104-2108 kubelet[6055]: W0531 18:10:32.502814    6055 sysinfo.go:203] Nodes topology is not available, providing CPU topology

	* 

	* ==> storage-provisioner [a24e38366a7b] <==

	* I0531 17:35:42.604630       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0531 17:35:42.693442       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0531 17:35:42.693925       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0531 17:36:00.237376       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0531 17:36:00.237517       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"384e3ae8-40aa-4b44-8ed1-ea8b9c2eb632", APIVersion:"v1", ResourceVersion:"648", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-20220531173104-2108_eb15f159-a5f4-4351-8afd-7524ee07e4af became leader

	I0531 17:36:00.237615       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-20220531173104-2108_eb15f159-a5f4-4351-8afd-7524ee07e4af!

	I0531 17:36:00.338799       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-20220531173104-2108_eb15f159-a5f4-4351-8afd-7524ee07e4af!

	I0531 17:36:28.124827       1 controller.go:1332] provision "default/myclaim" class "standard": started

	I0531 17:36:28.125875       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"18fcadfc-4369-421a-97a7-f376ed316380", APIVersion:"v1", ResourceVersion:"686", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/myclaim"

	I0531 17:36:28.125373       1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{standard    b434fe0f-783d-4d0d-8b61-1218c61b254f 471 0 2022-05-31 17:33:10 +0000 UTC <nil> <nil> map[addonmanager.kubernetes.io/mode:EnsureExists] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{"storageclass.kubernetes.io/is-default-class":"true"},"labels":{"addonmanager.kubernetes.io/mode":"EnsureExists"},"name":"standard"},"provisioner":"k8s.io/minikube-hostpath"}

	 storageclass.kubernetes.io/is-default-class:true] [] []  [{kubectl-client-side-apply Update storage.k8s.io/v1 2022-05-31 17:33:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{},"f:storageclass.kubernetes.io/is-default-class":{}},"f:labels":{".":{},"f:addonmanager.kubernetes.io/mode":{}}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-18fcadfc-4369-421a-97a7-f376ed316380 &PersistentVolumeClaim{ObjectMeta:{myclaim  default  18fcadfc-4369-421a-97a7-f376ed316380 686 0 2022-05-31 17:36:28 +0000 UTC <nil> <nil> map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"myclaim","namespace":"default"},"spec":{"accessModes":["Rea

dWriteOnce"],"resources":{"requests":{"storage":"500Mi"}},"volumeMode":"Filesystem"}}

	 volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath volume.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection]  [{kube-controller-manager Update v1 2022-05-31 17:36:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}}}} {kubectl.exe Update v1 2022-05-31 17:36:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{524288000 0} {<nil>} 500Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*standard,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:ResourceList{}

,Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/myclaim

	I0531 17:36:28.128438       1 controller.go:1439] provision "default/myclaim" class "standard": volume "pvc-18fcadfc-4369-421a-97a7-f376ed316380" provisioned

	I0531 17:36:28.129530       1 controller.go:1456] provision "default/myclaim" class "standard": succeeded

	I0531 17:36:28.129644       1 volume_store.go:212] Trying to save persistentvolume "pvc-18fcadfc-4369-421a-97a7-f376ed316380"

	I0531 17:36:28.141506       1 volume_store.go:219] persistentvolume "pvc-18fcadfc-4369-421a-97a7-f376ed316380" saved

	I0531 17:36:28.142141       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"18fcadfc-4369-421a-97a7-f376ed316380", APIVersion:"v1", ResourceVersion:"686", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-18fcadfc-4369-421a-97a7-f376ed316380

	* 

	* ==> storage-provisioner [c93090aa2535] <==

	* I0531 17:35:24.385678       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	F0531 17:35:24.389863       1 main.go:39] error getting server version: Get "https://10.96.0.1:443/version?timeout=32s": dial tcp 10.96.0.1:443: connect: connection refused

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.APIServer}} -p functional-20220531173104-2108 -n functional-20220531173104-2108

helpers_test.go:254: (dbg) Done: out/minikube-windows-amd64.exe status --format={{.APIServer}} -p functional-20220531173104-2108 -n functional-20220531173104-2108: (6.3387248s)

helpers_test.go:261: (dbg) Run:  kubectl --context functional-20220531173104-2108 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:270: non-running pods: 

helpers_test.go:272: ======> post-mortem[TestFunctional/parallel/ServiceCmd]: describe non-running pods <======

helpers_test.go:275: (dbg) Run:  kubectl --context functional-20220531173104-2108 describe pod 

helpers_test.go:275: (dbg) Non-zero exit: kubectl --context functional-20220531173104-2108 describe pod : exit status 1 (199.0365ms)

** stderr ** 

	error: resource name may not be empty

** /stderr **

helpers_test.go:277: kubectl --context functional-20220531173104-2108 describe pod : exit status 1

--- FAIL: TestFunctional/parallel/ServiceCmd (2067.20s)

=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

E0531 17:39:13.017354    2108 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\addons-20220531171726-2108\client.crt: The system cannot find the path specified.

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

=== CONT  TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:169: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}

functional_test_tunnel_test.go:180: nginx-svc svc.status.loadBalancer.ingress never got an IP: timed out waiting for the condition

functional_test_tunnel_test.go:181: (dbg) Run:  kubectl --context functional-20220531173104-2108 get svc nginx-svc

functional_test_tunnel_test.go:185: failed to kubectl get svc nginx-svc:

-- stdout --

	NAME        TYPE           CLUSTER-IP      EXTERNAL-IP   PORT(S)        AGE

	nginx-svc   LoadBalancer   10.101.31.148   <pending>     80:31262/TCP   3m16s

-- /stdout --

--- FAIL: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (180.95s)

=== RUN   TestKubernetesUpgrade

=== PAUSE TestKubernetesUpgrade

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:229: (dbg) Run:  out/minikube-windows-amd64.exe start -p kubernetes-upgrade-20220531191315-2108 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:229: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p kubernetes-upgrade-20220531191315-2108 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker: exit status 80 (6m52.9113005s)

-- stdout --

	* [kubernetes-upgrade-20220531191315-2108] minikube v1.26.0-beta.1 on Microsoft Windows 10 Enterprise N 10.0.19044 Build 19044

	  - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	  - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	  - MINIKUBE_LOCATION=14079

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	* Using the docker driver based on user configuration

	* Using Docker Desktop driver with the root privilege

	* Starting control plane node kubernetes-upgrade-20220531191315-2108 in cluster kubernetes-upgrade-20220531191315-2108

	* Pulling base image ...

	* Creating docker container (CPUs=2, Memory=2200MB) ...

	* docker "kubernetes-upgrade-20220531191315-2108" container is missing, will recreate.

	* Creating docker container (CPUs=2, Memory=2200MB) ...

-- /stdout --

** stderr ** 

	I0531 19:13:16.051544    9456 out.go:296] Setting OutFile to fd 1564 ...

	I0531 19:13:16.108538    9456 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0531 19:13:16.108538    9456 out.go:309] Setting ErrFile to fd 1456...

	I0531 19:13:16.108538    9456 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0531 19:13:16.122545    9456 out.go:303] Setting JSON to false

	I0531 19:13:16.124544    9456 start.go:115] hostinfo: {"hostname":"minikube7","uptime":82666,"bootTime":1653941730,"procs":161,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19044 Build 19044","kernelVersion":"10.0.19044 Build 19044","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f66ed2ea-6c04-4a6b-8eea-b2fb0953e990"}

	W0531 19:13:16.125539    9456 start.go:123] gopshost.Virtualization returned error: not implemented yet

	I0531 19:13:16.132540    9456 out.go:177] * [kubernetes-upgrade-20220531191315-2108] minikube v1.26.0-beta.1 on Microsoft Windows 10 Enterprise N 10.0.19044 Build 19044

	I0531 19:13:16.138533    9456 notify.go:193] Checking for updates...

	I0531 19:13:16.141543    9456 out.go:177]   - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I0531 19:13:16.147538    9456 out.go:177]   - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	I0531 19:13:16.153544    9456 out.go:177]   - MINIKUBE_LOCATION=14079

	I0531 19:13:16.157534    9456 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0531 19:13:16.162537    9456 config.go:178] Loaded profile config "NoKubernetes-20220531190920-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v0.0.0

	I0531 19:13:16.163541    9456 config.go:178] Loaded profile config "missing-upgrade-20220531190920-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	I0531 19:13:16.163541    9456 config.go:178] Loaded profile config "stopped-upgrade-20220531190920-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	I0531 19:13:16.163541    9456 driver.go:358] Setting default libvirt URI to qemu:///system

	I0531 19:13:19.119230    9456 docker.go:137] docker version: linux-20.10.14

	I0531 19:13:19.131242    9456 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0531 19:13:21.446504    9456 cli_runner.go:217] Completed: docker system info --format "{{json .}}": (2.315088s)

	I0531 19:13:21.446972    9456 info.go:265] docker info: {ID:JKWR:L4LW:XYJC:G6AI:GZFU:RUGW:CCH6:OD2M:V572:4FTB:B7YC:DTUC Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:87 OomKillDisable:true NGoroutines:66 SystemTime:2022-05-31 19:13:20.2614209 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_

64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,

profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc.

Version:v0.17.0]] Warnings:<nil>}}

	I0531 19:13:21.450265    9456 out.go:177] * Using the docker driver based on user configuration

	I0531 19:13:21.454087    9456 start.go:284] selected driver: docker

	I0531 19:13:21.454087    9456 start.go:806] validating driver "docker" against <nil>

	I0531 19:13:21.454087    9456 start.go:817] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0531 19:13:21.522178    9456 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0531 19:13:23.859728    9456 cli_runner.go:217] Completed: docker system info --format "{{json .}}": (2.3375391s)

	I0531 19:13:23.859728    9456 info.go:265] docker info: {ID:JKWR:L4LW:XYJC:G6AI:GZFU:RUGW:CCH6:OD2M:V572:4FTB:B7YC:DTUC Containers:3 ContainersRunning:3 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:89 OomKillDisable:true NGoroutines:66 SystemTime:2022-05-31 19:13:22.6592397 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_

64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,

profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc.

Version:v0.17.0]] Warnings:<nil>}}

	I0531 19:13:23.859728    9456 start_flags.go:292] no existing cluster config was found, will generate one from the flags 

	I0531 19:13:23.860718    9456 start_flags.go:829] Wait components to verify : map[apiserver:true system_pods:true]

	I0531 19:13:23.873716    9456 out.go:177] * Using Docker Desktop driver with the root privilege

	I0531 19:13:23.876705    9456 cni.go:95] Creating CNI manager for ""

	I0531 19:13:23.876996    9456 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0531 19:13:23.877068    9456 start_flags.go:306] config:

	{Name:kubernetes-upgrade-20220531191315-2108 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-20220531191315-2108 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[]

DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}

	I0531 19:13:23.880975    9456 out.go:177] * Starting control plane node kubernetes-upgrade-20220531191315-2108 in cluster kubernetes-upgrade-20220531191315-2108

	I0531 19:13:23.884698    9456 cache.go:120] Beginning downloading kic base image for docker with docker

	I0531 19:13:23.887466    9456 out.go:177] * Pulling base image ...

	I0531 19:13:23.890435    9456 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I0531 19:13:23.890435    9456 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 in local docker daemon

	I0531 19:13:23.890435    9456 preload.go:148] Found local preload: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4

	I0531 19:13:23.890435    9456 cache.go:57] Caching tarball of preloaded images

	I0531 19:13:23.891170    9456 preload.go:174] Found C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0531 19:13:23.891170    9456 cache.go:60] Finished verifying existence of preloaded tar for  v1.16.0 on docker

	I0531 19:13:23.891714    9456 profile.go:148] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20220531191315-2108\config.json ...

	I0531 19:13:23.891925    9456 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\kubernetes-upgrade-20220531191315-2108\config.json: {Name:mkebf72d829d95f5a7e4f9a5d36a090b7a97ede7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:13:25.079664    9456 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 in local docker daemon, skipping pull

	I0531 19:13:25.079664    9456 cache.go:141] gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 exists in daemon, skipping load

	I0531 19:13:25.079784    9456 cache.go:206] Successfully downloaded all kic artifacts

	I0531 19:13:25.080103    9456 start.go:352] acquiring machines lock for kubernetes-upgrade-20220531191315-2108: {Name:mk11cef1482e399c3184a31b95484b539a7a52c1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0531 19:13:25.080305    9456 start.go:356] acquired machines lock for "kubernetes-upgrade-20220531191315-2108" in 133µs

	I0531 19:13:25.080636    9456 start.go:91] Provisioning new machine with config: &{Name:kubernetes-upgrade-20220531191315-2108 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-20220531191315

-2108 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:f

alse} &{Name: IP: Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0531 19:13:25.080917    9456 start.go:131] createHost starting for "" (driver="docker")

	I0531 19:13:25.091190    9456 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...

	I0531 19:13:25.091190    9456 start.go:165] libmachine.API.Create for "kubernetes-upgrade-20220531191315-2108" (driver="docker")

	I0531 19:13:25.091190    9456 client.go:168] LocalClient.Create starting

	I0531 19:13:25.092655    9456 main.go:134] libmachine: Reading certificate data from C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem

	I0531 19:13:25.092951    9456 main.go:134] libmachine: Decoding PEM data...

	I0531 19:13:25.093231    9456 main.go:134] libmachine: Parsing certificate...

	I0531 19:13:25.093478    9456 main.go:134] libmachine: Reading certificate data from C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem

	I0531 19:13:25.093686    9456 main.go:134] libmachine: Decoding PEM data...

	I0531 19:13:25.093686    9456 main.go:134] libmachine: Parsing certificate...

	I0531 19:13:25.106627    9456 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-20220531191315-2108 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0531 19:13:26.213958    9456 cli_runner.go:211] docker network inspect kubernetes-upgrade-20220531191315-2108 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0531 19:13:26.213958    9456 cli_runner.go:217] Completed: docker network inspect kubernetes-upgrade-20220531191315-2108 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}": (1.1063149s)

	I0531 19:13:26.223940    9456 network_create.go:272] running [docker network inspect kubernetes-upgrade-20220531191315-2108] to gather additional debugging logs...

	I0531 19:13:26.223940    9456 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-20220531191315-2108

	W0531 19:13:27.450864    9456 cli_runner.go:211] docker network inspect kubernetes-upgrade-20220531191315-2108 returned with exit code 1

	I0531 19:13:27.450938    9456 cli_runner.go:217] Completed: docker network inspect kubernetes-upgrade-20220531191315-2108: (1.2268472s)

	I0531 19:13:27.450938    9456 network_create.go:275] error running [docker network inspect kubernetes-upgrade-20220531191315-2108]: docker network inspect kubernetes-upgrade-20220531191315-2108: exit status 1

	stdout:

	[]

	stderr:

	Error: No such network: kubernetes-upgrade-20220531191315-2108

	I0531 19:13:27.451016    9456 network_create.go:277] output of [docker network inspect kubernetes-upgrade-20220531191315-2108]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error: No such network: kubernetes-upgrade-20220531191315-2108

	** /stderr **

	I0531 19:13:27.457995    9456 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0531 19:13:28.691794    9456 cli_runner.go:217] Completed: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}": (1.2332195s)

	I0531 19:13:28.710763    9456 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc000c864e8] misses:0}

	I0531 19:13:28.710763    9456 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I0531 19:13:28.710763    9456 network_create.go:115] attempt to create docker network kubernetes-upgrade-20220531191315-2108 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...

	I0531 19:13:28.721776    9456 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true kubernetes-upgrade-20220531191315-2108

	I0531 19:13:30.032903    9456 cli_runner.go:217] Completed: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true kubernetes-upgrade-20220531191315-2108: (1.3110035s)

	I0531 19:13:30.033197    9456 network_create.go:99] docker network kubernetes-upgrade-20220531191315-2108 192.168.49.0/24 created

	I0531 19:13:30.033197    9456 kic.go:106] calculated static IP "192.168.49.2" for the "kubernetes-upgrade-20220531191315-2108" container

	I0531 19:13:30.052659    9456 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I0531 19:13:31.295644    9456 cli_runner.go:217] Completed: docker ps -a --format {{.Names}}: (1.2429783s)

	I0531 19:13:31.302185    9456 cli_runner.go:164] Run: docker volume create kubernetes-upgrade-20220531191315-2108 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true

	I0531 19:13:32.540167    9456 cli_runner.go:217] Completed: docker volume create kubernetes-upgrade-20220531191315-2108 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true: (1.2366623s)

	I0531 19:13:32.540167    9456 oci.go:103] Successfully created a docker volume kubernetes-upgrade-20220531191315-2108

	I0531 19:13:32.554945    9456 cli_runner.go:164] Run: docker run --rm --name kubernetes-upgrade-20220531191315-2108-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --entrypoint /usr/bin/test -v kubernetes-upgrade-20220531191315-2108:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 -d /var/lib

	I0531 19:13:35.752774    9456 cli_runner.go:217] Completed: docker run --rm --name kubernetes-upgrade-20220531191315-2108-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --entrypoint /usr/bin/test -v kubernetes-upgrade-20220531191315-2108:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 -d /var/lib: (3.1978142s)

	I0531 19:13:35.752774    9456 oci.go:107] Successfully prepared a docker volume kubernetes-upgrade-20220531191315-2108

	I0531 19:13:35.752774    9456 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I0531 19:13:35.752774    9456 kic.go:179] Starting extracting preloaded images to volume ...

	I0531 19:13:35.760295    9456 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v kubernetes-upgrade-20220531191315-2108:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 -I lz4 -xf /preloaded.tar -C /extractDir

	I0531 19:14:06.449661    9456 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v kubernetes-upgrade-20220531191315-2108:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 -I lz4 -xf /preloaded.tar -C /extractDir: (30.6892276s)

	I0531 19:14:06.449661    9456 kic.go:188] duration metric: took 30.696748 seconds to extract preloaded images to volume

	I0531 19:14:06.457652    9456 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0531 19:14:09.016244    9456 cli_runner.go:217] Completed: docker system info --format "{{json .}}": (2.5585806s)

	I0531 19:14:09.016244    9456 info.go:265] docker info: {ID:JKWR:L4LW:XYJC:G6AI:GZFU:RUGW:CCH6:OD2M:V572:4FTB:B7YC:DTUC Containers:2 ContainersRunning:2 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:74 OomKillDisable:true NGoroutines:62 SystemTime:2022-05-31 19:14:07.7610822 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_

64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,

profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc.

Version:v0.17.0]] Warnings:<nil>}}

	I0531 19:14:09.034262    9456 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"

	I0531 19:14:11.585102    9456 cli_runner.go:217] Completed: docker info --format "'{{json .SecurityOptions}}'": (2.5508285s)

	I0531 19:14:11.595212    9456 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname kubernetes-upgrade-20220531191315-2108 --name kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --network kubernetes-upgrade-20220531191315-2108 --ip 192.168.49.2 --volume kubernetes-upgrade-20220531191315-2108:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418

	W0531 19:14:13.214830    9456 cli_runner.go:211] docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname kubernetes-upgrade-20220531191315-2108 --name kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --network kubernetes-upgrade-20220531191315-2108 --ip 192.168.49.2 --volume kubernetes-upgrade-20220531191315-2108:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 returned with exit code 12

5

	I0531 19:14:13.214830    9456 cli_runner.go:217] Completed: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname kubernetes-upgrade-20220531191315-2108 --name kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --network kubernetes-upgrade-20220531191315-2108 --ip 192.168.49.2 --volume kubernetes-upgrade-20220531191315-2108:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418: (1.6196099s)

	I0531 19:14:13.214830    9456 client.go:171] LocalClient.Create took 48.1234214s

	I0531 19:14:15.232127    9456 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0531 19:14:15.240558    9456 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108

	W0531 19:14:16.427583    9456 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108 returned with exit code 1

	I0531 19:14:16.427583    9456 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108: (1.1867867s)

	I0531 19:14:16.427583    9456 retry.go:31] will retry after 276.165072ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0531 19:14:16.734713    9456 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108

	W0531 19:14:17.960953    9456 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108 returned with exit code 1

	I0531 19:14:17.961324    9456 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108: (1.226234s)

	W0531 19:14:17.961429    9456 start.go:281] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	W0531 19:14:17.961575    9456 start.go:248] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0531 19:14:17.972305    9456 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0531 19:14:17.978925    9456 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108

	W0531 19:14:19.265188    9456 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108 returned with exit code 1

	I0531 19:14:19.265188    9456 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108: (1.286257s)

	I0531 19:14:19.265188    9456 retry.go:31] will retry after 291.140013ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0531 19:14:19.571381    9456 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108

	W0531 19:14:20.833228    9456 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108 returned with exit code 1

	I0531 19:14:20.833228    9456 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108: (1.261842s)

	W0531 19:14:20.833228    9456 start.go:296] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	W0531 19:14:20.833228    9456 start.go:253] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0531 19:14:20.833228    9456 start.go:134] duration metric: createHost completed in 55.751964s

	I0531 19:14:20.833228    9456 start.go:81] releasing machines lock for "kubernetes-upgrade-20220531191315-2108", held for 55.7525551s

	W0531 19:14:20.833228    9456 start.go:599] error starting host: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname kubernetes-upgrade-20220531191315-2108 --name kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --network kubernetes-upgrade-20220531191315-2108 --ip 192.168.49.2 --volume kubernetes-upgrade-20220531191315-2108:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786

303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418: exit status 125

	stdout:

	9999f89419ab60fc86f55222180a60e9b37b4d52db98ed215b80d388bded3524

	stderr:

	docker: Error response from daemon: network kubernetes-upgrade-20220531191315-2108 not found.

	I0531 19:14:20.849287    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:14:22.015257    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1659647s)

	W0531 19:14:22.015371    9456 start.go:604] delete host: Docker machine "kubernetes-upgrade-20220531191315-2108" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.

	W0531 19:14:22.015465    9456 out.go:239] ! StartHost failed, but will try again: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname kubernetes-upgrade-20220531191315-2108 --name kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --network kubernetes-upgrade-20220531191315-2108 --ip 192.168.49.2 --volume kubernetes-upgrade-20220531191315-2108:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-142

30@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418: exit status 125

	stdout:

	9999f89419ab60fc86f55222180a60e9b37b4d52db98ed215b80d388bded3524

	stderr:

	docker: Error response from daemon: network kubernetes-upgrade-20220531191315-2108 not found.

	! StartHost failed, but will try again: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname kubernetes-upgrade-20220531191315-2108 --name kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --network kubernetes-upgrade-20220531191315-2108 --ip 192.168.49.2 --volume kubernetes-upgrade-20220531191315-2108:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e8

9f0007072a54fdbcc2f86a1fb8575418: exit status 125

	stdout:

	9999f89419ab60fc86f55222180a60e9b37b4d52db98ed215b80d388bded3524

	stderr:

	docker: Error response from daemon: network kubernetes-upgrade-20220531191315-2108 not found.

	I0531 19:14:22.015867    9456 start.go:614] Will try again in 5 seconds ...

	I0531 19:14:27.021335    9456 start.go:352] acquiring machines lock for kubernetes-upgrade-20220531191315-2108: {Name:mk11cef1482e399c3184a31b95484b539a7a52c1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0531 19:14:27.021335    9456 start.go:356] acquired machines lock for "kubernetes-upgrade-20220531191315-2108" in 0s

	I0531 19:14:27.021963    9456 start.go:94] Skipping create...Using existing machine configuration

	I0531 19:14:27.021963    9456 fix.go:55] fixHost starting: 

	I0531 19:14:27.039733    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:14:28.282752    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.2428993s)

	I0531 19:14:28.282844    9456 fix.go:103] recreateIfNeeded on kubernetes-upgrade-20220531191315-2108: state= err=<nil>

	I0531 19:14:28.282844    9456 fix.go:108] machineExists: false. err=machine does not exist

	I0531 19:14:28.327397    9456 out.go:177] * docker "kubernetes-upgrade-20220531191315-2108" container is missing, will recreate.

	I0531 19:14:28.330269    9456 delete.go:124] DEMOLISHING kubernetes-upgrade-20220531191315-2108 ...

	I0531 19:14:28.345273    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:14:29.518144    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1728657s)

	I0531 19:14:29.518144    9456 stop.go:79] host is in state 

	I0531 19:14:29.519299    9456 main.go:134] libmachine: Stopping "kubernetes-upgrade-20220531191315-2108"...

	I0531 19:14:29.541457    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:14:30.771045    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.2295821s)

	I0531 19:14:30.787060    9456 kic_runner.go:93] Run: systemctl --version

	I0531 19:14:30.787060    9456 kic_runner.go:114] Args: [docker exec --privileged kubernetes-upgrade-20220531191315-2108 systemctl --version]

	I0531 19:14:31.988468    9456 kic_runner.go:93] Run: sudo service kubelet stop

	I0531 19:14:31.988468    9456 kic_runner.go:114] Args: [docker exec --privileged kubernetes-upgrade-20220531191315-2108 sudo service kubelet stop]

	I0531 19:14:33.135987    9456 openrc.go:165] stop output: 

	** stderr ** 

	Error response from daemon: Container 9999f89419ab60fc86f55222180a60e9b37b4d52db98ed215b80d388bded3524 is not running

	** /stderr **

	W0531 19:14:33.135987    9456 kic.go:439] couldn't stop kubelet. will continue with stop anyways: sudo service kubelet stop: exit status 1

	stdout:

	stderr:

	Error response from daemon: Container 9999f89419ab60fc86f55222180a60e9b37b4d52db98ed215b80d388bded3524 is not running

	I0531 19:14:33.162307    9456 kic_runner.go:93] Run: sudo service kubelet stop

	I0531 19:14:33.162395    9456 kic_runner.go:114] Args: [docker exec --privileged kubernetes-upgrade-20220531191315-2108 sudo service kubelet stop]

	I0531 19:14:34.365880    9456 openrc.go:165] stop output: 

	** stderr ** 

	Error response from daemon: Container 9999f89419ab60fc86f55222180a60e9b37b4d52db98ed215b80d388bded3524 is not running

	** /stderr **

	W0531 19:14:34.366181    9456 kic.go:441] couldn't force stop kubelet. will continue with stop anyways: sudo service kubelet stop: exit status 1

	stdout:

	stderr:

	Error response from daemon: Container 9999f89419ab60fc86f55222180a60e9b37b4d52db98ed215b80d388bded3524 is not running

	I0531 19:14:34.382530    9456 kic_runner.go:93] Run: docker ps -a --filter=name=k8s_.*_(kube-system|kubernetes-dashboard|storage-gluster|istio-operator)_ --format={{.ID}}

	I0531 19:14:34.382530    9456 kic_runner.go:114] Args: [docker exec --privileged kubernetes-upgrade-20220531191315-2108 docker ps -a --filter=name=k8s_.*_(kube-system|kubernetes-dashboard|storage-gluster|istio-operator)_ --format={{.ID}}]

	I0531 19:14:35.623591    9456 kic.go:452] unable list containers : docker: docker ps -a --filter=name=k8s_.*_(kube-system|kubernetes-dashboard|storage-gluster|istio-operator)_ --format={{.ID}}: exit status 1

	stdout:

	stderr:

	Error response from daemon: Container 9999f89419ab60fc86f55222180a60e9b37b4d52db98ed215b80d388bded3524 is not running

	I0531 19:14:35.623591    9456 kic.go:462] successfully stopped kubernetes!

	I0531 19:14:35.647602    9456 kic_runner.go:93] Run: pgrep kube-apiserver

	I0531 19:14:35.647602    9456 kic_runner.go:114] Args: [docker exec --privileged kubernetes-upgrade-20220531191315-2108 pgrep kube-apiserver]

	I0531 19:14:38.208276    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:14:39.394947    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1866663s)

	I0531 19:14:42.418799    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:14:43.572207    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1534032s)

	I0531 19:14:46.592604    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:14:47.689109    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.0965002s)

	I0531 19:14:50.720278    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:14:51.958261    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.2379773s)

	I0531 19:14:54.979217    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:14:56.223241    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.2440184s)

	I0531 19:14:59.257574    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:15:00.480247    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.2226679s)

	I0531 19:15:03.511988    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:15:04.648939    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1369459s)

	I0531 19:15:07.671821    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:15:08.920227    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.2484003s)

	I0531 19:15:11.938782    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:15:13.046534    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.106803s)

	I0531 19:15:16.074704    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:15:17.164992    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.0902834s)

	I0531 19:15:20.188259    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:15:21.393966    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.2056429s)

	I0531 19:15:24.421799    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:15:25.563799    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1418224s)

	I0531 19:15:28.585543    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:15:29.939500    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.353951s)

	I0531 19:15:32.962277    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:15:34.114570    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1522878s)

	I0531 19:15:37.133058    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:15:38.358615    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.2255518s)

	I0531 19:15:41.385088    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:15:42.530147    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1450542s)

	I0531 19:15:45.555592    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:15:46.725728    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1701306s)

	I0531 19:15:49.753639    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:15:50.920387    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1667431s)

	I0531 19:15:53.936317    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:15:55.102600    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1662777s)

	I0531 19:15:58.125561    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:15:59.304263    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1785489s)

	I0531 19:16:02.331884    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:16:03.630687    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.2987973s)

	I0531 19:16:06.655003    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:16:07.886717    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.2317082s)

	I0531 19:16:10.916836    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:16:12.256871    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.3400292s)

	I0531 19:16:15.285578    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:16:16.659456    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.373871s)

	I0531 19:16:19.692829    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:16:21.049802    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.3568779s)

	I0531 19:16:24.072729    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:16:25.395748    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.3227137s)

	I0531 19:16:28.442020    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:16:29.756071    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.3140451s)

	I0531 19:16:32.777089    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:16:34.093957    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.3168616s)

	I0531 19:16:37.125879    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:16:38.452417    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.3265329s)

	I0531 19:16:41.477270    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:16:42.895829    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.4185534s)

	I0531 19:16:45.932500    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:16:47.270234    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.337267s)

	I0531 19:16:50.296473    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:16:51.789396    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.4929153s)

	I0531 19:16:54.808640    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:16:56.072207    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.2635616s)

	I0531 19:16:59.094954    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:17:00.497621    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.4026606s)

	I0531 19:17:03.518263    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:17:04.713109    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1948411s)

	I0531 19:17:07.739611    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:17:08.955274    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.2154762s)

	I0531 19:17:11.978833    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:17:13.092324    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1134862s)

	I0531 19:17:16.122807    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:17:17.225864    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1030524s)

	I0531 19:17:20.256164    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:17:21.399922    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1437533s)

	I0531 19:17:24.425813    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:17:25.703123    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.2771299s)

	I0531 19:17:28.724223    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:17:29.855893    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1316654s)

	I0531 19:17:32.872108    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:17:34.036115    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1640019s)

	I0531 19:17:37.051120    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:17:38.200935    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1498096s)

	I0531 19:17:41.220717    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:17:42.333737    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.113015s)

	I0531 19:17:45.359703    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:17:46.556159    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1964503s)

	I0531 19:17:49.584999    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:17:50.707137    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1221336s)

	I0531 19:17:53.730298    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:17:54.925203    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1949s)

	I0531 19:17:57.956316    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:17:59.154459    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.198137s)

	I0531 19:18:02.193193    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:18:03.456281    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.2630151s)

	I0531 19:18:06.474693    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:18:07.865168    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1801116s)

	I0531 19:18:10.888962    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:18:11.965989    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.0770221s)

	I0531 19:18:14.994044    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:18:16.150649    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.156415s)

	I0531 19:18:19.548557    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:18:20.627750    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.0790306s)

	I0531 19:18:23.643944    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:18:24.697757    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.0527348s)

	I0531 19:18:27.716689    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:18:28.906688    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.189993s)

	I0531 19:18:31.928176    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:18:33.071869    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1436882s)

	I0531 19:18:36.094758    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:18:37.243220    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1484214s)

	I0531 19:18:40.263757    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:18:41.356952    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.0930929s)

	I0531 19:18:44.384031    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:18:45.510215    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1261793s)

	I0531 19:18:48.549728    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:18:49.685461    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1357282s)

	I0531 19:18:52.686696    9456 stop.go:59] stop err: Maximum number of retries (60) exceeded

	I0531 19:18:52.686992    9456 delete.go:129] stophost failed (probably ok): Temporary Error: stop: Maximum number of retries (60) exceeded

	I0531 19:18:52.705173    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:18:53.829743    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1245652s)

	W0531 19:18:53.829743    9456 delete.go:135] deletehost failed: Docker machine "kubernetes-upgrade-20220531191315-2108" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.

	I0531 19:18:53.836742    9456 cli_runner.go:164] Run: docker container inspect -f {{.Id}} kubernetes-upgrade-20220531191315-2108

	I0531 19:18:54.981964    9456 cli_runner.go:217] Completed: docker container inspect -f {{.Id}} kubernetes-upgrade-20220531191315-2108: (1.1452166s)

	I0531 19:18:54.989009    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:18:56.148717    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1595558s)

	I0531 19:18:56.158472    9456 cli_runner.go:164] Run: docker exec --privileged -t kubernetes-upgrade-20220531191315-2108 /bin/bash -c "sudo init 0"

	W0531 19:18:58.545134    9456 cli_runner.go:211] docker exec --privileged -t kubernetes-upgrade-20220531191315-2108 /bin/bash -c "sudo init 0" returned with exit code 1

	I0531 19:18:58.545134    9456 cli_runner.go:217] Completed: docker exec --privileged -t kubernetes-upgrade-20220531191315-2108 /bin/bash -c "sudo init 0": (2.3865748s)

	I0531 19:18:58.545134    9456 oci.go:625] error shutdown kubernetes-upgrade-20220531191315-2108: docker exec --privileged -t kubernetes-upgrade-20220531191315-2108 /bin/bash -c "sudo init 0": exit status 1

	stdout:

	stderr:

	Error response from daemon: Container 9999f89419ab60fc86f55222180a60e9b37b4d52db98ed215b80d388bded3524 is not running

	I0531 19:18:59.553137    9456 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}

	I0531 19:19:00.683918    9456 cli_runner.go:217] Completed: docker container inspect kubernetes-upgrade-20220531191315-2108 --format={{.State.Status}}: (1.1305765s)

	I0531 19:19:00.683992    9456 oci.go:639] temporary error: container kubernetes-upgrade-20220531191315-2108 status is  but expect it to be exited

	I0531 19:19:00.684072    9456 oci.go:645] Successfully shutdown container kubernetes-upgrade-20220531191315-2108

	I0531 19:19:00.692806    9456 cli_runner.go:164] Run: docker rm -f -v kubernetes-upgrade-20220531191315-2108

	I0531 19:19:01.917926    9456 cli_runner.go:217] Completed: docker rm -f -v kubernetes-upgrade-20220531191315-2108: (1.2251145s)

	I0531 19:19:01.924925    9456 cli_runner.go:164] Run: docker container inspect -f {{.Id}} kubernetes-upgrade-20220531191315-2108

	W0531 19:19:04.000106    9456 cli_runner.go:211] docker container inspect -f {{.Id}} kubernetes-upgrade-20220531191315-2108 returned with exit code 1

	I0531 19:19:04.000172    9456 cli_runner.go:217] Completed: docker container inspect -f {{.Id}} kubernetes-upgrade-20220531191315-2108: (2.0750014s)

	I0531 19:19:04.013441    9456 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-20220531191315-2108 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0531 19:19:06.778528    9456 cli_runner.go:211] docker network inspect kubernetes-upgrade-20220531191315-2108 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0531 19:19:06.778528    9456 cli_runner.go:217] Completed: docker network inspect kubernetes-upgrade-20220531191315-2108 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}": (2.7650741s)

	I0531 19:19:06.788503    9456 network_create.go:272] running [docker network inspect kubernetes-upgrade-20220531191315-2108] to gather additional debugging logs...

	I0531 19:19:06.788503    9456 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-20220531191315-2108

	W0531 19:19:07.886577    9456 cli_runner.go:211] docker network inspect kubernetes-upgrade-20220531191315-2108 returned with exit code 1

	I0531 19:19:07.886796    9456 cli_runner.go:217] Completed: docker network inspect kubernetes-upgrade-20220531191315-2108: (1.0980684s)

	I0531 19:19:07.886796    9456 network_create.go:275] error running [docker network inspect kubernetes-upgrade-20220531191315-2108]: docker network inspect kubernetes-upgrade-20220531191315-2108: exit status 1

	stdout:

	[]

	stderr:

	Error: No such network: kubernetes-upgrade-20220531191315-2108

	I0531 19:19:07.886901    9456 network_create.go:277] output of [docker network inspect kubernetes-upgrade-20220531191315-2108]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error: No such network: kubernetes-upgrade-20220531191315-2108

	** /stderr **

	W0531 19:19:07.887722    9456 delete.go:139] delete failed (probably ok) <nil>

	I0531 19:19:07.887722    9456 fix.go:115] Sleeping 1 second for extra luck!

	I0531 19:19:08.897835    9456 start.go:131] createHost starting for "" (driver="docker")

	I0531 19:19:08.903552    9456 out.go:204] * Creating docker container (CPUs=2, Memory=2200MB) ...

	I0531 19:19:08.903552    9456 start.go:165] libmachine.API.Create for "kubernetes-upgrade-20220531191315-2108" (driver="docker")

	I0531 19:19:08.903552    9456 client.go:168] LocalClient.Create starting

	I0531 19:19:08.904239    9456 main.go:134] libmachine: Reading certificate data from C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem

	I0531 19:19:08.910348    9456 main.go:134] libmachine: Decoding PEM data...

	I0531 19:19:08.910348    9456 main.go:134] libmachine: Parsing certificate...

	I0531 19:19:08.910348    9456 main.go:134] libmachine: Reading certificate data from C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem

	I0531 19:19:08.915462    9456 main.go:134] libmachine: Decoding PEM data...

	I0531 19:19:08.915462    9456 main.go:134] libmachine: Parsing certificate...

	I0531 19:19:08.927455    9456 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-20220531191315-2108 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0531 19:19:10.047518    9456 cli_runner.go:211] docker network inspect kubernetes-upgrade-20220531191315-2108 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0531 19:19:10.047518    9456 cli_runner.go:217] Completed: docker network inspect kubernetes-upgrade-20220531191315-2108 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}": (1.1200571s)

	I0531 19:19:10.053518    9456 network_create.go:272] running [docker network inspect kubernetes-upgrade-20220531191315-2108] to gather additional debugging logs...

	I0531 19:19:10.054517    9456 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-20220531191315-2108

	W0531 19:19:11.185640    9456 cli_runner.go:211] docker network inspect kubernetes-upgrade-20220531191315-2108 returned with exit code 1

	I0531 19:19:11.185640    9456 cli_runner.go:217] Completed: docker network inspect kubernetes-upgrade-20220531191315-2108: (1.1311176s)

	I0531 19:19:11.185640    9456 network_create.go:275] error running [docker network inspect kubernetes-upgrade-20220531191315-2108]: docker network inspect kubernetes-upgrade-20220531191315-2108: exit status 1

	stdout:

	[]

	stderr:

	Error: No such network: kubernetes-upgrade-20220531191315-2108

	I0531 19:19:11.185640    9456 network_create.go:277] output of [docker network inspect kubernetes-upgrade-20220531191315-2108]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error: No such network: kubernetes-upgrade-20220531191315-2108

	** /stderr **

	I0531 19:19:11.192638    9456 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0531 19:19:12.310143    9456 cli_runner.go:217] Completed: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}": (1.1174997s)

	I0531 19:19:12.327055    9456 network.go:284] reusing subnet 192.168.49.0 that has expired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc000c864e8] amended:false}} dirty:map[] misses:0}

	I0531 19:19:12.327194    9456 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I0531 19:19:12.327194    9456 network_create.go:115] attempt to create docker network kubernetes-upgrade-20220531191315-2108 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...

	I0531 19:19:12.336568    9456 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true kubernetes-upgrade-20220531191315-2108

	I0531 19:19:13.578077    9456 cli_runner.go:217] Completed: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true kubernetes-upgrade-20220531191315-2108: (1.2412888s)

	I0531 19:19:13.578123    9456 network_create.go:99] docker network kubernetes-upgrade-20220531191315-2108 192.168.49.0/24 created

	I0531 19:19:13.578123    9456 kic.go:106] calculated static IP "192.168.49.2" for the "kubernetes-upgrade-20220531191315-2108" container

	I0531 19:19:13.592800    9456 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I0531 19:19:14.752001    9456 cli_runner.go:217] Completed: docker ps -a --format {{.Names}}: (1.1589502s)

	I0531 19:19:14.759980    9456 cli_runner.go:164] Run: docker volume create kubernetes-upgrade-20220531191315-2108 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true

	I0531 19:19:15.858136    9456 cli_runner.go:217] Completed: docker volume create kubernetes-upgrade-20220531191315-2108 --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true: (1.0981507s)

	I0531 19:19:15.858136    9456 oci.go:103] Successfully created a docker volume kubernetes-upgrade-20220531191315-2108

	I0531 19:19:15.867243    9456 cli_runner.go:164] Run: docker run --rm --name kubernetes-upgrade-20220531191315-2108-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --entrypoint /usr/bin/test -v kubernetes-upgrade-20220531191315-2108:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 -d /var/lib

	I0531 19:19:22.713288    9456 cli_runner.go:217] Completed: docker run --rm --name kubernetes-upgrade-20220531191315-2108-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --entrypoint /usr/bin/test -v kubernetes-upgrade-20220531191315-2108:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 -d /var/lib: (6.8460136s)

	I0531 19:19:22.713288    9456 oci.go:107] Successfully prepared a docker volume kubernetes-upgrade-20220531191315-2108

	I0531 19:19:22.713288    9456 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime docker

	I0531 19:19:22.713288    9456 kic.go:179] Starting extracting preloaded images to volume ...

	I0531 19:19:22.722276    9456 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v kubernetes-upgrade-20220531191315-2108:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 -I lz4 -xf /preloaded.tar -C /extractDir

	I0531 19:19:50.344033    9456 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.16.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v kubernetes-upgrade-20220531191315-2108:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 -I lz4 -xf /preloaded.tar -C /extractDir: (27.6216318s)

	I0531 19:19:50.344033    9456 kic.go:188] duration metric: took 27.630620 seconds to extract preloaded images to volume

	I0531 19:19:50.352025    9456 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0531 19:19:52.671605    9456 cli_runner.go:217] Completed: docker system info --format "{{json .}}": (2.3195695s)

	I0531 19:19:52.671605    9456 info.go:265] docker info: {ID:JKWR:L4LW:XYJC:G6AI:GZFU:RUGW:CCH6:OD2M:V572:4FTB:B7YC:DTUC Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:63 OomKillDisable:true NGoroutines:58 SystemTime:2022-05-31 19:19:51.4830474 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_

64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,

profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc.

Version:v0.17.0]] Warnings:<nil>}}

	I0531 19:19:52.679613    9456 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"

	I0531 19:19:54.960533    9456 cli_runner.go:217] Completed: docker info --format "'{{json .SecurityOptions}}'": (2.2809096s)

	I0531 19:19:54.969529    9456 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname kubernetes-upgrade-20220531191315-2108 --name kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --network kubernetes-upgrade-20220531191315-2108 --ip 192.168.49.2 --volume kubernetes-upgrade-20220531191315-2108:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418

	W0531 19:19:56.361408    9456 cli_runner.go:211] docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname kubernetes-upgrade-20220531191315-2108 --name kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --network kubernetes-upgrade-20220531191315-2108 --ip 192.168.49.2 --volume kubernetes-upgrade-20220531191315-2108:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 returned with exit code 12

5

	I0531 19:19:56.361408    9456 cli_runner.go:217] Completed: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname kubernetes-upgrade-20220531191315-2108 --name kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --network kubernetes-upgrade-20220531191315-2108 --ip 192.168.49.2 --volume kubernetes-upgrade-20220531191315-2108:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418: (1.3918719s)

	I0531 19:19:56.361408    9456 client.go:171] LocalClient.Create took 47.4576389s

	I0531 19:19:58.384754    9456 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0531 19:19:58.391709    9456 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108

	W0531 19:19:59.540214    9456 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108 returned with exit code 1

	I0531 19:19:59.540214    9456 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108: (1.1484996s)

	I0531 19:19:59.540214    9456 retry.go:31] will retry after 231.159374ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0531 19:19:59.784730    9456 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108

	W0531 19:20:00.896129    9456 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108 returned with exit code 1

	I0531 19:20:00.896232    9456 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108: (1.1112698s)

	W0531 19:20:00.896316    9456 start.go:281] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	W0531 19:20:00.896316    9456 start.go:248] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0531 19:20:00.906623    9456 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0531 19:20:00.914450    9456 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108

	W0531 19:20:02.093928    9456 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108 returned with exit code 1

	I0531 19:20:02.093928    9456 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108: (1.1794721s)

	I0531 19:20:02.093928    9456 retry.go:31] will retry after 141.409254ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0531 19:20:02.248791    9456 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108

	W0531 19:20:03.436285    9456 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108 returned with exit code 1

	I0531 19:20:03.436285    9456 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108: (1.1874295s)

	W0531 19:20:03.436285    9456 start.go:296] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	W0531 19:20:03.436285    9456 start.go:253] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0531 19:20:03.436285    9456 start.go:134] duration metric: createHost completed in 54.5379948s

	I0531 19:20:03.447283    9456 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0531 19:20:03.455286    9456 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108

	W0531 19:20:04.652441    9456 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108 returned with exit code 1

	I0531 19:20:04.652624    9456 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108: (1.1971493s)

	I0531 19:20:04.652624    9456 retry.go:31] will retry after 149.242379ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0531 19:20:04.822302    9456 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108

	W0531 19:20:05.994211    9456 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108 returned with exit code 1

	I0531 19:20:05.994211    9456 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108: (1.1719032s)

	W0531 19:20:05.994211    9456 start.go:281] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	W0531 19:20:05.994211    9456 start.go:248] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0531 19:20:06.003204    9456 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0531 19:20:06.010199    9456 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108

	W0531 19:20:07.174752    9456 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108 returned with exit code 1

	I0531 19:20:07.174752    9456 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108: (1.1645472s)

	I0531 19:20:07.174752    9456 retry.go:31] will retry after 253.803157ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0531 19:20:07.453684    9456 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108

	W0531 19:20:08.664874    9456 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108 returned with exit code 1

	I0531 19:20:08.665150    9456 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220531191315-2108: (1.211185s)

	W0531 19:20:08.665333    9456 start.go:296] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	W0531 19:20:08.665425    9456 start.go:253] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0531 19:20:08.665425    9456 fix.go:57] fixHost completed within 5m41.6419197s

	I0531 19:20:08.665425    9456 start.go:81] releasing machines lock for "kubernetes-upgrade-20220531191315-2108", held for 5m41.6425482s

	W0531 19:20:08.666231    9456 out.go:239] * Failed to start docker container. Running "minikube delete -p kubernetes-upgrade-20220531191315-2108" may fix it: recreate: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname kubernetes-upgrade-20220531191315-2108 --name kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --network kubernetes-upgrade-20220531191315-2108 --ip 192.168.49.2 --volume kubernetes-upgrade-20220531191315-2108:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::500

0 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418: exit status 125

	stdout:

	d208bf51202a9bdc978217cbda4726db76f458b9ccdfa37f212d2c84cec8196f

	stderr:

	docker: Error response from daemon: network kubernetes-upgrade-20220531191315-2108 not found.

	* Failed to start docker container. Running "minikube delete -p kubernetes-upgrade-20220531191315-2108" may fix it: recreate: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname kubernetes-upgrade-20220531191315-2108 --name kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --network kubernetes-upgrade-20220531191315-2108 --ip 192.168.49.2 --volume kubernetes-upgrade-20220531191315-2108:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-mi

nikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418: exit status 125

	stdout:

	d208bf51202a9bdc978217cbda4726db76f458b9ccdfa37f212d2c84cec8196f

	stderr:

	docker: Error response from daemon: network kubernetes-upgrade-20220531191315-2108 not found.

	I0531 19:20:08.670749    9456 out.go:177] 

	W0531 19:20:08.673753    9456 out.go:239] X Exiting due to GUEST_PROVISION: Failed to start host: recreate: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname kubernetes-upgrade-20220531191315-2108 --name kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --network kubernetes-upgrade-20220531191315-2108 --ip 192.168.49.2 --volume kubernetes-upgrade-20220531191315-2108:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-bui

lds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418: exit status 125

	stdout:

	d208bf51202a9bdc978217cbda4726db76f458b9ccdfa37f212d2c84cec8196f

	stderr:

	docker: Error response from daemon: network kubernetes-upgrade-20220531191315-2108 not found.

	X Exiting due to GUEST_PROVISION: Failed to start host: recreate: creating host: create: creating: create kic node: create container: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname kubernetes-upgrade-20220531191315-2108 --name kubernetes-upgrade-20220531191315-2108 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=kubernetes-upgrade-20220531191315-2108 --network kubernetes-upgrade-20220531191315-2108 --ip 192.168.49.2 --volume kubernetes-upgrade-20220531191315-2108:/var --security-opt apparmor=unconfined --memory=2200mb --memory-swap=2200mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e95378

6303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418: exit status 125

	stdout:

	d208bf51202a9bdc978217cbda4726db76f458b9ccdfa37f212d2c84cec8196f

	stderr:

	docker: Error response from daemon: network kubernetes-upgrade-20220531191315-2108 not found.

	W0531 19:20:08.673753    9456 out.go:239] * 

	* 

	W0531 19:20:08.674751    9456 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0531 19:20:08.678756    9456 out.go:177] 

** /stderr **

version_upgrade_test.go:231: failed to start minikube HEAD with oldest k8s version: out/minikube-windows-amd64.exe start -p kubernetes-upgrade-20220531191315-2108 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker: exit status 80

version_upgrade_test.go:234: (dbg) Run:  out/minikube-windows-amd64.exe stop -p kubernetes-upgrade-20220531191315-2108

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:234: (dbg) Non-zero exit: out/minikube-windows-amd64.exe stop -p kubernetes-upgrade-20220531191315-2108: exit status 82 (4m25.7637113s)

-- stdout --

	* Stopping node "kubernetes-upgrade-20220531191315-2108"  ...

-- /stdout --

** stderr ** 

	E0531 19:20:14.900076    7728 daemonize_windows.go:38] error terminating scheduled stop for profile kubernetes-upgrade-20220531191315-2108: stopping schedule-stop service for profile kubernetes-upgrade-20220531191315-2108: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	X Exiting due to GUEST_STOP_TIMEOUT: Temporary Error: stop: Maximum number of retries (60) exceeded

	* 

	╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                       │

	│    * If the above advice does not help, please let us know:                                                           │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                         │

	│                                                                                                                       │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                              │

	│    * Please also attach the following file to the GitHub issue:                                                       │

	│    * - C:\Users\jenkins.minikube7\AppData\Local\Temp\minikube_stop_00bf5dc3d80d6eb9ce31b0df7efaf9ad81c5ff31_15.log    │

	│                                                                                                                       │

	╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

version_upgrade_test.go:236: out/minikube-windows-amd64.exe stop -p kubernetes-upgrade-20220531191315-2108 failed: exit status 82

panic.go:482: *** TestKubernetesUpgrade FAILED at 2022-05-31 19:24:34.6198188 +0000 GMT m=+7745.660224101

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestKubernetesUpgrade]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect kubernetes-upgrade-20220531191315-2108

helpers_test.go:231: (dbg) Done: docker inspect kubernetes-upgrade-20220531191315-2108: (1.1765913s)

helpers_test.go:235: (dbg) docker inspect kubernetes-upgrade-20220531191315-2108:

-- stdout --

	[

	    {

	        "Id": "d208bf51202a9bdc978217cbda4726db76f458b9ccdfa37f212d2c84cec8196f",

	        "Created": "2022-05-31T19:19:56.1065998Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "created",

	            "Running": false,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 0,

	            "ExitCode": 128,

	            "Error": "network kubernetes-upgrade-20220531191315-2108 not found",

	            "StartedAt": "0001-01-01T00:00:00Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:aedbaa58534633065a66af6f01ba15f6c7dc1b8a285b6938f9d04325ceab9ed4",

	        "ResolvConfPath": "",

	        "HostnamePath": "",

	        "HostsPath": "",

	        "LogPath": "",

	        "Name": "/kubernetes-upgrade-20220531191315-2108",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "unconfined",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "kubernetes-upgrade-20220531191315-2108:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "kubernetes-upgrade-20220531191315-2108",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 2306867200,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 2306867200,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/202a28681afc2711646e0524508ac497ecb25b22f752dc92dc27598590669ffa-init/diff:/var/lib/docker/overlay2/42ebd8012a176a6c9bc83a2b81ffb1eb5c8e01d5410cb5d59346522bbaddf2cc/diff:/var/lib/docker/overlay2/59dce173ea661e9679f479af711a101ab0e97afb60abfd3c5b7a199b5c3e2b3b/diff:/var/lib/docker/overlay2/0328b60a223ca9f8bab93e6b86106d8b64d16fa559a56e88abbdee372b3b6a70/diff:/var/lib/docker/overlay2/b781f2620a052ee02138337819bde18c09122be2f20b7cfefaf7688f18d0c559/diff:/var/lib/docker/overlay2/af966c145b90b1748180b9ffcb1521d6fa9914e1d0ca582b239123591ffd1527/diff:/var/lib/docker/overlay2/5cd2b511f6f3bc93855ed77b5510ca4c67426eea433ccda53ea8e864342a413e/diff:/var/lib/docker/overlay2/f896d291d0c004470c3e38ea0d3be8e2b2a48ea36d45662c40fe3e105cbf4dec/diff:/var/lib/docker/overlay2/9e8994dcf5b1692245d5e40982d040298bfa7f7977892cf4be8ba3697f2c1283/diff:/var/lib/docker/overlay2/a7da4130c1b629e2a737b34701c6d4dfe6c48f92771856a887e06a1edc5456f8/diff:/var/lib/docker/overlay2/4c2573

4b9c8459489256b5f70dbb446897b9510d1cf9187e903f845ffa2a7ec2/diff:/var/lib/docker/overlay2/5c6cef49a0d0d1a36777fa7e0955ecdffb41ce354b7984f232e9cd51916416f7/diff:/var/lib/docker/overlay2/b79c799ed97edb702ed4c4ccb55ef9c645ae162e30e8f297ca5dd1152c29de41/diff:/var/lib/docker/overlay2/c84b7bc7c79ffdedf2d1265e21eec011dc3215811fb0569f7eb7d6b9aec884e8/diff:/var/lib/docker/overlay2/df8e2c3af362fd04ee17cb8d67105cf489427b2ae7cec77b79a2778e6c8c0234/diff:/var/lib/docker/overlay2/e56e356f8425868b31ada978267de73f074f211985ff1849ece7ab8341c33bae/diff:/var/lib/docker/overlay2/82c032066e83d3297742c83dd29132974e9db73a0b0b0a8edd3bcbbdb29cd53c/diff:/var/lib/docker/overlay2/15532131f3e6d0b2faf705733b06ae0c869147f2ca9592e3a80b6eaadad23544/diff:/var/lib/docker/overlay2/73fa456f504732f46cbe49368167247ca47b3099a6a75a7023ba16e7f598aee5/diff:/var/lib/docker/overlay2/e5635e020aadcc8dd1e5e3cd2eaa45cb97147f47bf406211fc61d7cbfc531193/diff:/var/lib/docker/overlay2/40b76b3249d3f7a8a737e2db80ebc1ed3b76d59724641217e8aae414ad832781/diff:/var/lib/d

ocker/overlay2/50ea2ce78d4fe52f626b2755a14f71a3c4f9b5a4f929646d9200876bdb1652c1/diff:/var/lib/docker/overlay2/d0a6e94d1f4aa73824d39c6e655bc4bdcd6568cea821b5d0f71174591c9cbbb3/diff:/var/lib/docker/overlay2/20c8fbe37a8c89a03b7bffe8cbc507e888cd5886f86f43b551d6a09fee1ce5e7/diff:/var/lib/docker/overlay2/48942b31cfe24e44c65a8be1785cd90488444f8c420a79b72a123034b01dd3f8/diff:/var/lib/docker/overlay2/c90124ab97e02facd949bfbd45815d6d73a40303b47ba4a4bc035788f5ee2dc3/diff:/var/lib/docker/overlay2/38c82aeabee1c8f46551413ecabb24f2f22680bb623f79e40c751558747a03f5/diff:/var/lib/docker/overlay2/4fa8894d1c1d773bc2e0511f273eab03fb7b8be7489eab5cd3eb57cc0d12e855/diff:/var/lib/docker/overlay2/23319fcddb47e50928e2044bac662de8153728f3a2eefa9c6ad5a5f413efec88/diff:/var/lib/docker/overlay2/b7ecd073b5b747c21ecbd1ca61887899f7e227fac3e383e24f868549b7929d74/diff:/var/lib/docker/overlay2/29a5674b4bbabfd07c4ce0b2a8b84ce98af380bf984043a4a9a6cd0743e4630c/diff:/var/lib/docker/overlay2/86a10266979ed72dc4372ade724e64741de35702626642ba60a15cca143

3682e/diff:/var/lib/docker/overlay2/03a1af7f82f1cb2b6eadbd1f13c8e9f6ca281ef3a8968d6aa45d284f286aefca/diff:/var/lib/docker/overlay2/f36cce4566278d24128326f8ef6ea446884c0c6941ccdb763ddf936e178afbff/diff:/var/lib/docker/overlay2/e54a2a61ba3597af53ec65a822821ffca97788e4b1dbfeedf98bf4d12e78973d/diff:/var/lib/docker/overlay2/dd54a25b898b0d7952f0bcb99a0450ee3d6b4269599e9355b4ae5e0c540c2caa/diff:/var/lib/docker/overlay2/ae6c1d1e9e79e03382217f21886420e3118a3f18f7c44f76c19262a84a43e219/diff:/var/lib/docker/overlay2/82faa00f86c1fa99063466464f71cdd6d510aa3e45c6c43301b2119b5bd5285a/diff:/var/lib/docker/overlay2/9f54999972b485642f042b9ed4d00316be0a1d35c060e619aca79b1583180446/diff:/var/lib/docker/overlay2/b467240c20564ba44d0946c716cf18ab5be973b43b02c37ee3ddd8f94502f41b/diff:/var/lib/docker/overlay2/21217d4ff1c5cf81dd53cfd831e0961189fb9f86812e1f53843f0022383345e6/diff",

	                "MergedDir": "/var/lib/docker/overlay2/202a28681afc2711646e0524508ac497ecb25b22f752dc92dc27598590669ffa/merged",

	                "UpperDir": "/var/lib/docker/overlay2/202a28681afc2711646e0524508ac497ecb25b22f752dc92dc27598590669ffa/diff",

	                "WorkDir": "/var/lib/docker/overlay2/202a28681afc2711646e0524508ac497ecb25b22f752dc92dc27598590669ffa/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "kubernetes-upgrade-20220531191315-2108",

	                "Source": "/var/lib/docker/volumes/kubernetes-upgrade-20220531191315-2108/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "kubernetes-upgrade-20220531191315-2108",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "kubernetes-upgrade-20220531191315-2108",

	                "name.minikube.sigs.k8s.io": "kubernetes-upgrade-20220531191315-2108",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {},

	            "SandboxKey": "",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "kubernetes-upgrade-20220531191315-2108": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": null,

	                    "NetworkID": "",

	                    "EndpointID": "",

	                    "Gateway": "",

	                    "IPAddress": "",

	                    "IPPrefixLen": 0,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.Host}} -p kubernetes-upgrade-20220531191315-2108 -n kubernetes-upgrade-20220531191315-2108

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-windows-amd64.exe status --format={{.Host}} -p kubernetes-upgrade-20220531191315-2108 -n kubernetes-upgrade-20220531191315-2108: exit status 7 (3.0268043s)

-- stdout --

	Nonexistent

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "kubernetes-upgrade-20220531191315-2108" host is not running, skipping log retrieval (state="Nonexistent")

helpers_test.go:175: Cleaning up "kubernetes-upgrade-20220531191315-2108" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-windows-amd64.exe delete -p kubernetes-upgrade-20220531191315-2108

=== CONT  TestKubernetesUpgrade

helpers_test.go:178: (dbg) Done: out/minikube-windows-amd64.exe delete -p kubernetes-upgrade-20220531191315-2108: (20.8939747s)

--- FAIL: TestKubernetesUpgrade (703.93s)

=== RUN   TestNoKubernetes/serial/Start

no_kubernetes_test.go:136: (dbg) Run:  out/minikube-windows-amd64.exe start -p NoKubernetes-20220531190920-2108 --no-kubernetes --driver=docker

=== CONT  TestNoKubernetes/serial/Start

no_kubernetes_test.go:136: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p NoKubernetes-20220531190920-2108 --no-kubernetes --driver=docker: exit status 1 (15.5957396s)

-- stdout --

	* [NoKubernetes-20220531190920-2108] minikube v1.26.0-beta.1 on Microsoft Windows 10 Enterprise N 10.0.19044 Build 19044

	  - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	  - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	  - MINIKUBE_LOCATION=14079

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	* Using the docker driver based on user configuration

	* Using Docker Desktop driver with the root privilege

	* Starting minikube without Kubernetes NoKubernetes-20220531190920-2108 in cluster NoKubernetes-20220531190920-2108

	* Pulling base image ...

	* Creating docker container (CPUs=2, Memory=16300MB) ...

-- /stdout --

no_kubernetes_test.go:138: failed to start minikube with args: "out/minikube-windows-amd64.exe start -p NoKubernetes-20220531190920-2108 --no-kubernetes --driver=docker" : exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestNoKubernetes/serial/Start]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect NoKubernetes-20220531190920-2108

helpers_test.go:231: (dbg) Done: docker inspect NoKubernetes-20220531190920-2108: (1.2378623s)

helpers_test.go:235: (dbg) docker inspect NoKubernetes-20220531190920-2108:

-- stdout --

	[

	    {

	        "Name": "NoKubernetes-20220531190920-2108",

	        "Id": "c979c1adbea096163a6999c3c0eea729b4b8d4e6daf3406c5c572f4debc0feaa",

	        "Created": "2022-05-31T19:14:20.6451034Z",

	        "Scope": "local",

	        "Driver": "bridge",

	        "EnableIPv6": false,

	        "IPAM": {

	            "Driver": "default",

	            "Options": {},

	            "Config": [

	                {

	                    "Subnet": "192.168.49.0/24",

	                    "Gateway": "192.168.49.1"

	                }

	            ]

	        },

	        "Internal": false,

	        "Attachable": false,

	        "Ingress": false,

	        "ConfigFrom": {

	            "Network": ""

	        },

	        "ConfigOnly": false,

	        "Containers": {},

	        "Options": {

	            "--icc": "",

	            "--ip-masq": "",

	            "com.docker.network.driver.mtu": "1500"

	        },

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true"

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.Host}} -p NoKubernetes-20220531190920-2108 -n NoKubernetes-20220531190920-2108

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-windows-amd64.exe status --format={{.Host}} -p NoKubernetes-20220531190920-2108 -n NoKubernetes-20220531190920-2108: exit status 7 (3.144847s)

-- stdout --

	Nonexistent

-- /stdout --

** stderr ** 

	E0531 19:14:24.821790    1884 status.go:247] status error: host: state: unknown state "NoKubernetes-20220531190920-2108": docker container inspect NoKubernetes-20220531190920-2108 --format={{.State.Status}}: exit status 1

	stdout:

	stderr:

	Error: No such container: NoKubernetes-20220531190920-2108

** /stderr **

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "NoKubernetes-20220531190920-2108" host is not running, skipping log retrieval (state="Nonexistent")

--- FAIL: TestNoKubernetes/serial/Start (19.99s)

=== RUN   TestPause/serial/VerifyDeletedResources

pause_test.go:142: (dbg) Run:  out/minikube-windows-amd64.exe profile list --output json

pause_test.go:142: (dbg) Done: out/minikube-windows-amd64.exe profile list --output json: (9.7031605s)

pause_test.go:168: (dbg) Run:  docker ps -a

pause_test.go:168: (dbg) Done: docker ps -a: (1.1931133s)

pause_test.go:173: (dbg) Run:  docker volume inspect pause-20220531191437-2108

pause_test.go:173: (dbg) Done: docker volume inspect pause-20220531191437-2108: (2.7419445s)

pause_test.go:175: expected to see error and volume "docker volume inspect pause-20220531191437-2108" to not exist after deletion but got no error and this output: 

-- stdout --

	[

	    {

	        "CreatedAt": "2022-05-31T19:15:29Z",

	        "Driver": "local",

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "pause-20220531191437-2108"

	        },

	        "Mountpoint": "/var/lib/docker/volumes/pause-20220531191437-2108/_data",

	        "Name": "pause-20220531191437-2108",

	        "Options": {},

	        "Scope": "local"

	    }

	]

-- /stdout --

pause_test.go:178: (dbg) Run:  docker network ls

pause_test.go:178: (dbg) Done: docker network ls: (3.2328609s)

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestPause/serial/VerifyDeletedResources]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect pause-20220531191437-2108

helpers_test.go:235: (dbg) docker inspect pause-20220531191437-2108:

-- stdout --

	[

	    {

	        "CreatedAt": "2022-05-31T19:15:29Z",

	        "Driver": "local",

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "pause-20220531191437-2108"

	        },

	        "Mountpoint": "/var/lib/docker/volumes/pause-20220531191437-2108/_data",

	        "Name": "pause-20220531191437-2108",

	        "Options": {},

	        "Scope": "local"

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.Host}} -p pause-20220531191437-2108 -n pause-20220531191437-2108

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-windows-amd64.exe status --format={{.Host}} -p pause-20220531191437-2108 -n pause-20220531191437-2108: exit status 85 (517.9535ms)

-- stdout --

	* Profile "pause-20220531191437-2108" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p pause-20220531191437-2108"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "pause-20220531191437-2108" host is not running, skipping log retrieval (state="* Profile \"pause-20220531191437-2108\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p pause-20220531191437-2108\"")

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestPause/serial/VerifyDeletedResources]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect pause-20220531191437-2108

helpers_test.go:231: (dbg) Done: docker inspect pause-20220531191437-2108: (3.9484534s)

helpers_test.go:235: (dbg) docker inspect pause-20220531191437-2108:

-- stdout --

	[

	    {

	        "CreatedAt": "2022-05-31T19:15:29Z",

	        "Driver": "local",

	        "Labels": {

	            "created_by.minikube.sigs.k8s.io": "true",

	            "name.minikube.sigs.k8s.io": "pause-20220531191437-2108"

	        },

	        "Mountpoint": "/var/lib/docker/volumes/pause-20220531191437-2108/_data",

	        "Name": "pause-20220531191437-2108",

	        "Options": {},

	        "Scope": "local"

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.Host}} -p pause-20220531191437-2108 -n pause-20220531191437-2108

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-windows-amd64.exe status --format={{.Host}} -p pause-20220531191437-2108 -n pause-20220531191437-2108: exit status 85 (385.0044ms)

-- stdout --

	* Profile "pause-20220531191437-2108" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p pause-20220531191437-2108"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "pause-20220531191437-2108" host is not running, skipping log retrieval (state="* Profile \"pause-20220531191437-2108\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p pause-20220531191437-2108\"")

--- FAIL: TestPause/serial/VerifyDeletedResources (22.05s)

=== RUN   TestStartStop/group/old-k8s-version/serial/Pause

start_stop_delete_test.go:313: (dbg) Run:  out/minikube-windows-amd64.exe pause -p old-k8s-version-20220531192531-2108 --alsologtostderr -v=1

=== CONT  TestStartStop/group/old-k8s-version/serial/Pause

start_stop_delete_test.go:313: (dbg) Non-zero exit: out/minikube-windows-amd64.exe pause -p old-k8s-version-20220531192531-2108 --alsologtostderr -v=1: exit status 80 (9.2355283s)

-- stdout --

	* Pausing node old-k8s-version-20220531192531-2108 ... 

-- /stdout --

** stderr ** 

	I0531 19:43:50.796534    9208 out.go:296] Setting OutFile to fd 1816 ...

	I0531 19:43:50.866522    9208 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0531 19:43:50.866522    9208 out.go:309] Setting ErrFile to fd 1840...

	I0531 19:43:50.867526    9208 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0531 19:43:50.879525    9208 out.go:303] Setting JSON to false

	I0531 19:43:50.879525    9208 mustload.go:65] Loading cluster: old-k8s-version-20220531192531-2108

	I0531 19:43:50.880530    9208 config.go:178] Loaded profile config "old-k8s-version-20220531192531-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0

	I0531 19:43:50.897510    9208 cli_runner.go:164] Run: docker container inspect old-k8s-version-20220531192531-2108 --format={{.State.Status}}

	I0531 19:43:54.319795    9208 cli_runner.go:217] Completed: docker container inspect old-k8s-version-20220531192531-2108 --format={{.State.Status}}: (3.4221697s)

	I0531 19:43:54.320024    9208 host.go:66] Checking if "old-k8s-version-20220531192531-2108" exists ...

	I0531 19:43:54.344735    9208 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-20220531192531-2108

	I0531 19:43:55.819724    9208 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" old-k8s-version-20220531192531-2108: (1.4748795s)

	I0531 19:43:55.824646    9208 pause.go:58] "namespaces" ="keys" ="(MISSING)"

	I0531 19:43:55.827940    9208 out.go:177] * Pausing node old-k8s-version-20220531192531-2108 ... 

	I0531 19:43:55.835033    9208 host.go:66] Checking if "old-k8s-version-20220531192531-2108" exists ...

	I0531 19:43:55.858651    9208 ssh_runner.go:195] Run: systemctl --version

	I0531 19:43:55.869643    9208 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220531192531-2108

	I0531 19:43:57.379567    9208 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" old-k8s-version-20220531192531-2108: (1.5099176s)

	I0531 19:43:57.379693    9208 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54198 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\old-k8s-version-20220531192531-2108\id_rsa Username:docker}

	I0531 19:43:57.508180    9208 ssh_runner.go:235] Completed: systemctl --version: (1.6495219s)

	I0531 19:43:57.519167    9208 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0531 19:43:57.561836    9208 pause.go:50] kubelet running: true

	I0531 19:43:57.578853    9208 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet

	I0531 19:43:57.921839    9208 retry.go:31] will retry after 276.165072ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install disable kubelet

	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.

	I0531 19:43:58.212884    9208 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0531 19:43:58.256050    9208 pause.go:50] kubelet running: true

	I0531 19:43:58.269206    9208 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet

	I0531 19:43:58.609400    9208 retry.go:31] will retry after 540.190908ms: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install disable kubelet

	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.

	I0531 19:43:59.170670    9208 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0531 19:43:59.202429    9208 pause.go:50] kubelet running: true

	I0531 19:43:59.215078    9208 ssh_runner.go:195] Run: sudo systemctl disable --now kubelet

	I0531 19:43:59.567810    9208 out.go:177] 

	W0531 19:43:59.570826    9208 out.go:239] X Exiting due to GUEST_PAUSE: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install disable kubelet

	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.

	X Exiting due to GUEST_PAUSE: kubelet disable --now: sudo systemctl disable --now kubelet: Process exited with status 1

	stdout:

	stderr:

	Synchronizing state of kubelet.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install disable kubelet

	update-rc.d: error: kubelet Default-Start contains no runlevels, aborting.

	W0531 19:43:59.570826    9208 out.go:239] * 

	* 

	W0531 19:43:59.700343    9208 out.go:239] ╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                       │

	│    * If the above advice does not help, please let us know:                                                           │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                         │

	│                                                                                                                       │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                              │

	│    * Please also attach the following file to the GitHub issue:                                                       │

	│    * - C:\Users\jenkins.minikube7\AppData\Local\Temp\minikube_pause_8a34b101973a5475dd3f2895f630b939c2202307_5.log    │

	│                                                                                                                       │

	╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                                                       │

	│    * If the above advice does not help, please let us know:                                                           │

	│      https://github.com/kubernetes/minikube/issues/new/choose                                                         │

	│                                                                                                                       │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                              │

	│    * Please also attach the following file to the GitHub issue:                                                       │

	│    * - C:\Users\jenkins.minikube7\AppData\Local\Temp\minikube_pause_8a34b101973a5475dd3f2895f630b939c2202307_5.log    │

	│                                                                                                                       │

	╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

	I0531 19:43:59.705995    9208 out.go:177] 

** /stderr **

start_stop_delete_test.go:313: out/minikube-windows-amd64.exe pause -p old-k8s-version-20220531192531-2108 --alsologtostderr -v=1 failed: exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/Pause]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect old-k8s-version-20220531192531-2108

=== CONT  TestStartStop/group/old-k8s-version/serial/Pause

helpers_test.go:231: (dbg) Done: docker inspect old-k8s-version-20220531192531-2108: (1.3714537s)

helpers_test.go:235: (dbg) docker inspect old-k8s-version-20220531192531-2108:

-- stdout --

	[

	    {

	        "Id": "73d9dd1c979f96bb5332755b3731cd7b8a50346468819b2bc362eb6e60c2bebe",

	        "Created": "2022-05-31T19:32:10.7783868Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 209389,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2022-05-31T19:35:54.7458106Z",

	            "FinishedAt": "2022-05-31T19:35:32.9751099Z"

	        },

	        "Image": "sha256:aedbaa58534633065a66af6f01ba15f6c7dc1b8a285b6938f9d04325ceab9ed4",

	        "ResolvConfPath": "/var/lib/docker/containers/73d9dd1c979f96bb5332755b3731cd7b8a50346468819b2bc362eb6e60c2bebe/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/73d9dd1c979f96bb5332755b3731cd7b8a50346468819b2bc362eb6e60c2bebe/hostname",

	        "HostsPath": "/var/lib/docker/containers/73d9dd1c979f96bb5332755b3731cd7b8a50346468819b2bc362eb6e60c2bebe/hosts",

	        "LogPath": "/var/lib/docker/containers/73d9dd1c979f96bb5332755b3731cd7b8a50346468819b2bc362eb6e60c2bebe/73d9dd1c979f96bb5332755b3731cd7b8a50346468819b2bc362eb6e60c2bebe-json.log",

	        "Name": "/old-k8s-version-20220531192531-2108",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "old-k8s-version-20220531192531-2108:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "old-k8s-version-20220531192531-2108",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 2306867200,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 2306867200,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/62b6f32bd3ed97def9fa39268e79cead11ff11a89372be02429bef84bcf65810-init/diff:/var/lib/docker/overlay2/42ebd8012a176a6c9bc83a2b81ffb1eb5c8e01d5410cb5d59346522bbaddf2cc/diff:/var/lib/docker/overlay2/59dce173ea661e9679f479af711a101ab0e97afb60abfd3c5b7a199b5c3e2b3b/diff:/var/lib/docker/overlay2/0328b60a223ca9f8bab93e6b86106d8b64d16fa559a56e88abbdee372b3b6a70/diff:/var/lib/docker/overlay2/b781f2620a052ee02138337819bde18c09122be2f20b7cfefaf7688f18d0c559/diff:/var/lib/docker/overlay2/af966c145b90b1748180b9ffcb1521d6fa9914e1d0ca582b239123591ffd1527/diff:/var/lib/docker/overlay2/5cd2b511f6f3bc93855ed77b5510ca4c67426eea433ccda53ea8e864342a413e/diff:/var/lib/docker/overlay2/f896d291d0c004470c3e38ea0d3be8e2b2a48ea36d45662c40fe3e105cbf4dec/diff:/var/lib/docker/overlay2/9e8994dcf5b1692245d5e40982d040298bfa7f7977892cf4be8ba3697f2c1283/diff:/var/lib/docker/overlay2/a7da4130c1b629e2a737b34701c6d4dfe6c48f92771856a887e06a1edc5456f8/diff:/var/lib/docker/overlay2/4c2573

4b9c8459489256b5f70dbb446897b9510d1cf9187e903f845ffa2a7ec2/diff:/var/lib/docker/overlay2/5c6cef49a0d0d1a36777fa7e0955ecdffb41ce354b7984f232e9cd51916416f7/diff:/var/lib/docker/overlay2/b79c799ed97edb702ed4c4ccb55ef9c645ae162e30e8f297ca5dd1152c29de41/diff:/var/lib/docker/overlay2/c84b7bc7c79ffdedf2d1265e21eec011dc3215811fb0569f7eb7d6b9aec884e8/diff:/var/lib/docker/overlay2/df8e2c3af362fd04ee17cb8d67105cf489427b2ae7cec77b79a2778e6c8c0234/diff:/var/lib/docker/overlay2/e56e356f8425868b31ada978267de73f074f211985ff1849ece7ab8341c33bae/diff:/var/lib/docker/overlay2/82c032066e83d3297742c83dd29132974e9db73a0b0b0a8edd3bcbbdb29cd53c/diff:/var/lib/docker/overlay2/15532131f3e6d0b2faf705733b06ae0c869147f2ca9592e3a80b6eaadad23544/diff:/var/lib/docker/overlay2/73fa456f504732f46cbe49368167247ca47b3099a6a75a7023ba16e7f598aee5/diff:/var/lib/docker/overlay2/e5635e020aadcc8dd1e5e3cd2eaa45cb97147f47bf406211fc61d7cbfc531193/diff:/var/lib/docker/overlay2/40b76b3249d3f7a8a737e2db80ebc1ed3b76d59724641217e8aae414ad832781/diff:/var/lib/d

ocker/overlay2/50ea2ce78d4fe52f626b2755a14f71a3c4f9b5a4f929646d9200876bdb1652c1/diff:/var/lib/docker/overlay2/d0a6e94d1f4aa73824d39c6e655bc4bdcd6568cea821b5d0f71174591c9cbbb3/diff:/var/lib/docker/overlay2/20c8fbe37a8c89a03b7bffe8cbc507e888cd5886f86f43b551d6a09fee1ce5e7/diff:/var/lib/docker/overlay2/48942b31cfe24e44c65a8be1785cd90488444f8c420a79b72a123034b01dd3f8/diff:/var/lib/docker/overlay2/c90124ab97e02facd949bfbd45815d6d73a40303b47ba4a4bc035788f5ee2dc3/diff:/var/lib/docker/overlay2/38c82aeabee1c8f46551413ecabb24f2f22680bb623f79e40c751558747a03f5/diff:/var/lib/docker/overlay2/4fa8894d1c1d773bc2e0511f273eab03fb7b8be7489eab5cd3eb57cc0d12e855/diff:/var/lib/docker/overlay2/23319fcddb47e50928e2044bac662de8153728f3a2eefa9c6ad5a5f413efec88/diff:/var/lib/docker/overlay2/b7ecd073b5b747c21ecbd1ca61887899f7e227fac3e383e24f868549b7929d74/diff:/var/lib/docker/overlay2/29a5674b4bbabfd07c4ce0b2a8b84ce98af380bf984043a4a9a6cd0743e4630c/diff:/var/lib/docker/overlay2/86a10266979ed72dc4372ade724e64741de35702626642ba60a15cca143

3682e/diff:/var/lib/docker/overlay2/03a1af7f82f1cb2b6eadbd1f13c8e9f6ca281ef3a8968d6aa45d284f286aefca/diff:/var/lib/docker/overlay2/f36cce4566278d24128326f8ef6ea446884c0c6941ccdb763ddf936e178afbff/diff:/var/lib/docker/overlay2/e54a2a61ba3597af53ec65a822821ffca97788e4b1dbfeedf98bf4d12e78973d/diff:/var/lib/docker/overlay2/dd54a25b898b0d7952f0bcb99a0450ee3d6b4269599e9355b4ae5e0c540c2caa/diff:/var/lib/docker/overlay2/ae6c1d1e9e79e03382217f21886420e3118a3f18f7c44f76c19262a84a43e219/diff:/var/lib/docker/overlay2/82faa00f86c1fa99063466464f71cdd6d510aa3e45c6c43301b2119b5bd5285a/diff:/var/lib/docker/overlay2/9f54999972b485642f042b9ed4d00316be0a1d35c060e619aca79b1583180446/diff:/var/lib/docker/overlay2/b467240c20564ba44d0946c716cf18ab5be973b43b02c37ee3ddd8f94502f41b/diff:/var/lib/docker/overlay2/21217d4ff1c5cf81dd53cfd831e0961189fb9f86812e1f53843f0022383345e6/diff",

	                "MergedDir": "/var/lib/docker/overlay2/62b6f32bd3ed97def9fa39268e79cead11ff11a89372be02429bef84bcf65810/merged",

	                "UpperDir": "/var/lib/docker/overlay2/62b6f32bd3ed97def9fa39268e79cead11ff11a89372be02429bef84bcf65810/diff",

	                "WorkDir": "/var/lib/docker/overlay2/62b6f32bd3ed97def9fa39268e79cead11ff11a89372be02429bef84bcf65810/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "volume",

	                "Name": "old-k8s-version-20220531192531-2108",

	                "Source": "/var/lib/docker/volumes/old-k8s-version-20220531192531-2108/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            },

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            }

	        ],

	        "Config": {

	            "Hostname": "old-k8s-version-20220531192531-2108",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "old-k8s-version-20220531192531-2108",

	                "name.minikube.sigs.k8s.io": "old-k8s-version-20220531192531-2108",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "9d19ad06dc07a20673d48b61192d7c0e0905e29621856aeb09b8f9b0410f62d1",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "54198"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "54199"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "54200"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "54201"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "54202"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/9d19ad06dc07",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "old-k8s-version-20220531192531-2108": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.76.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "73d9dd1c979f",

	                        "old-k8s-version-20220531192531-2108"

	                    ],

	                    "NetworkID": "ee4a2a412a92078b653cbcaf1d57d8604149789ff8c7d75dfb2ed03e6ea10fc2",

	                    "EndpointID": "4270c98919ae2493bf9ef2d067f5322982869ac9e0583f0317a4898c720e0680",

	                    "Gateway": "192.168.76.1",

	                    "IPAddress": "192.168.76.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:4c:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.Host}} -p old-k8s-version-20220531192531-2108 -n old-k8s-version-20220531192531-2108

=== CONT  TestStartStop/group/old-k8s-version/serial/Pause

helpers_test.go:239: (dbg) Done: out/minikube-windows-amd64.exe status --format={{.Host}} -p old-k8s-version-20220531192531-2108 -n old-k8s-version-20220531192531-2108: (8.3818537s)

helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/Pause FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/Pause]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-windows-amd64.exe -p old-k8s-version-20220531192531-2108 logs -n 25

E0531 19:44:12.281863    2108 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\no-preload-20220531192611-2108\client.crt: The system cannot find the path specified.

E0531 19:44:13.058811    2108 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\addons-20220531171726-2108\client.crt: The system cannot find the path specified.

helpers_test.go:247: (dbg) Done: out/minikube-windows-amd64.exe -p old-k8s-version-20220531192531-2108 logs -n 25: (10.5571464s)

helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/Pause logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|------------------------------------------------------------|------------------------------------------------|-------------------|----------------|---------------------|---------------------|

	| Command |                            Args                            |                    Profile                     |       User        |    Version     |     Start Time      |      End Time       |

	|---------|------------------------------------------------------------|------------------------------------------------|-------------------|----------------|---------------------|---------------------|

	| addons  | enable dashboard -p                                        | old-k8s-version-20220531192531-2108            | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:35 GMT | 31 May 22 19:35 GMT |

	|         | old-k8s-version-20220531192531-2108                        |                                                |                   |                |                     |                     |

	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |                                                |                   |                |                     |                     |

	| start   | -p                                                         | no-preload-20220531192611-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:29 GMT | 31 May 22 19:36 GMT |

	|         | no-preload-20220531192611-2108                             |                                                |                   |                |                     |                     |

	|         | --memory=2200                                              |                                                |                   |                |                     |                     |

	|         | --alsologtostderr                                          |                                                |                   |                |                     |                     |

	|         | --wait=true --preload=false                                |                                                |                   |                |                     |                     |

	|         | --driver=docker                                            |                                                |                   |                |                     |                     |

	|         | --kubernetes-version=v1.23.6                               |                                                |                   |                |                     |                     |

	| start   | -p                                                         | default-k8s-different-port-20220531193451-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:34 GMT | 31 May 22 19:37 GMT |

	|         | default-k8s-different-port-20220531193451-2108             |                                                |                   |                |                     |                     |

	|         | --memory=2200 --alsologtostderr --wait=true                |                                                |                   |                |                     |                     |

	|         | --apiserver-port=8444 --driver=docker                      |                                                |                   |                |                     |                     |

	|         | --kubernetes-version=v1.23.6                               |                                                |                   |                |                     |                     |

	| addons  | enable metrics-server -p                                   | default-k8s-different-port-20220531193451-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:37 GMT | 31 May 22 19:37 GMT |

	|         | default-k8s-different-port-20220531193451-2108             |                                                |                   |                |                     |                     |

	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |                                                |                   |                |                     |                     |

	|         | --registries=MetricsServer=fake.domain                     |                                                |                   |                |                     |                     |

	| ssh     | -p                                                         | no-preload-20220531192611-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:37 GMT | 31 May 22 19:37 GMT |

	|         | no-preload-20220531192611-2108                             |                                                |                   |                |                     |                     |

	|         | sudo crictl images -o json                                 |                                                |                   |                |                     |                     |

	| pause   | -p                                                         | no-preload-20220531192611-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:37 GMT | 31 May 22 19:37 GMT |

	|         | no-preload-20220531192611-2108                             |                                                |                   |                |                     |                     |

	|         | --alsologtostderr -v=1                                     |                                                |                   |                |                     |                     |

	| stop    | -p                                                         | default-k8s-different-port-20220531193451-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:37 GMT | 31 May 22 19:37 GMT |

	|         | default-k8s-different-port-20220531193451-2108             |                                                |                   |                |                     |                     |

	|         | --alsologtostderr -v=3                                     |                                                |                   |                |                     |                     |

	| addons  | enable dashboard -p                                        | default-k8s-different-port-20220531193451-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:37 GMT | 31 May 22 19:37 GMT |

	|         | default-k8s-different-port-20220531193451-2108             |                                                |                   |                |                     |                     |

	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |                                                |                   |                |                     |                     |

	| unpause | -p                                                         | no-preload-20220531192611-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:37 GMT | 31 May 22 19:37 GMT |

	|         | no-preload-20220531192611-2108                             |                                                |                   |                |                     |                     |

	|         | --alsologtostderr -v=1                                     |                                                |                   |                |                     |                     |

	| delete  | -p                                                         | no-preload-20220531192611-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:38 GMT | 31 May 22 19:38 GMT |

	|         | no-preload-20220531192611-2108                             |                                                |                   |                |                     |                     |

	| delete  | -p                                                         | no-preload-20220531192611-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:38 GMT | 31 May 22 19:38 GMT |

	|         | no-preload-20220531192611-2108                             |                                                |                   |                |                     |                     |

	| start   | -p newest-cni-20220531193849-2108 --memory=2200            | newest-cni-20220531193849-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:38 GMT | 31 May 22 19:41 GMT |

	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |                                                |                   |                |                     |                     |

	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |                                                |                   |                |                     |                     |

	|         | --extra-config=kubelet.network-plugin=cni                  |                                                |                   |                |                     |                     |

	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |                                                |                   |                |                     |                     |

	|         | --driver=docker --kubernetes-version=v1.23.6               |                                                |                   |                |                     |                     |

	| addons  | enable metrics-server -p                                   | newest-cni-20220531193849-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:41 GMT | 31 May 22 19:41 GMT |

	|         | newest-cni-20220531193849-2108                             |                                                |                   |                |                     |                     |

	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |                                                |                   |                |                     |                     |

	|         | --registries=MetricsServer=fake.domain                     |                                                |                   |                |                     |                     |

	| stop    | -p                                                         | newest-cni-20220531193849-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:41 GMT | 31 May 22 19:41 GMT |

	|         | newest-cni-20220531193849-2108                             |                                                |                   |                |                     |                     |

	|         | --alsologtostderr -v=3                                     |                                                |                   |                |                     |                     |

	| addons  | enable dashboard -p                                        | newest-cni-20220531193849-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:41 GMT | 31 May 22 19:41 GMT |

	|         | newest-cni-20220531193849-2108                             |                                                |                   |                |                     |                     |

	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |                                                |                   |                |                     |                     |

	| start   | -p                                                         | embed-certs-20220531193346-2108                | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:33 GMT | 31 May 22 19:42 GMT |

	|         | embed-certs-20220531193346-2108                            |                                                |                   |                |                     |                     |

	|         | --memory=2200 --alsologtostderr                            |                                                |                   |                |                     |                     |

	|         | --wait=true --embed-certs                                  |                                                |                   |                |                     |                     |

	|         | --driver=docker                                            |                                                |                   |                |                     |                     |

	|         | --kubernetes-version=v1.23.6                               |                                                |                   |                |                     |                     |

	| addons  | enable metrics-server -p                                   | embed-certs-20220531193346-2108                | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:42 GMT | 31 May 22 19:42 GMT |

	|         | embed-certs-20220531193346-2108                            |                                                |                   |                |                     |                     |

	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |                                                |                   |                |                     |                     |

	|         | --registries=MetricsServer=fake.domain                     |                                                |                   |                |                     |                     |

	| stop    | -p                                                         | embed-certs-20220531193346-2108                | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:42 GMT | 31 May 22 19:42 GMT |

	|         | embed-certs-20220531193346-2108                            |                                                |                   |                |                     |                     |

	|         | --alsologtostderr -v=3                                     |                                                |                   |                |                     |                     |

	| addons  | enable dashboard -p                                        | embed-certs-20220531193346-2108                | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:42 GMT | 31 May 22 19:42 GMT |

	|         | embed-certs-20220531193346-2108                            |                                                |                   |                |                     |                     |

	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |                                                |                   |                |                     |                     |

	| start   | -p newest-cni-20220531193849-2108 --memory=2200            | newest-cni-20220531193849-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:41 GMT | 31 May 22 19:43 GMT |

	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |                                                |                   |                |                     |                     |

	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |                                                |                   |                |                     |                     |

	|         | --extra-config=kubelet.network-plugin=cni                  |                                                |                   |                |                     |                     |

	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |                                                |                   |                |                     |                     |

	|         | --driver=docker --kubernetes-version=v1.23.6               |                                                |                   |                |                     |                     |

	| ssh     | -p                                                         | newest-cni-20220531193849-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:43 GMT | 31 May 22 19:43 GMT |

	|         | newest-cni-20220531193849-2108                             |                                                |                   |                |                     |                     |

	|         | sudo crictl images -o json                                 |                                                |                   |                |                     |                     |

	| start   | -p                                                         | old-k8s-version-20220531192531-2108            | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:35 GMT | 31 May 22 19:43 GMT |

	|         | old-k8s-version-20220531192531-2108                        |                                                |                   |                |                     |                     |

	|         | --memory=2200 --alsologtostderr                            |                                                |                   |                |                     |                     |

	|         | --wait=true --kvm-network=default                          |                                                |                   |                |                     |                     |

	|         | --kvm-qemu-uri=qemu:///system                              |                                                |                   |                |                     |                     |

	|         | --disable-driver-mounts                                    |                                                |                   |                |                     |                     |

	|         | --keep-context=false                                       |                                                |                   |                |                     |                     |

	|         | --driver=docker                                            |                                                |                   |                |                     |                     |

	|         | --kubernetes-version=v1.16.0                               |                                                |                   |                |                     |                     |

	| pause   | -p                                                         | newest-cni-20220531193849-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:43 GMT | 31 May 22 19:43 GMT |

	|         | newest-cni-20220531193849-2108                             |                                                |                   |                |                     |                     |

	|         | --alsologtostderr -v=1                                     |                                                |                   |                |                     |                     |

	| ssh     | -p                                                         | old-k8s-version-20220531192531-2108            | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:43 GMT | 31 May 22 19:43 GMT |

	|         | old-k8s-version-20220531192531-2108                        |                                                |                   |                |                     |                     |

	|         | sudo crictl images -o json                                 |                                                |                   |                |                     |                     |

	| unpause | -p                                                         | newest-cni-20220531193849-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:43 GMT | 31 May 22 19:43 GMT |

	|         | newest-cni-20220531193849-2108                             |                                                |                   |                |                     |                     |

	|         | --alsologtostderr -v=1                                     |                                                |                   |                |                     |                     |

	|---------|------------------------------------------------------------|------------------------------------------------|-------------------|----------------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2022/05/31 19:42:50

	Running on machine: minikube7

	Binary: Built with gc go1.18.2 for windows/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0531 19:42:50.127342    8616 out.go:296] Setting OutFile to fd 2016 ...

	I0531 19:42:50.216255    8616 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0531 19:42:50.216255    8616 out.go:309] Setting ErrFile to fd 712...

	I0531 19:42:50.216255    8616 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0531 19:42:50.238305    8616 out.go:303] Setting JSON to false

	I0531 19:42:50.243280    8616 start.go:115] hostinfo: {"hostname":"minikube7","uptime":84440,"bootTime":1653941730,"procs":156,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19044 Build 19044","kernelVersion":"10.0.19044 Build 19044","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f66ed2ea-6c04-4a6b-8eea-b2fb0953e990"}

	W0531 19:42:50.243280    8616 start.go:123] gopshost.Virtualization returned error: not implemented yet

	I0531 19:42:50.247300    8616 out.go:177] * [embed-certs-20220531193346-2108] minikube v1.26.0-beta.1 on Microsoft Windows 10 Enterprise N 10.0.19044 Build 19044

	I0531 19:42:50.251277    8616 notify.go:193] Checking for updates...

	I0531 19:42:50.254277    8616 out.go:177]   - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I0531 19:42:50.257263    8616 out.go:177]   - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	I0531 19:42:50.259281    8616 out.go:177]   - MINIKUBE_LOCATION=14079

	I0531 19:42:50.262281    8616 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0531 19:42:46.136944    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:46.155664    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:42:46.155664    7556 api_server.go:102] status: https://127.0.0.1:54458/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:42:46.638060    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:46.725795    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:42:46.725795    7556 api_server.go:102] status: https://127.0.0.1:54458/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:42:47.143046    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:47.242770    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:42:47.242770    7556 api_server.go:102] status: https://127.0.0.1:54458/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:42:47.638251    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:47.830869    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:42:47.831617    7556 api_server.go:102] status: https://127.0.0.1:54458/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:42:48.140734    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:48.245672    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:42:48.245672    7556 api_server.go:102] status: https://127.0.0.1:54458/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:42:48.641307    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:48.733322    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:42:48.733322    7556 api_server.go:102] status: https://127.0.0.1:54458/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:42:49.147453    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:49.240676    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:42:49.240676    7556 api_server.go:102] status: https://127.0.0.1:54458/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:42:49.648266    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:49.743281    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:42:49.743281    7556 api_server.go:102] status: https://127.0.0.1:54458/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:42:50.146279    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:50.240267    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 200:

	ok

	I0531 19:42:50.325883    7556 api_server.go:140] control plane version: v1.23.6

	I0531 19:42:50.325883    7556 api_server.go:130] duration metric: took 12.194093s to wait for apiserver health ...

	I0531 19:42:50.325883    7556 cni.go:95] Creating CNI manager for ""

	I0531 19:42:50.325883    7556 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0531 19:42:50.325883    7556 system_pods.go:43] waiting for kube-system pods to appear ...

	I0531 19:42:50.433899    7556 system_pods.go:59] 8 kube-system pods found

	I0531 19:42:50.433899    7556 system_pods.go:61] "coredns-64897985d-qpzx5" [801bd65d-655d-451b-a3ff-79295aaeaf09] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I0531 19:42:50.433899    7556 system_pods.go:61] "etcd-newest-cni-20220531193849-2108" [663ce3bf-8420-4d38-a012-54abf228ce78] Running

	I0531 19:42:50.433899    7556 system_pods.go:61] "kube-apiserver-newest-cni-20220531193849-2108" [e713d4e4-3356-41ac-b8af-52bf19d65052] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I0531 19:42:50.433899    7556 system_pods.go:61] "kube-controller-manager-newest-cni-20220531193849-2108" [fd22af45-85a2-484a-a239-0e45831e8df8] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0531 19:42:50.433899    7556 system_pods.go:61] "kube-proxy-mh9ct" [85823877-90a8-4ad0-b0ad-b4ed75f4845e] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])

	I0531 19:42:50.433899    7556 system_pods.go:61] "kube-scheduler-newest-cni-20220531193849-2108" [34deeb35-60bc-42b6-a91d-cedda9a76363] Running

	I0531 19:42:50.433899    7556 system_pods.go:61] "metrics-server-b955d9d8-rt44k" [d0c2b733-0fd1-4e34-88aa-d73b77704a89] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:42:50.433899    7556 system_pods.go:61] "storage-provisioner" [a104bd0d-cf9b-4dd3-b127-d3e84c4ae96b] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0531 19:42:50.433899    7556 system_pods.go:74] duration metric: took 108.0157ms to wait for pod list to return data ...

	I0531 19:42:50.433899    7556 node_conditions.go:102] verifying NodePressure condition ...

	I0531 19:42:50.538880    7556 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki

	I0531 19:42:50.538880    7556 node_conditions.go:123] node cpu capacity is 16

	I0531 19:42:50.538880    7556 node_conditions.go:105] duration metric: took 104.9809ms to run NodePressure ...

	I0531 19:42:50.538880    7556 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I0531 19:42:49.037358    1340 system_pods.go:86] 4 kube-system pods found

	I0531 19:42:49.037358    1340 system_pods.go:89] "coredns-5644d7b6d9-jxp72" [f831437f-5aa7-42cd-bb72-b1a20942f56a] Running

	I0531 19:42:49.037358    1340 system_pods.go:89] "kube-proxy-r556l" [86e67749-a177-45b6-8857-e4f6c55b8dd8] Running

	I0531 19:42:49.037358    1340 system_pods.go:89] "metrics-server-6f89b5864b-v8mjx" [c248957e-7215-4044-9e73-acc8998b61f1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:42:49.037358    1340 system_pods.go:89] "storage-provisioner" [8001c475-f873-4298-ad3e-ac9b8d56927b] Running

	I0531 19:42:49.037358    1340 retry.go:31] will retry after 6.402197611s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler

	I0531 19:42:52.545436    7556 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml": (2.0065467s)

	I0531 19:42:52.545436    7556 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0531 19:42:52.637427    7556 ops.go:34] apiserver oom_adj: -16

	I0531 19:42:52.637427    7556 kubeadm.go:630] restartCluster took 27.8311331s

	I0531 19:42:52.637427    7556 kubeadm.go:397] StartCluster complete in 27.9633793s

	I0531 19:42:52.637427    7556 settings.go:142] acquiring lock: {Name:mk2f48f1c2db86c45c5c20d13312e07e9c171d09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:42:52.638421    7556 settings.go:150] Updating kubeconfig:  C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I0531 19:42:52.642395    7556 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\kubeconfig: {Name:mk3b9816be6135fef42a073128e9ed356868417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:42:52.750403    7556 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "newest-cni-20220531193849-2108" rescaled to 1

	I0531 19:42:52.750403    7556 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.23.6 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0531 19:42:52.750403    7556 addons.go:415] enableAddons start: toEnable=map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true], additional=[]

	I0531 19:42:52.756465    7556 out.go:177] * Verifying Kubernetes components...

	I0531 19:42:52.750403    7556 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.6/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0531 19:42:52.750403    7556 addons.go:65] Setting storage-provisioner=true in profile "newest-cni-20220531193849-2108"

	I0531 19:42:52.750403    7556 addons.go:65] Setting metrics-server=true in profile "newest-cni-20220531193849-2108"

	I0531 19:42:52.750403    7556 addons.go:65] Setting default-storageclass=true in profile "newest-cni-20220531193849-2108"

	I0531 19:42:52.750403    7556 addons.go:65] Setting dashboard=true in profile "newest-cni-20220531193849-2108"

	I0531 19:42:52.751430    7556 config.go:178] Loaded profile config "newest-cni-20220531193849-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.6

	I0531 19:42:51.472496    9560 pod_ready.go:102] pod "metrics-server-b955d9d8-9rlw5" in "kube-system" namespace has status "Ready":"False"

	I0531 19:42:53.953088    9560 pod_ready.go:81] duration metric: took 4m0.1785878s waiting for pod "metrics-server-b955d9d8-9rlw5" in "kube-system" namespace to be "Ready" ...

	E0531 19:42:53.953088    9560 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-b955d9d8-9rlw5" in "kube-system" namespace to be "Ready" (will not retry!)

	I0531 19:42:53.953088    9560 pod_ready.go:38] duration metric: took 4m5.5039717s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0531 19:42:53.953088    9560 kubeadm.go:630] restartCluster took 4m28.9618863s

	W0531 19:42:53.953731    9560 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"

	I0531 19:42:53.953731    9560 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"

	I0531 19:42:52.756465    7556 addons.go:153] Setting addon storage-provisioner=true in "newest-cni-20220531193849-2108"

	W0531 19:42:52.759410    7556 addons.go:165] addon storage-provisioner should already be in state true

	I0531 19:42:52.756465    7556 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "newest-cni-20220531193849-2108"

	I0531 19:42:52.760420    7556 host.go:66] Checking if "newest-cni-20220531193849-2108" exists ...

	I0531 19:42:52.756465    7556 addons.go:153] Setting addon metrics-server=true in "newest-cni-20220531193849-2108"

	W0531 19:42:52.760420    7556 addons.go:165] addon metrics-server should already be in state true

	I0531 19:42:52.756465    7556 addons.go:153] Setting addon dashboard=true in "newest-cni-20220531193849-2108"

	W0531 19:42:52.760420    7556 addons.go:165] addon dashboard should already be in state true

	I0531 19:42:52.760420    7556 host.go:66] Checking if "newest-cni-20220531193849-2108" exists ...

	I0531 19:42:52.760420    7556 host.go:66] Checking if "newest-cni-20220531193849-2108" exists ...

	I0531 19:42:52.787289    7556 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0531 19:42:52.798232    7556 cli_runner.go:164] Run: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}

	I0531 19:42:52.802209    7556 cli_runner.go:164] Run: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}

	I0531 19:42:52.803210    7556 cli_runner.go:164] Run: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}

	I0531 19:42:52.807213    7556 cli_runner.go:164] Run: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}

	I0531 19:42:53.346951    7556 start.go:786] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I0531 19:42:53.362835    7556 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108

	I0531 19:42:54.408200    7556 cli_runner.go:217] Completed: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}: (1.6099613s)

	I0531 19:42:54.435301    7556 cli_runner.go:217] Completed: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}: (1.6330855s)

	I0531 19:42:54.439314    7556 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0531 19:42:54.442291    7556 addons.go:348] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0531 19:42:54.442291    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0531 19:42:54.446291    7556 cli_runner.go:217] Completed: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}: (1.6430744s)

	I0531 19:42:54.451275    7556 out.go:177]   - Using image kubernetesui/dashboard:v2.5.1

	I0531 19:42:54.454298    7556 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4

	I0531 19:42:54.456303    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-ns.yaml

	I0531 19:42:54.456303    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)

	I0531 19:42:54.456303    7556 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108

	I0531 19:42:54.461309    7556 cli_runner.go:217] Completed: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}: (1.6540886s)

	I0531 19:42:54.464270    7556 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4

	I0531 19:42:50.265252    8616 config.go:178] Loaded profile config "embed-certs-20220531193346-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.6

	I0531 19:42:50.267300    8616 driver.go:358] Setting default libvirt URI to qemu:///system

	I0531 19:42:54.110723    8616 docker.go:137] docker version: linux-20.10.14

	I0531 19:42:54.118695    8616 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0531 19:42:54.465305    7556 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108

	I0531 19:42:54.466270    7556 addons.go:348] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0531 19:42:54.466270    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0531 19:42:54.477291    7556 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108

	I0531 19:42:54.530792    7556 addons.go:153] Setting addon default-storageclass=true in "newest-cni-20220531193849-2108"

	W0531 19:42:54.530929    7556 addons.go:165] addon default-storageclass should already be in state true

	I0531 19:42:54.530929    7556 host.go:66] Checking if "newest-cni-20220531193849-2108" exists ...

	I0531 19:42:54.565279    7556 cli_runner.go:164] Run: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}

	I0531 19:42:55.004826    7556 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108: (1.6419837s)

	I0531 19:42:55.004826    7556 api_server.go:51] waiting for apiserver process to appear ...

	I0531 19:42:55.017835    7556 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:42:55.060968    7556 api_server.go:71] duration metric: took 2.3105545s to wait for apiserver process to appear ...

	I0531 19:42:55.060968    7556 api_server.go:87] waiting for apiserver healthz status ...

	I0531 19:42:55.060968    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:55.159964    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 200:

	ok

	I0531 19:42:55.165977    7556 api_server.go:140] control plane version: v1.23.6

	I0531 19:42:55.165977    7556 api_server.go:130] duration metric: took 105.0091ms to wait for apiserver health ...

	I0531 19:42:55.165977    7556 system_pods.go:43] waiting for kube-system pods to appear ...

	I0531 19:42:55.244153    7556 system_pods.go:59] 8 kube-system pods found

	I0531 19:42:55.244153    7556 system_pods.go:61] "coredns-64897985d-qpzx5" [801bd65d-655d-451b-a3ff-79295aaeaf09] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I0531 19:42:55.244153    7556 system_pods.go:61] "etcd-newest-cni-20220531193849-2108" [663ce3bf-8420-4d38-a012-54abf228ce78] Running

	I0531 19:42:55.244153    7556 system_pods.go:61] "kube-apiserver-newest-cni-20220531193849-2108" [e713d4e4-3356-41ac-b8af-52bf19d65052] Running

	I0531 19:42:55.244153    7556 system_pods.go:61] "kube-controller-manager-newest-cni-20220531193849-2108" [fd22af45-85a2-484a-a239-0e45831e8df8] Running

	I0531 19:42:55.244153    7556 system_pods.go:61] "kube-proxy-mh9ct" [85823877-90a8-4ad0-b0ad-b4ed75f4845e] Running

	I0531 19:42:55.244153    7556 system_pods.go:61] "kube-scheduler-newest-cni-20220531193849-2108" [34deeb35-60bc-42b6-a91d-cedda9a76363] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I0531 19:42:55.244153    7556 system_pods.go:61] "metrics-server-b955d9d8-rt44k" [d0c2b733-0fd1-4e34-88aa-d73b77704a89] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:42:55.244153    7556 system_pods.go:61] "storage-provisioner" [a104bd0d-cf9b-4dd3-b127-d3e84c4ae96b] Running

	I0531 19:42:55.244153    7556 system_pods.go:74] duration metric: took 78.1757ms to wait for pod list to return data ...

	I0531 19:42:55.244153    7556 default_sa.go:34] waiting for default service account to be created ...

	I0531 19:42:55.253122    7556 default_sa.go:45] found service account: "default"

	I0531 19:42:55.253122    7556 default_sa.go:55] duration metric: took 7.9853ms for default service account to be created ...

	I0531 19:42:55.254122    7556 kubeadm.go:572] duration metric: took 2.5037081s to wait for : map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] ...

	I0531 19:42:55.254122    7556 node_conditions.go:102] verifying NodePressure condition ...

	I0531 19:42:55.265141    7556 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki

	I0531 19:42:55.265141    7556 node_conditions.go:123] node cpu capacity is 16

	I0531 19:42:55.265141    7556 node_conditions.go:105] duration metric: took 11.0188ms to run NodePressure ...

	I0531 19:42:55.265141    7556 start.go:213] waiting for startup goroutines ...

	I0531 19:42:56.082328    7556 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108: (1.6160519s)

	I0531 19:42:56.082328    7556 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54454 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\newest-cni-20220531193849-2108\id_rsa Username:docker}

	I0531 19:42:56.098315    7556 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108: (1.6210174s)

	I0531 19:42:56.098315    7556 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54454 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\newest-cni-20220531193849-2108\id_rsa Username:docker}

	I0531 19:42:56.129090    7556 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108: (1.6726375s)

	I0531 19:42:57.078202    8616 cli_runner.go:217] Completed: docker system info --format "{{json .}}": (2.9594937s)

	I0531 19:42:57.079004    8616 info.go:265] docker info: {ID:JKWR:L4LW:XYJC:G6AI:GZFU:RUGW:CCH6:OD2M:V572:4FTB:B7YC:DTUC Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:92 OomKillDisable:true NGoroutines:63 SystemTime:2022-05-31 19:42:55.6928806 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_

64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,

profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc.

Version:v0.17.0]] Warnings:<nil>}}

	I0531 19:42:57.083679    8616 out.go:177] * Using the docker driver based on existing profile

	I0531 19:42:55.542888    1340 system_pods.go:86] 5 kube-system pods found

	I0531 19:42:55.542888    1340 system_pods.go:89] "coredns-5644d7b6d9-jxp72" [f831437f-5aa7-42cd-bb72-b1a20942f56a] Running

	I0531 19:42:55.542888    1340 system_pods.go:89] "etcd-old-k8s-version-20220531192531-2108" [d26cf30c-3701-4ea4-8a08-6aa0010138c2] Pending

	I0531 19:42:55.542888    1340 system_pods.go:89] "kube-proxy-r556l" [86e67749-a177-45b6-8857-e4f6c55b8dd8] Running

	I0531 19:42:55.542888    1340 system_pods.go:89] "metrics-server-6f89b5864b-v8mjx" [c248957e-7215-4044-9e73-acc8998b61f1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:42:55.542888    1340 system_pods.go:89] "storage-provisioner" [8001c475-f873-4298-ad3e-ac9b8d56927b] Running

	I0531 19:42:55.543887    1340 retry.go:31] will retry after 6.062999549s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler

	I0531 19:42:57.086388    8616 start.go:284] selected driver: docker

	I0531 19:42:57.086388    8616 start.go:806] validating driver "docker" against &{Name:embed-certs-20220531193346-2108 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.6 ClusterName:embed-certs-20220531193346-2108 Namespace:d

efault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.23.6 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.5.1@sha256:cc746e7a0b1eec0db01cbabbb6386b23d7af97e79fa9e36bb883a95b7eb96fe2 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s Schedule

dStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}

	I0531 19:42:57.086388    8616 start.go:817] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0531 19:42:57.174246    8616 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0531 19:42:59.712379    8616 cli_runner.go:217] Completed: docker system info --format "{{json .}}": (2.5379525s)

	I0531 19:42:59.712780    8616 info.go:265] docker info: {ID:JKWR:L4LW:XYJC:G6AI:GZFU:RUGW:CCH6:OD2M:V572:4FTB:B7YC:DTUC Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:92 OomKillDisable:true NGoroutines:63 SystemTime:2022-05-31 19:42:58.4856581 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_

64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,

profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc.

Version:v0.17.0]] Warnings:<nil>}}

	I0531 19:42:59.713307    8616 start_flags.go:847] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0531 19:42:59.713408    8616 cni.go:95] Creating CNI manager for ""

	I0531 19:42:59.713408    8616 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0531 19:42:59.713435    8616 start_flags.go:306] config:

	{Name:embed-certs-20220531193346-2108 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.6 ClusterName:embed-certs-20220531193346-2108 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus

ter.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.23.6 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.5.1@sha256:cc746e7a0b1eec0db01cbabbb6386b23d7af97e79fa9e36bb883a95b7eb96fe2 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:f

alse ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}

	I0531 19:42:59.719162    8616 out.go:177] * Starting control plane node embed-certs-20220531193346-2108 in cluster embed-certs-20220531193346-2108

	I0531 19:42:59.722725    8616 cache.go:120] Beginning downloading kic base image for docker with docker

	I0531 19:42:59.725806    8616 out.go:177] * Pulling base image ...

	I0531 19:42:59.729482    8616 preload.go:132] Checking if preload exists for k8s version v1.23.6 and runtime docker

	I0531 19:42:59.729687    8616 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 in local docker daemon

	I0531 19:42:59.729848    8616 preload.go:148] Found local preload: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.23.6-docker-overlay2-amd64.tar.lz4

	I0531 19:42:59.729948    8616 cache.go:57] Caching tarball of preloaded images

	I0531 19:42:59.730619    8616 preload.go:174] Found C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.23.6-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0531 19:42:59.731046    8616 cache.go:60] Finished verifying existence of preloaded tar for  v1.23.6 on docker

	I0531 19:42:59.731505    8616 profile.go:148] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\config.json ...

	I0531 19:42:56.129266    7556 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54454 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\newest-cni-20220531193849-2108\id_rsa Username:docker}

	I0531 19:42:56.152573    7556 cli_runner.go:217] Completed: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}: (1.5871038s)

	I0531 19:42:56.152573    7556 addons.go:348] installing /etc/kubernetes/addons/storageclass.yaml

	I0531 19:42:56.152573    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0531 19:42:56.160019    7556 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108

	I0531 19:42:56.540386    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml

	I0531 19:42:56.540938    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)

	I0531 19:42:56.555337    7556 addons.go:348] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0531 19:42:56.555337    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1849 bytes)

	I0531 19:42:56.568986    7556 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0531 19:42:56.824720    7556 addons.go:348] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0531 19:42:56.824720    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0531 19:42:56.831199    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml

	I0531 19:42:56.831199    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)

	I0531 19:42:57.036004    7556 addons.go:348] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0531 19:42:57.036038    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0531 19:42:57.052974    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-configmap.yaml

	I0531 19:42:57.053103    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)

	I0531 19:42:57.174246    7556 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0531 19:42:57.230987    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-dp.yaml

	I0531 19:42:57.231080    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)

	I0531 19:42:57.340153    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-role.yaml

	I0531 19:42:57.340153    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)

	I0531 19:42:57.529392    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml

	I0531 19:42:57.529392    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)

	I0531 19:42:57.597366    7556 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108: (1.4373411s)

	I0531 19:42:57.597597    7556 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54454 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\newest-cni-20220531193849-2108\id_rsa Username:docker}

	I0531 19:42:57.642507    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-sa.yaml

	I0531 19:42:57.642507    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)

	I0531 19:42:57.745306    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-secret.yaml

	I0531 19:42:57.745306    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)

	I0531 19:42:57.841187    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-svc.yaml

	I0531 19:42:57.841187    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)

	I0531 19:42:57.950588    7556 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0531 19:42:58.061914    7556 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	I0531 19:43:01.060754    8616 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 in local docker daemon, skipping pull

	I0531 19:43:01.060754    8616 cache.go:141] gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 exists in daemon, skipping load

	I0531 19:43:01.060932    8616 cache.go:206] Successfully downloaded all kic artifacts

	I0531 19:43:01.061977    8616 start.go:352] acquiring machines lock for embed-certs-20220531193346-2108: {Name:mk63e14faf496672dd0ff3bf59fb3b27b51120db Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0531 19:43:01.061977    8616 start.go:356] acquired machines lock for "embed-certs-20220531193346-2108" in 0s

	I0531 19:43:01.061977    8616 start.go:94] Skipping create...Using existing machine configuration

	I0531 19:43:01.061977    8616 fix.go:55] fixHost starting: 

	I0531 19:43:01.077901    8616 cli_runner.go:164] Run: docker container inspect embed-certs-20220531193346-2108 --format={{.State.Status}}

	I0531 19:43:02.412373    8616 cli_runner.go:217] Completed: docker container inspect embed-certs-20220531193346-2108 --format={{.State.Status}}: (1.3344665s)

	I0531 19:43:02.412373    8616 fix.go:103] recreateIfNeeded on embed-certs-20220531193346-2108: state=Stopped err=<nil>

	W0531 19:43:02.412373    8616 fix.go:129] unexpected machine state, will restart: <nil>

	I0531 19:43:02.432375    8616 out.go:177] * Restarting existing docker container for "embed-certs-20220531193346-2108" ...

	I0531 19:43:01.632478    1340 system_pods.go:86] 6 kube-system pods found

	I0531 19:43:01.632478    1340 system_pods.go:89] "coredns-5644d7b6d9-jxp72" [f831437f-5aa7-42cd-bb72-b1a20942f56a] Running

	I0531 19:43:01.632478    1340 system_pods.go:89] "etcd-old-k8s-version-20220531192531-2108" [d26cf30c-3701-4ea4-8a08-6aa0010138c2] Pending

	I0531 19:43:01.632478    1340 system_pods.go:89] "kube-controller-manager-old-k8s-version-20220531192531-2108" [f99468bb-525f-4752-9dab-f40607db0d10] Pending

	I0531 19:43:01.632478    1340 system_pods.go:89] "kube-proxy-r556l" [86e67749-a177-45b6-8857-e4f6c55b8dd8] Running

	I0531 19:43:01.632478    1340 system_pods.go:89] "metrics-server-6f89b5864b-v8mjx" [c248957e-7215-4044-9e73-acc8998b61f1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:43:01.632478    1340 system_pods.go:89] "storage-provisioner" [8001c475-f873-4298-ad3e-ac9b8d56927b] Running

	I0531 19:43:01.632478    1340 retry.go:31] will retry after 10.504197539s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler

	I0531 19:43:01.236824    7556 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (4.6678186s)

	I0531 19:43:01.635485    7556 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (4.4612198s)

	I0531 19:43:01.635485    7556 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (3.6848808s)

	I0531 19:43:01.635485    7556 addons.go:386] Verifying addon metrics-server=true in "newest-cni-20220531193849-2108"

	I0531 19:43:02.727980    7556 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (4.6660457s)

	I0531 19:43:02.732954    7556 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard

	I0531 19:43:02.735959    7556 addons.go:417] enableAddons completed in 9.9855123s

	I0531 19:43:02.974430    7556 start.go:504] kubectl: 1.18.2, cluster: 1.23.6 (minor skew: 5)

	I0531 19:43:02.977020    7556 out.go:177] 

	W0531 19:43:02.978721    7556 out.go:239] ! C:\ProgramData\chocolatey\bin\kubectl.exe is version 1.18.2, which may have incompatibilites with Kubernetes 1.23.6.

	I0531 19:43:02.982712    7556 out.go:177]   - Want kubectl v1.23.6? Try 'minikube kubectl -- get pods -A'

	I0531 19:43:02.986727    7556 out.go:177] * Done! kubectl is now configured to use "newest-cni-20220531193849-2108" cluster and "default" namespace by default

	I0531 19:43:02.454413    8616 cli_runner.go:164] Run: docker start embed-certs-20220531193346-2108

	I0531 19:43:04.888118    8616 cli_runner.go:217] Completed: docker start embed-certs-20220531193346-2108: (2.4336945s)

	I0531 19:43:04.899149    8616 cli_runner.go:164] Run: docker container inspect embed-certs-20220531193346-2108 --format={{.State.Status}}

	I0531 19:43:06.460445    8616 cli_runner.go:217] Completed: docker container inspect embed-certs-20220531193346-2108 --format={{.State.Status}}: (1.5602977s)

	I0531 19:43:06.460445    8616 kic.go:416] container "embed-certs-20220531193346-2108" state is running.

	I0531 19:43:06.474428    8616 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220531193346-2108

	I0531 19:43:07.957441    8616 cli_runner.go:217] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220531193346-2108: (1.4830066s)

	I0531 19:43:07.957441    8616 profile.go:148] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\config.json ...

	I0531 19:43:07.960439    8616 machine.go:88] provisioning docker machine ...

	I0531 19:43:07.960439    8616 ubuntu.go:169] provisioning hostname "embed-certs-20220531193346-2108"

	I0531 19:43:07.970438    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:09.409622    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.4380322s)

	I0531 19:43:09.412613    8616 main.go:134] libmachine: Using SSH client type: native

	I0531 19:43:09.413634    8616 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x1322ea0] 0x1325d00 <nil>  [] 0s} 127.0.0.1 54560 <nil> <nil>}

	I0531 19:43:09.413634    8616 main.go:134] libmachine: About to run SSH command:

	sudo hostname embed-certs-20220531193346-2108 && echo "embed-certs-20220531193346-2108" | sudo tee /etc/hostname

	I0531 19:43:09.664937    8616 main.go:134] libmachine: SSH cmd err, output: <nil>: embed-certs-20220531193346-2108

	I0531 19:43:09.674907    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:12.159805    1340 system_pods.go:86] 7 kube-system pods found

	I0531 19:43:12.159805    1340 system_pods.go:89] "coredns-5644d7b6d9-jxp72" [f831437f-5aa7-42cd-bb72-b1a20942f56a] Running

	I0531 19:43:12.159805    1340 system_pods.go:89] "etcd-old-k8s-version-20220531192531-2108" [d26cf30c-3701-4ea4-8a08-6aa0010138c2] Running

	I0531 19:43:12.159805    1340 system_pods.go:89] "kube-controller-manager-old-k8s-version-20220531192531-2108" [f99468bb-525f-4752-9dab-f40607db0d10] Running

	I0531 19:43:12.159805    1340 system_pods.go:89] "kube-proxy-r556l" [86e67749-a177-45b6-8857-e4f6c55b8dd8] Running

	I0531 19:43:12.159805    1340 system_pods.go:89] "kube-scheduler-old-k8s-version-20220531192531-2108" [7bbd9c04-c349-4dae-8a28-e0127457afce] Pending

	I0531 19:43:12.159805    1340 system_pods.go:89] "metrics-server-6f89b5864b-v8mjx" [c248957e-7215-4044-9e73-acc8998b61f1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:43:12.159805    1340 system_pods.go:89] "storage-provisioner" [8001c475-f873-4298-ad3e-ac9b8d56927b] Running

	I0531 19:43:12.159805    1340 retry.go:31] will retry after 12.194240946s: missing components: kube-apiserver, kube-scheduler

	I0531 19:43:11.086438    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.4115245s)

	I0531 19:43:11.092434    8616 main.go:134] libmachine: Using SSH client type: native

	I0531 19:43:11.093440    8616 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x1322ea0] 0x1325d00 <nil>  [] 0s} 127.0.0.1 54560 <nil> <nil>}

	I0531 19:43:11.093440    8616 main.go:134] libmachine: About to run SSH command:

			if ! grep -xq '.*\sembed-certs-20220531193346-2108' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-20220531193346-2108/g' /etc/hosts;

				else 

					echo '127.0.1.1 embed-certs-20220531193346-2108' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0531 19:43:11.255429    8616 main.go:134] libmachine: SSH cmd err, output: <nil>: 

	I0531 19:43:11.255429    8616 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube7\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube7\minikube-integration\.minikube}

	I0531 19:43:11.255429    8616 ubuntu.go:177] setting up certificates

	I0531 19:43:11.255429    8616 provision.go:83] configureAuth start

	I0531 19:43:11.265440    8616 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220531193346-2108

	I0531 19:43:12.708520    8616 cli_runner.go:217] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220531193346-2108: (1.4430742s)

	I0531 19:43:12.708520    8616 provision.go:138] copyHostCerts

	I0531 19:43:12.708520    8616 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem, removing ...

	I0531 19:43:12.708520    8616 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cert.pem

	I0531 19:43:12.709415    8616 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem (1123 bytes)

	I0531 19:43:12.710359    8616 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem, removing ...

	I0531 19:43:12.710359    8616 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\key.pem

	I0531 19:43:12.711169    8616 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem (1679 bytes)

	I0531 19:43:12.712053    8616 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem, removing ...

	I0531 19:43:12.712053    8616 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.pem

	I0531 19:43:12.712716    8616 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem (1078 bytes)

	I0531 19:43:12.713400    8616 provision.go:112] generating server cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.embed-certs-20220531193346-2108 san=[192.168.67.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-20220531193346-2108]

	I0531 19:43:13.011580    8616 provision.go:172] copyRemoteCerts

	I0531 19:43:13.023550    8616 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0531 19:43:13.038556    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:14.338732    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.3001706s)

	I0531 19:43:14.338732    8616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54560 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\embed-certs-20220531193346-2108\id_rsa Username:docker}

	I0531 19:43:14.551697    8616 ssh_runner.go:235] Completed: sudo mkdir -p /etc/docker /etc/docker /etc/docker: (1.5281407s)

	I0531 19:43:14.552675    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0531 19:43:14.613469    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1265 bytes)

	I0531 19:43:14.684854    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0531 19:43:14.747113    8616 provision.go:86] duration metric: configureAuth took 3.4916684s

	I0531 19:43:14.747113    8616 ubuntu.go:193] setting minikube options for container-runtime

	I0531 19:43:14.748088    8616 config.go:178] Loaded profile config "embed-certs-20220531193346-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.6

	I0531 19:43:14.761866    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:16.087899    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.3258419s)

	I0531 19:43:16.091824    8616 main.go:134] libmachine: Using SSH client type: native

	I0531 19:43:16.092214    8616 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x1322ea0] 0x1325d00 <nil>  [] 0s} 127.0.0.1 54560 <nil> <nil>}

	I0531 19:43:16.092298    8616 main.go:134] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0531 19:43:16.307822    8616 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay

	I0531 19:43:16.307822    8616 ubuntu.go:71] root file system type: overlay

	I0531 19:43:16.308825    8616 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0531 19:43:16.317850    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:17.695543    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.3776872s)

	I0531 19:43:17.701536    8616 main.go:134] libmachine: Using SSH client type: native

	I0531 19:43:17.701536    8616 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x1322ea0] 0x1325d00 <nil>  [] 0s} 127.0.0.1 54560 <nil> <nil>}

	I0531 19:43:17.701536    8616 main.go:134] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0531 19:43:17.874809    8616 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0531 19:43:17.883833    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:19.149206    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.2653668s)

	I0531 19:43:19.152226    8616 main.go:134] libmachine: Using SSH client type: native

	I0531 19:43:19.153214    8616 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x1322ea0] 0x1325d00 <nil>  [] 0s} 127.0.0.1 54560 <nil> <nil>}

	I0531 19:43:19.153214    8616 main.go:134] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0531 19:43:19.357762    8616 main.go:134] libmachine: SSH cmd err, output: <nil>: 

	I0531 19:43:19.357762    8616 machine.go:91] provisioned docker machine in 11.397274s

	I0531 19:43:19.357762    8616 start.go:306] post-start starting for "embed-certs-20220531193346-2108" (driver="docker")

	I0531 19:43:19.357762    8616 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0531 19:43:19.368634    8616 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0531 19:43:19.375625    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:24.393133    1340 system_pods.go:86] 8 kube-system pods found

	I0531 19:43:24.393133    1340 system_pods.go:89] "coredns-5644d7b6d9-jxp72" [f831437f-5aa7-42cd-bb72-b1a20942f56a] Running

	I0531 19:43:24.393133    1340 system_pods.go:89] "etcd-old-k8s-version-20220531192531-2108" [d26cf30c-3701-4ea4-8a08-6aa0010138c2] Running

	I0531 19:43:24.393133    1340 system_pods.go:89] "kube-apiserver-old-k8s-version-20220531192531-2108" [d699c547-2f4a-4e3d-8249-2018ca3f8fb7] Running

	I0531 19:43:24.393133    1340 system_pods.go:89] "kube-controller-manager-old-k8s-version-20220531192531-2108" [f99468bb-525f-4752-9dab-f40607db0d10] Running

	I0531 19:43:24.393133    1340 system_pods.go:89] "kube-proxy-r556l" [86e67749-a177-45b6-8857-e4f6c55b8dd8] Running

	I0531 19:43:24.393133    1340 system_pods.go:89] "kube-scheduler-old-k8s-version-20220531192531-2108" [7bbd9c04-c349-4dae-8a28-e0127457afce] Running

	I0531 19:43:24.393133    1340 system_pods.go:89] "metrics-server-6f89b5864b-v8mjx" [c248957e-7215-4044-9e73-acc8998b61f1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:43:24.393133    1340 system_pods.go:89] "storage-provisioner" [8001c475-f873-4298-ad3e-ac9b8d56927b] Running

	I0531 19:43:24.393133    1340 system_pods.go:126] duration metric: took 56.8618258s to wait for k8s-apps to be running ...

	I0531 19:43:24.393133    1340 system_svc.go:44] waiting for kubelet service to be running ....

	I0531 19:43:24.403125    1340 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0531 19:43:24.445798    1340 system_svc.go:56] duration metric: took 52.6647ms WaitForService to wait for kubelet.

	I0531 19:43:24.445798    1340 kubeadm.go:572] duration metric: took 1m7.5077501s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0531 19:43:24.445798    1340 node_conditions.go:102] verifying NodePressure condition ...

	I0531 19:43:24.453799    1340 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki

	I0531 19:43:24.453799    1340 node_conditions.go:123] node cpu capacity is 16

	I0531 19:43:24.453799    1340 node_conditions.go:105] duration metric: took 8.0013ms to run NodePressure ...

	I0531 19:43:24.453799    1340 start.go:213] waiting for startup goroutines ...

	I0531 19:43:24.669491    1340 start.go:504] kubectl: 1.18.2, cluster: 1.16.0 (minor skew: 2)

	I0531 19:43:24.674088    1340 out.go:177] 

	W0531 19:43:24.677260    1340 out.go:239] ! C:\ProgramData\chocolatey\bin\kubectl.exe is version 1.18.2, which may have incompatibilites with Kubernetes 1.16.0.

	I0531 19:43:24.680532    1340 out.go:177]   - Want kubectl v1.16.0? Try 'minikube kubectl -- get pods -A'

	I0531 19:43:24.685300    1340 out.go:177] * Done! kubectl is now configured to use "old-k8s-version-20220531192531-2108" cluster and "default" namespace by default

	I0531 19:43:20.624671    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.2490409s)

	I0531 19:43:20.624671    8616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54560 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\embed-certs-20220531193346-2108\id_rsa Username:docker}

	I0531 19:43:20.759134    8616 ssh_runner.go:235] Completed: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs: (1.3904934s)

	I0531 19:43:20.769129    8616 ssh_runner.go:195] Run: cat /etc/os-release

	I0531 19:43:20.781134    8616 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I0531 19:43:20.781134    8616 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I0531 19:43:20.781134    8616 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I0531 19:43:20.781134    8616 info.go:137] Remote host: Ubuntu 20.04.4 LTS

	I0531 19:43:20.781134    8616 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\addons for local assets ...

	I0531 19:43:20.782134    8616 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\files for local assets ...

	I0531 19:43:20.783138    8616 filesync.go:149] local asset: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\21082.pem -> 21082.pem in /etc/ssl/certs

	I0531 19:43:20.797122    8616 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0531 19:43:20.827072    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\21082.pem --> /etc/ssl/certs/21082.pem (1708 bytes)

	I0531 19:43:20.887348    8616 start.go:309] post-start completed in 1.5295791s

	I0531 19:43:20.898339    8616 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0531 19:43:20.904357    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:22.218797    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.3134488s)

	I0531 19:43:22.218797    8616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54560 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\embed-certs-20220531193346-2108\id_rsa Username:docker}

	I0531 19:43:22.370144    8616 ssh_runner.go:235] Completed: sh -c "df -h /var | awk 'NR==2{print $5}'": (1.4717985s)

	I0531 19:43:22.382114    8616 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0531 19:43:22.399454    8616 fix.go:57] fixHost completed within 21.3373847s

	I0531 19:43:22.399454    8616 start.go:81] releasing machines lock for "embed-certs-20220531193346-2108", held for 21.3373847s

	I0531 19:43:22.406442    8616 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220531193346-2108

	I0531 19:43:23.736218    8616 cli_runner.go:217] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220531193346-2108: (1.3297705s)

	I0531 19:43:23.739211    8616 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0531 19:43:23.747232    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:23.748219    8616 ssh_runner.go:195] Run: systemctl --version

	I0531 19:43:23.757214    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:25.191855    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.4446175s)

	I0531 19:43:25.192881    8616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54560 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\embed-certs-20220531193346-2108\id_rsa Username:docker}

	I0531 19:43:25.216528    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.4593082s)

	I0531 19:43:25.216528    8616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54560 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\embed-certs-20220531193346-2108\id_rsa Username:docker}

	I0531 19:43:25.434737    8616 ssh_runner.go:235] Completed: curl -sS -m 2 https://k8s.gcr.io/: (1.6955191s)

	I0531 19:43:25.434737    8616 ssh_runner.go:235] Completed: systemctl --version: (1.6865115s)

	I0531 19:43:25.450724    8616 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0531 19:43:25.564263    8616 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0531 19:43:25.598655    8616 cruntime.go:273] skipping containerd shutdown because we are bound to it

	I0531 19:43:25.608101    8616 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0531 19:43:25.652695    8616 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I0531 19:43:25.706768    8616 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0531 19:43:25.913648    8616 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0531 19:43:26.130777    8616 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0531 19:43:26.181761    8616 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0531 19:43:26.375718    8616 ssh_runner.go:195] Run: sudo systemctl start docker

	I0531 19:43:26.412452    8616 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0531 19:43:26.527203    8616 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0531 19:43:26.636205    8616 out.go:204] * Preparing Kubernetes v1.23.6 on Docker 20.10.16 ...

	I0531 19:43:26.651207    8616 cli_runner.go:164] Run: docker exec -t embed-certs-20220531193346-2108 dig +short host.docker.internal

	I0531 19:43:28.191872    8616 cli_runner.go:217] Completed: docker exec -t embed-certs-20220531193346-2108 dig +short host.docker.internal: (1.5406583s)

	I0531 19:43:28.191872    8616 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2

	I0531 19:43:28.202880    8616 ssh_runner.go:195] Run: grep 192.168.65.2	host.minikube.internal$ /etc/hosts

	I0531 19:43:28.218418    8616 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0531 19:43:28.262706    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:29.498586    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.2358751s)

	I0531 19:43:29.498586    8616 preload.go:132] Checking if preload exists for k8s version v1.23.6 and runtime docker

	I0531 19:43:29.505594    8616 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0531 19:43:29.585592    8616 docker.go:610] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.23.6

	k8s.gcr.io/kube-proxy:v1.23.6

	k8s.gcr.io/kube-scheduler:v1.23.6

	k8s.gcr.io/kube-controller-manager:v1.23.6

	k8s.gcr.io/etcd:3.5.1-0

	k8s.gcr.io/coredns/coredns:v1.8.6

	k8s.gcr.io/pause:3.6

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28.4-glibc

	-- /stdout --

	I0531 19:43:29.585592    8616 docker.go:541] Images already preloaded, skipping extraction

	I0531 19:43:29.592584    8616 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0531 19:43:29.692450    8616 docker.go:610] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.23.6

	k8s.gcr.io/kube-controller-manager:v1.23.6

	k8s.gcr.io/kube-proxy:v1.23.6

	k8s.gcr.io/kube-scheduler:v1.23.6

	k8s.gcr.io/etcd:3.5.1-0

	k8s.gcr.io/coredns/coredns:v1.8.6

	k8s.gcr.io/pause:3.6

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28.4-glibc

	-- /stdout --

	I0531 19:43:29.692450    8616 cache_images.go:84] Images are preloaded, skipping loading

	I0531 19:43:29.698436    8616 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0531 19:43:29.922432    8616 cni.go:95] Creating CNI manager for ""

	I0531 19:43:29.922549    8616 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0531 19:43:29.922549    8616 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0531 19:43:29.922549    8616 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.67.2 APIServerPort:8443 KubernetesVersion:v1.23.6 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-20220531193346-2108 NodeName:embed-certs-20220531193346-2108 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.67.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.67.2 CgroupDriver:cgroupfs ClientCAFile:/

var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0531 19:43:29.922775    8616 kubeadm.go:162] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.67.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "embed-certs-20220531193346-2108"

	  kubeletExtraArgs:

	    node-ip: 192.168.67.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.23.6

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0531 19:43:29.922863    8616 kubeadm.go:961] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.23.6/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=embed-certs-20220531193346-2108 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.67.2

	[Install]

	 config:

	{KubernetesVersion:v1.23.6 ClusterName:embed-certs-20220531193346-2108 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0531 19:43:29.937834    8616 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.23.6

	I0531 19:43:29.970126    8616 binaries.go:44] Found k8s binaries, skipping transfer

	I0531 19:43:29.980712    8616 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0531 19:43:30.003043    8616 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (357 bytes)

	I0531 19:43:30.040432    8616 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0531 19:43:30.080432    8616 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2053 bytes)

	I0531 19:43:30.128472    8616 ssh_runner.go:195] Run: grep 192.168.67.2	control-plane.minikube.internal$ /etc/hosts

	I0531 19:43:30.144212    8616 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0531 19:43:30.174247    8616 certs.go:54] Setting up C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108 for IP: 192.168.67.2

	I0531 19:43:30.174247    8616 certs.go:182] skipping minikubeCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key

	I0531 19:43:30.175233    8616 certs.go:182] skipping proxyClientCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key

	I0531 19:43:30.175233    8616 certs.go:298] skipping minikube-user signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\client.key

	I0531 19:43:30.176258    8616 certs.go:298] skipping minikube signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\apiserver.key.c7fa3a9e

	I0531 19:43:30.176258    8616 certs.go:298] skipping aggregator signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\proxy-client.key

	I0531 19:43:30.177245    8616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\2108.pem (1338 bytes)

	W0531 19:43:30.177245    8616 certs.go:384] ignoring C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\2108_empty.pem, impossibly tiny 0 bytes

	I0531 19:43:30.178242    8616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem (1675 bytes)

	I0531 19:43:30.178242    8616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem (1078 bytes)

	I0531 19:43:30.178242    8616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem (1123 bytes)

	I0531 19:43:30.178242    8616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem (1679 bytes)

	I0531 19:43:30.179223    8616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\21082.pem (1708 bytes)

	I0531 19:43:30.181232    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0531 19:43:30.231446    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0531 19:43:30.286026    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0531 19:43:30.347980    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0531 19:43:30.409568    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0531 19:43:30.468376    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0531 19:43:30.523994    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0531 19:43:30.580310    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0531 19:43:30.649449    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0531 19:43:30.719603    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\2108.pem --> /usr/share/ca-certificates/2108.pem (1338 bytes)

	I0531 19:43:30.786513    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\21082.pem --> /usr/share/ca-certificates/21082.pem (1708 bytes)

	I0531 19:43:30.859521    8616 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (752 bytes)

	I0531 19:43:30.907080    8616 ssh_runner.go:195] Run: openssl version

	I0531 19:43:30.929093    8616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0531 19:43:30.986864    8616 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0531 19:43:31.005336    8616 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 May 31 17:19 /usr/share/ca-certificates/minikubeCA.pem

	I0531 19:43:31.014329    8616 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0531 19:43:31.040343    8616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0531 19:43:31.077357    8616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2108.pem && ln -fs /usr/share/ca-certificates/2108.pem /etc/ssl/certs/2108.pem"

	I0531 19:43:31.111349    8616 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2108.pem

	I0531 19:43:31.121345    8616 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 May 31 17:31 /usr/share/ca-certificates/2108.pem

	I0531 19:43:31.132335    8616 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2108.pem

	I0531 19:43:31.156335    8616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/2108.pem /etc/ssl/certs/51391683.0"

	I0531 19:43:31.198345    8616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/21082.pem && ln -fs /usr/share/ca-certificates/21082.pem /etc/ssl/certs/21082.pem"

	I0531 19:43:31.230395    8616 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/21082.pem

	I0531 19:43:31.245833    8616 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 May 31 17:31 /usr/share/ca-certificates/21082.pem

	I0531 19:43:31.256203    8616 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/21082.pem

	I0531 19:43:31.279205    8616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/21082.pem /etc/ssl/certs/3ec20f2e.0"

	I0531 19:43:31.309204    8616 kubeadm.go:395] StartCluster: {Name:embed-certs-20220531193346-2108 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.6 ClusterName:embed-certs-20220531193346-2108 Namespace:default APIServerName

:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.23.6 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.5.1@sha256:cc746e7a0b1eec0db01cbabbb6386b23d7af97e79fa9e36bb883a95b7eb96fe2 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedP

orts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}

	I0531 19:43:31.319672    8616 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0531 19:43:31.403071    8616 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0531 19:43:31.428156    8616 kubeadm.go:410] found existing configuration files, will attempt cluster restart

	I0531 19:43:31.429149    8616 kubeadm.go:626] restartCluster start

	I0531 19:43:31.439155    8616 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I0531 19:43:31.459646    8616 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:31.471196    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:32.683774    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.2125727s)

	I0531 19:43:32.685818    8616 kubeconfig.go:116] verify returned: extract IP: "embed-certs-20220531193346-2108" does not appear in C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I0531 19:43:32.687090    8616 kubeconfig.go:127] "embed-certs-20220531193346-2108" context is missing from C:\Users\jenkins.minikube7\minikube-integration\kubeconfig - will repair!

	I0531 19:43:32.689552    8616 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\kubeconfig: {Name:mk3b9816be6135fef42a073128e9ed356868417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:43:32.711443    8616 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0531 19:43:32.741481    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:32.755718    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:32.782840    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:32.998467    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:33.009814    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:33.038110    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:33.187690    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:33.198728    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:33.231759    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:33.389082    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:33.401128    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:33.437991    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:33.596003    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:33.610434    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:33.649694    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:33.783691    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:33.794460    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:33.820957    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:33.989461    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:34.000602    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:34.029721    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:34.197752    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:34.208129    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:34.240212    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:34.388876    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:34.398381    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:34.427592    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:34.592690    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:34.603583    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:34.630736    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:34.793731    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:34.802574    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:34.840450    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:34.982936    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:34.994510    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:35.019918    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:35.194019    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:35.206505    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:35.239207    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:35.383180    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:35.395711    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:35.424130    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:35.588664    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:35.599428    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:35.628476    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:35.794694    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:35.804703    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:35.835435    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:35.835435    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:35.845430    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:35.872922    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:35.872966    8616 kubeadm.go:601] needs reconfigure: apiserver error: timed out waiting for the condition

	I0531 19:43:35.872966    8616 kubeadm.go:1092] stopping kube-system containers ...

	I0531 19:43:35.888288    8616 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0531 19:43:36.000416    8616 docker.go:442] Stopping containers: [18f322b433f7 51e6610a10f8 a57711de2363 b6d1008f5a7a 05f4ee855b48 5f2d7ca41131 a4c5949a368e 76eefca54c8e 938b770e6a22 7d10308b7ec6 284f4ae8d238 af695fbb3afb 09ad7210375d 74454f5b27c5 95eae5077bdb 459d9f4673a9]

	I0531 19:43:36.009398    8616 ssh_runner.go:195] Run: docker stop 18f322b433f7 51e6610a10f8 a57711de2363 b6d1008f5a7a 05f4ee855b48 5f2d7ca41131 a4c5949a368e 76eefca54c8e 938b770e6a22 7d10308b7ec6 284f4ae8d238 af695fbb3afb 09ad7210375d 74454f5b27c5 95eae5077bdb 459d9f4673a9

	I0531 19:43:36.107408    8616 ssh_runner.go:195] Run: sudo systemctl stop kubelet

	I0531 19:43:36.149402    8616 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0531 19:43:36.172404    8616 kubeadm.go:155] found existing configuration files:

	-rw------- 1 root root 5643 May 31 19:41 /etc/kubernetes/admin.conf

	-rw------- 1 root root 5652 May 31 19:41 /etc/kubernetes/controller-manager.conf

	-rw------- 1 root root 2063 May 31 19:41 /etc/kubernetes/kubelet.conf

	-rw------- 1 root root 5604 May 31 19:41 /etc/kubernetes/scheduler.conf

	I0531 19:43:36.182417    8616 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0531 19:43:36.212422    8616 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0531 19:43:36.244428    8616 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0531 19:43:36.266416    8616 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:36.278403    8616 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0531 19:43:36.311760    8616 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0531 19:43:36.334758    8616 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:36.343790    8616 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0531 19:43:36.383787    8616 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0531 19:43:36.405748    8616 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I0531 19:43:36.405748    8616 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I0531 19:43:36.547878    8616 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I0531 19:43:37.853479    8616 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.3055954s)

	I0531 19:43:37.854020    8616 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I0531 19:43:38.190227    8616 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I0531 19:43:38.364256    8616 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I0531 19:43:38.640714    8616 api_server.go:51] waiting for apiserver process to appear ...

	I0531 19:43:38.654240    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:39.203285    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:39.698006    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:40.197265    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:40.699188    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:41.204693    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:41.696036    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:42.200147    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:42.701351    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:42.745446    8616 api_server.go:71] duration metric: took 4.1047578s to wait for apiserver process to appear ...

	I0531 19:43:42.745446    8616 api_server.go:87] waiting for apiserver healthz status ...

	I0531 19:43:42.745446    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:42.750441    8616 api_server.go:256] stopped: https://127.0.0.1:54559/healthz: Get "https://127.0.0.1:54559/healthz": EOF

	I0531 19:43:43.260468    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:44.816816    9560 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force": (50.8628666s)

	I0531 19:43:44.834841    9560 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0531 19:43:44.875054    9560 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0531 19:43:44.910403    9560 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver

	I0531 19:43:44.926341    9560 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0531 19:43:44.952402    9560 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0531 19:43:44.952402    9560 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I0531 19:43:48.268195    8616 api_server.go:256] stopped: https://127.0.0.1:54559/healthz: Get "https://127.0.0.1:54559/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

	I0531 19:43:48.760057    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:49.742236    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W0531 19:43:49.742236    8616 api_server.go:102] status: https://127.0.0.1:54559/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I0531 19:43:49.762242    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:49.834262    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W0531 19:43:49.834262    8616 api_server.go:102] status: https://127.0.0.1:54559/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I0531 19:43:50.265125    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:50.325042    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:43:50.325997    8616 api_server.go:102] status: https://127.0.0.1:54559/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:43:50.754281    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:50.778515    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:43:50.778515    8616 api_server.go:102] status: https://127.0.0.1:54559/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:43:51.256439    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:51.326599    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:43:51.326599    8616 api_server.go:102] status: https://127.0.0.1:54559/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:43:51.759811    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:51.871137    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:43:51.871223    8616 api_server.go:102] status: https://127.0.0.1:54559/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:43:52.250743    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:52.368759    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:43:52.368759    8616 api_server.go:102] status: https://127.0.0.1:54559/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:43:52.756360    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:52.847081    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:43:52.847081    8616 api_server.go:102] status: https://127.0.0.1:54559/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:43:53.262170    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:53.433182    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 200:

	ok

	I0531 19:43:53.526458    8616 api_server.go:140] control plane version: v1.23.6

	I0531 19:43:53.526458    8616 api_server.go:130] duration metric: took 10.7809658s to wait for apiserver health ...

	I0531 19:43:53.526458    8616 cni.go:95] Creating CNI manager for ""

	I0531 19:43:53.526458    8616 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0531 19:43:53.526780    8616 system_pods.go:43] waiting for kube-system pods to appear ...

	I0531 19:43:53.834702    8616 system_pods.go:59] 8 kube-system pods found

	I0531 19:43:53.834702    8616 system_pods.go:61] "coredns-64897985d-h6l4d" [45e6521b-b5ba-4365-bf64-ed7f35254f8d] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I0531 19:43:53.834702    8616 system_pods.go:61] "etcd-embed-certs-20220531193346-2108" [8748c975-baa9-452c-8caa-89e8ff59a91a] Running

	I0531 19:43:53.834702    8616 system_pods.go:61] "kube-apiserver-embed-certs-20220531193346-2108" [df786508-0ac8-406a-b97b-c6650f016ceb] Running

	I0531 19:43:53.834702    8616 system_pods.go:61] "kube-controller-manager-embed-certs-20220531193346-2108" [fc4dc9a6-b756-47c3-93c8-b37e4a6af2ea] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0531 19:43:53.834702    8616 system_pods.go:61] "kube-proxy-qmdlz" [e19359f3-a2a5-4148-a7a1-ba356b861a3a] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])

	I0531 19:43:53.834702    8616 system_pods.go:61] "kube-scheduler-embed-certs-20220531193346-2108" [f3efddc7-a2d0-44d8-a33b-a9b19295fe12] Running

	I0531 19:43:53.834702    8616 system_pods.go:61] "metrics-server-b955d9d8-n88dp" [eb244db6-b3bb-4838-a675-474d5d7a17d7] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:43:53.834702    8616 system_pods.go:61] "storage-provisioner" [1f06e411-8a16-4f79-b44d-1c60e7d37395] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0531 19:43:53.834702    8616 system_pods.go:74] duration metric: took 307.92ms to wait for pod list to return data ...

	I0531 19:43:53.834702    8616 node_conditions.go:102] verifying NodePressure condition ...

	I0531 19:43:53.929683    8616 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki

	I0531 19:43:53.929683    8616 node_conditions.go:123] node cpu capacity is 16

	I0531 19:43:53.929683    8616 node_conditions.go:105] duration metric: took 94.9807ms to run NodePressure ...

	I0531 19:43:53.929683    8616 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I0531 19:43:56.629261    8616 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml": (2.6995662s)

	I0531 19:43:56.629261    8616 kubeadm.go:762] waiting for restarted kubelet to initialise ...

	I0531 19:43:56.740265    8616 kubeadm.go:777] kubelet initialised

	I0531 19:43:56.740265    8616 kubeadm.go:778] duration metric: took 111.0043ms waiting for restarted kubelet to initialise ...

	I0531 19:43:56.740265    8616 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0531 19:43:56.844460    8616 pod_ready.go:78] waiting up to 4m0s for pod "coredns-64897985d-h6l4d" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.488158    8616 pod_ready.go:92] pod "coredns-64897985d-h6l4d" in "kube-system" namespace has status "Ready":"True"

	I0531 19:43:58.488158    8616 pod_ready.go:81] duration metric: took 1.6436914s waiting for pod "coredns-64897985d-h6l4d" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.488158    8616 pod_ready.go:78] waiting up to 4m0s for pod "etcd-embed-certs-20220531193346-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.510159    8616 pod_ready.go:92] pod "etcd-embed-certs-20220531193346-2108" in "kube-system" namespace has status "Ready":"True"

	I0531 19:43:58.510159    8616 pod_ready.go:81] duration metric: took 22.0001ms waiting for pod "etcd-embed-certs-20220531193346-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.510159    8616 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-embed-certs-20220531193346-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.527166    8616 pod_ready.go:92] pod "kube-apiserver-embed-certs-20220531193346-2108" in "kube-system" namespace has status "Ready":"True"

	I0531 19:43:58.527166    8616 pod_ready.go:81] duration metric: took 17.0071ms waiting for pod "kube-apiserver-embed-certs-20220531193346-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.527166    8616 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-embed-certs-20220531193346-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.550165    8616 pod_ready.go:92] pod "kube-controller-manager-embed-certs-20220531193346-2108" in "kube-system" namespace has status "Ready":"True"

	I0531 19:43:58.550165    8616 pod_ready.go:81] duration metric: took 22.9989ms waiting for pod "kube-controller-manager-embed-certs-20220531193346-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.550165    8616 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-qmdlz" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.565167    8616 pod_ready.go:92] pod "kube-proxy-qmdlz" in "kube-system" namespace has status "Ready":"True"

	I0531 19:43:58.566182    8616 pod_ready.go:81] duration metric: took 16.0169ms waiting for pod "kube-proxy-qmdlz" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.566182    8616 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-embed-certs-20220531193346-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.885714    8616 pod_ready.go:92] pod "kube-scheduler-embed-certs-20220531193346-2108" in "kube-system" namespace has status "Ready":"True"

	I0531 19:43:58.885714    8616 pod_ready.go:81] duration metric: took 319.5308ms waiting for pod "kube-scheduler-embed-certs-20220531193346-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.885714    8616 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace to be "Ready" ...

	I0531 19:44:01.299568    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:03.307027    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:07.756660    9560 out.go:204]   - Generating certificates and keys ...

	I0531 19:44:07.763661    9560 out.go:204]   - Booting up control plane ...

	I0531 19:44:07.770647    9560 out.go:204]   - Configuring RBAC rules ...

	I0531 19:44:07.776631    9560 cni.go:95] Creating CNI manager for ""

	I0531 19:44:07.776631    9560 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0531 19:44:07.776631    9560 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0531 19:44:07.790660    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl label nodes minikube.k8s.io/version=v1.26.0-beta.1 minikube.k8s.io/commit=bd46569bd7cb517fcad2e704abdebd2826bd8454 minikube.k8s.io/name=default-k8s-different-port-20220531193451-2108 minikube.k8s.io/updated_at=2022_05_31T19_44_07_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:07.790660    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:07.840339    9560 ops.go:34] apiserver oom_adj: -16

	I0531 19:44:08.352099    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	* 

	* ==> Docker <==

	* -- Logs begin at Tue 2022-05-31 19:35:55 UTC, end at Tue 2022-05-31 19:44:16 UTC. --

	May 31 19:41:34 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:41:34.111328500Z" level=info msg="ignoring event" container=56f2c3f6f12d593c333cb56a645be9bccf6ec84c695bd35b566c7eeb8726b9eb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 19:41:34 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:41:34.438347700Z" level=info msg="ignoring event" container=1e1669e95902d78a506bfba3e4980acc39f4e7c136bac62f41c3780d8f0816a0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 19:41:34 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:41:34.771144900Z" level=info msg="ignoring event" container=2dd05fb9ca85f1c865a22a2973b8fb5a65db284592e4e14e2ddd5e91443dbedc module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 19:41:35 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:41:35.070201300Z" level=info msg="ignoring event" container=edfbcbda899056e2410c4acf8ea6a853cdd0b2fbe327f91acc1611a8d3d3391c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 19:42:18 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:18.649088800Z" level=error msg="stream copy error: reading from a closed fifo"

	May 31 19:42:18 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:18.719649300Z" level=error msg="stream copy error: reading from a closed fifo"

	May 31 19:42:19 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:19.821922300Z" level=error msg="247dabaa3d5f823c5b66c2062b47692e5b49e91435959ae09de0f032a5623800 cleanup: failed to delete container from containerd: no such container"

	May 31 19:42:19 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:19.822450700Z" level=error msg="Handler for POST /containers/247dabaa3d5f823c5b66c2062b47692e5b49e91435959ae09de0f032a5623800/start returned error: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: writing syncT \"procResume\": write init-p: broken pipe: unknown"

	May 31 19:42:28 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:28.645661400Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:42:28 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:28.645743100Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:42:28 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:28.655547400Z" level=error msg="Handler for POST /images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:42:29 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:29.873960300Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="k8s.gcr.io/echoserver:1.4"

	May 31 19:42:30 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:30.049928000Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="k8s.gcr.io/echoserver:1.4"

	May 31 19:42:47 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:47.980007500Z" level=warning msg="reference for unknown type: " digest="sha256:cc746e7a0b1eec0db01cbabbb6386b23d7af97e79fa9e36bb883a95b7eb96fe2" remote="docker.io/kubernetesui/dashboard@sha256:cc746e7a0b1eec0db01cbabbb6386b23d7af97e79fa9e36bb883a95b7eb96fe2"

	May 31 19:42:48 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:48.345433300Z" level=info msg="ignoring event" container=9baa5613dc437df519abd371e1c81dd506a65210c0049a8f8c6a60cba02b84c9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 19:42:49 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:49.050869500Z" level=info msg="ignoring event" container=a82f5f7cd3eb6a6365072d16275bd8268df4e96e619a79fa57e043015adfdee5 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 19:43:01 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:43:01.022851800Z" level=info msg="ignoring event" container=817b790393050f42b01ddb3442a99a6c5ba58651a8df3b91e5f0c0ffb80c4666 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 19:43:11 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:43:11.258016700Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:43:11 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:43:11.258272000Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:43:11 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:43:11.270055200Z" level=error msg="Handler for POST /images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:43:22 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:43:22.420615000Z" level=info msg="ignoring event" container=03167ba0f08fdff581ad496cd4bbb5dbff52a4602923c0fecd2f201ef3c775cb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 19:43:39 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:43:39.644305000Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:43:39 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:43:39.644465200Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:43:39 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:43:39.661137500Z" level=error msg="Handler for POST /images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:44:09 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:44:09.254101000Z" level=info msg="ignoring event" container=d9bab4566384602eebba16adb5527bbde86b9377f00da7d2e1af2ddc1ea2b2a8 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                            CREATED              STATE               NAME                        ATTEMPT             POD ID

	d9bab45663846       a90209bb39e3d                                                                                    9 seconds ago        Exited              dashboard-metrics-scraper   4                   10762210a70b3

	8c65f88737998       kubernetesui/dashboard@sha256:cc746e7a0b1eec0db01cbabbb6386b23d7af97e79fa9e36bb883a95b7eb96fe2   About a minute ago   Running             kubernetes-dashboard        0                   363a1b018898e

	78333097362ef       6e38f40d628db                                                                                    About a minute ago   Running             storage-provisioner         0                   8357a697373e0

	fb1686d28fd2f       bf261d1579144                                                                                    About a minute ago   Running             coredns                     0                   e64f972d867d6

	49b44baa515c4       c21b0c7400f98                                                                                    2 minutes ago        Running             kube-proxy                  0                   46895f03742d0

	be55be2991218       b2756210eeabf                                                                                    2 minutes ago        Running             etcd                        0                   2f1d5465012c0

	2e7bf308b9082       301ddc62b80b1                                                                                    2 minutes ago        Running             kube-scheduler              0                   2b7ee67a9db7a

	86f1dffe85081       b305571ca60a5                                                                                    2 minutes ago        Running             kube-apiserver              0                   28f7e7bc70e63

	963332154a4f7       06a629a7e51cd                                                                                    2 minutes ago        Running             kube-controller-manager     0                   b80cecadcecf5

	* 

	* ==> coredns [fb1686d28fd2] <==

	* .:53

	2022-05-31T19:42:20.924Z [INFO] plugin/reload: Running configuration MD5 = f64cb9b977c7dfca58c4fab108535a76

	2022-05-31T19:42:20.925Z [INFO] CoreDNS-1.6.2

	2022-05-31T19:42:20.929Z [INFO] linux/amd64, go1.12.8, 795a3eb

	CoreDNS-1.6.2

	linux/amd64, go1.12.8, 795a3eb

	[INFO] Reloading

	2022-05-31T19:42:57.534Z [INFO] plugin/reload: Running configuration MD5 = 034a4984a79adc08e57427d1bc08b68f

	[INFO] Reloading complete

	* 

	* ==> describe nodes <==

	* Name:               old-k8s-version-20220531192531-2108

	Roles:              master

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=old-k8s-version-20220531192531-2108

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=bd46569bd7cb517fcad2e704abdebd2826bd8454

	                    minikube.k8s.io/name=old-k8s-version-20220531192531-2108

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2022_05_31T19_41_59_0700

	                    minikube.k8s.io/version=v1.26.0-beta.1

	                    node-role.kubernetes.io/master=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Tue, 31 May 2022 19:41:54 +0000

	Taints:             <none>

	Unschedulable:      false

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Tue, 31 May 2022 19:44:16 +0000   Tue, 31 May 2022 19:41:49 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Tue, 31 May 2022 19:44:16 +0000   Tue, 31 May 2022 19:41:49 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Tue, 31 May 2022 19:44:16 +0000   Tue, 31 May 2022 19:41:49 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Tue, 31 May 2022 19:44:16 +0000   Tue, 31 May 2022 19:41:49 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.76.2

	  Hostname:    old-k8s-version-20220531192531-2108

	Capacity:

	 cpu:                16

	 ephemeral-storage:  263174212Ki

	 hugepages-1Gi:      0

	 hugepages-2Mi:      0

	 memory:             52638988Ki

	 pods:               110

	Allocatable:

	 cpu:                16

	 ephemeral-storage:  263174212Ki

	 hugepages-1Gi:      0

	 hugepages-2Mi:      0

	 memory:             52638988Ki

	 pods:               110

	System Info:

	 Machine ID:                 bfc82849fe6e4a6a9236307a23a8b5f1

	 System UUID:                bfc82849fe6e4a6a9236307a23a8b5f1

	 Boot ID:                    99d8680c-6839-4c5e-a5fa-8740ef80d5ef

	 Kernel Version:             5.10.102.1-microsoft-standard-WSL2

	 OS Image:                   Ubuntu 20.04.4 LTS

	 Operating System:           linux

	 Architecture:               amd64

	 Container Runtime Version:  docker://20.10.16

	 Kubelet Version:            v1.16.0

	 Kube-Proxy Version:         v1.16.0

	PodCIDR:                     10.244.0.0/24

	PodCIDRs:                    10.244.0.0/24

	Non-terminated Pods:         (10 in total)

	  Namespace                  Name                                                           CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE

	  ---------                  ----                                                           ------------  ----------  ---------------  -------------  ---

	  kube-system                coredns-5644d7b6d9-jxp72                                       100m (0%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (0%!)(MISSING)     2m4s

	  kube-system                etcd-old-k8s-version-20220531192531-2108                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         86s

	  kube-system                kube-apiserver-old-k8s-version-20220531192531-2108             250m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         65s

	  kube-system                kube-controller-manager-old-k8s-version-20220531192531-2108    200m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         84s

	  kube-system                kube-proxy-r556l                                               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m4s

	  kube-system                kube-scheduler-old-k8s-version-20220531192531-2108             100m (0%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         68s

	  kube-system                metrics-server-6f89b5864b-v8mjx                                100m (0%!)(MISSING)     0 (0%!)(MISSING)      200Mi (0%!)(MISSING)       0 (0%!)(MISSING)         115s

	  kube-system                storage-provisioner                                            0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         117s

	  kubernetes-dashboard       dashboard-metrics-scraper-6b84985989-cs5v7                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         113s

	  kubernetes-dashboard       kubernetes-dashboard-6fb5469cf5-spl8w                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         112s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (4%!)(MISSING)   0 (0%!)(MISSING)

	  memory             270Mi (0%!)(MISSING)  170Mi (0%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From                                             Message

	  ----    ------                   ----                   ----                                             -------

	  Normal  NodeHasSufficientMemory  2m37s (x7 over 2m38s)  kubelet, old-k8s-version-20220531192531-2108     Node old-k8s-version-20220531192531-2108 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    2m37s (x8 over 2m38s)  kubelet, old-k8s-version-20220531192531-2108     Node old-k8s-version-20220531192531-2108 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m37s (x8 over 2m38s)  kubelet, old-k8s-version-20220531192531-2108     Node old-k8s-version-20220531192531-2108 status is now: NodeHasSufficientPID

	  Normal  Starting                 2m                     kube-proxy, old-k8s-version-20220531192531-2108  Starting kube-proxy.

	* 

	* ==> dmesg <==

	* [  +0.001366] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000006] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000932] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000006] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.089750] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000005] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.002712] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000005] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.106424] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000004] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.091580] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000006] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[May31 19:22] WSL2: Performing memory compaction.

	[May31 19:23] WSL2: Performing memory compaction.

	[May31 19:24] WSL2: Performing memory compaction.

	[May31 19:25] WSL2: Performing memory compaction.

	[May31 19:26] WSL2: Performing memory compaction.

	[May31 19:27] WSL2: Performing memory compaction.

	[May31 19:28] WSL2: Performing memory compaction.

	[May31 19:30] WSL2: Performing memory compaction.

	[May31 19:32] WSL2: Performing memory compaction.

	[May31 19:34] WSL2: Performing memory compaction.

	[May31 19:37] WSL2: Performing memory compaction.

	[May31 19:39] WSL2: Performing memory compaction.

	[May31 19:40] WSL2: Performing memory compaction.

	* 

	* ==> etcd [be55be299121] <==

	* 2022-05-31 19:42:22.743121 W | etcdserver: read-only range request "key:\"/registry/deployments/kube-system/metrics-server\" " with result "range_response_count:0 size:5" took too long (106.7399ms) to execute

	2022-05-31 19:42:22.950495 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kube-system/metrics-server\" " with result "range_response_count:0 size:5" took too long (108.5051ms) to execute

	2022-05-31 19:42:24.137531 W | etcdserver: read-only range request "key:\"/registry/namespaces/kubernetes-dashboard\" " with result "range_response_count:0 size:5" took too long (105.795ms) to execute

	2022-05-31 19:42:24.246233 W | etcdserver: read-only range request "key:\"/registry/storageclasses/standard\" " with result "range_response_count:0 size:5" took too long (110.6488ms) to execute

	2022-05-31 19:42:24.441034 W | etcdserver: read-only range request "key:\"/registry/replicasets/kube-system/metrics-server-6f89b5864b\" " with result "range_response_count:1 size:1313" took too long (111.79ms) to execute

	2022-05-31 19:42:24.441959 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-proxy-r556l\" " with result "range_response_count:1 size:2188" took too long (110.2984ms) to execute

	2022-05-31 19:42:24.443824 W | etcdserver: read-only range request "key:\"/registry/clusterroles/kubernetes-dashboard\" " with result "range_response_count:0 size:5" took too long (112.0249ms) to execute

	2022-05-31 19:42:24.724190 W | etcdserver: read-only range request "key:\"/registry/clusterrolebindings/kubernetes-dashboard\" " with result "range_response_count:0 size:5" took too long (100.0251ms) to execute

	2022-05-31 19:42:25.350706 W | etcdserver: read-only range request "key:\"/registry/roles/kubernetes-dashboard/kubernetes-dashboard\" " with result "range_response_count:0 size:5" took too long (231.0518ms) to execute

	2022-05-31 19:42:25.623252 W | etcdserver: read-only range request "key:\"/registry/deployments/kubernetes-dashboard/kubernetes-dashboard\" " with result "range_response_count:1 size:2624" took too long (191.1718ms) to execute

	2022-05-31 19:42:25.623439 W | etcdserver: request "header:<ID:15638328711796955181 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/deployments/kubernetes-dashboard/dashboard-metrics-scraper\" mod_revision:436 > success:<request_put:<key:\"/registry/deployments/kubernetes-dashboard/dashboard-metrics-scraper\" value_size:2711 >> failure:<request_range:<key:\"/registry/deployments/kubernetes-dashboard/dashboard-metrics-scraper\" > >>" with result "size:16" took too long (103.4478ms) to execute

	2022-05-31 19:42:25.624064 W | etcdserver: read-only range request "key:\"/registry/rolebindings/kubernetes-dashboard/kubernetes-dashboard\" " with result "range_response_count:0 size:5" took too long (182.9407ms) to execute

	2022-05-31 19:42:25.828303 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kubernetes-dashboard/kubernetes-dashboard\" " with result "range_response_count:0 size:5" took too long (194.2906ms) to execute

	2022-05-31 19:42:25.828526 W | etcdserver: read-only range request "key:\"/registry/serviceaccounts/kubernetes-dashboard/kubernetes-dashboard\" " with result "range_response_count:0 size:5" took too long (100.0597ms) to execute

	2022-05-31 19:42:25.828730 W | etcdserver: read-only range request "key:\"/registry/events/kubernetes-dashboard/dashboard-metrics-scraper-6b84985989.16f44803f955b5cc\" " with result "range_response_count:1 size:695" took too long (108.0618ms) to execute

	2022-05-31 19:42:26.630811 W | etcdserver: read-only range request "key:\"/registry/pods/kubernetes-dashboard/dashboard-metrics-scraper-6b84985989-cs5v7\" " with result "range_response_count:1 size:1332" took too long (107.6487ms) to execute

	2022-05-31 19:42:26.830639 W | etcdserver: read-only range request "key:\"/registry/services/specs/kubernetes-dashboard/dashboard-metrics-scraper\" " with result "range_response_count:0 size:5" took too long (105.1522ms) to execute

	2022-05-31 19:42:26.840350 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" " with result "range_response_count:1 size:765" took too long (107.9713ms) to execute

	2022-05-31 19:42:27.442251 W | etcdserver: request "header:<ID:15638328711796955265 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/deployments/kubernetes-dashboard/kubernetes-dashboard\" mod_revision:446 > success:<request_put:<key:\"/registry/deployments/kubernetes-dashboard/kubernetes-dashboard\" value_size:2654 >> failure:<request_range:<key:\"/registry/deployments/kubernetes-dashboard/kubernetes-dashboard\" > >>" with result "size:16" took too long (107.2543ms) to execute

	2022-05-31 19:42:27.442940 W | etcdserver: read-only range request "key:\"/registry/replicasets/kubernetes-dashboard/kubernetes-dashboard-6fb5469cf5\" " with result "range_response_count:1 size:1341" took too long (114.3883ms) to execute

	2022-05-31 19:42:27.443132 W | etcdserver: read-only range request "key:\"/registry/pods/kubernetes-dashboard/kubernetes-dashboard-6fb5469cf5-spl8w\" " with result "range_response_count:1 size:1433" took too long (118.4499ms) to execute

	2022-05-31 19:42:27.443515 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/\" range_end:\"/registry/pods/kube-system0\" " with result "range_response_count:4 size:7727" took too long (103.0409ms) to execute

	2022-05-31 19:42:27.726784 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/\" range_end:\"/registry/pods/kube-system0\" " with result "range_response_count:4 size:7727" took too long (191.366ms) to execute

	2022-05-31 19:42:59.737641 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" " with result "range_response_count:1 size:765" took too long (192.8333ms) to execute

	2022-05-31 19:43:46.615330 W | etcdserver: read-only range request "key:\"/registry/services/endpoints\" range_end:\"/registry/services/endpointt\" count_only:true " with result "range_response_count:0 size:7" took too long (179.4081ms) to execute

	* 

	* ==> kernel <==

	*  19:44:19 up  2:32,  0 users,  load average: 11.37, 6.91, 4.69

	Linux old-k8s-version-20220531192531-2108 5.10.102.1-microsoft-standard-WSL2 #1 SMP Wed Mar 2 00:30:59 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.4 LTS"

	* 

	* ==> kube-apiserver [86f1dffe8508] <==

	* I0531 19:41:54.923124       1 storage_scheduling.go:139] created PriorityClass system-cluster-critical with value 2000000000

	I0531 19:41:54.923189       1 storage_scheduling.go:148] all system priority classes are created successfully or already exist.

	I0531 19:41:56.856445       1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0531 19:41:57.121158       1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	W0531 19:41:57.373567       1 lease.go:222] Resetting endpoints for master service "kubernetes" to [192.168.76.2]

	I0531 19:41:57.374922       1 controller.go:606] quota admission added evaluator for: endpoints

	I0531 19:41:58.391090       1 controller.go:606] quota admission added evaluator for: serviceaccounts

	I0531 19:41:58.838399       1 controller.go:606] quota admission added evaluator for: deployments.apps

	I0531 19:41:59.067007       1 controller.go:606] quota admission added evaluator for: daemonsets.apps

	I0531 19:42:00.831630       1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io

	I0531 19:42:15.123502       1 controller.go:606] quota admission added evaluator for: replicasets.apps

	I0531 19:42:15.127329       1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps

	I0531 19:42:15.540631       1 controller.go:606] quota admission added evaluator for: events.events.k8s.io

	E0531 19:42:21.037408       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}

	E0531 19:42:24.321308       1 available_controller.go:416] v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.metrics.k8s.io": the object has been modified; please apply your changes to the latest version and try again

	I0531 19:42:28.041510       1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io

	W0531 19:42:28.042270       1 handler_proxy.go:99] no RequestInfo found in the context

	E0531 19:42:28.042505       1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	I0531 19:42:28.042586       1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	I0531 19:43:28.042562       1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io

	W0531 19:43:28.042881       1 handler_proxy.go:99] no RequestInfo found in the context

	E0531 19:43:28.042943       1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	I0531 19:43:28.042960       1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	* 

	* ==> kube-controller-manager [963332154a4f] <==

	* I0531 19:42:25.629311       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-6b84985989", UID:"9c398431-17d0-4314-8e73-409c72e6fd2f", APIVersion:"apps/v1", ResourceVersion:"435", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "dashboard-metrics-scraper-6b84985989-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0531 19:42:25.629361       1 replica_set.go:450] Sync "kubernetes-dashboard/kubernetes-dashboard-6fb5469cf5" failed with pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0531 19:42:25.723920       1 replica_set.go:450] Sync "kubernetes-dashboard/kubernetes-dashboard-6fb5469cf5" failed with pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0531 19:42:25.724140       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-6fb5469cf5", UID:"40a45895-1dcf-45f7-a413-5594ec6dfeae", APIVersion:"apps/v1", ResourceVersion:"442", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0531 19:42:25.831478       1 replica_set.go:450] Sync "kubernetes-dashboard/kubernetes-dashboard-6fb5469cf5" failed with pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0531 19:42:25.831589       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-6b84985989", UID:"9c398431-17d0-4314-8e73-409c72e6fd2f", APIVersion:"apps/v1", ResourceVersion:"435", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "dashboard-metrics-scraper-6b84985989-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0531 19:42:25.831621       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-6fb5469cf5", UID:"40a45895-1dcf-45f7-a413-5594ec6dfeae", APIVersion:"apps/v1", ResourceVersion:"442", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0531 19:42:25.831478       1 replica_set.go:450] Sync "kubernetes-dashboard/dashboard-metrics-scraper-6b84985989" failed with pods "dashboard-metrics-scraper-6b84985989-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0531 19:42:25.845070       1 replica_set.go:450] Sync "kubernetes-dashboard/kubernetes-dashboard-6fb5469cf5" failed with pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0531 19:42:25.845070       1 replica_set.go:450] Sync "kubernetes-dashboard/dashboard-metrics-scraper-6b84985989" failed with pods "dashboard-metrics-scraper-6b84985989-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0531 19:42:25.845111       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-6b84985989", UID:"9c398431-17d0-4314-8e73-409c72e6fd2f", APIVersion:"apps/v1", ResourceVersion:"435", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "dashboard-metrics-scraper-6b84985989-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0531 19:42:25.845338       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-6fb5469cf5", UID:"40a45895-1dcf-45f7-a413-5594ec6dfeae", APIVersion:"apps/v1", ResourceVersion:"442", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0531 19:42:25.925957       1 replica_set.go:450] Sync "kubernetes-dashboard/kubernetes-dashboard-6fb5469cf5" failed with pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0531 19:42:25.926050       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-6fb5469cf5", UID:"40a45895-1dcf-45f7-a413-5594ec6dfeae", APIVersion:"apps/v1", ResourceVersion:"442", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0531 19:42:25.926273       1 replica_set.go:450] Sync "kubernetes-dashboard/dashboard-metrics-scraper-6b84985989" failed with pods "dashboard-metrics-scraper-6b84985989-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0531 19:42:25.926443       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-6b84985989", UID:"9c398431-17d0-4314-8e73-409c72e6fd2f", APIVersion:"apps/v1", ResourceVersion:"435", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "dashboard-metrics-scraper-6b84985989-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0531 19:42:26.334974       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-6b84985989", UID:"9c398431-17d0-4314-8e73-409c72e6fd2f", APIVersion:"apps/v1", ResourceVersion:"435", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: dashboard-metrics-scraper-6b84985989-cs5v7

	I0531 19:42:27.125010       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-6fb5469cf5", UID:"40a45895-1dcf-45f7-a413-5594ec6dfeae", APIVersion:"apps/v1", ResourceVersion:"442", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kubernetes-dashboard-6fb5469cf5-spl8w

	E0531 19:42:45.384462       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	W0531 19:42:47.140581       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E0531 19:43:15.637500       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	W0531 19:43:19.143177       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E0531 19:43:45.891581       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	W0531 19:43:51.148696       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E0531 19:44:16.143760       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	* 

	* ==> kube-proxy [49b44baa515c] <==

	* W0531 19:42:19.444246       1 proxier.go:584] Failed to read file /lib/modules/5.10.102.1-microsoft-standard-WSL2/modules.builtin with error open /lib/modules/5.10.102.1-microsoft-standard-WSL2/modules.builtin: no such file or directory. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules

	W0531 19:42:19.446817       1 proxier.go:597] Failed to load kernel module ip_vs with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules

	W0531 19:42:19.448464       1 proxier.go:597] Failed to load kernel module ip_vs_rr with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules

	W0531 19:42:19.450411       1 proxier.go:597] Failed to load kernel module ip_vs_wrr with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules

	W0531 19:42:19.452862       1 proxier.go:597] Failed to load kernel module ip_vs_sh with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules

	W0531 19:42:19.455345       1 proxier.go:597] Failed to load kernel module nf_conntrack with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules

	W0531 19:42:19.467121       1 server_others.go:329] Flag proxy-mode="" unknown, assuming iptables proxy

	I0531 19:42:19.544240       1 node.go:135] Successfully retrieved node IP: 192.168.76.2

	I0531 19:42:19.544403       1 server_others.go:149] Using iptables Proxier.

	I0531 19:42:19.546875       1 server.go:529] Version: v1.16.0

	I0531 19:42:19.549594       1 config.go:313] Starting service config controller

	I0531 19:42:19.549892       1 shared_informer.go:197] Waiting for caches to sync for service config

	I0531 19:42:19.550030       1 config.go:131] Starting endpoints config controller

	I0531 19:42:19.550059       1 shared_informer.go:197] Waiting for caches to sync for endpoints config

	I0531 19:42:19.719990       1 shared_informer.go:204] Caches are synced for service config 

	I0531 19:42:19.720004       1 shared_informer.go:204] Caches are synced for endpoints config 

	* 

	* ==> kube-scheduler [2e7bf308b908] <==

	* E0531 19:41:54.325388       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0531 19:41:54.325504       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0531 19:41:54.325639       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0531 19:41:54.329115       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0531 19:41:54.329869       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0531 19:41:54.330888       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0531 19:41:54.330887       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0531 19:41:54.332887       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0531 19:41:54.332892       1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0531 19:41:55.329102       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0531 19:41:55.332862       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0531 19:41:55.332977       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0531 19:41:55.334522       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0531 19:41:55.334630       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0531 19:41:55.423075       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0531 19:41:55.423889       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0531 19:41:55.425687       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0531 19:41:55.425758       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0531 19:41:55.431862       1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0531 19:41:55.432247       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0531 19:41:56.333544       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0531 19:41:56.336222       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0531 19:41:56.338066       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0531 19:41:56.342236       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0531 19:41:56.342315       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	* 

	* ==> kubelet <==

	* -- Logs begin at Tue 2022-05-31 19:35:55 UTC, end at Tue 2022-05-31 19:44:19 UTC. --

	May 31 19:43:11 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:11.271608    5553 kuberuntime_image.go:50] Pull image "fake.domain/k8s.gcr.io/echoserver:1.4" failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host

	May 31 19:43:11 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:11.271930    5553 kuberuntime_manager.go:783] container start failed: ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host

	May 31 19:43:11 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:11.272001    5553 pod_workers.go:191] Error syncing pod c248957e-7215-4044-9e73-acc8998b61f1 ("metrics-server-6f89b5864b-v8mjx_kube-system(c248957e-7215-4044-9e73-acc8998b61f1)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:43:11 old-k8s-version-20220531192531-2108 kubelet[5553]: W0531 19:43:11.623208    5553 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/kubernetes-dashboard-6fb5469cf5-spl8w through plugin: invalid network status for

	May 31 19:43:12 old-k8s-version-20220531192531-2108 kubelet[5553]: W0531 19:43:12.849219    5553 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/kubernetes-dashboard-6fb5469cf5-spl8w through plugin: invalid network status for

	May 31 19:43:21 old-k8s-version-20220531192531-2108 kubelet[5553]: W0531 19:43:21.993681    5553 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-6b84985989-cs5v7 through plugin: invalid network status for

	May 31 19:43:23 old-k8s-version-20220531192531-2108 kubelet[5553]: W0531 19:43:23.275984    5553 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-6b84985989-cs5v7 through plugin: invalid network status for

	May 31 19:43:23 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:23.290492    5553 pod_workers.go:191] Error syncing pod 82fa1259-4596-4392-9f56-571eafe449d1 ("dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"

	May 31 19:43:24 old-k8s-version-20220531192531-2108 kubelet[5553]: W0531 19:43:24.306814    5553 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-6b84985989-cs5v7 through plugin: invalid network status for

	May 31 19:43:25 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:25.560752    5553 pod_workers.go:191] Error syncing pod c248957e-7215-4044-9e73-acc8998b61f1 ("metrics-server-6f89b5864b-v8mjx_kube-system(c248957e-7215-4044-9e73-acc8998b61f1)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/k8s.gcr.io/echoserver:1.4\""

	May 31 19:43:29 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:29.445512    5553 pod_workers.go:191] Error syncing pod 82fa1259-4596-4392-9f56-571eafe449d1 ("dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"

	May 31 19:43:39 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:39.662275    5553 remote_image.go:113] PullImage "fake.domain/k8s.gcr.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host

	May 31 19:43:39 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:39.662417    5553 kuberuntime_image.go:50] Pull image "fake.domain/k8s.gcr.io/echoserver:1.4" failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host

	May 31 19:43:39 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:39.662599    5553 kuberuntime_manager.go:783] container start failed: ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host

	May 31 19:43:39 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:39.662670    5553 pod_workers.go:191] Error syncing pod c248957e-7215-4044-9e73-acc8998b61f1 ("metrics-server-6f89b5864b-v8mjx_kube-system(c248957e-7215-4044-9e73-acc8998b61f1)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:43:42 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:42.551936    5553 pod_workers.go:191] Error syncing pod 82fa1259-4596-4392-9f56-571eafe449d1 ("dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"

	May 31 19:43:51 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:51.568837    5553 pod_workers.go:191] Error syncing pod c248957e-7215-4044-9e73-acc8998b61f1 ("metrics-server-6f89b5864b-v8mjx_kube-system(c248957e-7215-4044-9e73-acc8998b61f1)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/k8s.gcr.io/echoserver:1.4\""

	May 31 19:43:54 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:54.552084    5553 pod_workers.go:191] Error syncing pod 82fa1259-4596-4392-9f56-571eafe449d1 ("dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"

	May 31 19:44:06 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:44:06.557836    5553 pod_workers.go:191] Error syncing pod c248957e-7215-4044-9e73-acc8998b61f1 ("metrics-server-6f89b5864b-v8mjx_kube-system(c248957e-7215-4044-9e73-acc8998b61f1)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/k8s.gcr.io/echoserver:1.4\""

	May 31 19:44:08 old-k8s-version-20220531192531-2108 kubelet[5553]: W0531 19:44:08.934232    5553 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-6b84985989-cs5v7 through plugin: invalid network status for

	May 31 19:44:09 old-k8s-version-20220531192531-2108 kubelet[5553]: W0531 19:44:09.402928    5553 container.go:409] Failed to create summary reader for "/kubepods/besteffort/pod82fa1259-4596-4392-9f56-571eafe449d1/d9bab4566384602eebba16adb5527bbde86b9377f00da7d2e1af2ddc1ea2b2a8": none of the resources are being tracked.

	May 31 19:44:10 old-k8s-version-20220531192531-2108 kubelet[5553]: W0531 19:44:10.250330    5553 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-6b84985989-cs5v7 through plugin: invalid network status for

	May 31 19:44:10 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:44:10.268374    5553 pod_workers.go:191] Error syncing pod 82fa1259-4596-4392-9f56-571eafe449d1 ("dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"

	May 31 19:44:11 old-k8s-version-20220531192531-2108 kubelet[5553]: W0531 19:44:11.282563    5553 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-6b84985989-cs5v7 through plugin: invalid network status for

	May 31 19:44:19 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:44:19.443677    5553 pod_workers.go:191] Error syncing pod 82fa1259-4596-4392-9f56-571eafe449d1 ("dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"

	* 

	* ==> kubernetes-dashboard [8c65f8873799] <==

	* 2022/05/31 19:43:11 Starting overwatch

	2022/05/31 19:43:11 Using namespace: kubernetes-dashboard

	2022/05/31 19:43:11 Using in-cluster config to connect to apiserver

	2022/05/31 19:43:11 Using secret token for csrf signing

	2022/05/31 19:43:11 Initializing csrf token from kubernetes-dashboard-csrf secret

	2022/05/31 19:43:11 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf

	2022/05/31 19:43:11 Successful initial request to the apiserver, version: v1.16.0

	2022/05/31 19:43:11 Generating JWE encryption key

	2022/05/31 19:43:11 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting

	2022/05/31 19:43:11 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard

	2022/05/31 19:43:12 Initializing JWE encryption key from synchronized object

	2022/05/31 19:43:12 Creating in-cluster Sidecar client

	2022/05/31 19:43:12 Serving insecurely on HTTP port: 9090

	2022/05/31 19:43:12 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2022/05/31 19:43:42 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2022/05/31 19:44:12 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	* 

	* ==> storage-provisioner [78333097362e] <==

	* I0531 19:42:26.537283       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0531 19:42:26.627656       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0531 19:42:26.628194       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0531 19:42:26.726417       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0531 19:42:26.728128       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-20220531192531-2108_dedac804-a1e6-404e-a773-fabda9042592!

	I0531 19:42:26.729441       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"9faff84a-d94b-40cf-9dbc-713d9688f4e4", APIVersion:"v1", ResourceVersion:"474", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-20220531192531-2108_dedac804-a1e6-404e-a773-fabda9042592 became leader

	I0531 19:42:26.931160       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-20220531192531-2108_dedac804-a1e6-404e-a773-fabda9042592!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.APIServer}} -p old-k8s-version-20220531192531-2108 -n old-k8s-version-20220531192531-2108

helpers_test.go:254: (dbg) Done: out/minikube-windows-amd64.exe status --format={{.APIServer}} -p old-k8s-version-20220531192531-2108 -n old-k8s-version-20220531192531-2108: (10.7140405s)

helpers_test.go:261: (dbg) Run:  kubectl --context old-k8s-version-20220531192531-2108 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:270: non-running pods: metrics-server-6f89b5864b-v8mjx

helpers_test.go:272: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/Pause]: describe non-running pods <======

helpers_test.go:275: (dbg) Run:  kubectl --context old-k8s-version-20220531192531-2108 describe pod metrics-server-6f89b5864b-v8mjx

helpers_test.go:275: (dbg) Non-zero exit: kubectl --context old-k8s-version-20220531192531-2108 describe pod metrics-server-6f89b5864b-v8mjx: exit status 1 (338.8752ms)

** stderr ** 

	Error from server (NotFound): pods "metrics-server-6f89b5864b-v8mjx" not found

** /stderr **

helpers_test.go:277: kubectl --context old-k8s-version-20220531192531-2108 describe pod metrics-server-6f89b5864b-v8mjx: exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/Pause]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect old-k8s-version-20220531192531-2108

helpers_test.go:231: (dbg) Done: docker inspect old-k8s-version-20220531192531-2108: (1.379114s)

helpers_test.go:235: (dbg) docker inspect old-k8s-version-20220531192531-2108:

-- stdout --

	[

	    {

	        "Id": "73d9dd1c979f96bb5332755b3731cd7b8a50346468819b2bc362eb6e60c2bebe",

	        "Created": "2022-05-31T19:32:10.7783868Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 209389,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2022-05-31T19:35:54.7458106Z",

	            "FinishedAt": "2022-05-31T19:35:32.9751099Z"

	        },

	        "Image": "sha256:aedbaa58534633065a66af6f01ba15f6c7dc1b8a285b6938f9d04325ceab9ed4",

	        "ResolvConfPath": "/var/lib/docker/containers/73d9dd1c979f96bb5332755b3731cd7b8a50346468819b2bc362eb6e60c2bebe/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/73d9dd1c979f96bb5332755b3731cd7b8a50346468819b2bc362eb6e60c2bebe/hostname",

	        "HostsPath": "/var/lib/docker/containers/73d9dd1c979f96bb5332755b3731cd7b8a50346468819b2bc362eb6e60c2bebe/hosts",

	        "LogPath": "/var/lib/docker/containers/73d9dd1c979f96bb5332755b3731cd7b8a50346468819b2bc362eb6e60c2bebe/73d9dd1c979f96bb5332755b3731cd7b8a50346468819b2bc362eb6e60c2bebe-json.log",

	        "Name": "/old-k8s-version-20220531192531-2108",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "old-k8s-version-20220531192531-2108:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "old-k8s-version-20220531192531-2108",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "0"

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 2306867200,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 2306867200,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/62b6f32bd3ed97def9fa39268e79cead11ff11a89372be02429bef84bcf65810-init/diff:/var/lib/docker/overlay2/42ebd8012a176a6c9bc83a2b81ffb1eb5c8e01d5410cb5d59346522bbaddf2cc/diff:/var/lib/docker/overlay2/59dce173ea661e9679f479af711a101ab0e97afb60abfd3c5b7a199b5c3e2b3b/diff:/var/lib/docker/overlay2/0328b60a223ca9f8bab93e6b86106d8b64d16fa559a56e88abbdee372b3b6a70/diff:/var/lib/docker/overlay2/b781f2620a052ee02138337819bde18c09122be2f20b7cfefaf7688f18d0c559/diff:/var/lib/docker/overlay2/af966c145b90b1748180b9ffcb1521d6fa9914e1d0ca582b239123591ffd1527/diff:/var/lib/docker/overlay2/5cd2b511f6f3bc93855ed77b5510ca4c67426eea433ccda53ea8e864342a413e/diff:/var/lib/docker/overlay2/f896d291d0c004470c3e38ea0d3be8e2b2a48ea36d45662c40fe3e105cbf4dec/diff:/var/lib/docker/overlay2/9e8994dcf5b1692245d5e40982d040298bfa7f7977892cf4be8ba3697f2c1283/diff:/var/lib/docker/overlay2/a7da4130c1b629e2a737b34701c6d4dfe6c48f92771856a887e06a1edc5456f8/diff:/var/lib/docker/overlay2/4c2573

4b9c8459489256b5f70dbb446897b9510d1cf9187e903f845ffa2a7ec2/diff:/var/lib/docker/overlay2/5c6cef49a0d0d1a36777fa7e0955ecdffb41ce354b7984f232e9cd51916416f7/diff:/var/lib/docker/overlay2/b79c799ed97edb702ed4c4ccb55ef9c645ae162e30e8f297ca5dd1152c29de41/diff:/var/lib/docker/overlay2/c84b7bc7c79ffdedf2d1265e21eec011dc3215811fb0569f7eb7d6b9aec884e8/diff:/var/lib/docker/overlay2/df8e2c3af362fd04ee17cb8d67105cf489427b2ae7cec77b79a2778e6c8c0234/diff:/var/lib/docker/overlay2/e56e356f8425868b31ada978267de73f074f211985ff1849ece7ab8341c33bae/diff:/var/lib/docker/overlay2/82c032066e83d3297742c83dd29132974e9db73a0b0b0a8edd3bcbbdb29cd53c/diff:/var/lib/docker/overlay2/15532131f3e6d0b2faf705733b06ae0c869147f2ca9592e3a80b6eaadad23544/diff:/var/lib/docker/overlay2/73fa456f504732f46cbe49368167247ca47b3099a6a75a7023ba16e7f598aee5/diff:/var/lib/docker/overlay2/e5635e020aadcc8dd1e5e3cd2eaa45cb97147f47bf406211fc61d7cbfc531193/diff:/var/lib/docker/overlay2/40b76b3249d3f7a8a737e2db80ebc1ed3b76d59724641217e8aae414ad832781/diff:/var/lib/d

ocker/overlay2/50ea2ce78d4fe52f626b2755a14f71a3c4f9b5a4f929646d9200876bdb1652c1/diff:/var/lib/docker/overlay2/d0a6e94d1f4aa73824d39c6e655bc4bdcd6568cea821b5d0f71174591c9cbbb3/diff:/var/lib/docker/overlay2/20c8fbe37a8c89a03b7bffe8cbc507e888cd5886f86f43b551d6a09fee1ce5e7/diff:/var/lib/docker/overlay2/48942b31cfe24e44c65a8be1785cd90488444f8c420a79b72a123034b01dd3f8/diff:/var/lib/docker/overlay2/c90124ab97e02facd949bfbd45815d6d73a40303b47ba4a4bc035788f5ee2dc3/diff:/var/lib/docker/overlay2/38c82aeabee1c8f46551413ecabb24f2f22680bb623f79e40c751558747a03f5/diff:/var/lib/docker/overlay2/4fa8894d1c1d773bc2e0511f273eab03fb7b8be7489eab5cd3eb57cc0d12e855/diff:/var/lib/docker/overlay2/23319fcddb47e50928e2044bac662de8153728f3a2eefa9c6ad5a5f413efec88/diff:/var/lib/docker/overlay2/b7ecd073b5b747c21ecbd1ca61887899f7e227fac3e383e24f868549b7929d74/diff:/var/lib/docker/overlay2/29a5674b4bbabfd07c4ce0b2a8b84ce98af380bf984043a4a9a6cd0743e4630c/diff:/var/lib/docker/overlay2/86a10266979ed72dc4372ade724e64741de35702626642ba60a15cca143

3682e/diff:/var/lib/docker/overlay2/03a1af7f82f1cb2b6eadbd1f13c8e9f6ca281ef3a8968d6aa45d284f286aefca/diff:/var/lib/docker/overlay2/f36cce4566278d24128326f8ef6ea446884c0c6941ccdb763ddf936e178afbff/diff:/var/lib/docker/overlay2/e54a2a61ba3597af53ec65a822821ffca97788e4b1dbfeedf98bf4d12e78973d/diff:/var/lib/docker/overlay2/dd54a25b898b0d7952f0bcb99a0450ee3d6b4269599e9355b4ae5e0c540c2caa/diff:/var/lib/docker/overlay2/ae6c1d1e9e79e03382217f21886420e3118a3f18f7c44f76c19262a84a43e219/diff:/var/lib/docker/overlay2/82faa00f86c1fa99063466464f71cdd6d510aa3e45c6c43301b2119b5bd5285a/diff:/var/lib/docker/overlay2/9f54999972b485642f042b9ed4d00316be0a1d35c060e619aca79b1583180446/diff:/var/lib/docker/overlay2/b467240c20564ba44d0946c716cf18ab5be973b43b02c37ee3ddd8f94502f41b/diff:/var/lib/docker/overlay2/21217d4ff1c5cf81dd53cfd831e0961189fb9f86812e1f53843f0022383345e6/diff",

	                "MergedDir": "/var/lib/docker/overlay2/62b6f32bd3ed97def9fa39268e79cead11ff11a89372be02429bef84bcf65810/merged",

	                "UpperDir": "/var/lib/docker/overlay2/62b6f32bd3ed97def9fa39268e79cead11ff11a89372be02429bef84bcf65810/diff",

	                "WorkDir": "/var/lib/docker/overlay2/62b6f32bd3ed97def9fa39268e79cead11ff11a89372be02429bef84bcf65810/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "old-k8s-version-20220531192531-2108",

	                "Source": "/var/lib/docker/volumes/old-k8s-version-20220531192531-2108/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "old-k8s-version-20220531192531-2108",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "old-k8s-version-20220531192531-2108",

	                "name.minikube.sigs.k8s.io": "old-k8s-version-20220531192531-2108",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "9d19ad06dc07a20673d48b61192d7c0e0905e29621856aeb09b8f9b0410f62d1",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "54198"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "54199"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "54200"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "54201"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "54202"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/9d19ad06dc07",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "old-k8s-version-20220531192531-2108": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.76.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "73d9dd1c979f",

	                        "old-k8s-version-20220531192531-2108"

	                    ],

	                    "NetworkID": "ee4a2a412a92078b653cbcaf1d57d8604149789ff8c7d75dfb2ed03e6ea10fc2",

	                    "EndpointID": "4270c98919ae2493bf9ef2d067f5322982869ac9e0583f0317a4898c720e0680",

	                    "Gateway": "192.168.76.1",

	                    "IPAddress": "192.168.76.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:4c:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.Host}} -p old-k8s-version-20220531192531-2108 -n old-k8s-version-20220531192531-2108

=== CONT  TestStartStop/group/old-k8s-version/serial/Pause

helpers_test.go:239: (dbg) Done: out/minikube-windows-amd64.exe status --format={{.Host}} -p old-k8s-version-20220531192531-2108 -n old-k8s-version-20220531192531-2108: (8.3383137s)

helpers_test.go:244: <<< TestStartStop/group/old-k8s-version/serial/Pause FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestStartStop/group/old-k8s-version/serial/Pause]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-windows-amd64.exe -p old-k8s-version-20220531192531-2108 logs -n 25

E0531 19:44:43.346320    2108 cert_rotation.go:168] key failed with : open C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\no-preload-20220531192611-2108\client.crt: The system cannot find the path specified.

=== CONT  TestStartStop/group/old-k8s-version/serial/Pause

helpers_test.go:247: (dbg) Done: out/minikube-windows-amd64.exe -p old-k8s-version-20220531192531-2108 logs -n 25: (8.6893321s)

helpers_test.go:252: TestStartStop/group/old-k8s-version/serial/Pause logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|------------------------------------------------------------|------------------------------------------------|-------------------|----------------|---------------------|---------------------|

	| Command |                            Args                            |                    Profile                     |       User        |    Version     |     Start Time      |      End Time       |

	|---------|------------------------------------------------------------|------------------------------------------------|-------------------|----------------|---------------------|---------------------|

	| start   | -p                                                         | default-k8s-different-port-20220531193451-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:34 GMT | 31 May 22 19:37 GMT |

	|         | default-k8s-different-port-20220531193451-2108             |                                                |                   |                |                     |                     |

	|         | --memory=2200 --alsologtostderr --wait=true                |                                                |                   |                |                     |                     |

	|         | --apiserver-port=8444 --driver=docker                      |                                                |                   |                |                     |                     |

	|         | --kubernetes-version=v1.23.6                               |                                                |                   |                |                     |                     |

	| addons  | enable metrics-server -p                                   | default-k8s-different-port-20220531193451-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:37 GMT | 31 May 22 19:37 GMT |

	|         | default-k8s-different-port-20220531193451-2108             |                                                |                   |                |                     |                     |

	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |                                                |                   |                |                     |                     |

	|         | --registries=MetricsServer=fake.domain                     |                                                |                   |                |                     |                     |

	| ssh     | -p                                                         | no-preload-20220531192611-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:37 GMT | 31 May 22 19:37 GMT |

	|         | no-preload-20220531192611-2108                             |                                                |                   |                |                     |                     |

	|         | sudo crictl images -o json                                 |                                                |                   |                |                     |                     |

	| pause   | -p                                                         | no-preload-20220531192611-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:37 GMT | 31 May 22 19:37 GMT |

	|         | no-preload-20220531192611-2108                             |                                                |                   |                |                     |                     |

	|         | --alsologtostderr -v=1                                     |                                                |                   |                |                     |                     |

	| stop    | -p                                                         | default-k8s-different-port-20220531193451-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:37 GMT | 31 May 22 19:37 GMT |

	|         | default-k8s-different-port-20220531193451-2108             |                                                |                   |                |                     |                     |

	|         | --alsologtostderr -v=3                                     |                                                |                   |                |                     |                     |

	| addons  | enable dashboard -p                                        | default-k8s-different-port-20220531193451-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:37 GMT | 31 May 22 19:37 GMT |

	|         | default-k8s-different-port-20220531193451-2108             |                                                |                   |                |                     |                     |

	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |                                                |                   |                |                     |                     |

	| unpause | -p                                                         | no-preload-20220531192611-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:37 GMT | 31 May 22 19:37 GMT |

	|         | no-preload-20220531192611-2108                             |                                                |                   |                |                     |                     |

	|         | --alsologtostderr -v=1                                     |                                                |                   |                |                     |                     |

	| delete  | -p                                                         | no-preload-20220531192611-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:38 GMT | 31 May 22 19:38 GMT |

	|         | no-preload-20220531192611-2108                             |                                                |                   |                |                     |                     |

	| delete  | -p                                                         | no-preload-20220531192611-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:38 GMT | 31 May 22 19:38 GMT |

	|         | no-preload-20220531192611-2108                             |                                                |                   |                |                     |                     |

	| start   | -p newest-cni-20220531193849-2108 --memory=2200            | newest-cni-20220531193849-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:38 GMT | 31 May 22 19:41 GMT |

	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |                                                |                   |                |                     |                     |

	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |                                                |                   |                |                     |                     |

	|         | --extra-config=kubelet.network-plugin=cni                  |                                                |                   |                |                     |                     |

	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |                                                |                   |                |                     |                     |

	|         | --driver=docker --kubernetes-version=v1.23.6               |                                                |                   |                |                     |                     |

	| addons  | enable metrics-server -p                                   | newest-cni-20220531193849-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:41 GMT | 31 May 22 19:41 GMT |

	|         | newest-cni-20220531193849-2108                             |                                                |                   |                |                     |                     |

	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |                                                |                   |                |                     |                     |

	|         | --registries=MetricsServer=fake.domain                     |                                                |                   |                |                     |                     |

	| stop    | -p                                                         | newest-cni-20220531193849-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:41 GMT | 31 May 22 19:41 GMT |

	|         | newest-cni-20220531193849-2108                             |                                                |                   |                |                     |                     |

	|         | --alsologtostderr -v=3                                     |                                                |                   |                |                     |                     |

	| addons  | enable dashboard -p                                        | newest-cni-20220531193849-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:41 GMT | 31 May 22 19:41 GMT |

	|         | newest-cni-20220531193849-2108                             |                                                |                   |                |                     |                     |

	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |                                                |                   |                |                     |                     |

	| start   | -p                                                         | embed-certs-20220531193346-2108                | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:33 GMT | 31 May 22 19:42 GMT |

	|         | embed-certs-20220531193346-2108                            |                                                |                   |                |                     |                     |

	|         | --memory=2200 --alsologtostderr                            |                                                |                   |                |                     |                     |

	|         | --wait=true --embed-certs                                  |                                                |                   |                |                     |                     |

	|         | --driver=docker                                            |                                                |                   |                |                     |                     |

	|         | --kubernetes-version=v1.23.6                               |                                                |                   |                |                     |                     |

	| addons  | enable metrics-server -p                                   | embed-certs-20220531193346-2108                | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:42 GMT | 31 May 22 19:42 GMT |

	|         | embed-certs-20220531193346-2108                            |                                                |                   |                |                     |                     |

	|         | --images=MetricsServer=k8s.gcr.io/echoserver:1.4           |                                                |                   |                |                     |                     |

	|         | --registries=MetricsServer=fake.domain                     |                                                |                   |                |                     |                     |

	| stop    | -p                                                         | embed-certs-20220531193346-2108                | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:42 GMT | 31 May 22 19:42 GMT |

	|         | embed-certs-20220531193346-2108                            |                                                |                   |                |                     |                     |

	|         | --alsologtostderr -v=3                                     |                                                |                   |                |                     |                     |

	| addons  | enable dashboard -p                                        | embed-certs-20220531193346-2108                | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:42 GMT | 31 May 22 19:42 GMT |

	|         | embed-certs-20220531193346-2108                            |                                                |                   |                |                     |                     |

	|         | --images=MetricsScraper=k8s.gcr.io/echoserver:1.4          |                                                |                   |                |                     |                     |

	| start   | -p newest-cni-20220531193849-2108 --memory=2200            | newest-cni-20220531193849-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:41 GMT | 31 May 22 19:43 GMT |

	|         | --alsologtostderr --wait=apiserver,system_pods,default_sa  |                                                |                   |                |                     |                     |

	|         | --feature-gates ServerSideApply=true --network-plugin=cni  |                                                |                   |                |                     |                     |

	|         | --extra-config=kubelet.network-plugin=cni                  |                                                |                   |                |                     |                     |

	|         | --extra-config=kubeadm.pod-network-cidr=192.168.111.111/16 |                                                |                   |                |                     |                     |

	|         | --driver=docker --kubernetes-version=v1.23.6               |                                                |                   |                |                     |                     |

	| ssh     | -p                                                         | newest-cni-20220531193849-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:43 GMT | 31 May 22 19:43 GMT |

	|         | newest-cni-20220531193849-2108                             |                                                |                   |                |                     |                     |

	|         | sudo crictl images -o json                                 |                                                |                   |                |                     |                     |

	| start   | -p                                                         | old-k8s-version-20220531192531-2108            | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:35 GMT | 31 May 22 19:43 GMT |

	|         | old-k8s-version-20220531192531-2108                        |                                                |                   |                |                     |                     |

	|         | --memory=2200 --alsologtostderr                            |                                                |                   |                |                     |                     |

	|         | --wait=true --kvm-network=default                          |                                                |                   |                |                     |                     |

	|         | --kvm-qemu-uri=qemu:///system                              |                                                |                   |                |                     |                     |

	|         | --disable-driver-mounts                                    |                                                |                   |                |                     |                     |

	|         | --keep-context=false                                       |                                                |                   |                |                     |                     |

	|         | --driver=docker                                            |                                                |                   |                |                     |                     |

	|         | --kubernetes-version=v1.16.0                               |                                                |                   |                |                     |                     |

	| pause   | -p                                                         | newest-cni-20220531193849-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:43 GMT | 31 May 22 19:43 GMT |

	|         | newest-cni-20220531193849-2108                             |                                                |                   |                |                     |                     |

	|         | --alsologtostderr -v=1                                     |                                                |                   |                |                     |                     |

	| ssh     | -p                                                         | old-k8s-version-20220531192531-2108            | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:43 GMT | 31 May 22 19:43 GMT |

	|         | old-k8s-version-20220531192531-2108                        |                                                |                   |                |                     |                     |

	|         | sudo crictl images -o json                                 |                                                |                   |                |                     |                     |

	| unpause | -p                                                         | newest-cni-20220531193849-2108                 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:43 GMT | 31 May 22 19:43 GMT |

	|         | newest-cni-20220531193849-2108                             |                                                |                   |                |                     |                     |

	|         | --alsologtostderr -v=1                                     |                                                |                   |                |                     |                     |

	| logs    | old-k8s-version-20220531192531-2108                        | old-k8s-version-20220531192531-2108            | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:44 GMT | 31 May 22 19:44 GMT |

	|         | logs -n 25                                                 |                                                |                   |                |                     |                     |

	| start   | -p                                                         | default-k8s-different-port-20220531193451-2108 | minikube7\jenkins | v1.26.0-beta.1 | 31 May 22 19:37 GMT | 31 May 22 19:44 GMT |

	|         | default-k8s-different-port-20220531193451-2108             |                                                |                   |                |                     |                     |

	|         | --memory=2200 --alsologtostderr --wait=true                |                                                |                   |                |                     |                     |

	|         | --apiserver-port=8444 --driver=docker                      |                                                |                   |                |                     |                     |

	|         | --kubernetes-version=v1.23.6                               |                                                |                   |                |                     |                     |

	|---------|------------------------------------------------------------|------------------------------------------------|-------------------|----------------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2022/05/31 19:42:50

	Running on machine: minikube7

	Binary: Built with gc go1.18.2 for windows/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0531 19:42:50.127342    8616 out.go:296] Setting OutFile to fd 2016 ...

	I0531 19:42:50.216255    8616 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0531 19:42:50.216255    8616 out.go:309] Setting ErrFile to fd 712...

	I0531 19:42:50.216255    8616 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0531 19:42:50.238305    8616 out.go:303] Setting JSON to false

	I0531 19:42:50.243280    8616 start.go:115] hostinfo: {"hostname":"minikube7","uptime":84440,"bootTime":1653941730,"procs":156,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19044 Build 19044","kernelVersion":"10.0.19044 Build 19044","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f66ed2ea-6c04-4a6b-8eea-b2fb0953e990"}

	W0531 19:42:50.243280    8616 start.go:123] gopshost.Virtualization returned error: not implemented yet

	I0531 19:42:50.247300    8616 out.go:177] * [embed-certs-20220531193346-2108] minikube v1.26.0-beta.1 on Microsoft Windows 10 Enterprise N 10.0.19044 Build 19044

	I0531 19:42:50.251277    8616 notify.go:193] Checking for updates...

	I0531 19:42:50.254277    8616 out.go:177]   - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I0531 19:42:50.257263    8616 out.go:177]   - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	I0531 19:42:50.259281    8616 out.go:177]   - MINIKUBE_LOCATION=14079

	I0531 19:42:50.262281    8616 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0531 19:42:46.136944    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:46.155664    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:42:46.155664    7556 api_server.go:102] status: https://127.0.0.1:54458/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:42:46.638060    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:46.725795    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:42:46.725795    7556 api_server.go:102] status: https://127.0.0.1:54458/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:42:47.143046    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:47.242770    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:42:47.242770    7556 api_server.go:102] status: https://127.0.0.1:54458/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:42:47.638251    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:47.830869    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:42:47.831617    7556 api_server.go:102] status: https://127.0.0.1:54458/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:42:48.140734    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:48.245672    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:42:48.245672    7556 api_server.go:102] status: https://127.0.0.1:54458/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:42:48.641307    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:48.733322    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:42:48.733322    7556 api_server.go:102] status: https://127.0.0.1:54458/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:42:49.147453    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:49.240676    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:42:49.240676    7556 api_server.go:102] status: https://127.0.0.1:54458/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:42:49.648266    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:49.743281    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:42:49.743281    7556 api_server.go:102] status: https://127.0.0.1:54458/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:42:50.146279    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:50.240267    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 200:

	ok

	I0531 19:42:50.325883    7556 api_server.go:140] control plane version: v1.23.6

	I0531 19:42:50.325883    7556 api_server.go:130] duration metric: took 12.194093s to wait for apiserver health ...

	I0531 19:42:50.325883    7556 cni.go:95] Creating CNI manager for ""

	I0531 19:42:50.325883    7556 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0531 19:42:50.325883    7556 system_pods.go:43] waiting for kube-system pods to appear ...

	I0531 19:42:50.433899    7556 system_pods.go:59] 8 kube-system pods found

	I0531 19:42:50.433899    7556 system_pods.go:61] "coredns-64897985d-qpzx5" [801bd65d-655d-451b-a3ff-79295aaeaf09] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I0531 19:42:50.433899    7556 system_pods.go:61] "etcd-newest-cni-20220531193849-2108" [663ce3bf-8420-4d38-a012-54abf228ce78] Running

	I0531 19:42:50.433899    7556 system_pods.go:61] "kube-apiserver-newest-cni-20220531193849-2108" [e713d4e4-3356-41ac-b8af-52bf19d65052] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I0531 19:42:50.433899    7556 system_pods.go:61] "kube-controller-manager-newest-cni-20220531193849-2108" [fd22af45-85a2-484a-a239-0e45831e8df8] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0531 19:42:50.433899    7556 system_pods.go:61] "kube-proxy-mh9ct" [85823877-90a8-4ad0-b0ad-b4ed75f4845e] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])

	I0531 19:42:50.433899    7556 system_pods.go:61] "kube-scheduler-newest-cni-20220531193849-2108" [34deeb35-60bc-42b6-a91d-cedda9a76363] Running

	I0531 19:42:50.433899    7556 system_pods.go:61] "metrics-server-b955d9d8-rt44k" [d0c2b733-0fd1-4e34-88aa-d73b77704a89] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:42:50.433899    7556 system_pods.go:61] "storage-provisioner" [a104bd0d-cf9b-4dd3-b127-d3e84c4ae96b] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0531 19:42:50.433899    7556 system_pods.go:74] duration metric: took 108.0157ms to wait for pod list to return data ...

	I0531 19:42:50.433899    7556 node_conditions.go:102] verifying NodePressure condition ...

	I0531 19:42:50.538880    7556 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki

	I0531 19:42:50.538880    7556 node_conditions.go:123] node cpu capacity is 16

	I0531 19:42:50.538880    7556 node_conditions.go:105] duration metric: took 104.9809ms to run NodePressure ...

	I0531 19:42:50.538880    7556 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I0531 19:42:49.037358    1340 system_pods.go:86] 4 kube-system pods found

	I0531 19:42:49.037358    1340 system_pods.go:89] "coredns-5644d7b6d9-jxp72" [f831437f-5aa7-42cd-bb72-b1a20942f56a] Running

	I0531 19:42:49.037358    1340 system_pods.go:89] "kube-proxy-r556l" [86e67749-a177-45b6-8857-e4f6c55b8dd8] Running

	I0531 19:42:49.037358    1340 system_pods.go:89] "metrics-server-6f89b5864b-v8mjx" [c248957e-7215-4044-9e73-acc8998b61f1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:42:49.037358    1340 system_pods.go:89] "storage-provisioner" [8001c475-f873-4298-ad3e-ac9b8d56927b] Running

	I0531 19:42:49.037358    1340 retry.go:31] will retry after 6.402197611s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler

	I0531 19:42:52.545436    7556 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml": (2.0065467s)

	I0531 19:42:52.545436    7556 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0531 19:42:52.637427    7556 ops.go:34] apiserver oom_adj: -16

	I0531 19:42:52.637427    7556 kubeadm.go:630] restartCluster took 27.8311331s

	I0531 19:42:52.637427    7556 kubeadm.go:397] StartCluster complete in 27.9633793s

	I0531 19:42:52.637427    7556 settings.go:142] acquiring lock: {Name:mk2f48f1c2db86c45c5c20d13312e07e9c171d09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:42:52.638421    7556 settings.go:150] Updating kubeconfig:  C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I0531 19:42:52.642395    7556 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\kubeconfig: {Name:mk3b9816be6135fef42a073128e9ed356868417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:42:52.750403    7556 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "newest-cni-20220531193849-2108" rescaled to 1

	I0531 19:42:52.750403    7556 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.23.6 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0531 19:42:52.750403    7556 addons.go:415] enableAddons start: toEnable=map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true], additional=[]

	I0531 19:42:52.756465    7556 out.go:177] * Verifying Kubernetes components...

	I0531 19:42:52.750403    7556 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.6/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0531 19:42:52.750403    7556 addons.go:65] Setting storage-provisioner=true in profile "newest-cni-20220531193849-2108"

	I0531 19:42:52.750403    7556 addons.go:65] Setting metrics-server=true in profile "newest-cni-20220531193849-2108"

	I0531 19:42:52.750403    7556 addons.go:65] Setting default-storageclass=true in profile "newest-cni-20220531193849-2108"

	I0531 19:42:52.750403    7556 addons.go:65] Setting dashboard=true in profile "newest-cni-20220531193849-2108"

	I0531 19:42:52.751430    7556 config.go:178] Loaded profile config "newest-cni-20220531193849-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.6

	I0531 19:42:51.472496    9560 pod_ready.go:102] pod "metrics-server-b955d9d8-9rlw5" in "kube-system" namespace has status "Ready":"False"

	I0531 19:42:53.953088    9560 pod_ready.go:81] duration metric: took 4m0.1785878s waiting for pod "metrics-server-b955d9d8-9rlw5" in "kube-system" namespace to be "Ready" ...

	E0531 19:42:53.953088    9560 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting 4m0s for pod "metrics-server-b955d9d8-9rlw5" in "kube-system" namespace to be "Ready" (will not retry!)

	I0531 19:42:53.953088    9560 pod_ready.go:38] duration metric: took 4m5.5039717s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0531 19:42:53.953088    9560 kubeadm.go:630] restartCluster took 4m28.9618863s

	W0531 19:42:53.953731    9560 out.go:239] ! Unable to restart cluster, will reset it: extra: timed out waiting 4m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"

	I0531 19:42:53.953731    9560 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force"

	I0531 19:42:52.756465    7556 addons.go:153] Setting addon storage-provisioner=true in "newest-cni-20220531193849-2108"

	W0531 19:42:52.759410    7556 addons.go:165] addon storage-provisioner should already be in state true

	I0531 19:42:52.756465    7556 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "newest-cni-20220531193849-2108"

	I0531 19:42:52.760420    7556 host.go:66] Checking if "newest-cni-20220531193849-2108" exists ...

	I0531 19:42:52.756465    7556 addons.go:153] Setting addon metrics-server=true in "newest-cni-20220531193849-2108"

	W0531 19:42:52.760420    7556 addons.go:165] addon metrics-server should already be in state true

	I0531 19:42:52.756465    7556 addons.go:153] Setting addon dashboard=true in "newest-cni-20220531193849-2108"

	W0531 19:42:52.760420    7556 addons.go:165] addon dashboard should already be in state true

	I0531 19:42:52.760420    7556 host.go:66] Checking if "newest-cni-20220531193849-2108" exists ...

	I0531 19:42:52.760420    7556 host.go:66] Checking if "newest-cni-20220531193849-2108" exists ...

	I0531 19:42:52.787289    7556 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0531 19:42:52.798232    7556 cli_runner.go:164] Run: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}

	I0531 19:42:52.802209    7556 cli_runner.go:164] Run: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}

	I0531 19:42:52.803210    7556 cli_runner.go:164] Run: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}

	I0531 19:42:52.807213    7556 cli_runner.go:164] Run: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}

	I0531 19:42:53.346951    7556 start.go:786] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I0531 19:42:53.362835    7556 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108

	I0531 19:42:54.408200    7556 cli_runner.go:217] Completed: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}: (1.6099613s)

	I0531 19:42:54.435301    7556 cli_runner.go:217] Completed: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}: (1.6330855s)

	I0531 19:42:54.439314    7556 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0531 19:42:54.442291    7556 addons.go:348] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0531 19:42:54.442291    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0531 19:42:54.446291    7556 cli_runner.go:217] Completed: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}: (1.6430744s)

	I0531 19:42:54.451275    7556 out.go:177]   - Using image kubernetesui/dashboard:v2.5.1

	I0531 19:42:54.454298    7556 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4

	I0531 19:42:54.456303    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-ns.yaml

	I0531 19:42:54.456303    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)

	I0531 19:42:54.456303    7556 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108

	I0531 19:42:54.461309    7556 cli_runner.go:217] Completed: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}: (1.6540886s)

	I0531 19:42:54.464270    7556 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4

	I0531 19:42:50.265252    8616 config.go:178] Loaded profile config "embed-certs-20220531193346-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.6

	I0531 19:42:50.267300    8616 driver.go:358] Setting default libvirt URI to qemu:///system

	I0531 19:42:54.110723    8616 docker.go:137] docker version: linux-20.10.14

	I0531 19:42:54.118695    8616 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0531 19:42:54.465305    7556 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108

	I0531 19:42:54.466270    7556 addons.go:348] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0531 19:42:54.466270    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0531 19:42:54.477291    7556 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108

	I0531 19:42:54.530792    7556 addons.go:153] Setting addon default-storageclass=true in "newest-cni-20220531193849-2108"

	W0531 19:42:54.530929    7556 addons.go:165] addon default-storageclass should already be in state true

	I0531 19:42:54.530929    7556 host.go:66] Checking if "newest-cni-20220531193849-2108" exists ...

	I0531 19:42:54.565279    7556 cli_runner.go:164] Run: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}

	I0531 19:42:55.004826    7556 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108: (1.6419837s)

	I0531 19:42:55.004826    7556 api_server.go:51] waiting for apiserver process to appear ...

	I0531 19:42:55.017835    7556 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:42:55.060968    7556 api_server.go:71] duration metric: took 2.3105545s to wait for apiserver process to appear ...

	I0531 19:42:55.060968    7556 api_server.go:87] waiting for apiserver healthz status ...

	I0531 19:42:55.060968    7556 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54458/healthz ...

	I0531 19:42:55.159964    7556 api_server.go:266] https://127.0.0.1:54458/healthz returned 200:

	ok

	I0531 19:42:55.165977    7556 api_server.go:140] control plane version: v1.23.6

	I0531 19:42:55.165977    7556 api_server.go:130] duration metric: took 105.0091ms to wait for apiserver health ...

	I0531 19:42:55.165977    7556 system_pods.go:43] waiting for kube-system pods to appear ...

	I0531 19:42:55.244153    7556 system_pods.go:59] 8 kube-system pods found

	I0531 19:42:55.244153    7556 system_pods.go:61] "coredns-64897985d-qpzx5" [801bd65d-655d-451b-a3ff-79295aaeaf09] Pending / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I0531 19:42:55.244153    7556 system_pods.go:61] "etcd-newest-cni-20220531193849-2108" [663ce3bf-8420-4d38-a012-54abf228ce78] Running

	I0531 19:42:55.244153    7556 system_pods.go:61] "kube-apiserver-newest-cni-20220531193849-2108" [e713d4e4-3356-41ac-b8af-52bf19d65052] Running

	I0531 19:42:55.244153    7556 system_pods.go:61] "kube-controller-manager-newest-cni-20220531193849-2108" [fd22af45-85a2-484a-a239-0e45831e8df8] Running

	I0531 19:42:55.244153    7556 system_pods.go:61] "kube-proxy-mh9ct" [85823877-90a8-4ad0-b0ad-b4ed75f4845e] Running

	I0531 19:42:55.244153    7556 system_pods.go:61] "kube-scheduler-newest-cni-20220531193849-2108" [34deeb35-60bc-42b6-a91d-cedda9a76363] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I0531 19:42:55.244153    7556 system_pods.go:61] "metrics-server-b955d9d8-rt44k" [d0c2b733-0fd1-4e34-88aa-d73b77704a89] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:42:55.244153    7556 system_pods.go:61] "storage-provisioner" [a104bd0d-cf9b-4dd3-b127-d3e84c4ae96b] Running

	I0531 19:42:55.244153    7556 system_pods.go:74] duration metric: took 78.1757ms to wait for pod list to return data ...

	I0531 19:42:55.244153    7556 default_sa.go:34] waiting for default service account to be created ...

	I0531 19:42:55.253122    7556 default_sa.go:45] found service account: "default"

	I0531 19:42:55.253122    7556 default_sa.go:55] duration metric: took 7.9853ms for default service account to be created ...

	I0531 19:42:55.254122    7556 kubeadm.go:572] duration metric: took 2.5037081s to wait for : map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] ...

	I0531 19:42:55.254122    7556 node_conditions.go:102] verifying NodePressure condition ...

	I0531 19:42:55.265141    7556 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki

	I0531 19:42:55.265141    7556 node_conditions.go:123] node cpu capacity is 16

	I0531 19:42:55.265141    7556 node_conditions.go:105] duration metric: took 11.0188ms to run NodePressure ...

	I0531 19:42:55.265141    7556 start.go:213] waiting for startup goroutines ...

	I0531 19:42:56.082328    7556 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108: (1.6160519s)

	I0531 19:42:56.082328    7556 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54454 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\newest-cni-20220531193849-2108\id_rsa Username:docker}

	I0531 19:42:56.098315    7556 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108: (1.6210174s)

	I0531 19:42:56.098315    7556 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54454 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\newest-cni-20220531193849-2108\id_rsa Username:docker}

	I0531 19:42:56.129090    7556 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108: (1.6726375s)

	I0531 19:42:57.078202    8616 cli_runner.go:217] Completed: docker system info --format "{{json .}}": (2.9594937s)

	I0531 19:42:57.079004    8616 info.go:265] docker info: {ID:JKWR:L4LW:XYJC:G6AI:GZFU:RUGW:CCH6:OD2M:V572:4FTB:B7YC:DTUC Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:92 OomKillDisable:true NGoroutines:63 SystemTime:2022-05-31 19:42:55.6928806 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_

64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,

profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc.

Version:v0.17.0]] Warnings:<nil>}}

	I0531 19:42:57.083679    8616 out.go:177] * Using the docker driver based on existing profile

	I0531 19:42:55.542888    1340 system_pods.go:86] 5 kube-system pods found

	I0531 19:42:55.542888    1340 system_pods.go:89] "coredns-5644d7b6d9-jxp72" [f831437f-5aa7-42cd-bb72-b1a20942f56a] Running

	I0531 19:42:55.542888    1340 system_pods.go:89] "etcd-old-k8s-version-20220531192531-2108" [d26cf30c-3701-4ea4-8a08-6aa0010138c2] Pending

	I0531 19:42:55.542888    1340 system_pods.go:89] "kube-proxy-r556l" [86e67749-a177-45b6-8857-e4f6c55b8dd8] Running

	I0531 19:42:55.542888    1340 system_pods.go:89] "metrics-server-6f89b5864b-v8mjx" [c248957e-7215-4044-9e73-acc8998b61f1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:42:55.542888    1340 system_pods.go:89] "storage-provisioner" [8001c475-f873-4298-ad3e-ac9b8d56927b] Running

	I0531 19:42:55.543887    1340 retry.go:31] will retry after 6.062999549s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler

	I0531 19:42:57.086388    8616 start.go:284] selected driver: docker

	I0531 19:42:57.086388    8616 start.go:806] validating driver "docker" against &{Name:embed-certs-20220531193346-2108 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.6 ClusterName:embed-certs-20220531193346-2108 Namespace:d

efault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.23.6 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.5.1@sha256:cc746e7a0b1eec0db01cbabbb6386b23d7af97e79fa9e36bb883a95b7eb96fe2 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s Schedule

dStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}

	I0531 19:42:57.086388    8616 start.go:817] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0531 19:42:57.174246    8616 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0531 19:42:59.712379    8616 cli_runner.go:217] Completed: docker system info --format "{{json .}}": (2.5379525s)

	I0531 19:42:59.712780    8616 info.go:265] docker info: {ID:JKWR:L4LW:XYJC:G6AI:GZFU:RUGW:CCH6:OD2M:V572:4FTB:B7YC:DTUC Containers:4 ContainersRunning:3 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:92 OomKillDisable:true NGoroutines:63 SystemTime:2022-05-31 19:42:58.4856581 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_

64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,

profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc.

Version:v0.17.0]] Warnings:<nil>}}

	I0531 19:42:59.713307    8616 start_flags.go:847] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0531 19:42:59.713408    8616 cni.go:95] Creating CNI manager for ""

	I0531 19:42:59.713408    8616 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0531 19:42:59.713435    8616 start_flags.go:306] config:

	{Name:embed-certs-20220531193346-2108 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.6 ClusterName:embed-certs-20220531193346-2108 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus

ter.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.23.6 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.5.1@sha256:cc746e7a0b1eec0db01cbabbb6386b23d7af97e79fa9e36bb883a95b7eb96fe2 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:f

alse ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}

	I0531 19:42:59.719162    8616 out.go:177] * Starting control plane node embed-certs-20220531193346-2108 in cluster embed-certs-20220531193346-2108

	I0531 19:42:59.722725    8616 cache.go:120] Beginning downloading kic base image for docker with docker

	I0531 19:42:59.725806    8616 out.go:177] * Pulling base image ...

	I0531 19:42:59.729482    8616 preload.go:132] Checking if preload exists for k8s version v1.23.6 and runtime docker

	I0531 19:42:59.729687    8616 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 in local docker daemon

	I0531 19:42:59.729848    8616 preload.go:148] Found local preload: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.23.6-docker-overlay2-amd64.tar.lz4

	I0531 19:42:59.729948    8616 cache.go:57] Caching tarball of preloaded images

	I0531 19:42:59.730619    8616 preload.go:174] Found C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.23.6-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0531 19:42:59.731046    8616 cache.go:60] Finished verifying existence of preloaded tar for  v1.23.6 on docker

	I0531 19:42:59.731505    8616 profile.go:148] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\config.json ...

	I0531 19:42:56.129266    7556 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54454 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\newest-cni-20220531193849-2108\id_rsa Username:docker}

	I0531 19:42:56.152573    7556 cli_runner.go:217] Completed: docker container inspect newest-cni-20220531193849-2108 --format={{.State.Status}}: (1.5871038s)

	I0531 19:42:56.152573    7556 addons.go:348] installing /etc/kubernetes/addons/storageclass.yaml

	I0531 19:42:56.152573    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0531 19:42:56.160019    7556 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108

	I0531 19:42:56.540386    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml

	I0531 19:42:56.540938    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)

	I0531 19:42:56.555337    7556 addons.go:348] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0531 19:42:56.555337    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1849 bytes)

	I0531 19:42:56.568986    7556 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0531 19:42:56.824720    7556 addons.go:348] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0531 19:42:56.824720    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0531 19:42:56.831199    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml

	I0531 19:42:56.831199    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)

	I0531 19:42:57.036004    7556 addons.go:348] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0531 19:42:57.036038    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0531 19:42:57.052974    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-configmap.yaml

	I0531 19:42:57.053103    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)

	I0531 19:42:57.174246    7556 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0531 19:42:57.230987    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-dp.yaml

	I0531 19:42:57.231080    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)

	I0531 19:42:57.340153    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-role.yaml

	I0531 19:42:57.340153    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)

	I0531 19:42:57.529392    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml

	I0531 19:42:57.529392    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)

	I0531 19:42:57.597366    7556 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" newest-cni-20220531193849-2108: (1.4373411s)

	I0531 19:42:57.597597    7556 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54454 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\newest-cni-20220531193849-2108\id_rsa Username:docker}

	I0531 19:42:57.642507    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-sa.yaml

	I0531 19:42:57.642507    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)

	I0531 19:42:57.745306    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-secret.yaml

	I0531 19:42:57.745306    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)

	I0531 19:42:57.841187    7556 addons.go:348] installing /etc/kubernetes/addons/dashboard-svc.yaml

	I0531 19:42:57.841187    7556 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)

	I0531 19:42:57.950588    7556 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0531 19:42:58.061914    7556 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	I0531 19:43:01.060754    8616 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 in local docker daemon, skipping pull

	I0531 19:43:01.060754    8616 cache.go:141] gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 exists in daemon, skipping load

	I0531 19:43:01.060932    8616 cache.go:206] Successfully downloaded all kic artifacts

	I0531 19:43:01.061977    8616 start.go:352] acquiring machines lock for embed-certs-20220531193346-2108: {Name:mk63e14faf496672dd0ff3bf59fb3b27b51120db Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0531 19:43:01.061977    8616 start.go:356] acquired machines lock for "embed-certs-20220531193346-2108" in 0s

	I0531 19:43:01.061977    8616 start.go:94] Skipping create...Using existing machine configuration

	I0531 19:43:01.061977    8616 fix.go:55] fixHost starting: 

	I0531 19:43:01.077901    8616 cli_runner.go:164] Run: docker container inspect embed-certs-20220531193346-2108 --format={{.State.Status}}

	I0531 19:43:02.412373    8616 cli_runner.go:217] Completed: docker container inspect embed-certs-20220531193346-2108 --format={{.State.Status}}: (1.3344665s)

	I0531 19:43:02.412373    8616 fix.go:103] recreateIfNeeded on embed-certs-20220531193346-2108: state=Stopped err=<nil>

	W0531 19:43:02.412373    8616 fix.go:129] unexpected machine state, will restart: <nil>

	I0531 19:43:02.432375    8616 out.go:177] * Restarting existing docker container for "embed-certs-20220531193346-2108" ...

	I0531 19:43:01.632478    1340 system_pods.go:86] 6 kube-system pods found

	I0531 19:43:01.632478    1340 system_pods.go:89] "coredns-5644d7b6d9-jxp72" [f831437f-5aa7-42cd-bb72-b1a20942f56a] Running

	I0531 19:43:01.632478    1340 system_pods.go:89] "etcd-old-k8s-version-20220531192531-2108" [d26cf30c-3701-4ea4-8a08-6aa0010138c2] Pending

	I0531 19:43:01.632478    1340 system_pods.go:89] "kube-controller-manager-old-k8s-version-20220531192531-2108" [f99468bb-525f-4752-9dab-f40607db0d10] Pending

	I0531 19:43:01.632478    1340 system_pods.go:89] "kube-proxy-r556l" [86e67749-a177-45b6-8857-e4f6c55b8dd8] Running

	I0531 19:43:01.632478    1340 system_pods.go:89] "metrics-server-6f89b5864b-v8mjx" [c248957e-7215-4044-9e73-acc8998b61f1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:43:01.632478    1340 system_pods.go:89] "storage-provisioner" [8001c475-f873-4298-ad3e-ac9b8d56927b] Running

	I0531 19:43:01.632478    1340 retry.go:31] will retry after 10.504197539s: missing components: etcd, kube-apiserver, kube-controller-manager, kube-scheduler

	I0531 19:43:01.236824    7556 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (4.6678186s)

	I0531 19:43:01.635485    7556 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (4.4612198s)

	I0531 19:43:01.635485    7556 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (3.6848808s)

	I0531 19:43:01.635485    7556 addons.go:386] Verifying addon metrics-server=true in "newest-cni-20220531193849-2108"

	I0531 19:43:02.727980    7556 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (4.6660457s)

	I0531 19:43:02.732954    7556 out.go:177] * Enabled addons: storage-provisioner, default-storageclass, metrics-server, dashboard

	I0531 19:43:02.735959    7556 addons.go:417] enableAddons completed in 9.9855123s

	I0531 19:43:02.974430    7556 start.go:504] kubectl: 1.18.2, cluster: 1.23.6 (minor skew: 5)

	I0531 19:43:02.977020    7556 out.go:177] 

	W0531 19:43:02.978721    7556 out.go:239] ! C:\ProgramData\chocolatey\bin\kubectl.exe is version 1.18.2, which may have incompatibilites with Kubernetes 1.23.6.

	I0531 19:43:02.982712    7556 out.go:177]   - Want kubectl v1.23.6? Try 'minikube kubectl -- get pods -A'

	I0531 19:43:02.986727    7556 out.go:177] * Done! kubectl is now configured to use "newest-cni-20220531193849-2108" cluster and "default" namespace by default

	I0531 19:43:02.454413    8616 cli_runner.go:164] Run: docker start embed-certs-20220531193346-2108

	I0531 19:43:04.888118    8616 cli_runner.go:217] Completed: docker start embed-certs-20220531193346-2108: (2.4336945s)

	I0531 19:43:04.899149    8616 cli_runner.go:164] Run: docker container inspect embed-certs-20220531193346-2108 --format={{.State.Status}}

	I0531 19:43:06.460445    8616 cli_runner.go:217] Completed: docker container inspect embed-certs-20220531193346-2108 --format={{.State.Status}}: (1.5602977s)

	I0531 19:43:06.460445    8616 kic.go:416] container "embed-certs-20220531193346-2108" state is running.

	I0531 19:43:06.474428    8616 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220531193346-2108

	I0531 19:43:07.957441    8616 cli_runner.go:217] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220531193346-2108: (1.4830066s)

	I0531 19:43:07.957441    8616 profile.go:148] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\config.json ...

	I0531 19:43:07.960439    8616 machine.go:88] provisioning docker machine ...

	I0531 19:43:07.960439    8616 ubuntu.go:169] provisioning hostname "embed-certs-20220531193346-2108"

	I0531 19:43:07.970438    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:09.409622    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.4380322s)

	I0531 19:43:09.412613    8616 main.go:134] libmachine: Using SSH client type: native

	I0531 19:43:09.413634    8616 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x1322ea0] 0x1325d00 <nil>  [] 0s} 127.0.0.1 54560 <nil> <nil>}

	I0531 19:43:09.413634    8616 main.go:134] libmachine: About to run SSH command:

	sudo hostname embed-certs-20220531193346-2108 && echo "embed-certs-20220531193346-2108" | sudo tee /etc/hostname

	I0531 19:43:09.664937    8616 main.go:134] libmachine: SSH cmd err, output: <nil>: embed-certs-20220531193346-2108

	I0531 19:43:09.674907    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:12.159805    1340 system_pods.go:86] 7 kube-system pods found

	I0531 19:43:12.159805    1340 system_pods.go:89] "coredns-5644d7b6d9-jxp72" [f831437f-5aa7-42cd-bb72-b1a20942f56a] Running

	I0531 19:43:12.159805    1340 system_pods.go:89] "etcd-old-k8s-version-20220531192531-2108" [d26cf30c-3701-4ea4-8a08-6aa0010138c2] Running

	I0531 19:43:12.159805    1340 system_pods.go:89] "kube-controller-manager-old-k8s-version-20220531192531-2108" [f99468bb-525f-4752-9dab-f40607db0d10] Running

	I0531 19:43:12.159805    1340 system_pods.go:89] "kube-proxy-r556l" [86e67749-a177-45b6-8857-e4f6c55b8dd8] Running

	I0531 19:43:12.159805    1340 system_pods.go:89] "kube-scheduler-old-k8s-version-20220531192531-2108" [7bbd9c04-c349-4dae-8a28-e0127457afce] Pending

	I0531 19:43:12.159805    1340 system_pods.go:89] "metrics-server-6f89b5864b-v8mjx" [c248957e-7215-4044-9e73-acc8998b61f1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:43:12.159805    1340 system_pods.go:89] "storage-provisioner" [8001c475-f873-4298-ad3e-ac9b8d56927b] Running

	I0531 19:43:12.159805    1340 retry.go:31] will retry after 12.194240946s: missing components: kube-apiserver, kube-scheduler

	I0531 19:43:11.086438    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.4115245s)

	I0531 19:43:11.092434    8616 main.go:134] libmachine: Using SSH client type: native

	I0531 19:43:11.093440    8616 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x1322ea0] 0x1325d00 <nil>  [] 0s} 127.0.0.1 54560 <nil> <nil>}

	I0531 19:43:11.093440    8616 main.go:134] libmachine: About to run SSH command:

			if ! grep -xq '.*\sembed-certs-20220531193346-2108' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 embed-certs-20220531193346-2108/g' /etc/hosts;

				else 

					echo '127.0.1.1 embed-certs-20220531193346-2108' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0531 19:43:11.255429    8616 main.go:134] libmachine: SSH cmd err, output: <nil>: 

	I0531 19:43:11.255429    8616 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube7\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube7\minikube-integration\.minikube}

	I0531 19:43:11.255429    8616 ubuntu.go:177] setting up certificates

	I0531 19:43:11.255429    8616 provision.go:83] configureAuth start

	I0531 19:43:11.265440    8616 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220531193346-2108

	I0531 19:43:12.708520    8616 cli_runner.go:217] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220531193346-2108: (1.4430742s)

	I0531 19:43:12.708520    8616 provision.go:138] copyHostCerts

	I0531 19:43:12.708520    8616 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem, removing ...

	I0531 19:43:12.708520    8616 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cert.pem

	I0531 19:43:12.709415    8616 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem (1123 bytes)

	I0531 19:43:12.710359    8616 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem, removing ...

	I0531 19:43:12.710359    8616 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\key.pem

	I0531 19:43:12.711169    8616 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem (1679 bytes)

	I0531 19:43:12.712053    8616 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem, removing ...

	I0531 19:43:12.712053    8616 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.pem

	I0531 19:43:12.712716    8616 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem (1078 bytes)

	I0531 19:43:12.713400    8616 provision.go:112] generating server cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.embed-certs-20220531193346-2108 san=[192.168.67.2 127.0.0.1 localhost 127.0.0.1 minikube embed-certs-20220531193346-2108]

	I0531 19:43:13.011580    8616 provision.go:172] copyRemoteCerts

	I0531 19:43:13.023550    8616 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0531 19:43:13.038556    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:14.338732    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.3001706s)

	I0531 19:43:14.338732    8616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54560 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\embed-certs-20220531193346-2108\id_rsa Username:docker}

	I0531 19:43:14.551697    8616 ssh_runner.go:235] Completed: sudo mkdir -p /etc/docker /etc/docker /etc/docker: (1.5281407s)

	I0531 19:43:14.552675    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0531 19:43:14.613469    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1265 bytes)

	I0531 19:43:14.684854    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0531 19:43:14.747113    8616 provision.go:86] duration metric: configureAuth took 3.4916684s

	I0531 19:43:14.747113    8616 ubuntu.go:193] setting minikube options for container-runtime

	I0531 19:43:14.748088    8616 config.go:178] Loaded profile config "embed-certs-20220531193346-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.6

	I0531 19:43:14.761866    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:16.087899    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.3258419s)

	I0531 19:43:16.091824    8616 main.go:134] libmachine: Using SSH client type: native

	I0531 19:43:16.092214    8616 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x1322ea0] 0x1325d00 <nil>  [] 0s} 127.0.0.1 54560 <nil> <nil>}

	I0531 19:43:16.092298    8616 main.go:134] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0531 19:43:16.307822    8616 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay

	I0531 19:43:16.307822    8616 ubuntu.go:71] root file system type: overlay

	I0531 19:43:16.308825    8616 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0531 19:43:16.317850    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:17.695543    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.3776872s)

	I0531 19:43:17.701536    8616 main.go:134] libmachine: Using SSH client type: native

	I0531 19:43:17.701536    8616 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x1322ea0] 0x1325d00 <nil>  [] 0s} 127.0.0.1 54560 <nil> <nil>}

	I0531 19:43:17.701536    8616 main.go:134] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0531 19:43:17.874809    8616 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0531 19:43:17.883833    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:19.149206    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.2653668s)

	I0531 19:43:19.152226    8616 main.go:134] libmachine: Using SSH client type: native

	I0531 19:43:19.153214    8616 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x1322ea0] 0x1325d00 <nil>  [] 0s} 127.0.0.1 54560 <nil> <nil>}

	I0531 19:43:19.153214    8616 main.go:134] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0531 19:43:19.357762    8616 main.go:134] libmachine: SSH cmd err, output: <nil>: 

	I0531 19:43:19.357762    8616 machine.go:91] provisioned docker machine in 11.397274s

	I0531 19:43:19.357762    8616 start.go:306] post-start starting for "embed-certs-20220531193346-2108" (driver="docker")

	I0531 19:43:19.357762    8616 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0531 19:43:19.368634    8616 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0531 19:43:19.375625    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:24.393133    1340 system_pods.go:86] 8 kube-system pods found

	I0531 19:43:24.393133    1340 system_pods.go:89] "coredns-5644d7b6d9-jxp72" [f831437f-5aa7-42cd-bb72-b1a20942f56a] Running

	I0531 19:43:24.393133    1340 system_pods.go:89] "etcd-old-k8s-version-20220531192531-2108" [d26cf30c-3701-4ea4-8a08-6aa0010138c2] Running

	I0531 19:43:24.393133    1340 system_pods.go:89] "kube-apiserver-old-k8s-version-20220531192531-2108" [d699c547-2f4a-4e3d-8249-2018ca3f8fb7] Running

	I0531 19:43:24.393133    1340 system_pods.go:89] "kube-controller-manager-old-k8s-version-20220531192531-2108" [f99468bb-525f-4752-9dab-f40607db0d10] Running

	I0531 19:43:24.393133    1340 system_pods.go:89] "kube-proxy-r556l" [86e67749-a177-45b6-8857-e4f6c55b8dd8] Running

	I0531 19:43:24.393133    1340 system_pods.go:89] "kube-scheduler-old-k8s-version-20220531192531-2108" [7bbd9c04-c349-4dae-8a28-e0127457afce] Running

	I0531 19:43:24.393133    1340 system_pods.go:89] "metrics-server-6f89b5864b-v8mjx" [c248957e-7215-4044-9e73-acc8998b61f1] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:43:24.393133    1340 system_pods.go:89] "storage-provisioner" [8001c475-f873-4298-ad3e-ac9b8d56927b] Running

	I0531 19:43:24.393133    1340 system_pods.go:126] duration metric: took 56.8618258s to wait for k8s-apps to be running ...

	I0531 19:43:24.393133    1340 system_svc.go:44] waiting for kubelet service to be running ....

	I0531 19:43:24.403125    1340 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0531 19:43:24.445798    1340 system_svc.go:56] duration metric: took 52.6647ms WaitForService to wait for kubelet.

	I0531 19:43:24.445798    1340 kubeadm.go:572] duration metric: took 1m7.5077501s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0531 19:43:24.445798    1340 node_conditions.go:102] verifying NodePressure condition ...

	I0531 19:43:24.453799    1340 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki

	I0531 19:43:24.453799    1340 node_conditions.go:123] node cpu capacity is 16

	I0531 19:43:24.453799    1340 node_conditions.go:105] duration metric: took 8.0013ms to run NodePressure ...

	I0531 19:43:24.453799    1340 start.go:213] waiting for startup goroutines ...

	I0531 19:43:24.669491    1340 start.go:504] kubectl: 1.18.2, cluster: 1.16.0 (minor skew: 2)

	I0531 19:43:24.674088    1340 out.go:177] 

	W0531 19:43:24.677260    1340 out.go:239] ! C:\ProgramData\chocolatey\bin\kubectl.exe is version 1.18.2, which may have incompatibilites with Kubernetes 1.16.0.

	I0531 19:43:24.680532    1340 out.go:177]   - Want kubectl v1.16.0? Try 'minikube kubectl -- get pods -A'

	I0531 19:43:24.685300    1340 out.go:177] * Done! kubectl is now configured to use "old-k8s-version-20220531192531-2108" cluster and "default" namespace by default

	I0531 19:43:20.624671    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.2490409s)

	I0531 19:43:20.624671    8616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54560 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\embed-certs-20220531193346-2108\id_rsa Username:docker}

	I0531 19:43:20.759134    8616 ssh_runner.go:235] Completed: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs: (1.3904934s)

	I0531 19:43:20.769129    8616 ssh_runner.go:195] Run: cat /etc/os-release

	I0531 19:43:20.781134    8616 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I0531 19:43:20.781134    8616 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I0531 19:43:20.781134    8616 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I0531 19:43:20.781134    8616 info.go:137] Remote host: Ubuntu 20.04.4 LTS

	I0531 19:43:20.781134    8616 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\addons for local assets ...

	I0531 19:43:20.782134    8616 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\files for local assets ...

	I0531 19:43:20.783138    8616 filesync.go:149] local asset: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\21082.pem -> 21082.pem in /etc/ssl/certs

	I0531 19:43:20.797122    8616 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0531 19:43:20.827072    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\21082.pem --> /etc/ssl/certs/21082.pem (1708 bytes)

	I0531 19:43:20.887348    8616 start.go:309] post-start completed in 1.5295791s

	I0531 19:43:20.898339    8616 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0531 19:43:20.904357    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:22.218797    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.3134488s)

	I0531 19:43:22.218797    8616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54560 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\embed-certs-20220531193346-2108\id_rsa Username:docker}

	I0531 19:43:22.370144    8616 ssh_runner.go:235] Completed: sh -c "df -h /var | awk 'NR==2{print $5}'": (1.4717985s)

	I0531 19:43:22.382114    8616 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0531 19:43:22.399454    8616 fix.go:57] fixHost completed within 21.3373847s

	I0531 19:43:22.399454    8616 start.go:81] releasing machines lock for "embed-certs-20220531193346-2108", held for 21.3373847s

	I0531 19:43:22.406442    8616 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220531193346-2108

	I0531 19:43:23.736218    8616 cli_runner.go:217] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" embed-certs-20220531193346-2108: (1.3297705s)

	I0531 19:43:23.739211    8616 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0531 19:43:23.747232    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:23.748219    8616 ssh_runner.go:195] Run: systemctl --version

	I0531 19:43:23.757214    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:25.191855    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.4446175s)

	I0531 19:43:25.192881    8616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54560 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\embed-certs-20220531193346-2108\id_rsa Username:docker}

	I0531 19:43:25.216528    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.4593082s)

	I0531 19:43:25.216528    8616 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54560 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\embed-certs-20220531193346-2108\id_rsa Username:docker}

	I0531 19:43:25.434737    8616 ssh_runner.go:235] Completed: curl -sS -m 2 https://k8s.gcr.io/: (1.6955191s)

	I0531 19:43:25.434737    8616 ssh_runner.go:235] Completed: systemctl --version: (1.6865115s)

	I0531 19:43:25.450724    8616 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0531 19:43:25.564263    8616 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0531 19:43:25.598655    8616 cruntime.go:273] skipping containerd shutdown because we are bound to it

	I0531 19:43:25.608101    8616 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0531 19:43:25.652695    8616 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I0531 19:43:25.706768    8616 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0531 19:43:25.913648    8616 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0531 19:43:26.130777    8616 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0531 19:43:26.181761    8616 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0531 19:43:26.375718    8616 ssh_runner.go:195] Run: sudo systemctl start docker

	I0531 19:43:26.412452    8616 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0531 19:43:26.527203    8616 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0531 19:43:26.636205    8616 out.go:204] * Preparing Kubernetes v1.23.6 on Docker 20.10.16 ...

	I0531 19:43:26.651207    8616 cli_runner.go:164] Run: docker exec -t embed-certs-20220531193346-2108 dig +short host.docker.internal

	I0531 19:43:28.191872    8616 cli_runner.go:217] Completed: docker exec -t embed-certs-20220531193346-2108 dig +short host.docker.internal: (1.5406583s)

	I0531 19:43:28.191872    8616 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2

	I0531 19:43:28.202880    8616 ssh_runner.go:195] Run: grep 192.168.65.2	host.minikube.internal$ /etc/hosts

	I0531 19:43:28.218418    8616 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0531 19:43:28.262706    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:29.498586    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.2358751s)

	I0531 19:43:29.498586    8616 preload.go:132] Checking if preload exists for k8s version v1.23.6 and runtime docker

	I0531 19:43:29.505594    8616 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0531 19:43:29.585592    8616 docker.go:610] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.23.6

	k8s.gcr.io/kube-proxy:v1.23.6

	k8s.gcr.io/kube-scheduler:v1.23.6

	k8s.gcr.io/kube-controller-manager:v1.23.6

	k8s.gcr.io/etcd:3.5.1-0

	k8s.gcr.io/coredns/coredns:v1.8.6

	k8s.gcr.io/pause:3.6

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28.4-glibc

	-- /stdout --

	I0531 19:43:29.585592    8616 docker.go:541] Images already preloaded, skipping extraction

	I0531 19:43:29.592584    8616 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0531 19:43:29.692450    8616 docker.go:610] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.23.6

	k8s.gcr.io/kube-controller-manager:v1.23.6

	k8s.gcr.io/kube-proxy:v1.23.6

	k8s.gcr.io/kube-scheduler:v1.23.6

	k8s.gcr.io/etcd:3.5.1-0

	k8s.gcr.io/coredns/coredns:v1.8.6

	k8s.gcr.io/pause:3.6

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28.4-glibc

	-- /stdout --

	I0531 19:43:29.692450    8616 cache_images.go:84] Images are preloaded, skipping loading

	I0531 19:43:29.698436    8616 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0531 19:43:29.922432    8616 cni.go:95] Creating CNI manager for ""

	I0531 19:43:29.922549    8616 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0531 19:43:29.922549    8616 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0531 19:43:29.922549    8616 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.67.2 APIServerPort:8443 KubernetesVersion:v1.23.6 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:embed-certs-20220531193346-2108 NodeName:embed-certs-20220531193346-2108 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.67.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.67.2 CgroupDriver:cgroupfs ClientCAFile:/

var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0531 19:43:29.922775    8616 kubeadm.go:162] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.67.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "embed-certs-20220531193346-2108"

	  kubeletExtraArgs:

	    node-ip: 192.168.67.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.67.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.23.6

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0531 19:43:29.922863    8616 kubeadm.go:961] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.23.6/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=embed-certs-20220531193346-2108 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.67.2

	[Install]

	 config:

	{KubernetesVersion:v1.23.6 ClusterName:embed-certs-20220531193346-2108 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0531 19:43:29.937834    8616 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.23.6

	I0531 19:43:29.970126    8616 binaries.go:44] Found k8s binaries, skipping transfer

	I0531 19:43:29.980712    8616 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0531 19:43:30.003043    8616 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (357 bytes)

	I0531 19:43:30.040432    8616 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0531 19:43:30.080432    8616 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2053 bytes)

	I0531 19:43:30.128472    8616 ssh_runner.go:195] Run: grep 192.168.67.2	control-plane.minikube.internal$ /etc/hosts

	I0531 19:43:30.144212    8616 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.67.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0531 19:43:30.174247    8616 certs.go:54] Setting up C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108 for IP: 192.168.67.2

	I0531 19:43:30.174247    8616 certs.go:182] skipping minikubeCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key

	I0531 19:43:30.175233    8616 certs.go:182] skipping proxyClientCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key

	I0531 19:43:30.175233    8616 certs.go:298] skipping minikube-user signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\client.key

	I0531 19:43:30.176258    8616 certs.go:298] skipping minikube signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\apiserver.key.c7fa3a9e

	I0531 19:43:30.176258    8616 certs.go:298] skipping aggregator signed cert generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\proxy-client.key

	I0531 19:43:30.177245    8616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\2108.pem (1338 bytes)

	W0531 19:43:30.177245    8616 certs.go:384] ignoring C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\2108_empty.pem, impossibly tiny 0 bytes

	I0531 19:43:30.178242    8616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem (1675 bytes)

	I0531 19:43:30.178242    8616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem (1078 bytes)

	I0531 19:43:30.178242    8616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem (1123 bytes)

	I0531 19:43:30.178242    8616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem (1679 bytes)

	I0531 19:43:30.179223    8616 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\21082.pem (1708 bytes)

	I0531 19:43:30.181232    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0531 19:43:30.231446    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0531 19:43:30.286026    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0531 19:43:30.347980    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\embed-certs-20220531193346-2108\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0531 19:43:30.409568    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0531 19:43:30.468376    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0531 19:43:30.523994    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0531 19:43:30.580310    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0531 19:43:30.649449    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0531 19:43:30.719603    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\2108.pem --> /usr/share/ca-certificates/2108.pem (1338 bytes)

	I0531 19:43:30.786513    8616 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\21082.pem --> /usr/share/ca-certificates/21082.pem (1708 bytes)

	I0531 19:43:30.859521    8616 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (752 bytes)

	I0531 19:43:30.907080    8616 ssh_runner.go:195] Run: openssl version

	I0531 19:43:30.929093    8616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0531 19:43:30.986864    8616 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0531 19:43:31.005336    8616 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 May 31 17:19 /usr/share/ca-certificates/minikubeCA.pem

	I0531 19:43:31.014329    8616 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0531 19:43:31.040343    8616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0531 19:43:31.077357    8616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2108.pem && ln -fs /usr/share/ca-certificates/2108.pem /etc/ssl/certs/2108.pem"

	I0531 19:43:31.111349    8616 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2108.pem

	I0531 19:43:31.121345    8616 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 May 31 17:31 /usr/share/ca-certificates/2108.pem

	I0531 19:43:31.132335    8616 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2108.pem

	I0531 19:43:31.156335    8616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/2108.pem /etc/ssl/certs/51391683.0"

	I0531 19:43:31.198345    8616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/21082.pem && ln -fs /usr/share/ca-certificates/21082.pem /etc/ssl/certs/21082.pem"

	I0531 19:43:31.230395    8616 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/21082.pem

	I0531 19:43:31.245833    8616 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 May 31 17:31 /usr/share/ca-certificates/21082.pem

	I0531 19:43:31.256203    8616 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/21082.pem

	I0531 19:43:31.279205    8616 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/21082.pem /etc/ssl/certs/3ec20f2e.0"

	I0531 19:43:31.309204    8616 kubeadm.go:395] StartCluster: {Name:embed-certs-20220531193346-2108 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.6 ClusterName:embed-certs-20220531193346-2108 Namespace:default APIServerName

:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.67.2 Port:8443 KubernetesVersion:v1.23.6 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true] CustomAddonImages:map[Dashboard:kubernetesui/dashboard:v2.5.1@sha256:cc746e7a0b1eec0db01cbabbb6386b23d7af97e79fa9e36bb883a95b7eb96fe2 MetricsScraper:k8s.gcr.io/echoserver:1.4 MetricsServer:k8s.gcr.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedP

orts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}

	I0531 19:43:31.319672    8616 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0531 19:43:31.403071    8616 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0531 19:43:31.428156    8616 kubeadm.go:410] found existing configuration files, will attempt cluster restart

	I0531 19:43:31.429149    8616 kubeadm.go:626] restartCluster start

	I0531 19:43:31.439155    8616 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I0531 19:43:31.459646    8616 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:31.471196    8616 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108

	I0531 19:43:32.683774    8616 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" embed-certs-20220531193346-2108: (1.2125727s)

	I0531 19:43:32.685818    8616 kubeconfig.go:116] verify returned: extract IP: "embed-certs-20220531193346-2108" does not appear in C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I0531 19:43:32.687090    8616 kubeconfig.go:127] "embed-certs-20220531193346-2108" context is missing from C:\Users\jenkins.minikube7\minikube-integration\kubeconfig - will repair!

	I0531 19:43:32.689552    8616 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\kubeconfig: {Name:mk3b9816be6135fef42a073128e9ed356868417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:43:32.711443    8616 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0531 19:43:32.741481    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:32.755718    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:32.782840    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:32.998467    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:33.009814    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:33.038110    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:33.187690    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:33.198728    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:33.231759    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:33.389082    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:33.401128    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:33.437991    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:33.596003    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:33.610434    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:33.649694    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:33.783691    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:33.794460    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:33.820957    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:33.989461    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:34.000602    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:34.029721    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:34.197752    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:34.208129    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:34.240212    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:34.388876    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:34.398381    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:34.427592    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:34.592690    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:34.603583    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:34.630736    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:34.793731    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:34.802574    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:34.840450    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:34.982936    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:34.994510    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:35.019918    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:35.194019    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:35.206505    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:35.239207    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:35.383180    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:35.395711    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:35.424130    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:35.588664    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:35.599428    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:35.628476    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:35.794694    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:35.804703    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:35.835435    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:35.835435    8616 api_server.go:165] Checking apiserver status ...

	I0531 19:43:35.845430    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0531 19:43:35.872922    8616 api_server.go:169] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:35.872966    8616 kubeadm.go:601] needs reconfigure: apiserver error: timed out waiting for the condition

	I0531 19:43:35.872966    8616 kubeadm.go:1092] stopping kube-system containers ...

	I0531 19:43:35.888288    8616 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0531 19:43:36.000416    8616 docker.go:442] Stopping containers: [18f322b433f7 51e6610a10f8 a57711de2363 b6d1008f5a7a 05f4ee855b48 5f2d7ca41131 a4c5949a368e 76eefca54c8e 938b770e6a22 7d10308b7ec6 284f4ae8d238 af695fbb3afb 09ad7210375d 74454f5b27c5 95eae5077bdb 459d9f4673a9]

	I0531 19:43:36.009398    8616 ssh_runner.go:195] Run: docker stop 18f322b433f7 51e6610a10f8 a57711de2363 b6d1008f5a7a 05f4ee855b48 5f2d7ca41131 a4c5949a368e 76eefca54c8e 938b770e6a22 7d10308b7ec6 284f4ae8d238 af695fbb3afb 09ad7210375d 74454f5b27c5 95eae5077bdb 459d9f4673a9

	I0531 19:43:36.107408    8616 ssh_runner.go:195] Run: sudo systemctl stop kubelet

	I0531 19:43:36.149402    8616 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0531 19:43:36.172404    8616 kubeadm.go:155] found existing configuration files:

	-rw------- 1 root root 5643 May 31 19:41 /etc/kubernetes/admin.conf

	-rw------- 1 root root 5652 May 31 19:41 /etc/kubernetes/controller-manager.conf

	-rw------- 1 root root 2063 May 31 19:41 /etc/kubernetes/kubelet.conf

	-rw------- 1 root root 5604 May 31 19:41 /etc/kubernetes/scheduler.conf

	I0531 19:43:36.182417    8616 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0531 19:43:36.212422    8616 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0531 19:43:36.244428    8616 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0531 19:43:36.266416    8616 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:36.278403    8616 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0531 19:43:36.311760    8616 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0531 19:43:36.334758    8616 kubeadm.go:166] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I0531 19:43:36.343790    8616 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0531 19:43:36.383787    8616 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0531 19:43:36.405748    8616 kubeadm.go:703] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I0531 19:43:36.405748    8616 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I0531 19:43:36.547878    8616 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I0531 19:43:37.853479    8616 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (1.3055954s)

	I0531 19:43:37.854020    8616 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I0531 19:43:38.190227    8616 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I0531 19:43:38.364256    8616 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I0531 19:43:38.640714    8616 api_server.go:51] waiting for apiserver process to appear ...

	I0531 19:43:38.654240    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:39.203285    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:39.698006    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:40.197265    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:40.699188    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:41.204693    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:41.696036    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:42.200147    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:42.701351    8616 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:43:42.745446    8616 api_server.go:71] duration metric: took 4.1047578s to wait for apiserver process to appear ...

	I0531 19:43:42.745446    8616 api_server.go:87] waiting for apiserver healthz status ...

	I0531 19:43:42.745446    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:42.750441    8616 api_server.go:256] stopped: https://127.0.0.1:54559/healthz: Get "https://127.0.0.1:54559/healthz": EOF

	I0531 19:43:43.260468    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:44.816816    9560 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm reset --cri-socket /var/run/dockershim.sock --force": (50.8628666s)

	I0531 19:43:44.834841    9560 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0531 19:43:44.875054    9560 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0531 19:43:44.910403    9560 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver

	I0531 19:43:44.926341    9560 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0531 19:43:44.952402    9560 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0531 19:43:44.952402    9560 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I0531 19:43:48.268195    8616 api_server.go:256] stopped: https://127.0.0.1:54559/healthz: Get "https://127.0.0.1:54559/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

	I0531 19:43:48.760057    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:49.742236    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W0531 19:43:49.742236    8616 api_server.go:102] status: https://127.0.0.1:54559/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I0531 19:43:49.762242    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:49.834262    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W0531 19:43:49.834262    8616 api_server.go:102] status: https://127.0.0.1:54559/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I0531 19:43:50.265125    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:50.325042    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:43:50.325997    8616 api_server.go:102] status: https://127.0.0.1:54559/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[-]poststarthook/priority-and-fairness-config-producer failed: reason withheld

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:43:50.754281    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:50.778515    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:43:50.778515    8616 api_server.go:102] status: https://127.0.0.1:54559/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:43:51.256439    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:51.326599    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:43:51.326599    8616 api_server.go:102] status: https://127.0.0.1:54559/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:43:51.759811    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:51.871137    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:43:51.871223    8616 api_server.go:102] status: https://127.0.0.1:54559/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:43:52.250743    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:52.368759    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:43:52.368759    8616 api_server.go:102] status: https://127.0.0.1:54559/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:43:52.756360    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:52.847081    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	W0531 19:43:52.847081    8616 api_server.go:102] status: https://127.0.0.1:54559/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/bootstrap-controller ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[+]poststarthook/scheduling/bootstrap-system-priority-classes ok

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	healthz check failed

	I0531 19:43:53.262170    8616 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54559/healthz ...

	I0531 19:43:53.433182    8616 api_server.go:266] https://127.0.0.1:54559/healthz returned 200:

	ok

	I0531 19:43:53.526458    8616 api_server.go:140] control plane version: v1.23.6

	I0531 19:43:53.526458    8616 api_server.go:130] duration metric: took 10.7809658s to wait for apiserver health ...

	I0531 19:43:53.526458    8616 cni.go:95] Creating CNI manager for ""

	I0531 19:43:53.526458    8616 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0531 19:43:53.526780    8616 system_pods.go:43] waiting for kube-system pods to appear ...

	I0531 19:43:53.834702    8616 system_pods.go:59] 8 kube-system pods found

	I0531 19:43:53.834702    8616 system_pods.go:61] "coredns-64897985d-h6l4d" [45e6521b-b5ba-4365-bf64-ed7f35254f8d] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I0531 19:43:53.834702    8616 system_pods.go:61] "etcd-embed-certs-20220531193346-2108" [8748c975-baa9-452c-8caa-89e8ff59a91a] Running

	I0531 19:43:53.834702    8616 system_pods.go:61] "kube-apiserver-embed-certs-20220531193346-2108" [df786508-0ac8-406a-b97b-c6650f016ceb] Running

	I0531 19:43:53.834702    8616 system_pods.go:61] "kube-controller-manager-embed-certs-20220531193346-2108" [fc4dc9a6-b756-47c3-93c8-b37e4a6af2ea] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I0531 19:43:53.834702    8616 system_pods.go:61] "kube-proxy-qmdlz" [e19359f3-a2a5-4148-a7a1-ba356b861a3a] Running / Ready:ContainersNotReady (containers with unready status: [kube-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-proxy])

	I0531 19:43:53.834702    8616 system_pods.go:61] "kube-scheduler-embed-certs-20220531193346-2108" [f3efddc7-a2d0-44d8-a33b-a9b19295fe12] Running

	I0531 19:43:53.834702    8616 system_pods.go:61] "metrics-server-b955d9d8-n88dp" [eb244db6-b3bb-4838-a675-474d5d7a17d7] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:43:53.834702    8616 system_pods.go:61] "storage-provisioner" [1f06e411-8a16-4f79-b44d-1c60e7d37395] Running / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0531 19:43:53.834702    8616 system_pods.go:74] duration metric: took 307.92ms to wait for pod list to return data ...

	I0531 19:43:53.834702    8616 node_conditions.go:102] verifying NodePressure condition ...

	I0531 19:43:53.929683    8616 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki

	I0531 19:43:53.929683    8616 node_conditions.go:123] node cpu capacity is 16

	I0531 19:43:53.929683    8616 node_conditions.go:105] duration metric: took 94.9807ms to run NodePressure ...

	I0531 19:43:53.929683    8616 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I0531 19:43:56.629261    8616 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml": (2.6995662s)

	I0531 19:43:56.629261    8616 kubeadm.go:762] waiting for restarted kubelet to initialise ...

	I0531 19:43:56.740265    8616 kubeadm.go:777] kubelet initialised

	I0531 19:43:56.740265    8616 kubeadm.go:778] duration metric: took 111.0043ms waiting for restarted kubelet to initialise ...

	I0531 19:43:56.740265    8616 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0531 19:43:56.844460    8616 pod_ready.go:78] waiting up to 4m0s for pod "coredns-64897985d-h6l4d" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.488158    8616 pod_ready.go:92] pod "coredns-64897985d-h6l4d" in "kube-system" namespace has status "Ready":"True"

	I0531 19:43:58.488158    8616 pod_ready.go:81] duration metric: took 1.6436914s waiting for pod "coredns-64897985d-h6l4d" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.488158    8616 pod_ready.go:78] waiting up to 4m0s for pod "etcd-embed-certs-20220531193346-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.510159    8616 pod_ready.go:92] pod "etcd-embed-certs-20220531193346-2108" in "kube-system" namespace has status "Ready":"True"

	I0531 19:43:58.510159    8616 pod_ready.go:81] duration metric: took 22.0001ms waiting for pod "etcd-embed-certs-20220531193346-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.510159    8616 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-embed-certs-20220531193346-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.527166    8616 pod_ready.go:92] pod "kube-apiserver-embed-certs-20220531193346-2108" in "kube-system" namespace has status "Ready":"True"

	I0531 19:43:58.527166    8616 pod_ready.go:81] duration metric: took 17.0071ms waiting for pod "kube-apiserver-embed-certs-20220531193346-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.527166    8616 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-embed-certs-20220531193346-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.550165    8616 pod_ready.go:92] pod "kube-controller-manager-embed-certs-20220531193346-2108" in "kube-system" namespace has status "Ready":"True"

	I0531 19:43:58.550165    8616 pod_ready.go:81] duration metric: took 22.9989ms waiting for pod "kube-controller-manager-embed-certs-20220531193346-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.550165    8616 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-qmdlz" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.565167    8616 pod_ready.go:92] pod "kube-proxy-qmdlz" in "kube-system" namespace has status "Ready":"True"

	I0531 19:43:58.566182    8616 pod_ready.go:81] duration metric: took 16.0169ms waiting for pod "kube-proxy-qmdlz" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.566182    8616 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-embed-certs-20220531193346-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.885714    8616 pod_ready.go:92] pod "kube-scheduler-embed-certs-20220531193346-2108" in "kube-system" namespace has status "Ready":"True"

	I0531 19:43:58.885714    8616 pod_ready.go:81] duration metric: took 319.5308ms waiting for pod "kube-scheduler-embed-certs-20220531193346-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:43:58.885714    8616 pod_ready.go:78] waiting up to 4m0s for pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace to be "Ready" ...

	I0531 19:44:01.299568    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:03.307027    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:07.756660    9560 out.go:204]   - Generating certificates and keys ...

	I0531 19:44:07.763661    9560 out.go:204]   - Booting up control plane ...

	I0531 19:44:07.770647    9560 out.go:204]   - Configuring RBAC rules ...

	I0531 19:44:07.776631    9560 cni.go:95] Creating CNI manager for ""

	I0531 19:44:07.776631    9560 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0531 19:44:07.776631    9560 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0531 19:44:07.790660    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl label nodes minikube.k8s.io/version=v1.26.0-beta.1 minikube.k8s.io/commit=bd46569bd7cb517fcad2e704abdebd2826bd8454 minikube.k8s.io/name=default-k8s-different-port-20220531193451-2108 minikube.k8s.io/updated_at=2022_05_31T19_44_07_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:07.790660    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:07.840339    9560 ops.go:34] apiserver oom_adj: -16

	I0531 19:44:08.352099    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:05.309753    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:07.337428    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:09.798297    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:09.482153    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:09.971972    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:10.464847    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:10.969442    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:11.476944    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:11.961230    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:12.471788    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:12.967463    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:13.460534    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:13.967474    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:11.816175    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:14.312525    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:14.468026    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:14.970487    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:15.475084    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:15.974523    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:16.469115    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:16.974170    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:17.462022    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:17.968911    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:18.470960    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:16.806595    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:18.810488    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:19.534925    9560 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig: (1.0638088s)

	I0531 19:44:19.970577    9560 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:44:20.438654    9560 kubeadm.go:1045] duration metric: took 12.6619693s to wait for elevateKubeSystemPrivileges.

	I0531 19:44:20.438654    9560 kubeadm.go:397] StartCluster complete in 5m55.5759519s

	I0531 19:44:20.438654    9560 settings.go:142] acquiring lock: {Name:mk2f48f1c2db86c45c5c20d13312e07e9c171d09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:44:20.439658    9560 settings.go:150] Updating kubeconfig:  C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I0531 19:44:20.443654    9560 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\kubeconfig: {Name:mk3b9816be6135fef42a073128e9ed356868417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:44:21.229705    9560 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "default-k8s-different-port-20220531193451-2108" rescaled to 1

	I0531 19:44:21.229705    9560 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.6/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0531 19:44:21.229705    9560 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.58.2 Port:8444 KubernetesVersion:v1.23.6 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0531 19:44:21.235704    9560 out.go:177] * Verifying Kubernetes components...

	I0531 19:44:21.229705    9560 addons.go:415] enableAddons start: toEnable=map[dashboard:true default-storageclass:true metrics-server:true storage-provisioner:true], additional=[]

	I0531 19:44:21.230733    9560 config.go:178] Loaded profile config "default-k8s-different-port-20220531193451-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.6

	I0531 19:44:21.239692    9560 addons.go:65] Setting storage-provisioner=true in profile "default-k8s-different-port-20220531193451-2108"

	I0531 19:44:21.239692    9560 addons.go:65] Setting default-storageclass=true in profile "default-k8s-different-port-20220531193451-2108"

	I0531 19:44:21.239692    9560 addons.go:153] Setting addon storage-provisioner=true in "default-k8s-different-port-20220531193451-2108"

	W0531 19:44:21.239692    9560 addons.go:165] addon storage-provisioner should already be in state true

	I0531 19:44:21.239692    9560 addons.go:65] Setting dashboard=true in profile "default-k8s-different-port-20220531193451-2108"

	I0531 19:44:21.239692    9560 addons.go:153] Setting addon dashboard=true in "default-k8s-different-port-20220531193451-2108"

	I0531 19:44:21.239692    9560 addons.go:65] Setting metrics-server=true in profile "default-k8s-different-port-20220531193451-2108"

	I0531 19:44:21.239692    9560 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "default-k8s-different-port-20220531193451-2108"

	I0531 19:44:21.239692    9560 addons.go:153] Setting addon metrics-server=true in "default-k8s-different-port-20220531193451-2108"

	W0531 19:44:21.239692    9560 addons.go:165] addon metrics-server should already be in state true

	I0531 19:44:21.239692    9560 host.go:66] Checking if "default-k8s-different-port-20220531193451-2108" exists ...

	I0531 19:44:21.239692    9560 host.go:66] Checking if "default-k8s-different-port-20220531193451-2108" exists ...

	W0531 19:44:21.239692    9560 addons.go:165] addon dashboard should already be in state true

	I0531 19:44:21.239692    9560 host.go:66] Checking if "default-k8s-different-port-20220531193451-2108" exists ...

	I0531 19:44:21.260676    9560 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0531 19:44:21.271683    9560 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220531193451-2108 --format={{.State.Status}}

	I0531 19:44:21.273689    9560 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220531193451-2108 --format={{.State.Status}}

	I0531 19:44:21.275673    9560 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220531193451-2108 --format={{.State.Status}}

	I0531 19:44:21.275673    9560 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220531193451-2108 --format={{.State.Status}}

	I0531 19:44:22.048618    9560 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.6/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.65.2 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.23.6/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0531 19:44:22.061616    9560 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8444/tcp") 0).HostPort}}'" default-k8s-different-port-20220531193451-2108

	I0531 19:44:22.911602    9560 cli_runner.go:217] Completed: docker container inspect default-k8s-different-port-20220531193451-2108 --format={{.State.Status}}: (1.6359211s)

	I0531 19:44:22.914600    9560 out.go:177]   - Using image kubernetesui/dashboard:v2.5.1

	I0531 19:44:22.916617    9560 cli_runner.go:217] Completed: docker container inspect default-k8s-different-port-20220531193451-2108 --format={{.State.Status}}: (1.6449265s)

	I0531 19:44:22.919604    9560 out.go:177]   - Using image k8s.gcr.io/echoserver:1.4

	I0531 19:44:22.922602    9560 addons.go:348] installing /etc/kubernetes/addons/dashboard-ns.yaml

	I0531 19:44:22.922602    9560 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-ns.yaml (759 bytes)

	I0531 19:44:22.930625    9560 addons.go:153] Setting addon default-storageclass=true in "default-k8s-different-port-20220531193451-2108"

	W0531 19:44:22.930625    9560 addons.go:165] addon default-storageclass should already be in state true

	I0531 19:44:22.930625    9560 host.go:66] Checking if "default-k8s-different-port-20220531193451-2108" exists ...

	I0531 19:44:22.944627    9560 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220531193451-2108

	I0531 19:44:22.957615    9560 cli_runner.go:164] Run: docker container inspect default-k8s-different-port-20220531193451-2108 --format={{.State.Status}}

	I0531 19:44:22.961614    9560 cli_runner.go:217] Completed: docker container inspect default-k8s-different-port-20220531193451-2108 --format={{.State.Status}}: (1.685933s)

	I0531 19:44:22.965626    9560 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0531 19:44:22.967607    9560 addons.go:348] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0531 19:44:22.967607    9560 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0531 19:44:22.976605    9560 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220531193451-2108

	I0531 19:44:22.980611    9560 cli_runner.go:217] Completed: docker container inspect default-k8s-different-port-20220531193451-2108 --format={{.State.Status}}: (1.7069152s)

	I0531 19:44:22.982607    9560 out.go:177]   - Using image fake.domain/k8s.gcr.io/echoserver:1.4

	I0531 19:44:22.985603    9560 addons.go:348] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0531 19:44:22.985603    9560 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0531 19:44:22.994627    9560 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220531193451-2108

	I0531 19:44:23.687963    9560 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8444/tcp") 0).HostPort}}'" default-k8s-different-port-20220531193451-2108: (1.6263394s)

	I0531 19:44:23.687963    9560 node_ready.go:35] waiting up to 6m0s for node "default-k8s-different-port-20220531193451-2108" to be "Ready" ...

	I0531 19:44:23.828370    9560 node_ready.go:49] node "default-k8s-different-port-20220531193451-2108" has status "Ready":"True"

	I0531 19:44:23.828734    9560 node_ready.go:38] duration metric: took 140.7709ms waiting for node "default-k8s-different-port-20220531193451-2108" to be "Ready" ...

	I0531 19:44:23.828734    9560 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0531 19:44:23.936964    9560 pod_ready.go:78] waiting up to 6m0s for pod "coredns-64897985d-884ps" in "kube-system" namespace to be "Ready" ...

	I0531 19:44:21.322140    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:23.803392    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:24.501961    9560 cli_runner.go:217] Completed: docker container inspect default-k8s-different-port-20220531193451-2108 --format={{.State.Status}}: (1.5433206s)

	I0531 19:44:24.501961    9560 addons.go:348] installing /etc/kubernetes/addons/storageclass.yaml

	I0531 19:44:24.501961    9560 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0531 19:44:24.506972    9560 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220531193451-2108: (1.5123383s)

	I0531 19:44:24.506972    9560 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54331 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\default-k8s-different-port-20220531193451-2108\id_rsa Username:docker}

	I0531 19:44:24.510973    9560 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220531193451-2108

	I0531 19:44:24.532741    9560 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220531193451-2108: (1.5881072s)

	I0531 19:44:24.532741    9560 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220531193451-2108: (1.5561296s)

	I0531 19:44:24.533696    9560 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54331 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\default-k8s-different-port-20220531193451-2108\id_rsa Username:docker}

	I0531 19:44:24.533846    9560 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54331 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\default-k8s-different-port-20220531193451-2108\id_rsa Username:docker}

	I0531 19:44:25.437388    9560 addons.go:348] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0531 19:44:25.437388    9560 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1849 bytes)

	I0531 19:44:25.462818    9560 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0531 19:44:25.529121    9560 addons.go:348] installing /etc/kubernetes/addons/dashboard-clusterrole.yaml

	I0531 19:44:25.529121    9560 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrole.yaml (1001 bytes)

	I0531 19:44:25.731080    9560 addons.go:348] installing /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml

	I0531 19:44:25.731080    9560 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml (1018 bytes)

	I0531 19:44:25.747097    9560 addons.go:348] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0531 19:44:25.747097    9560 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0531 19:44:25.844043    9560 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" default-k8s-different-port-20220531193451-2108: (1.3330635s)

	I0531 19:44:25.844043    9560 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54331 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\default-k8s-different-port-20220531193451-2108\id_rsa Username:docker}

	I0531 19:44:25.937163    9560 addons.go:348] installing /etc/kubernetes/addons/dashboard-configmap.yaml

	I0531 19:44:25.937163    9560 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-configmap.yaml (837 bytes)

	I0531 19:44:26.126892    9560 addons.go:348] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0531 19:44:26.126892    9560 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0531 19:44:26.325073    9560 addons.go:348] installing /etc/kubernetes/addons/dashboard-dp.yaml

	I0531 19:44:26.325073    9560 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-dp.yaml (4196 bytes)

	I0531 19:44:26.446367    9560 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0531 19:44:26.453092    9560 addons.go:348] installing /etc/kubernetes/addons/dashboard-role.yaml

	I0531 19:44:26.453226    9560 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-role.yaml (1724 bytes)

	I0531 19:44:26.569123    9560 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0531 19:44:26.642947    9560 addons.go:348] installing /etc/kubernetes/addons/dashboard-rolebinding.yaml

	I0531 19:44:26.642947    9560 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-rolebinding.yaml (1046 bytes)

	I0531 19:44:26.829387    9560 addons.go:348] installing /etc/kubernetes/addons/dashboard-sa.yaml

	I0531 19:44:26.829577    9560 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-sa.yaml (837 bytes)

	I0531 19:44:27.125508    9560 addons.go:348] installing /etc/kubernetes/addons/dashboard-secret.yaml

	I0531 19:44:27.125852    9560 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-secret.yaml (1389 bytes)

	I0531 19:44:27.260412    9560 addons.go:348] installing /etc/kubernetes/addons/dashboard-svc.yaml

	I0531 19:44:27.260412    9560 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/dashboard-svc.yaml (1294 bytes)

	I0531 19:44:27.363794    9560 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml

	I0531 19:44:26.325073    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:31.634839    9560 pod_ready.go:102] pod "coredns-64897985d-884ps" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:32.237634    9560 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.6/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.65.2 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.23.6/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (10.1879316s)

	I0531 19:44:32.237634    9560 start.go:806] {"host.minikube.internal": 192.168.65.2} host record injected into CoreDNS

	I0531 19:44:33.242650    9560 pod_ready.go:92] pod "coredns-64897985d-884ps" in "kube-system" namespace has status "Ready":"True"

	I0531 19:44:33.242721    9560 pod_ready.go:81] duration metric: took 9.3055945s waiting for pod "coredns-64897985d-884ps" in "kube-system" namespace to be "Ready" ...

	I0531 19:44:33.242721    9560 pod_ready.go:78] waiting up to 6m0s for pod "coredns-64897985d-kh4sm" in "kube-system" namespace to be "Ready" ...

	I0531 19:44:33.627904    9560 pod_ready.go:92] pod "coredns-64897985d-kh4sm" in "kube-system" namespace has status "Ready":"True"

	I0531 19:44:33.627904    9560 pod_ready.go:81] duration metric: took 385.1101ms waiting for pod "coredns-64897985d-kh4sm" in "kube-system" namespace to be "Ready" ...

	I0531 19:44:33.627904    9560 pod_ready.go:78] waiting up to 6m0s for pod "etcd-default-k8s-different-port-20220531193451-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:44:33.731711    9560 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (8.268857s)

	I0531 19:44:33.841582    9560 pod_ready.go:92] pod "etcd-default-k8s-different-port-20220531193451-2108" in "kube-system" namespace has status "Ready":"True"

	I0531 19:44:33.841654    9560 pod_ready.go:81] duration metric: took 213.7491ms waiting for pod "etcd-default-k8s-different-port-20220531193451-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:44:33.841654    9560 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-default-k8s-different-port-20220531193451-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:44:34.145728    9560 pod_ready.go:92] pod "kube-apiserver-default-k8s-different-port-20220531193451-2108" in "kube-system" namespace has status "Ready":"True"

	I0531 19:44:34.145969    9560 pod_ready.go:81] duration metric: took 304.3136ms waiting for pod "kube-apiserver-default-k8s-different-port-20220531193451-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:44:34.145969    9560 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-default-k8s-different-port-20220531193451-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:44:31.510804    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:33.810256    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:34.327366    9560 pod_ready.go:92] pod "kube-controller-manager-default-k8s-different-port-20220531193451-2108" in "kube-system" namespace has status "Ready":"True"

	I0531 19:44:34.327366    9560 pod_ready.go:81] duration metric: took 181.3956ms waiting for pod "kube-controller-manager-default-k8s-different-port-20220531193451-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:44:34.327366    9560 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-vm4xx" in "kube-system" namespace to be "Ready" ...

	I0531 19:44:34.437117    9560 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.9907156s)

	I0531 19:44:34.437117    9560 addons.go:386] Verifying addon metrics-server=true in "default-k8s-different-port-20220531193451-2108"

	I0531 19:44:34.437117    9560 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (7.8674005s)

	I0531 19:44:34.635216    9560 pod_ready.go:92] pod "kube-proxy-vm4xx" in "kube-system" namespace has status "Ready":"True"

	I0531 19:44:34.635216    9560 pod_ready.go:81] duration metric: took 307.8491ms waiting for pod "kube-proxy-vm4xx" in "kube-system" namespace to be "Ready" ...

	I0531 19:44:34.635216    9560 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-default-k8s-different-port-20220531193451-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:44:34.849278    9560 pod_ready.go:92] pod "kube-scheduler-default-k8s-different-port-20220531193451-2108" in "kube-system" namespace has status "Ready":"True"

	I0531 19:44:34.849360    9560 pod_ready.go:81] duration metric: took 214.1034ms waiting for pod "kube-scheduler-default-k8s-different-port-20220531193451-2108" in "kube-system" namespace to be "Ready" ...

	I0531 19:44:34.849360    9560 pod_ready.go:38] duration metric: took 11.0204756s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0531 19:44:34.849436    9560 api_server.go:51] waiting for apiserver process to appear ...

	I0531 19:44:34.861644    9560 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0531 19:44:36.044255    9560 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/dashboard-ns.yaml -f /etc/kubernetes/addons/dashboard-clusterrole.yaml -f /etc/kubernetes/addons/dashboard-clusterrolebinding.yaml -f /etc/kubernetes/addons/dashboard-configmap.yaml -f /etc/kubernetes/addons/dashboard-dp.yaml -f /etc/kubernetes/addons/dashboard-role.yaml -f /etc/kubernetes/addons/dashboard-rolebinding.yaml -f /etc/kubernetes/addons/dashboard-sa.yaml -f /etc/kubernetes/addons/dashboard-secret.yaml -f /etc/kubernetes/addons/dashboard-svc.yaml: (8.6804234s)

	I0531 19:44:36.044255    9560 ssh_runner.go:235] Completed: sudo pgrep -xnf kube-apiserver.*minikube.*: (1.1826061s)

	I0531 19:44:36.044368    9560 api_server.go:71] duration metric: took 14.8145997s to wait for apiserver process to appear ...

	I0531 19:44:36.044368    9560 api_server.go:87] waiting for apiserver healthz status ...

	I0531 19:44:36.044430    9560 api_server.go:240] Checking apiserver healthz at https://127.0.0.1:54335/healthz ...

	I0531 19:44:36.057400    9560 out.go:177] * Enabled addons: storage-provisioner, metrics-server, default-storageclass, dashboard

	I0531 19:44:36.060335    9560 addons.go:417] enableAddons completed in 14.8305665s

	I0531 19:44:36.224066    9560 api_server.go:266] https://127.0.0.1:54335/healthz returned 200:

	ok

	I0531 19:44:36.236498    9560 api_server.go:140] control plane version: v1.23.6

	I0531 19:44:36.236498    9560 api_server.go:130] duration metric: took 192.1293ms to wait for apiserver health ...

	I0531 19:44:36.236498    9560 system_pods.go:43] waiting for kube-system pods to appear ...

	I0531 19:44:36.336613    9560 system_pods.go:59] 9 kube-system pods found

	I0531 19:44:36.336613    9560 system_pods.go:61] "coredns-64897985d-884ps" [7e2fbf53-e186-470d-a621-422adcdefe32] Running

	I0531 19:44:36.336613    9560 system_pods.go:61] "coredns-64897985d-kh4sm" [97634b04-cc54-499b-b5bd-75ff7aaa05ab] Running

	I0531 19:44:36.336613    9560 system_pods.go:61] "etcd-default-k8s-different-port-20220531193451-2108" [7feb3af0-6f53-4104-9330-49b7717ce971] Running

	I0531 19:44:36.336613    9560 system_pods.go:61] "kube-apiserver-default-k8s-different-port-20220531193451-2108" [c7da96b9-e9f6-490e-9709-9b938eee0a8b] Running

	I0531 19:44:36.336613    9560 system_pods.go:61] "kube-controller-manager-default-k8s-different-port-20220531193451-2108" [2005a083-b32b-4917-ab29-f35f09eb7b73] Running

	I0531 19:44:36.336613    9560 system_pods.go:61] "kube-proxy-vm4xx" [fa9681eb-0cbe-4d1f-9533-1f8e3a229507] Running

	I0531 19:44:36.336613    9560 system_pods.go:61] "kube-scheduler-default-k8s-different-port-20220531193451-2108" [edc80bc1-bac0-4f1a-a048-d26c23630cef] Running

	I0531 19:44:36.336613    9560 system_pods.go:61] "metrics-server-b955d9d8-ztsk8" [5c61df25-03cd-4529-b27f-75b5a684dd1d] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:44:36.336613    9560 system_pods.go:61] "storage-provisioner" [92d9d4de-13a3-487a-8bd4-133e153e4444] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0531 19:44:36.336613    9560 system_pods.go:74] duration metric: took 100.1146ms to wait for pod list to return data ...

	I0531 19:44:36.336613    9560 default_sa.go:34] waiting for default service account to be created ...

	I0531 19:44:36.434215    9560 default_sa.go:45] found service account: "default"

	I0531 19:44:36.434215    9560 default_sa.go:55] duration metric: took 97.602ms for default service account to be created ...

	I0531 19:44:36.434215    9560 system_pods.go:116] waiting for k8s-apps to be running ...

	I0531 19:44:36.458219    9560 system_pods.go:86] 9 kube-system pods found

	I0531 19:44:36.458219    9560 system_pods.go:89] "coredns-64897985d-884ps" [7e2fbf53-e186-470d-a621-422adcdefe32] Running

	I0531 19:44:36.458219    9560 system_pods.go:89] "coredns-64897985d-kh4sm" [97634b04-cc54-499b-b5bd-75ff7aaa05ab] Running

	I0531 19:44:36.458219    9560 system_pods.go:89] "etcd-default-k8s-different-port-20220531193451-2108" [7feb3af0-6f53-4104-9330-49b7717ce971] Running

	I0531 19:44:36.458219    9560 system_pods.go:89] "kube-apiserver-default-k8s-different-port-20220531193451-2108" [c7da96b9-e9f6-490e-9709-9b938eee0a8b] Running

	I0531 19:44:36.458219    9560 system_pods.go:89] "kube-controller-manager-default-k8s-different-port-20220531193451-2108" [2005a083-b32b-4917-ab29-f35f09eb7b73] Running

	I0531 19:44:36.458219    9560 system_pods.go:89] "kube-proxy-vm4xx" [fa9681eb-0cbe-4d1f-9533-1f8e3a229507] Running

	I0531 19:44:36.458219    9560 system_pods.go:89] "kube-scheduler-default-k8s-different-port-20220531193451-2108" [edc80bc1-bac0-4f1a-a048-d26c23630cef] Running

	I0531 19:44:36.458219    9560 system_pods.go:89] "metrics-server-b955d9d8-ztsk8" [5c61df25-03cd-4529-b27f-75b5a684dd1d] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0531 19:44:36.458219    9560 system_pods.go:89] "storage-provisioner" [92d9d4de-13a3-487a-8bd4-133e153e4444] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0531 19:44:36.458219    9560 system_pods.go:126] duration metric: took 24.003ms to wait for k8s-apps to be running ...

	I0531 19:44:36.458219    9560 system_svc.go:44] waiting for kubelet service to be running ....

	I0531 19:44:36.471401    9560 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0531 19:44:36.632800    9560 system_svc.go:56] duration metric: took 174.5803ms WaitForService to wait for kubelet.

	I0531 19:44:36.632894    9560 kubeadm.go:572] duration metric: took 15.4031236s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0531 19:44:36.633100    9560 node_conditions.go:102] verifying NodePressure condition ...

	I0531 19:44:36.726771    9560 node_conditions.go:122] node storage ephemeral capacity is 263174212Ki

	I0531 19:44:36.726825    9560 node_conditions.go:123] node cpu capacity is 16

	I0531 19:44:36.726825    9560 node_conditions.go:105] duration metric: took 93.7246ms to run NodePressure ...

	I0531 19:44:36.726825    9560 start.go:213] waiting for startup goroutines ...

	I0531 19:44:36.942049    9560 start.go:504] kubectl: 1.18.2, cluster: 1.23.6 (minor skew: 5)

	I0531 19:44:36.944037    9560 out.go:177] 

	W0531 19:44:36.947044    9560 out.go:239] ! C:\ProgramData\chocolatey\bin\kubectl.exe is version 1.18.2, which may have incompatibilites with Kubernetes 1.23.6.

	I0531 19:44:36.952046    9560 out.go:177]   - Want kubectl v1.23.6? Try 'minikube kubectl -- get pods -A'

	I0531 19:44:36.959043    9560 out.go:177] * Done! kubectl is now configured to use "default-k8s-different-port-20220531193451-2108" cluster and "default" namespace by default

	I0531 19:44:36.305796    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	I0531 19:44:38.314968    8616 pod_ready.go:102] pod "metrics-server-b955d9d8-n88dp" in "kube-system" namespace has status "Ready":"False"

	* 

	* ==> Docker <==

	* -- Logs begin at Tue 2022-05-31 19:35:55 UTC, end at Tue 2022-05-31 19:44:49 UTC. --

	May 31 19:41:35 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:41:35.070201300Z" level=info msg="ignoring event" container=edfbcbda899056e2410c4acf8ea6a853cdd0b2fbe327f91acc1611a8d3d3391c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 19:42:18 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:18.649088800Z" level=error msg="stream copy error: reading from a closed fifo"

	May 31 19:42:18 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:18.719649300Z" level=error msg="stream copy error: reading from a closed fifo"

	May 31 19:42:19 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:19.821922300Z" level=error msg="247dabaa3d5f823c5b66c2062b47692e5b49e91435959ae09de0f032a5623800 cleanup: failed to delete container from containerd: no such container"

	May 31 19:42:19 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:19.822450700Z" level=error msg="Handler for POST /containers/247dabaa3d5f823c5b66c2062b47692e5b49e91435959ae09de0f032a5623800/start returned error: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: writing syncT \"procResume\": write init-p: broken pipe: unknown"

	May 31 19:42:28 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:28.645661400Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:42:28 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:28.645743100Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:42:28 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:28.655547400Z" level=error msg="Handler for POST /images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:42:29 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:29.873960300Z" level=warning msg="reference for unknown type: application/vnd.docker.distribution.manifest.v1+prettyjws" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" remote="k8s.gcr.io/echoserver:1.4"

	May 31 19:42:30 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:30.049928000Z" level=warning msg="Error persisting manifest" digest="sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb" error="error committing manifest to content store: commit failed: unexpected commit digest sha256:eaee4c452b076cdb05b391ed7e75e1ad0aca136665875ab5d7e2f3d9f4675769, expected sha256:5d99aa1120524c801bc8c1a7077e8f5ec122ba16b6dda1a5d3826057f67b9bcb: failed precondition" remote="k8s.gcr.io/echoserver:1.4"

	May 31 19:42:47 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:47.980007500Z" level=warning msg="reference for unknown type: " digest="sha256:cc746e7a0b1eec0db01cbabbb6386b23d7af97e79fa9e36bb883a95b7eb96fe2" remote="docker.io/kubernetesui/dashboard@sha256:cc746e7a0b1eec0db01cbabbb6386b23d7af97e79fa9e36bb883a95b7eb96fe2"

	May 31 19:42:48 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:48.345433300Z" level=info msg="ignoring event" container=9baa5613dc437df519abd371e1c81dd506a65210c0049a8f8c6a60cba02b84c9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 19:42:49 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:42:49.050869500Z" level=info msg="ignoring event" container=a82f5f7cd3eb6a6365072d16275bd8268df4e96e619a79fa57e043015adfdee5 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 19:43:01 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:43:01.022851800Z" level=info msg="ignoring event" container=817b790393050f42b01ddb3442a99a6c5ba58651a8df3b91e5f0c0ffb80c4666 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 19:43:11 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:43:11.258016700Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:43:11 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:43:11.258272000Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:43:11 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:43:11.270055200Z" level=error msg="Handler for POST /images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:43:22 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:43:22.420615000Z" level=info msg="ignoring event" container=03167ba0f08fdff581ad496cd4bbb5dbff52a4602923c0fecd2f201ef3c775cb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 19:43:39 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:43:39.644305000Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:43:39 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:43:39.644465200Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:43:39 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:43:39.661137500Z" level=error msg="Handler for POST /images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:44:09 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:44:09.254101000Z" level=info msg="ignoring event" container=d9bab4566384602eebba16adb5527bbde86b9377f00da7d2e1af2ddc1ea2b2a8 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 31 19:44:21 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:44:21.620781100Z" level=warning msg="Error getting v2 registry: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:44:21 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:44:21.620964500Z" level=info msg="Attempting next endpoint for pull after error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:44:21 old-k8s-version-20220531192531-2108 dockerd[250]: time="2022-05-31T19:44:21.651968600Z" level=error msg="Handler for POST /images/create returned error: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                            CREATED              STATE               NAME                        ATTEMPT             POD ID

	d9bab45663846       a90209bb39e3d                                                                                    41 seconds ago       Exited              dashboard-metrics-scraper   4                   10762210a70b3

	8c65f88737998       kubernetesui/dashboard@sha256:cc746e7a0b1eec0db01cbabbb6386b23d7af97e79fa9e36bb883a95b7eb96fe2   About a minute ago   Running             kubernetes-dashboard        0                   363a1b018898e

	78333097362ef       6e38f40d628db                                                                                    2 minutes ago        Running             storage-provisioner         0                   8357a697373e0

	fb1686d28fd2f       bf261d1579144                                                                                    2 minutes ago        Running             coredns                     0                   e64f972d867d6

	49b44baa515c4       c21b0c7400f98                                                                                    2 minutes ago        Running             kube-proxy                  0                   46895f03742d0

	be55be2991218       b2756210eeabf                                                                                    3 minutes ago        Running             etcd                        0                   2f1d5465012c0

	2e7bf308b9082       301ddc62b80b1                                                                                    3 minutes ago        Running             kube-scheduler              0                   2b7ee67a9db7a

	86f1dffe85081       b305571ca60a5                                                                                    3 minutes ago        Running             kube-apiserver              0                   28f7e7bc70e63

	963332154a4f7       06a629a7e51cd                                                                                    3 minutes ago        Running             kube-controller-manager     0                   b80cecadcecf5

	* 

	* ==> coredns [fb1686d28fd2] <==

	* .:53

	2022-05-31T19:42:20.924Z [INFO] plugin/reload: Running configuration MD5 = f64cb9b977c7dfca58c4fab108535a76

	2022-05-31T19:42:20.925Z [INFO] CoreDNS-1.6.2

	2022-05-31T19:42:20.929Z [INFO] linux/amd64, go1.12.8, 795a3eb

	CoreDNS-1.6.2

	linux/amd64, go1.12.8, 795a3eb

	[INFO] Reloading

	2022-05-31T19:42:57.534Z [INFO] plugin/reload: Running configuration MD5 = 034a4984a79adc08e57427d1bc08b68f

	[INFO] Reloading complete

	* 

	* ==> describe nodes <==

	* Name:               old-k8s-version-20220531192531-2108

	Roles:              master

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=old-k8s-version-20220531192531-2108

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=bd46569bd7cb517fcad2e704abdebd2826bd8454

	                    minikube.k8s.io/name=old-k8s-version-20220531192531-2108

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2022_05_31T19_41_59_0700

	                    minikube.k8s.io/version=v1.26.0-beta.1

	                    node-role.kubernetes.io/master=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Tue, 31 May 2022 19:41:54 +0000

	Taints:             <none>

	Unschedulable:      false

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Tue, 31 May 2022 19:44:16 +0000   Tue, 31 May 2022 19:41:49 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Tue, 31 May 2022 19:44:16 +0000   Tue, 31 May 2022 19:41:49 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Tue, 31 May 2022 19:44:16 +0000   Tue, 31 May 2022 19:41:49 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Tue, 31 May 2022 19:44:16 +0000   Tue, 31 May 2022 19:41:49 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.76.2

	  Hostname:    old-k8s-version-20220531192531-2108

	Capacity:

	 cpu:                16

	 ephemeral-storage:  263174212Ki

	 hugepages-1Gi:      0

	 hugepages-2Mi:      0

	 memory:             52638988Ki

	 pods:               110

	Allocatable:

	 cpu:                16

	 ephemeral-storage:  263174212Ki

	 hugepages-1Gi:      0

	 hugepages-2Mi:      0

	 memory:             52638988Ki

	 pods:               110

	System Info:

	 Machine ID:                 bfc82849fe6e4a6a9236307a23a8b5f1

	 System UUID:                bfc82849fe6e4a6a9236307a23a8b5f1

	 Boot ID:                    99d8680c-6839-4c5e-a5fa-8740ef80d5ef

	 Kernel Version:             5.10.102.1-microsoft-standard-WSL2

	 OS Image:                   Ubuntu 20.04.4 LTS

	 Operating System:           linux

	 Architecture:               amd64

	 Container Runtime Version:  docker://20.10.16

	 Kubelet Version:            v1.16.0

	 Kube-Proxy Version:         v1.16.0

	PodCIDR:                     10.244.0.0/24

	PodCIDRs:                    10.244.0.0/24

	Non-terminated Pods:         (10 in total)

	  Namespace                  Name                                                           CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE

	  ---------                  ----                                                           ------------  ----------  ---------------  -------------  ---

	  kube-system                coredns-5644d7b6d9-jxp72                                       100m (0%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (0%!)(MISSING)     2m34s

	  kube-system                etcd-old-k8s-version-20220531192531-2108                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         116s

	  kube-system                kube-apiserver-old-k8s-version-20220531192531-2108             250m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         95s

	  kube-system                kube-controller-manager-old-k8s-version-20220531192531-2108    200m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         114s

	  kube-system                kube-proxy-r556l                                               0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m34s

	  kube-system                kube-scheduler-old-k8s-version-20220531192531-2108             100m (0%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         98s

	  kube-system                metrics-server-6f89b5864b-v8mjx                                100m (0%!)(MISSING)     0 (0%!)(MISSING)      200Mi (0%!)(MISSING)       0 (0%!)(MISSING)         2m25s

	  kube-system                storage-provisioner                                            0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m27s

	  kubernetes-dashboard       dashboard-metrics-scraper-6b84985989-cs5v7                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m23s

	  kubernetes-dashboard       kubernetes-dashboard-6fb5469cf5-spl8w                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m22s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (4%!)(MISSING)   0 (0%!)(MISSING)

	  memory             270Mi (0%!)(MISSING)  170Mi (0%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                  From                                             Message

	  ----    ------                   ----                 ----                                             -------

	  Normal  NodeHasSufficientMemory  3m7s (x7 over 3m8s)  kubelet, old-k8s-version-20220531192531-2108     Node old-k8s-version-20220531192531-2108 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m7s (x8 over 3m8s)  kubelet, old-k8s-version-20220531192531-2108     Node old-k8s-version-20220531192531-2108 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m7s (x8 over 3m8s)  kubelet, old-k8s-version-20220531192531-2108     Node old-k8s-version-20220531192531-2108 status is now: NodeHasSufficientPID

	  Normal  Starting                 2m30s                kube-proxy, old-k8s-version-20220531192531-2108  Starting kube-proxy.

	* 

	* ==> dmesg <==

	* [  +0.001366] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000006] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000932] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000006] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.089750] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000005] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.002712] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000005] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.106424] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000004] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.091580] overlayfs: upperdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[  +0.000006] overlayfs: workdir is in-use as upperdir/workdir of another mount, accessing files from both mounts will result in undefined behavior.

	[May31 19:22] WSL2: Performing memory compaction.

	[May31 19:23] WSL2: Performing memory compaction.

	[May31 19:24] WSL2: Performing memory compaction.

	[May31 19:25] WSL2: Performing memory compaction.

	[May31 19:26] WSL2: Performing memory compaction.

	[May31 19:27] WSL2: Performing memory compaction.

	[May31 19:28] WSL2: Performing memory compaction.

	[May31 19:30] WSL2: Performing memory compaction.

	[May31 19:32] WSL2: Performing memory compaction.

	[May31 19:34] WSL2: Performing memory compaction.

	[May31 19:37] WSL2: Performing memory compaction.

	[May31 19:39] WSL2: Performing memory compaction.

	[May31 19:40] WSL2: Performing memory compaction.

	* 

	* ==> etcd [be55be299121] <==

	* 2022-05-31 19:42:26.630811 W | etcdserver: read-only range request "key:\"/registry/pods/kubernetes-dashboard/dashboard-metrics-scraper-6b84985989-cs5v7\" " with result "range_response_count:1 size:1332" took too long (107.6487ms) to execute

	2022-05-31 19:42:26.830639 W | etcdserver: read-only range request "key:\"/registry/services/specs/kubernetes-dashboard/dashboard-metrics-scraper\" " with result "range_response_count:0 size:5" took too long (105.1522ms) to execute

	2022-05-31 19:42:26.840350 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" " with result "range_response_count:1 size:765" took too long (107.9713ms) to execute

	2022-05-31 19:42:27.442251 W | etcdserver: request "header:<ID:15638328711796955265 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/deployments/kubernetes-dashboard/kubernetes-dashboard\" mod_revision:446 > success:<request_put:<key:\"/registry/deployments/kubernetes-dashboard/kubernetes-dashboard\" value_size:2654 >> failure:<request_range:<key:\"/registry/deployments/kubernetes-dashboard/kubernetes-dashboard\" > >>" with result "size:16" took too long (107.2543ms) to execute

	2022-05-31 19:42:27.442940 W | etcdserver: read-only range request "key:\"/registry/replicasets/kubernetes-dashboard/kubernetes-dashboard-6fb5469cf5\" " with result "range_response_count:1 size:1341" took too long (114.3883ms) to execute

	2022-05-31 19:42:27.443132 W | etcdserver: read-only range request "key:\"/registry/pods/kubernetes-dashboard/kubernetes-dashboard-6fb5469cf5-spl8w\" " with result "range_response_count:1 size:1433" took too long (118.4499ms) to execute

	2022-05-31 19:42:27.443515 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/\" range_end:\"/registry/pods/kube-system0\" " with result "range_response_count:4 size:7727" took too long (103.0409ms) to execute

	2022-05-31 19:42:27.726784 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/\" range_end:\"/registry/pods/kube-system0\" " with result "range_response_count:4 size:7727" took too long (191.366ms) to execute

	2022-05-31 19:42:59.737641 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" " with result "range_response_count:1 size:765" took too long (192.8333ms) to execute

	2022-05-31 19:43:46.615330 W | etcdserver: read-only range request "key:\"/registry/services/endpoints\" range_end:\"/registry/services/endpointt\" count_only:true " with result "range_response_count:0 size:7" took too long (179.4081ms) to execute

	2022-05-31 19:44:28.378981 W | wal: sync duration of 2.652483s, expected less than 1s

	2022-05-31 19:44:28.379407 W | etcdserver: read-only range request "key:\"/registry/ingress\" range_end:\"/registry/ingrest\" count_only:true " with result "range_response_count:0 size:5" took too long (2.5672282s) to execute

	2022-05-31 19:44:28.379449 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "range_response_count:0 size:5" took too long (446.7121ms) to execute

	2022-05-31 19:44:28.379503 W | etcdserver: read-only range request "key:\"/registry/namespaces/default\" " with result "range_response_count:1 size:172" took too long (1.0195367s) to execute

	2022-05-31 19:44:28.379646 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" " with result "range_response_count:1 size:765" took too long (1.7875564s) to execute

	2022-05-31 19:44:28.379737 W | etcdserver: read-only range request "key:\"/registry/priorityclasses\" range_end:\"/registry/priorityclasset\" count_only:true " with result "range_response_count:0 size:7" took too long (2.2886056s) to execute

	2022-05-31 19:44:28.379819 W | etcdserver: read-only range request "key:\"/registry/replicasets\" range_end:\"/registry/replicasett\" count_only:true " with result "range_response_count:0 size:7" took too long (1.8233543s) to execute

	2022-05-31 19:44:28.380038 W | etcdserver: read-only range request "key:\"/registry/apiregistration.k8s.io/apiservices\" range_end:\"/registry/apiregistration.k8s.io/apiservicet\" count_only:true " with result "range_response_count:0 size:7" took too long (1.7236893s) to execute

	2022-05-31 19:44:31.265268 W | etcdserver: read-only range request "key:\"/registry/health\" " with result "error:context canceled" took too long (1.9985346s) to execute

	WARNING: 2022/05/31 19:44:31 grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	2022-05-31 19:44:31.447580 W | wal: sync duration of 3.0605439s, expected less than 1s

	2022-05-31 19:44:31.452686 W | etcdserver: read-only range request "key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" " with result "range_response_count:1 size:765" took too long (1.057688s) to execute

	2022-05-31 19:44:31.452899 W | etcdserver: read-only range request "key:\"/registry/jobs/\" range_end:\"/registry/jobs0\" limit:500 " with result "range_response_count:0 size:5" took too long (991.3616ms) to execute

	2022-05-31 19:44:31.595680 W | etcdserver: read-only range request "key:\"/registry/masterleases/\" range_end:\"/registry/masterleases0\" " with result "range_response_count:1 size:133" took too long (133.4275ms) to execute

	2022-05-31 19:44:31.595763 W | etcdserver: read-only range request "key:\"/registry/cronjobs/\" range_end:\"/registry/cronjobs0\" limit:500 " with result "range_response_count:0 size:5" took too long (137.9661ms) to execute

	* 

	* ==> kernel <==

	*  19:44:49 up  2:32,  0 users,  load average: 9.76, 6.95, 4.78

	Linux old-k8s-version-20220531192531-2108 5.10.102.1-microsoft-standard-WSL2 #1 SMP Wed Mar 2 00:30:59 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.4 LTS"

	* 

	* ==> kube-apiserver [86f1dffe8508] <==

	* I0531 19:42:15.540631       1 controller.go:606] quota admission added evaluator for: events.events.k8s.io

	E0531 19:42:21.037408       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"context canceled"}

	E0531 19:42:24.321308       1 available_controller.go:416] v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.metrics.k8s.io": the object has been modified; please apply your changes to the latest version and try again

	I0531 19:42:28.041510       1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io

	W0531 19:42:28.042270       1 handler_proxy.go:99] no RequestInfo found in the context

	E0531 19:42:28.042505       1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	I0531 19:42:28.042586       1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	I0531 19:43:28.042562       1 controller.go:107] OpenAPI AggregationController: Processing item v1beta1.metrics.k8s.io

	W0531 19:43:28.042881       1 handler_proxy.go:99] no RequestInfo found in the context

	E0531 19:43:28.042943       1 controller.go:114] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	I0531 19:43:28.042960       1 controller.go:127] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	I0531 19:44:28.380791       1 trace.go:116] Trace[1541496348]: "Get" url:/api/v1/namespaces/default (started: 2022-05-31 19:44:27.3576741 +0000 UTC m=+162.419119001) (total time: 1.0230698s):

	Trace[1541496348]: [1.0229261s] [1.0228664s] About to write a response

	I0531 19:44:28.381585       1 trace.go:116] Trace[950649266]: "Get" url:/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath (started: 2022-05-31 19:44:26.5882129 +0000 UTC m=+161.652586901) (total time: 1.7904001s):

	Trace[950649266]: [1.7896403s] [1.7895117s] About to write a response

	I0531 19:44:31.453626       1 trace.go:116] Trace[1006579568]: "Get" url:/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath (started: 2022-05-31 19:44:30.3938889 +0000 UTC m=+165.455333701) (total time: 1.0596932s):

	Trace[1006579568]: [1.0596037s] [1.0595329s] About to write a response

	I0531 19:44:31.453813       1 trace.go:116] Trace[1200980499]: "GuaranteedUpdate etcd3" type:*v1.Endpoints (started: 2022-05-31 19:44:28.385392 +0000 UTC m=+163.446836901) (total time: 3.0683875s):

	Trace[1200980499]: [3.0649376s] [3.0634737s] Transaction prepared

	I0531 19:44:31.454012       1 trace.go:116] Trace[1731275634]: "List etcd3" key:/jobs,resourceVersion:,limit:500,continue: (started: 2022-05-31 19:44:30.4608477 +0000 UTC m=+165.522292601) (total time: 993.125ms):

	Trace[1731275634]: [993.125ms] [993.125ms] END

	I0531 19:44:31.454156       1 trace.go:116] Trace[1224807279]: "List" url:/apis/batch/v1/jobs (started: 2022-05-31 19:44:30.4606445 +0000 UTC m=+165.522089401) (total time: 993.4827ms):

	Trace[1224807279]: [993.383ms] [993.2085ms] Listing from storage done

	* 

	* ==> kube-controller-manager [963332154a4f] <==

	* E0531 19:42:25.723920       1 replica_set.go:450] Sync "kubernetes-dashboard/kubernetes-dashboard-6fb5469cf5" failed with pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0531 19:42:25.724140       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-6fb5469cf5", UID:"40a45895-1dcf-45f7-a413-5594ec6dfeae", APIVersion:"apps/v1", ResourceVersion:"442", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0531 19:42:25.831478       1 replica_set.go:450] Sync "kubernetes-dashboard/kubernetes-dashboard-6fb5469cf5" failed with pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0531 19:42:25.831589       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-6b84985989", UID:"9c398431-17d0-4314-8e73-409c72e6fd2f", APIVersion:"apps/v1", ResourceVersion:"435", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "dashboard-metrics-scraper-6b84985989-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0531 19:42:25.831621       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-6fb5469cf5", UID:"40a45895-1dcf-45f7-a413-5594ec6dfeae", APIVersion:"apps/v1", ResourceVersion:"442", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0531 19:42:25.831478       1 replica_set.go:450] Sync "kubernetes-dashboard/dashboard-metrics-scraper-6b84985989" failed with pods "dashboard-metrics-scraper-6b84985989-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0531 19:42:25.845070       1 replica_set.go:450] Sync "kubernetes-dashboard/kubernetes-dashboard-6fb5469cf5" failed with pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0531 19:42:25.845070       1 replica_set.go:450] Sync "kubernetes-dashboard/dashboard-metrics-scraper-6b84985989" failed with pods "dashboard-metrics-scraper-6b84985989-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0531 19:42:25.845111       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-6b84985989", UID:"9c398431-17d0-4314-8e73-409c72e6fd2f", APIVersion:"apps/v1", ResourceVersion:"435", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "dashboard-metrics-scraper-6b84985989-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0531 19:42:25.845338       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-6fb5469cf5", UID:"40a45895-1dcf-45f7-a413-5594ec6dfeae", APIVersion:"apps/v1", ResourceVersion:"442", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0531 19:42:25.925957       1 replica_set.go:450] Sync "kubernetes-dashboard/kubernetes-dashboard-6fb5469cf5" failed with pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0531 19:42:25.926050       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-6fb5469cf5", UID:"40a45895-1dcf-45f7-a413-5594ec6dfeae", APIVersion:"apps/v1", ResourceVersion:"442", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "kubernetes-dashboard-6fb5469cf5-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	E0531 19:42:25.926273       1 replica_set.go:450] Sync "kubernetes-dashboard/dashboard-metrics-scraper-6b84985989" failed with pods "dashboard-metrics-scraper-6b84985989-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0531 19:42:25.926443       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-6b84985989", UID:"9c398431-17d0-4314-8e73-409c72e6fd2f", APIVersion:"apps/v1", ResourceVersion:"435", FieldPath:""}): type: 'Warning' reason: 'FailedCreate' Error creating: pods "dashboard-metrics-scraper-6b84985989-" is forbidden: error looking up service account kubernetes-dashboard/kubernetes-dashboard: serviceaccount "kubernetes-dashboard" not found

	I0531 19:42:26.334974       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"dashboard-metrics-scraper-6b84985989", UID:"9c398431-17d0-4314-8e73-409c72e6fd2f", APIVersion:"apps/v1", ResourceVersion:"435", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: dashboard-metrics-scraper-6b84985989-cs5v7

	I0531 19:42:27.125010       1 event.go:255] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kubernetes-dashboard", Name:"kubernetes-dashboard-6fb5469cf5", UID:"40a45895-1dcf-45f7-a413-5594ec6dfeae", APIVersion:"apps/v1", ResourceVersion:"442", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kubernetes-dashboard-6fb5469cf5-spl8w

	E0531 19:42:45.384462       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	W0531 19:42:47.140581       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E0531 19:43:15.637500       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	W0531 19:43:19.143177       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E0531 19:43:45.891581       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	W0531 19:43:51.148696       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E0531 19:44:16.143760       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	W0531 19:44:23.151407       1 garbagecollector.go:640] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E0531 19:44:46.400529       1 resource_quota_controller.go:407] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	* 

	* ==> kube-proxy [49b44baa515c] <==

	* W0531 19:42:19.444246       1 proxier.go:584] Failed to read file /lib/modules/5.10.102.1-microsoft-standard-WSL2/modules.builtin with error open /lib/modules/5.10.102.1-microsoft-standard-WSL2/modules.builtin: no such file or directory. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules

	W0531 19:42:19.446817       1 proxier.go:597] Failed to load kernel module ip_vs with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules

	W0531 19:42:19.448464       1 proxier.go:597] Failed to load kernel module ip_vs_rr with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules

	W0531 19:42:19.450411       1 proxier.go:597] Failed to load kernel module ip_vs_wrr with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules

	W0531 19:42:19.452862       1 proxier.go:597] Failed to load kernel module ip_vs_sh with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules

	W0531 19:42:19.455345       1 proxier.go:597] Failed to load kernel module nf_conntrack with modprobe. You can ignore this message when kube-proxy is running inside container without mounting /lib/modules

	W0531 19:42:19.467121       1 server_others.go:329] Flag proxy-mode="" unknown, assuming iptables proxy

	I0531 19:42:19.544240       1 node.go:135] Successfully retrieved node IP: 192.168.76.2

	I0531 19:42:19.544403       1 server_others.go:149] Using iptables Proxier.

	I0531 19:42:19.546875       1 server.go:529] Version: v1.16.0

	I0531 19:42:19.549594       1 config.go:313] Starting service config controller

	I0531 19:42:19.549892       1 shared_informer.go:197] Waiting for caches to sync for service config

	I0531 19:42:19.550030       1 config.go:131] Starting endpoints config controller

	I0531 19:42:19.550059       1 shared_informer.go:197] Waiting for caches to sync for endpoints config

	I0531 19:42:19.719990       1 shared_informer.go:204] Caches are synced for service config 

	I0531 19:42:19.720004       1 shared_informer.go:204] Caches are synced for endpoints config 

	* 

	* ==> kube-scheduler [2e7bf308b908] <==

	* E0531 19:41:54.325388       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0531 19:41:54.325504       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0531 19:41:54.325639       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0531 19:41:54.329115       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0531 19:41:54.329869       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0531 19:41:54.330888       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0531 19:41:54.330887       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0531 19:41:54.332887       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0531 19:41:54.332892       1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0531 19:41:55.329102       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0531 19:41:55.332862       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0531 19:41:55.332977       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0531 19:41:55.334522       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0531 19:41:55.334630       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0531 19:41:55.423075       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0531 19:41:55.423889       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0531 19:41:55.425687       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0531 19:41:55.425758       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0531 19:41:55.431862       1 reflector.go:123] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:236: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0531 19:41:55.432247       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0531 19:41:56.333544       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0531 19:41:56.336222       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0531 19:41:56.338066       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0531 19:41:56.342236       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1beta1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0531 19:41:56.342315       1 reflector.go:123] k8s.io/client-go/informers/factory.go:134: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	* 

	* ==> kubelet <==

	* -- Logs begin at Tue 2022-05-31 19:35:55 UTC, end at Tue 2022-05-31 19:44:50 UTC. --

	May 31 19:43:24 old-k8s-version-20220531192531-2108 kubelet[5553]: W0531 19:43:24.306814    5553 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-6b84985989-cs5v7 through plugin: invalid network status for

	May 31 19:43:25 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:25.560752    5553 pod_workers.go:191] Error syncing pod c248957e-7215-4044-9e73-acc8998b61f1 ("metrics-server-6f89b5864b-v8mjx_kube-system(c248957e-7215-4044-9e73-acc8998b61f1)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/k8s.gcr.io/echoserver:1.4\""

	May 31 19:43:29 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:29.445512    5553 pod_workers.go:191] Error syncing pod 82fa1259-4596-4392-9f56-571eafe449d1 ("dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"

	May 31 19:43:39 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:39.662275    5553 remote_image.go:113] PullImage "fake.domain/k8s.gcr.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host

	May 31 19:43:39 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:39.662417    5553 kuberuntime_image.go:50] Pull image "fake.domain/k8s.gcr.io/echoserver:1.4" failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host

	May 31 19:43:39 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:39.662599    5553 kuberuntime_manager.go:783] container start failed: ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host

	May 31 19:43:39 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:39.662670    5553 pod_workers.go:191] Error syncing pod c248957e-7215-4044-9e73-acc8998b61f1 ("metrics-server-6f89b5864b-v8mjx_kube-system(c248957e-7215-4044-9e73-acc8998b61f1)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:43:42 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:42.551936    5553 pod_workers.go:191] Error syncing pod 82fa1259-4596-4392-9f56-571eafe449d1 ("dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"

	May 31 19:43:51 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:51.568837    5553 pod_workers.go:191] Error syncing pod c248957e-7215-4044-9e73-acc8998b61f1 ("metrics-server-6f89b5864b-v8mjx_kube-system(c248957e-7215-4044-9e73-acc8998b61f1)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/k8s.gcr.io/echoserver:1.4\""

	May 31 19:43:54 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:43:54.552084    5553 pod_workers.go:191] Error syncing pod 82fa1259-4596-4392-9f56-571eafe449d1 ("dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 40s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"

	May 31 19:44:06 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:44:06.557836    5553 pod_workers.go:191] Error syncing pod c248957e-7215-4044-9e73-acc8998b61f1 ("metrics-server-6f89b5864b-v8mjx_kube-system(c248957e-7215-4044-9e73-acc8998b61f1)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/k8s.gcr.io/echoserver:1.4\""

	May 31 19:44:08 old-k8s-version-20220531192531-2108 kubelet[5553]: W0531 19:44:08.934232    5553 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-6b84985989-cs5v7 through plugin: invalid network status for

	May 31 19:44:09 old-k8s-version-20220531192531-2108 kubelet[5553]: W0531 19:44:09.402928    5553 container.go:409] Failed to create summary reader for "/kubepods/besteffort/pod82fa1259-4596-4392-9f56-571eafe449d1/d9bab4566384602eebba16adb5527bbde86b9377f00da7d2e1af2ddc1ea2b2a8": none of the resources are being tracked.

	May 31 19:44:10 old-k8s-version-20220531192531-2108 kubelet[5553]: W0531 19:44:10.250330    5553 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-6b84985989-cs5v7 through plugin: invalid network status for

	May 31 19:44:10 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:44:10.268374    5553 pod_workers.go:191] Error syncing pod 82fa1259-4596-4392-9f56-571eafe449d1 ("dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"

	May 31 19:44:11 old-k8s-version-20220531192531-2108 kubelet[5553]: W0531 19:44:11.282563    5553 docker_sandbox.go:394] failed to read pod IP from plugin/docker: Couldn't find network status for kubernetes-dashboard/dashboard-metrics-scraper-6b84985989-cs5v7 through plugin: invalid network status for

	May 31 19:44:19 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:44:19.443677    5553 pod_workers.go:191] Error syncing pod 82fa1259-4596-4392-9f56-571eafe449d1 ("dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"

	May 31 19:44:21 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:44:21.653489    5553 remote_image.go:113] PullImage "fake.domain/k8s.gcr.io/echoserver:1.4" from image service failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host

	May 31 19:44:21 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:44:21.653959    5553 kuberuntime_image.go:50] Pull image "fake.domain/k8s.gcr.io/echoserver:1.4" failed: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host

	May 31 19:44:21 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:44:21.654224    5553 kuberuntime_manager.go:783] container start failed: ErrImagePull: rpc error: code = Unknown desc = Error response from daemon: Get "https://fake.domain/v2/": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host

	May 31 19:44:21 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:44:21.654330    5553 pod_workers.go:191] Error syncing pod c248957e-7215-4044-9e73-acc8998b61f1 ("metrics-server-6f89b5864b-v8mjx_kube-system(c248957e-7215-4044-9e73-acc8998b61f1)"), skipping: failed to "StartContainer" for "metrics-server" with ErrImagePull: "rpc error: code = Unknown desc = Error response from daemon: Get \"https://fake.domain/v2/\": dial tcp: lookup fake.domain on 192.168.65.2:53: no such host"

	May 31 19:44:30 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:44:30.553156    5553 pod_workers.go:191] Error syncing pod 82fa1259-4596-4392-9f56-571eafe449d1 ("dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"

	May 31 19:44:35 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:44:35.557793    5553 pod_workers.go:191] Error syncing pod c248957e-7215-4044-9e73-acc8998b61f1 ("metrics-server-6f89b5864b-v8mjx_kube-system(c248957e-7215-4044-9e73-acc8998b61f1)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/k8s.gcr.io/echoserver:1.4\""

	May 31 19:44:45 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:44:45.553135    5553 pod_workers.go:191] Error syncing pod 82fa1259-4596-4392-9f56-571eafe449d1 ("dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"), skipping: failed to "StartContainer" for "dashboard-metrics-scraper" with CrashLoopBackOff: "back-off 1m20s restarting failed container=dashboard-metrics-scraper pod=dashboard-metrics-scraper-6b84985989-cs5v7_kubernetes-dashboard(82fa1259-4596-4392-9f56-571eafe449d1)"

	May 31 19:44:46 old-k8s-version-20220531192531-2108 kubelet[5553]: E0531 19:44:46.557032    5553 pod_workers.go:191] Error syncing pod c248957e-7215-4044-9e73-acc8998b61f1 ("metrics-server-6f89b5864b-v8mjx_kube-system(c248957e-7215-4044-9e73-acc8998b61f1)"), skipping: failed to "StartContainer" for "metrics-server" with ImagePullBackOff: "Back-off pulling image \"fake.domain/k8s.gcr.io/echoserver:1.4\""

	* 

	* ==> kubernetes-dashboard [8c65f8873799] <==

	* 2022/05/31 19:43:11 Starting overwatch

	2022/05/31 19:43:11 Using namespace: kubernetes-dashboard

	2022/05/31 19:43:11 Using in-cluster config to connect to apiserver

	2022/05/31 19:43:11 Using secret token for csrf signing

	2022/05/31 19:43:11 Initializing csrf token from kubernetes-dashboard-csrf secret

	2022/05/31 19:43:11 Empty token. Generating and storing in a secret kubernetes-dashboard-csrf

	2022/05/31 19:43:11 Successful initial request to the apiserver, version: v1.16.0

	2022/05/31 19:43:11 Generating JWE encryption key

	2022/05/31 19:43:11 New synchronizer has been registered: kubernetes-dashboard-key-holder-kubernetes-dashboard. Starting

	2022/05/31 19:43:11 Starting secret synchronizer for kubernetes-dashboard-key-holder in namespace kubernetes-dashboard

	2022/05/31 19:43:12 Initializing JWE encryption key from synchronized object

	2022/05/31 19:43:12 Creating in-cluster Sidecar client

	2022/05/31 19:43:12 Serving insecurely on HTTP port: 9090

	2022/05/31 19:43:12 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2022/05/31 19:43:42 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2022/05/31 19:44:12 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	2022/05/31 19:44:42 Metric client health check failed: the server is currently unable to handle the request (get services dashboard-metrics-scraper). Retrying in 30 seconds.

	* 

	* ==> storage-provisioner [78333097362e] <==

	* I0531 19:42:26.537283       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0531 19:42:26.627656       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0531 19:42:26.628194       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0531 19:42:26.726417       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0531 19:42:26.728128       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_old-k8s-version-20220531192531-2108_dedac804-a1e6-404e-a773-fabda9042592!

	I0531 19:42:26.729441       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"9faff84a-d94b-40cf-9dbc-713d9688f4e4", APIVersion:"v1", ResourceVersion:"474", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' old-k8s-version-20220531192531-2108_dedac804-a1e6-404e-a773-fabda9042592 became leader

	I0531 19:42:26.931160       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_old-k8s-version-20220531192531-2108_dedac804-a1e6-404e-a773-fabda9042592!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-windows-amd64.exe status --format={{.APIServer}} -p old-k8s-version-20220531192531-2108 -n old-k8s-version-20220531192531-2108

helpers_test.go:254: (dbg) Done: out/minikube-windows-amd64.exe status --format={{.APIServer}} -p old-k8s-version-20220531192531-2108 -n old-k8s-version-20220531192531-2108: (7.5771303s)

helpers_test.go:261: (dbg) Run:  kubectl --context old-k8s-version-20220531192531-2108 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:270: non-running pods: metrics-server-6f89b5864b-v8mjx

helpers_test.go:272: ======> post-mortem[TestStartStop/group/old-k8s-version/serial/Pause]: describe non-running pods <======

helpers_test.go:275: (dbg) Run:  kubectl --context old-k8s-version-20220531192531-2108 describe pod metrics-server-6f89b5864b-v8mjx

=== CONT  TestStartStop/group/old-k8s-version/serial/Pause

helpers_test.go:275: (dbg) Non-zero exit: kubectl --context old-k8s-version-20220531192531-2108 describe pod metrics-server-6f89b5864b-v8mjx: exit status 1 (329.8148ms)

** stderr ** 

	Error from server (NotFound): pods "metrics-server-6f89b5864b-v8mjx" not found

** /stderr **

helpers_test.go:277: kubectl --context old-k8s-version-20220531192531-2108 describe pod metrics-server-6f89b5864b-v8mjx: exit status 1

--- FAIL: TestStartStop/group/old-k8s-version/serial/Pause (69.22s)

=== RUN   TestNetworkPlugins/group/cilium/Start

net_test.go:101: (dbg) Run:  out/minikube-windows-amd64.exe start -p cilium-20220531191937-2108 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=docker

=== CONT  TestNetworkPlugins/group/cilium/Start

net_test.go:101: (dbg) Non-zero exit: out/minikube-windows-amd64.exe start -p cilium-20220531191937-2108 --memory=2048 --alsologtostderr --wait=true --wait-timeout=5m --cni=cilium --driver=docker: exit status 80 (10m10.2993893s)

-- stdout --

	* [cilium-20220531191937-2108] minikube v1.26.0-beta.1 on Microsoft Windows 10 Enterprise N 10.0.19044 Build 19044

	  - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	  - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	  - MINIKUBE_LOCATION=14079

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	* Using the docker driver based on user configuration

	* Using Docker Desktop driver with the root privilege

	* Starting control plane node cilium-20220531191937-2108 in cluster cilium-20220531191937-2108

	* Pulling base image ...

	* Creating docker container (CPUs=2, Memory=2048MB) ...

	* Preparing Kubernetes v1.23.6 on Docker 20.10.16 ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

	  - Configuring RBAC rules ...

	* Configuring Cilium (Container Networking Interface) ...

	* Verifying Kubernetes components...

	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	* Enabled addons: storage-provisioner, default-storageclass

-- /stdout --

** stderr ** 

	I0531 19:47:19.217590    9268 out.go:296] Setting OutFile to fd 712 ...

	I0531 19:47:19.278596    9268 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0531 19:47:19.278596    9268 out.go:309] Setting ErrFile to fd 1932...

	I0531 19:47:19.278596    9268 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0531 19:47:19.297850    9268 out.go:303] Setting JSON to false

	I0531 19:47:19.303849    9268 start.go:115] hostinfo: {"hostname":"minikube7","uptime":84709,"bootTime":1653941730,"procs":158,"os":"windows","platform":"Microsoft Windows 10 Enterprise N","platformFamily":"Standalone Workstation","platformVersion":"10.0.19044 Build 19044","kernelVersion":"10.0.19044 Build 19044","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f66ed2ea-6c04-4a6b-8eea-b2fb0953e990"}

	W0531 19:47:19.303849    9268 start.go:123] gopshost.Virtualization returned error: not implemented yet

	I0531 19:47:19.309419    9268 out.go:177] * [cilium-20220531191937-2108] minikube v1.26.0-beta.1 on Microsoft Windows 10 Enterprise N 10.0.19044 Build 19044

	I0531 19:47:19.313642    9268 notify.go:193] Checking for updates...

	I0531 19:47:19.317167    9268 out.go:177]   - KUBECONFIG=C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I0531 19:47:19.320604    9268 out.go:177]   - MINIKUBE_HOME=C:\Users\jenkins.minikube7\minikube-integration\.minikube

	I0531 19:47:19.323082    9268 out.go:177]   - MINIKUBE_LOCATION=14079

	I0531 19:47:19.326529    9268 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0531 19:47:19.330325    9268 config.go:178] Loaded profile config "auto-20220531191922-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.6

	I0531 19:47:19.330870    9268 config.go:178] Loaded profile config "embed-certs-20220531193346-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.6

	I0531 19:47:19.331448    9268 config.go:178] Loaded profile config "kindnet-20220531191930-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.6

	I0531 19:47:19.331736    9268 driver.go:358] Setting default libvirt URI to qemu:///system

	I0531 19:47:22.056358    9268 docker.go:137] docker version: linux-20.10.14

	I0531 19:47:22.069230    9268 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0531 19:47:24.316876    9268 cli_runner.go:217] Completed: docker system info --format "{{json .}}": (2.2474528s)

	I0531 19:47:24.317733    9268 info.go:265] docker info: {ID:JKWR:L4LW:XYJC:G6AI:GZFU:RUGW:CCH6:OD2M:V572:4FTB:B7YC:DTUC Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:76 OomKillDisable:true NGoroutines:58 SystemTime:2022-05-31 19:47:23.1932863 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_

64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,

profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc.

Version:v0.17.0]] Warnings:<nil>}}

	I0531 19:47:24.322041    9268 out.go:177] * Using the docker driver based on user configuration

	I0531 19:47:24.325725    9268 start.go:284] selected driver: docker

	I0531 19:47:24.325725    9268 start.go:806] validating driver "docker" against <nil>

	I0531 19:47:24.325725    9268 start.go:817] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0531 19:47:24.393157    9268 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0531 19:47:26.469542    9268 cli_runner.go:217] Completed: docker system info --format "{{json .}}": (2.0763763s)

	I0531 19:47:26.469753    9268 info.go:265] docker info: {ID:JKWR:L4LW:XYJC:G6AI:GZFU:RUGW:CCH6:OD2M:V572:4FTB:B7YC:DTUC Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:76 OomKillDisable:true NGoroutines:58 SystemTime:2022-05-31 19:47:25.4358344 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_

64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,

profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc.

Version:v0.17.0]] Warnings:<nil>}}

	I0531 19:47:26.469753    9268 start_flags.go:292] no existing cluster config was found, will generate one from the flags 

	I0531 19:47:26.470460    9268 start_flags.go:847] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0531 19:47:26.479386    9268 out.go:177] * Using Docker Desktop driver with the root privilege

	I0531 19:47:26.482388    9268 cni.go:95] Creating CNI manager for "cilium"

	I0531 19:47:26.483390    9268 start_flags.go:301] Found "Cilium" CNI - setting NetworkPlugin=cni

	I0531 19:47:26.483390    9268 start_flags.go:306] config:

	{Name:cilium-20220531191937-2108 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.6 ClusterName:cilium-20220531191937-2108 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local

ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:cilium NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}

	I0531 19:47:26.488055    9268 out.go:177] * Starting control plane node cilium-20220531191937-2108 in cluster cilium-20220531191937-2108

	I0531 19:47:26.490618    9268 cache.go:120] Beginning downloading kic base image for docker with docker

	I0531 19:47:26.495318    9268 out.go:177] * Pulling base image ...

	I0531 19:47:26.498492    9268 preload.go:132] Checking if preload exists for k8s version v1.23.6 and runtime docker

	I0531 19:47:26.498492    9268 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 in local docker daemon

	I0531 19:47:26.498492    9268 preload.go:148] Found local preload: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.23.6-docker-overlay2-amd64.tar.lz4

	I0531 19:47:26.498492    9268 cache.go:57] Caching tarball of preloaded images

	I0531 19:47:26.499020    9268 preload.go:174] Found C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.23.6-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0531 19:47:26.499113    9268 cache.go:60] Finished verifying existence of preloaded tar for  v1.23.6 on docker

	I0531 19:47:26.499113    9268 profile.go:148] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\config.json ...

	I0531 19:47:26.499113    9268 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\config.json: {Name:mkea1612a842ac986f1eb1c0f851f2c0b09e23a6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:47:27.608354    9268 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 in local docker daemon, skipping pull

	I0531 19:47:27.608443    9268 cache.go:141] gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 exists in daemon, skipping load

	I0531 19:47:27.608549    9268 cache.go:206] Successfully downloaded all kic artifacts

	I0531 19:47:27.608549    9268 start.go:352] acquiring machines lock for cilium-20220531191937-2108: {Name:mk9e58b6c885a5b3f36494dbce20134a09cdb35e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0531 19:47:27.608549    9268 start.go:356] acquired machines lock for "cilium-20220531191937-2108" in 0s

	I0531 19:47:27.609089    9268 start.go:91] Provisioning new machine with config: &{Name:cilium-20220531191937-2108 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.6 ClusterName:cilium-20220531191937-2108 Namespace:default

APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:cilium NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.23.6 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docke

r BinaryMirror: DisableOptimizations:false DisableMetrics:false} &{Name: IP: Port:8443 KubernetesVersion:v1.23.6 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0531 19:47:27.609402    9268 start.go:131] createHost starting for "" (driver="docker")

	I0531 19:47:27.613663    9268 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...

	I0531 19:47:27.614218    9268 start.go:165] libmachine.API.Create for "cilium-20220531191937-2108" (driver="docker")

	I0531 19:47:27.614367    9268 client.go:168] LocalClient.Create starting

	I0531 19:47:27.614367    9268 main.go:134] libmachine: Reading certificate data from C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem

	I0531 19:47:27.615064    9268 main.go:134] libmachine: Decoding PEM data...

	I0531 19:47:27.615064    9268 main.go:134] libmachine: Parsing certificate...

	I0531 19:47:27.615280    9268 main.go:134] libmachine: Reading certificate data from C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem

	I0531 19:47:27.615605    9268 main.go:134] libmachine: Decoding PEM data...

	I0531 19:47:27.615605    9268 main.go:134] libmachine: Parsing certificate...

	I0531 19:47:27.630133    9268 cli_runner.go:164] Run: docker network inspect cilium-20220531191937-2108 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0531 19:47:28.728068    9268 cli_runner.go:211] docker network inspect cilium-20220531191937-2108 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0531 19:47:28.728220    9268 cli_runner.go:217] Completed: docker network inspect cilium-20220531191937-2108 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}": (1.0979305s)

	I0531 19:47:28.736419    9268 network_create.go:272] running [docker network inspect cilium-20220531191937-2108] to gather additional debugging logs...

	I0531 19:47:28.736419    9268 cli_runner.go:164] Run: docker network inspect cilium-20220531191937-2108

	W0531 19:47:29.803384    9268 cli_runner.go:211] docker network inspect cilium-20220531191937-2108 returned with exit code 1

	I0531 19:47:29.803384    9268 cli_runner.go:217] Completed: docker network inspect cilium-20220531191937-2108: (1.0669602s)

	I0531 19:47:29.803384    9268 network_create.go:275] error running [docker network inspect cilium-20220531191937-2108]: docker network inspect cilium-20220531191937-2108: exit status 1

	stdout:

	[]

	stderr:

	Error: No such network: cilium-20220531191937-2108

	I0531 19:47:29.803384    9268 network_create.go:277] output of [docker network inspect cilium-20220531191937-2108]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error: No such network: cilium-20220531191937-2108

	** /stderr **

	I0531 19:47:29.811391    9268 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0531 19:47:30.932517    9268 cli_runner.go:217] Completed: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}": (1.1211208s)

	I0531 19:47:30.955519    9268 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc00055e368] misses:0}

	I0531 19:47:30.955519    9268 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I0531 19:47:30.955519    9268 network_create.go:115] attempt to create docker network cilium-20220531191937-2108 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...

	I0531 19:47:30.963512    9268 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true cilium-20220531191937-2108

	W0531 19:47:32.161506    9268 cli_runner.go:211] docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true cilium-20220531191937-2108 returned with exit code 1

	I0531 19:47:32.161662    9268 cli_runner.go:217] Completed: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true cilium-20220531191937-2108: (1.197852s)

	W0531 19:47:32.161662    9268 network_create.go:107] failed to create docker network cilium-20220531191937-2108 192.168.49.0/24, will retry: subnet is taken

	I0531 19:47:32.181276    9268 network.go:279] skipping subnet 192.168.49.0 that has unexpired reservation: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00055e368] amended:false}} dirty:map[] misses:0}

	I0531 19:47:32.181276    9268 network.go:238] skipping subnet 192.168.49.0/24 that is reserved: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I0531 19:47:32.201335    9268 network.go:288] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[192.168.49.0:0xc00055e368] amended:true}} dirty:map[192.168.49.0:0xc00055e368 192.168.58.0:0xc000006688] misses:0}

	I0531 19:47:32.201335    9268 network.go:235] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I0531 19:47:32.201335    9268 network_create.go:115] attempt to create docker network cilium-20220531191937-2108 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...

	I0531 19:47:32.208876    9268 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true cilium-20220531191937-2108

	I0531 19:47:33.419302    9268 cli_runner.go:217] Completed: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true cilium-20220531191937-2108: (1.2103242s)

	I0531 19:47:33.419302    9268 network_create.go:99] docker network cilium-20220531191937-2108 192.168.58.0/24 created

	I0531 19:47:33.419375    9268 kic.go:106] calculated static IP "192.168.58.2" for the "cilium-20220531191937-2108" container

	I0531 19:47:33.434630    9268 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I0531 19:47:34.587341    9268 cli_runner.go:217] Completed: docker ps -a --format {{.Names}}: (1.1525273s)

	I0531 19:47:34.595280    9268 cli_runner.go:164] Run: docker volume create cilium-20220531191937-2108 --label name.minikube.sigs.k8s.io=cilium-20220531191937-2108 --label created_by.minikube.sigs.k8s.io=true

	I0531 19:47:35.746811    9268 cli_runner.go:217] Completed: docker volume create cilium-20220531191937-2108 --label name.minikube.sigs.k8s.io=cilium-20220531191937-2108 --label created_by.minikube.sigs.k8s.io=true: (1.151308s)

	I0531 19:47:35.746881    9268 oci.go:103] Successfully created a docker volume cilium-20220531191937-2108

	I0531 19:47:35.757201    9268 cli_runner.go:164] Run: docker run --rm --name cilium-20220531191937-2108-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-20220531191937-2108 --entrypoint /usr/bin/test -v cilium-20220531191937-2108:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 -d /var/lib

	I0531 19:47:38.748807    9268 cli_runner.go:217] Completed: docker run --rm --name cilium-20220531191937-2108-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-20220531191937-2108 --entrypoint /usr/bin/test -v cilium-20220531191937-2108:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 -d /var/lib: (2.9914525s)

	I0531 19:47:38.748954    9268 oci.go:107] Successfully prepared a docker volume cilium-20220531191937-2108

	I0531 19:47:38.748954    9268 preload.go:132] Checking if preload exists for k8s version v1.23.6 and runtime docker

	I0531 19:47:38.748954    9268 kic.go:179] Starting extracting preloaded images to volume ...

	I0531 19:47:38.759795    9268 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.23.6-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v cilium-20220531191937-2108:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 -I lz4 -xf /preloaded.tar -C /extractDir

	I0531 19:48:08.301586    9268 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v C:\Users\jenkins.minikube7\minikube-integration\.minikube\cache\preloaded-tarball\preloaded-images-k8s-v18-v1.23.6-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v cilium-20220531191937-2108:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 -I lz4 -xf /preloaded.tar -C /extractDir: (29.541589s)

	I0531 19:48:08.301670    9268 kic.go:188] duration metric: took 29.552589 seconds to extract preloaded images to volume

	I0531 19:48:08.310366    9268 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0531 19:48:10.821060    9268 cli_runner.go:217] Completed: docker system info --format "{{json .}}": (2.5106834s)

	I0531 19:48:10.821060    9268 info.go:265] docker info: {ID:JKWR:L4LW:XYJC:G6AI:GZFU:RUGW:CCH6:OD2M:V572:4FTB:B7YC:DTUC Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:true NFd:74 OomKillDisable:true NGoroutines:58 SystemTime:2022-05-31 19:48:09.5689926 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:3 KernelVersion:5.10.102.1-microsoft-standard-WSL2 OperatingSystem:Docker Desktop OSType:linux Architecture:x86_

64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:16 MemTotal:53902323712 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,

profile=default] ProductLicense: Warnings:[WARNING: No blkio throttle.read_bps_device support WARNING: No blkio throttle.write_bps_device support WARNING: No blkio throttle.read_iops_device support WARNING: No blkio throttle.write_iops_device support] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:C:\Program Files\Docker\cli-plugins\docker-buildx.exe SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2] map[Name:compose Path:C:\Program Files\Docker\cli-plugins\docker-compose.exe SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.1] map[Name:sbom Path:C:\Program Files\Docker\cli-plugins\docker-sbom.exe SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:C:\Program Files\Docker\cli-plugins\docker-scan.exe SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc.

Version:v0.17.0]] Warnings:<nil>}}

	I0531 19:48:10.828087    9268 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"

	I0531 19:48:13.261056    9268 cli_runner.go:217] Completed: docker info --format "'{{json .SecurityOptions}}'": (2.4329581s)

	I0531 19:48:13.271052    9268 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname cilium-20220531191937-2108 --name cilium-20220531191937-2108 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-20220531191937-2108 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=cilium-20220531191937-2108 --network cilium-20220531191937-2108 --ip 192.168.58.2 --volume cilium-20220531191937-2108:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418

	I0531 19:48:16.187190    9268 cli_runner.go:217] Completed: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname cilium-20220531191937-2108 --name cilium-20220531191937-2108 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=cilium-20220531191937-2108 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=cilium-20220531191937-2108 --network cilium-20220531191937-2108 --ip 192.168.58.2 --volume cilium-20220531191937-2108:/var --security-opt apparmor=unconfined --memory=2048mb --memory-swap=2048mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418: (2.9161256s)

	I0531 19:48:16.196190    9268 cli_runner.go:164] Run: docker container inspect cilium-20220531191937-2108 --format={{.State.Running}}

	I0531 19:48:17.467534    9268 cli_runner.go:217] Completed: docker container inspect cilium-20220531191937-2108 --format={{.State.Running}}: (1.2711058s)

	I0531 19:48:17.477527    9268 cli_runner.go:164] Run: docker container inspect cilium-20220531191937-2108 --format={{.State.Status}}

	I0531 19:48:18.715754    9268 cli_runner.go:217] Completed: docker container inspect cilium-20220531191937-2108 --format={{.State.Status}}: (1.2379937s)

	I0531 19:48:18.724742    9268 cli_runner.go:164] Run: docker exec cilium-20220531191937-2108 stat /var/lib/dpkg/alternatives/iptables

	I0531 19:48:20.082903    9268 cli_runner.go:217] Completed: docker exec cilium-20220531191937-2108 stat /var/lib/dpkg/alternatives/iptables: (1.3581547s)

	I0531 19:48:20.082903    9268 oci.go:247] the created container "cilium-20220531191937-2108" has a running status.

	I0531 19:48:20.082903    9268 kic.go:210] Creating ssh key for kic: C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\cilium-20220531191937-2108\id_rsa...

	I0531 19:48:20.214608    9268 kic_runner.go:191] docker (temp): C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\cilium-20220531191937-2108\id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)

	I0531 19:48:21.484220    9268 cli_runner.go:164] Run: docker container inspect cilium-20220531191937-2108 --format={{.State.Status}}

	I0531 19:48:22.650978    9268 cli_runner.go:217] Completed: docker container inspect cilium-20220531191937-2108 --format={{.State.Status}}: (1.1667527s)

	I0531 19:48:22.667965    9268 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys

	I0531 19:48:22.667965    9268 kic_runner.go:114] Args: [docker exec --privileged cilium-20220531191937-2108 chown docker:docker /home/docker/.ssh/authorized_keys]

	I0531 19:48:24.035166    9268 kic_runner.go:123] Done: [docker exec --privileged cilium-20220531191937-2108 chown docker:docker /home/docker/.ssh/authorized_keys]: (1.3671943s)

	I0531 19:48:24.041454    9268 kic.go:250] ensuring only current user has permissions to key file located at : C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\cilium-20220531191937-2108\id_rsa...

	I0531 19:48:24.606428    9268 cli_runner.go:164] Run: docker container inspect cilium-20220531191937-2108 --format={{.State.Status}}

	I0531 19:48:25.787331    9268 cli_runner.go:217] Completed: docker container inspect cilium-20220531191937-2108 --format={{.State.Status}}: (1.1548336s)

	I0531 19:48:25.787506    9268 machine.go:88] provisioning docker machine ...

	I0531 19:48:25.787506    9268 ubuntu.go:169] provisioning hostname "cilium-20220531191937-2108"

	I0531 19:48:25.797206    9268 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108

	I0531 19:48:26.941755    9268 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108: (1.1445437s)

	I0531 19:48:26.946762    9268 main.go:134] libmachine: Using SSH client type: native

	I0531 19:48:26.953987    9268 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x1322ea0] 0x1325d00 <nil>  [] 0s} 127.0.0.1 54754 <nil> <nil>}

	I0531 19:48:26.953987    9268 main.go:134] libmachine: About to run SSH command:

	sudo hostname cilium-20220531191937-2108 && echo "cilium-20220531191937-2108" | sudo tee /etc/hostname

	I0531 19:48:27.221638    9268 main.go:134] libmachine: SSH cmd err, output: <nil>: cilium-20220531191937-2108

	I0531 19:48:27.232353    9268 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108

	I0531 19:48:28.360495    9268 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108: (1.1278943s)

	I0531 19:48:28.365359    9268 main.go:134] libmachine: Using SSH client type: native

	I0531 19:48:28.365937    9268 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x1322ea0] 0x1325d00 <nil>  [] 0s} 127.0.0.1 54754 <nil> <nil>}

	I0531 19:48:28.366046    9268 main.go:134] libmachine: About to run SSH command:

			if ! grep -xq '.*\scilium-20220531191937-2108' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 cilium-20220531191937-2108/g' /etc/hosts;

				else 

					echo '127.0.1.1 cilium-20220531191937-2108' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0531 19:48:28.667846    9268 main.go:134] libmachine: SSH cmd err, output: <nil>: 

	I0531 19:48:28.667935    9268 ubuntu.go:175] set auth options {CertDir:C:\Users\jenkins.minikube7\minikube-integration\.minikube CaCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem CaPrivateKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ServerKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem ClientKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem ServerCertSANs:[] StorePath:C:\Users\jenkins.minikube7\minikube-integration\.minikube}

	I0531 19:48:28.667998    9268 ubuntu.go:177] setting up certificates

	I0531 19:48:28.667998    9268 provision.go:83] configureAuth start

	I0531 19:48:28.676062    9268 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cilium-20220531191937-2108

	I0531 19:48:29.751867    9268 cli_runner.go:217] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cilium-20220531191937-2108: (1.0758004s)

	I0531 19:48:29.751867    9268 provision.go:138] copyHostCerts

	I0531 19:48:29.751867    9268 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem, removing ...

	I0531 19:48:29.751867    9268 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.pem

	I0531 19:48:29.752920    9268 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/ca.pem (1078 bytes)

	I0531 19:48:29.753865    9268 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem, removing ...

	I0531 19:48:29.753865    9268 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\cert.pem

	I0531 19:48:29.753865    9268 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/cert.pem (1123 bytes)

	I0531 19:48:29.754892    9268 exec_runner.go:144] found C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem, removing ...

	I0531 19:48:29.755859    9268 exec_runner.go:207] rm: C:\Users\jenkins.minikube7\minikube-integration\.minikube\key.pem

	I0531 19:48:29.755859    9268 exec_runner.go:151] cp: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem --> C:\Users\jenkins.minikube7\minikube-integration\.minikube/key.pem (1679 bytes)

	I0531 19:48:29.756882    9268 provision.go:112] generating server cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem ca-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem private-key=C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem org=jenkins.cilium-20220531191937-2108 san=[192.168.58.2 127.0.0.1 localhost 127.0.0.1 minikube cilium-20220531191937-2108]

	I0531 19:48:29.997660    9268 provision.go:172] copyRemoteCerts

	I0531 19:48:30.009449    9268 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0531 19:48:30.018682    9268 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108

	I0531 19:48:31.057809    9268 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108: (1.0391217s)

	I0531 19:48:31.058511    9268 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54754 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\cilium-20220531191937-2108\id_rsa Username:docker}

	I0531 19:48:31.206606    9268 ssh_runner.go:235] Completed: sudo mkdir -p /etc/docker /etc/docker /etc/docker: (1.1971511s)

	I0531 19:48:31.207147    9268 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0531 19:48:31.271897    9268 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server.pem --> /etc/docker/server.pem (1253 bytes)

	I0531 19:48:31.323010    9268 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0531 19:48:31.371959    9268 provision.go:86] duration metric: configureAuth took 2.7039486s

	I0531 19:48:31.372155    9268 ubuntu.go:193] setting minikube options for container-runtime

	I0531 19:48:31.372667    9268 config.go:178] Loaded profile config "cilium-20220531191937-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.6

	I0531 19:48:31.383028    9268 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108

	I0531 19:48:32.456081    9268 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108: (1.0730485s)

	I0531 19:48:32.462481    9268 main.go:134] libmachine: Using SSH client type: native

	I0531 19:48:32.463528    9268 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x1322ea0] 0x1325d00 <nil>  [] 0s} 127.0.0.1 54754 <nil> <nil>}

	I0531 19:48:32.463528    9268 main.go:134] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0531 19:48:32.672247    9268 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay

	I0531 19:48:32.672247    9268 ubuntu.go:71] root file system type: overlay

	I0531 19:48:32.673568    9268 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0531 19:48:32.681753    9268 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108

	I0531 19:48:33.741320    9268 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108: (1.0595627s)

	I0531 19:48:33.744316    9268 main.go:134] libmachine: Using SSH client type: native

	I0531 19:48:33.745311    9268 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x1322ea0] 0x1325d00 <nil>  [] 0s} 127.0.0.1 54754 <nil> <nil>}

	I0531 19:48:33.745311    9268 main.go:134] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0531 19:48:33.986583    9268 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0531 19:48:33.995529    9268 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108

	I0531 19:48:35.046861    9268 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108: (1.0513277s)

	I0531 19:48:35.050883    9268 main.go:134] libmachine: Using SSH client type: native

	I0531 19:48:35.050883    9268 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x1322ea0] 0x1325d00 <nil>  [] 0s} 127.0.0.1 54754 <nil> <nil>}

	I0531 19:48:35.050883    9268 main.go:134] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0531 19:48:36.498569    9268 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2022-05-12 09:15:28.000000000 +0000

	+++ /lib/systemd/system/docker.service.new	2022-05-31 19:48:33.967307000 +0000

	@@ -1,30 +1,32 @@

	 [Unit]

	 Description=Docker Application Container Engine

	 Documentation=https://docs.docker.com

	-After=network-online.target docker.socket firewalld.service containerd.service

	+BindsTo=containerd.service

	+After=network-online.target firewalld.service containerd.service

	 Wants=network-online.target

	-Requires=docker.socket containerd.service

	+Requires=docker.socket

	+StartLimitBurst=3

	+StartLimitIntervalSec=60

	 [Service]

	 Type=notify

	-# the default is not to use systemd for cgroups because the delegate issues still

	-# exists and systemd currently does not support the cgroup feature set required

	-# for containers run by docker

	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

	-ExecReload=/bin/kill -s HUP $MAINPID

	-TimeoutSec=0

	-RestartSec=2

	-Restart=always

	-

	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.

	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location

	-# to make them work for either version of systemd.

	-StartLimitBurst=3

	+Restart=on-failure

	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.

	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make

	-# this option work for either version of systemd.

	-StartLimitInterval=60s

	+

	+

	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	+# The base configuration already specifies an 'ExecStart=...' command. The first directive

	+# here is to clear out that command inherited from the base configuration. Without this,

	+# the command from the base configuration and the command specified here are treated as

	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	+# will catch this invalid input and refuse to start the service with an error like:

	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	+

	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	+ExecStart=

	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	+ExecReload=/bin/kill -s HUP $MAINPID

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	@@ -32,16 +34,16 @@

	 LimitNPROC=infinity

	 LimitCORE=infinity

	-# Comment TasksMax if your systemd version does not support it.

	-# Only systemd 226 and above support this option.

	+# Uncomment TasksMax if your systemd version supports it.

	+# Only systemd 226 and above support this version.

	 TasksMax=infinity

	+TimeoutStartSec=0

	 # set delegate yes so that systemd does not reset the cgroups of docker containers

	 Delegate=yes

	 # kill only the docker process, not all processes in the cgroup

	 KillMode=process

	-OOMScoreAdjust=-500

	 [Install]

	 WantedBy=multi-user.target

	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install enable docker

	I0531 19:48:36.498661    9268 machine.go:91] provisioned docker machine in 10.711108s

	I0531 19:48:36.498734    9268 client.go:171] LocalClient.Create took 1m8.8840696s

	I0531 19:48:36.498734    9268 start.go:173] duration metric: libmachine.API.Create for "cilium-20220531191937-2108" took 1m8.8842184s

	I0531 19:48:36.498734    9268 start.go:306] post-start starting for "cilium-20220531191937-2108" (driver="docker")

	I0531 19:48:36.498832    9268 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0531 19:48:36.511843    9268 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0531 19:48:36.519175    9268 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108

	I0531 19:48:37.597735    9268 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108: (1.0785154s)

	I0531 19:48:37.597807    9268 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54754 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\cilium-20220531191937-2108\id_rsa Username:docker}

	I0531 19:48:37.753512    9268 ssh_runner.go:235] Completed: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs: (1.2415123s)

	I0531 19:48:37.768940    9268 ssh_runner.go:195] Run: cat /etc/os-release

	I0531 19:48:37.793144    9268 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I0531 19:48:37.793144    9268 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I0531 19:48:37.793144    9268 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I0531 19:48:37.793144    9268 info.go:137] Remote host: Ubuntu 20.04.4 LTS

	I0531 19:48:37.793144    9268 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\addons for local assets ...

	I0531 19:48:37.793144    9268 filesync.go:126] Scanning C:\Users\jenkins.minikube7\minikube-integration\.minikube\files for local assets ...

	I0531 19:48:37.794049    9268 filesync.go:149] local asset: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\21082.pem -> 21082.pem in /etc/ssl/certs

	I0531 19:48:37.803047    9268 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0531 19:48:37.826132    9268 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\21082.pem --> /etc/ssl/certs/21082.pem (1708 bytes)

	I0531 19:48:37.879440    9268 start.go:309] post-start completed in 1.380602s

	I0531 19:48:37.890943    9268 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cilium-20220531191937-2108

	I0531 19:48:39.069045    9268 cli_runner.go:217] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cilium-20220531191937-2108: (1.1779754s)

	I0531 19:48:39.069045    9268 profile.go:148] Saving config to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\config.json ...

	I0531 19:48:39.081960    9268 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0531 19:48:39.089034    9268 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108

	I0531 19:48:40.313476    9268 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108: (1.2244031s)

	I0531 19:48:40.313868    9268 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54754 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\cilium-20220531191937-2108\id_rsa Username:docker}

	I0531 19:48:40.400330    9268 ssh_runner.go:235] Completed: sh -c "df -h /var | awk 'NR==2{print $5}'": (1.3183639s)

	I0531 19:48:40.412028    9268 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0531 19:48:40.438223    9268 start.go:134] duration metric: createHost completed in 1m12.8285062s

	I0531 19:48:40.438364    9268 start.go:81] releasing machines lock for "cilium-20220531191937-2108", held for 1m12.829501s

	I0531 19:48:40.449902    9268 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cilium-20220531191937-2108

	I0531 19:48:41.556568    9268 cli_runner.go:217] Completed: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" cilium-20220531191937-2108: (1.1066081s)

	I0531 19:48:41.558574    9268 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0531 19:48:41.567573    9268 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108

	I0531 19:48:41.570571    9268 ssh_runner.go:195] Run: systemctl --version

	I0531 19:48:41.577570    9268 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108

	I0531 19:48:42.700018    9268 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108: (1.1324401s)

	I0531 19:48:42.700018    9268 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54754 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\cilium-20220531191937-2108\id_rsa Username:docker}

	I0531 19:48:42.721019    9268 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108: (1.1434438s)

	I0531 19:48:42.721019    9268 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54754 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\cilium-20220531191937-2108\id_rsa Username:docker}

	I0531 19:48:42.798409    9268 ssh_runner.go:235] Completed: systemctl --version: (1.2278325s)

	I0531 19:48:42.808389    9268 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0531 19:48:42.931501    9268 ssh_runner.go:235] Completed: curl -sS -m 2 https://k8s.gcr.io/: (1.3729205s)

	I0531 19:48:42.940499    9268 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0531 19:48:42.970862    9268 cruntime.go:273] skipping containerd shutdown because we are bound to it

	I0531 19:48:42.982676    9268 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0531 19:48:43.011214    9268 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/dockershim.sock

	image-endpoint: unix:///var/run/dockershim.sock

	" | sudo tee /etc/crictl.yaml"

	I0531 19:48:43.067404    9268 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0531 19:48:43.284827    9268 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0531 19:48:43.455438    9268 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0531 19:48:43.493420    9268 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0531 19:48:43.676110    9268 ssh_runner.go:195] Run: sudo systemctl start docker

	I0531 19:48:43.718551    9268 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0531 19:48:43.825365    9268 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0531 19:48:43.922674    9268 out.go:204] * Preparing Kubernetes v1.23.6 on Docker 20.10.16 ...

	I0531 19:48:43.930733    9268 cli_runner.go:164] Run: docker exec -t cilium-20220531191937-2108 dig +short host.docker.internal

	I0531 19:48:45.219163    9268 cli_runner.go:217] Completed: docker exec -t cilium-20220531191937-2108 dig +short host.docker.internal: (1.2884248s)

	I0531 19:48:45.219163    9268 network.go:96] got host ip for mount in container by digging dns: 192.168.65.2

	I0531 19:48:45.228172    9268 ssh_runner.go:195] Run: grep 192.168.65.2	host.minikube.internal$ /etc/hosts

	I0531 19:48:45.241834    9268 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.65.2	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0531 19:48:45.276834    9268 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" cilium-20220531191937-2108

	I0531 19:48:46.354390    9268 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" cilium-20220531191937-2108: (1.0770274s)

	I0531 19:48:46.354390    9268 preload.go:132] Checking if preload exists for k8s version v1.23.6 and runtime docker

	I0531 19:48:46.361386    9268 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0531 19:48:46.444859    9268 docker.go:610] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.23.6

	k8s.gcr.io/kube-scheduler:v1.23.6

	k8s.gcr.io/kube-proxy:v1.23.6

	k8s.gcr.io/kube-controller-manager:v1.23.6

	k8s.gcr.io/etcd:3.5.1-0

	k8s.gcr.io/coredns/coredns:v1.8.6

	k8s.gcr.io/pause:3.6

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0531 19:48:46.444859    9268 docker.go:541] Images already preloaded, skipping extraction

	I0531 19:48:46.452824    9268 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0531 19:48:46.520915    9268 docker.go:610] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.23.6

	k8s.gcr.io/kube-proxy:v1.23.6

	k8s.gcr.io/kube-scheduler:v1.23.6

	k8s.gcr.io/kube-controller-manager:v1.23.6

	k8s.gcr.io/etcd:3.5.1-0

	k8s.gcr.io/coredns/coredns:v1.8.6

	k8s.gcr.io/pause:3.6

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0531 19:48:46.520953    9268 cache_images.go:84] Images are preloaded, skipping loading

	I0531 19:48:46.530652    9268 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0531 19:48:46.726287    9268 cni.go:95] Creating CNI manager for "cilium"

	I0531 19:48:46.726287    9268 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0531 19:48:46.726287    9268 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.58.2 APIServerPort:8443 KubernetesVersion:v1.23.6 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:cilium-20220531191937-2108 NodeName:cilium-20220531191937-2108 DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.58.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.58.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/mi

nikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0531 19:48:46.726287    9268 kubeadm.go:162] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.58.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/dockershim.sock

	  name: "cilium-20220531191937-2108"

	  kubeletExtraArgs:

	    node-ip: 192.168.58.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.58.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.23.6

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0531 19:48:46.726934    9268 kubeadm.go:961] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.23.6/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=cilium-20220531191937-2108 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.58.2

	[Install]

	 config:

	{KubernetesVersion:v1.23.6 ClusterName:cilium-20220531191937-2108 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:cilium NodeIP: NodePort:8443 NodeName:}

	I0531 19:48:46.737359    9268 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.23.6

	I0531 19:48:46.768612    9268 binaries.go:44] Found k8s binaries, skipping transfer

	I0531 19:48:46.780845    9268 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0531 19:48:46.811604    9268 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (373 bytes)

	I0531 19:48:46.850077    9268 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0531 19:48:46.894088    9268 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2048 bytes)

	I0531 19:48:46.944720    9268 ssh_runner.go:195] Run: grep 192.168.58.2	control-plane.minikube.internal$ /etc/hosts

	I0531 19:48:46.954718    9268 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.58.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0531 19:48:46.980461    9268 certs.go:54] Setting up C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108 for IP: 192.168.58.2

	I0531 19:48:46.980461    9268 certs.go:182] skipping minikubeCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key

	I0531 19:48:46.981102    9268 certs.go:182] skipping proxyClientCA CA generation: C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key

	I0531 19:48:46.981961    9268 certs.go:302] generating minikube-user signed cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\client.key

	I0531 19:48:46.981961    9268 crypto.go:68] Generating cert C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\client.crt with IP's: []

	I0531 19:48:47.260440    9268 crypto.go:156] Writing cert to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\client.crt ...

	I0531 19:48:47.260440    9268 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\client.crt: {Name:mkfe33647c3ad3aac201569723c5fc0e1edd9893 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:48:47.261866    9268 crypto.go:164] Writing key to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\client.key ...

	I0531 19:48:47.261866    9268 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\client.key: {Name:mkd97d25e7ed6677e6c4d7c21b6e1c8c2455776f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:48:47.262896    9268 certs.go:302] generating minikube signed cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\apiserver.key.cee25041

	I0531 19:48:47.263776    9268 crypto.go:68] Generating cert C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\apiserver.crt.cee25041 with IP's: [192.168.58.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I0531 19:48:47.780014    9268 crypto.go:156] Writing cert to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\apiserver.crt.cee25041 ...

	I0531 19:48:47.780014    9268 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\apiserver.crt.cee25041: {Name:mkd62a0632ab36f625f9ca0f0a1e1c55a6fae821 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:48:47.781462    9268 crypto.go:164] Writing key to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\apiserver.key.cee25041 ...

	I0531 19:48:47.781462    9268 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\apiserver.key.cee25041: {Name:mkc8633657d57158f0bda8161912acf9d70414cc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:48:47.782333    9268 certs.go:320] copying C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\apiserver.crt.cee25041 -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\apiserver.crt

	I0531 19:48:47.789942    9268 certs.go:324] copying C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\apiserver.key.cee25041 -> C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\apiserver.key

	I0531 19:48:47.790927    9268 certs.go:302] generating aggregator signed cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\proxy-client.key

	I0531 19:48:47.791410    9268 crypto.go:68] Generating cert C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\proxy-client.crt with IP's: []

	I0531 19:48:48.016152    9268 crypto.go:156] Writing cert to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\proxy-client.crt ...

	I0531 19:48:48.016152    9268 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\proxy-client.crt: {Name:mk4612cab5437b5b51346883ff73dc34555dceab Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:48:48.017804    9268 crypto.go:164] Writing key to C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\proxy-client.key ...

	I0531 19:48:48.017804    9268 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\proxy-client.key: {Name:mk8bba2692e9ee6aead2c0c19c23f73d8361e756 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:48:48.025315    9268 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\2108.pem (1338 bytes)

	W0531 19:48:48.026469    9268 certs.go:384] ignoring C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\2108_empty.pem, impossibly tiny 0 bytes

	I0531 19:48:48.026469    9268 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca-key.pem (1675 bytes)

	I0531 19:48:48.026732    9268 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\ca.pem (1078 bytes)

	I0531 19:48:48.026985    9268 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\cert.pem (1123 bytes)

	I0531 19:48:48.027255    9268 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\key.pem (1679 bytes)

	I0531 19:48:48.027255    9268 certs.go:388] found cert: C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\21082.pem (1708 bytes)

	I0531 19:48:48.028928    9268 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0531 19:48:48.088403    9268 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0531 19:48:48.145868    9268 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0531 19:48:48.209697    9268 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\profiles\cilium-20220531191937-2108\proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0531 19:48:48.269047    9268 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0531 19:48:48.326417    9268 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0531 19:48:48.408416    9268 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0531 19:48:48.458396    9268 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0531 19:48:48.511753    9268 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\certs\2108.pem --> /usr/share/ca-certificates/2108.pem (1338 bytes)

	I0531 19:48:48.562810    9268 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\files\etc\ssl\certs\21082.pem --> /usr/share/ca-certificates/21082.pem (1708 bytes)

	I0531 19:48:48.611927    9268 ssh_runner.go:362] scp C:\Users\jenkins.minikube7\minikube-integration\.minikube\ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0531 19:48:48.659373    9268 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (752 bytes)

	I0531 19:48:48.702370    9268 ssh_runner.go:195] Run: openssl version

	I0531 19:48:48.730228    9268 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/21082.pem && ln -fs /usr/share/ca-certificates/21082.pem /etc/ssl/certs/21082.pem"

	I0531 19:48:48.769708    9268 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/21082.pem

	I0531 19:48:48.786475    9268 certs.go:431] hashing: -rw-r--r-- 1 root root 1708 May 31 17:31 /usr/share/ca-certificates/21082.pem

	I0531 19:48:48.797651    9268 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/21082.pem

	I0531 19:48:48.831240    9268 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/21082.pem /etc/ssl/certs/3ec20f2e.0"

	I0531 19:48:48.868959    9268 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0531 19:48:48.904841    9268 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0531 19:48:48.914846    9268 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 May 31 17:19 /usr/share/ca-certificates/minikubeCA.pem

	I0531 19:48:48.923847    9268 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0531 19:48:48.945843    9268 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0531 19:48:48.978599    9268 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/2108.pem && ln -fs /usr/share/ca-certificates/2108.pem /etc/ssl/certs/2108.pem"

	I0531 19:48:49.020324    9268 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/2108.pem

	I0531 19:48:49.034469    9268 certs.go:431] hashing: -rw-r--r-- 1 root root 1338 May 31 17:31 /usr/share/ca-certificates/2108.pem

	I0531 19:48:49.045730    9268 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/2108.pem

	I0531 19:48:49.080658    9268 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/2108.pem /etc/ssl/certs/51391683.0"

	I0531 19:48:49.103791    9268 kubeadm.go:395] StartCluster: {Name:cilium-20220531191937-2108 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.31-1653596720-14230@sha256:e953786303ac8350802546ee187d34e89f0007072a54fdbcc2f86a1fb8575418 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.6 ClusterName:cilium-20220531191937-2108 Namespace:default APIServerName:minikube

CA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:cilium NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.58.2 Port:8443 KubernetesVersion:v1.23.6 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:5m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:C:\Users\jenkins.minikube7:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMi

rror: DisableOptimizations:false DisableMetrics:false}

	I0531 19:48:49.114576    9268 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0531 19:48:49.203962    9268 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0531 19:48:49.238469    9268 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0531 19:48:49.263687    9268 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver

	I0531 19:48:49.273669    9268 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0531 19:48:49.301331    9268 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0531 19:48:49.301331    9268 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.6:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I0531 19:49:12.473148    9268 out.go:204]   - Generating certificates and keys ...

	I0531 19:49:12.478581    9268 out.go:204]   - Booting up control plane ...

	I0531 19:49:12.483747    9268 out.go:204]   - Configuring RBAC rules ...

	I0531 19:49:12.487745    9268 cni.go:95] Creating CNI manager for "cilium"

	I0531 19:49:12.491784    9268 out.go:177] * Configuring Cilium (Container Networking Interface) ...

	I0531 19:49:12.504739    9268 ssh_runner.go:195] Run: sudo /bin/bash -c "grep 'bpffs /sys/fs/bpf' /proc/mounts || sudo mount bpffs -t bpf /sys/fs/bpf"

	I0531 19:49:12.564468    9268 cilium.go:816] Using pod CIDR: 10.244.0.0/16

	I0531 19:49:12.564569    9268 cilium.go:827] cilium options: {PodSubnet:10.244.0.0/16}

	I0531 19:49:12.564770    9268 cilium.go:831] cilium config:

	---

	# Source: cilium/templates/cilium-agent-serviceaccount.yaml

	apiVersion: v1

	kind: ServiceAccount

	metadata:

	  name: cilium

	  namespace: kube-system

	---

	# Source: cilium/templates/cilium-operator-serviceaccount.yaml

	apiVersion: v1

	kind: ServiceAccount

	metadata:

	  name: cilium-operator

	  namespace: kube-system

	---

	# Source: cilium/templates/cilium-configmap.yaml

	apiVersion: v1

	kind: ConfigMap

	metadata:

	  name: cilium-config

	  namespace: kube-system

	data:

	  # Identity allocation mode selects how identities are shared between cilium

	  # nodes by setting how they are stored. The options are "crd" or "kvstore".

	  # - "crd" stores identities in kubernetes as CRDs (custom resource definition).

	  #   These can be queried with:

	  #     kubectl get ciliumid

	  # - "kvstore" stores identities in a kvstore, etcd or consul, that is

	  #   configured below. Cilium versions before 1.6 supported only the kvstore

	  #   backend. Upgrades from these older cilium versions should continue using

	  #   the kvstore by commenting out the identity-allocation-mode below, or

	  #   setting it to "kvstore".

	  identity-allocation-mode: crd

	  cilium-endpoint-gc-interval: "5m0s"

	  # If you want to run cilium in debug mode change this value to true

	  debug: "false"

	  # The agent can be put into the following three policy enforcement modes

	  # default, always and never.

	  # https://docs.cilium.io/en/latest/policy/intro/#policy-enforcement-modes

	  enable-policy: "default"

	  # Enable IPv4 addressing. If enabled, all endpoints are allocated an IPv4

	  # address.

	  enable-ipv4: "true"

	  # Enable IPv6 addressing. If enabled, all endpoints are allocated an IPv6

	  # address.

	  enable-ipv6: "false"

	  # Users who wish to specify their own custom CNI configuration file must set

	  # custom-cni-conf to "true", otherwise Cilium may overwrite the configuration.

	  custom-cni-conf: "false"

	  enable-bpf-clock-probe: "true"

	  # If you want cilium monitor to aggregate tracing for packets, set this level

	  # to "low", "medium", or "maximum". The higher the level, the less packets

	  # that will be seen in monitor output.

	  monitor-aggregation: medium

	  # The monitor aggregation interval governs the typical time between monitor

	  # notification events for each allowed connection.

	  #

	  # Only effective when monitor aggregation is set to "medium" or higher.

	  monitor-aggregation-interval: 5s

	  # The monitor aggregation flags determine which TCP flags which, upon the

	  # first observation, cause monitor notifications to be generated.

	  #

	  # Only effective when monitor aggregation is set to "medium" or higher.

	  monitor-aggregation-flags: all

	  # Specifies the ratio (0.0-1.0) of total system memory to use for dynamic

	  # sizing of the TCP CT, non-TCP CT, NAT and policy BPF maps.

	  bpf-map-dynamic-size-ratio: "0.0025"

	  # bpf-policy-map-max specifies the maximum number of entries in endpoint

	  # policy map (per endpoint)

	  bpf-policy-map-max: "16384"

	  # bpf-lb-map-max specifies the maximum number of entries in bpf lb service,

	  # backend and affinity maps.

	  bpf-lb-map-max: "65536"

	  # Pre-allocation of map entries allows per-packet latency to be reduced, at

	  # the expense of up-front memory allocation for the entries in the maps. The

	  # default value below will minimize memory usage in the default installation;

	  # users who are sensitive to latency may consider setting this to "true".

	  #

	  # This option was introduced in Cilium 1.4. Cilium 1.3 and earlier ignore

	  # this option and behave as though it is set to "true".

	  #

	  # If this value is modified, then during the next Cilium startup the restore

	  # of existing endpoints and tracking of ongoing connections may be disrupted.

	  # As a result, reply packets may be dropped and the load-balancing decisions

	  # for established connections may change.

	  #

	  # If this option is set to "false" during an upgrade from 1.3 or earlier to

	  # 1.4 or later, then it may cause one-time disruptions during the upgrade.

	  preallocate-bpf-maps: "false"

	  # Regular expression matching compatible Istio sidecar istio-proxy

	  # container image names

	  sidecar-istio-proxy-image: "cilium/istio_proxy"

	  # Name of the cluster. Only relevant when building a mesh of clusters.

	  cluster-name: default

	  # Unique ID of the cluster. Must be unique across all conneted clusters and

	  # in the range of 1 and 255. Only relevant when building a mesh of clusters.

	  cluster-id: ""

	  # Encapsulation mode for communication between nodes

	  # Possible values:

	  #   - disabled

	  #   - vxlan (default)

	  #   - geneve

	  tunnel: vxlan

	  # Enables L7 proxy for L7 policy enforcement and visibility

	  enable-l7-proxy: "true"

	  # wait-bpf-mount makes init container wait until bpf filesystem is mounted

	  wait-bpf-mount: "false"

	  masquerade: "true"

	  enable-bpf-masquerade: "true"

	  enable-xt-socket-fallback: "true"

	  install-iptables-rules: "true"

	  auto-direct-node-routes: "false"

	  enable-bandwidth-manager: "false"

	  enable-local-redirect-policy: "false"

	  kube-proxy-replacement:  "probe"

	  kube-proxy-replacement-healthz-bind-address: ""

	  enable-health-check-nodeport: "true"

	  node-port-bind-protection: "true"

	  enable-auto-protect-node-port-range: "true"

	  enable-session-affinity: "true"

	  k8s-require-ipv4-pod-cidr: "true"

	  k8s-require-ipv6-pod-cidr: "false"

	  enable-endpoint-health-checking: "true"

	  enable-health-checking: "true"

	  enable-well-known-identities: "false"

	  enable-remote-node-identity: "true"

	  operator-api-serve-addr: "127.0.0.1:9234"

	  # Enable Hubble gRPC service.

	  enable-hubble: "true"

	  # UNIX domain socket for Hubble server to listen to.

	  hubble-socket-path:  "/var/run/cilium/hubble.sock"

	  # An additional address for Hubble server to listen to (e.g. ":4244").

	  hubble-listen-address: ":4244"

	  hubble-disable-tls: "false"

	  hubble-tls-cert-file: /var/lib/cilium/tls/hubble/server.crt

	  hubble-tls-key-file: /var/lib/cilium/tls/hubble/server.key

	  hubble-tls-client-ca-files: /var/lib/cilium/tls/hubble/client-ca.crt

	  ipam: "cluster-pool"

	  cluster-pool-ipv4-cidr: "10.244.0.0/16"

	  cluster-pool-ipv4-mask-size: "24"

	  disable-cnp-status-updates: "true"

	  cgroup-root: "/run/cilium/cgroupv2"

	---

	# Source: cilium/templates/cilium-agent-clusterrole.yaml

	apiVersion: rbac.authorization.k8s.io/v1

	kind: ClusterRole

	metadata:

	  name: cilium

	rules:

	- apiGroups:

	  - networking.k8s.io

	  resources:

	  - networkpolicies

	  verbs:

	  - get

	  - list

	  - watch

	- apiGroups:

	  - discovery.k8s.io

	  resources:

	  - endpointslices

	  verbs:

	  - get

	  - list

	  - watch

	- apiGroups:

	  - ""

	  resources:

	  - namespaces

	  - services

	  - nodes

	  - endpoints

	  verbs:

	  - get

	  - list

	  - watch

	- apiGroups:

	  - ""

	  resources:

	  - pods

	  - pods/finalizers

	  verbs:

	  - get

	  - list

	  - watch

	  - update

	  - delete

	- apiGroups:

	  - ""

	  resources:

	  - nodes

	  verbs:

	  - get

	  - list

	  - watch

	  - update

	- apiGroups:

	  - ""

	  resources:

	  - nodes

	  - nodes/status

	  verbs:

	  - patch

	- apiGroups:

	  - apiextensions.k8s.io

	  resources:

	  - customresourcedefinitions

	  verbs:

	  # Deprecated for removal in v1.10

	  - create

	  - list

	  - watch

	  - update

	  # This is used when validating policies in preflight. This will need to stay

	  # until we figure out how to avoid "get" inside the preflight, and then

	  # should be removed ideally.

	  - get

	- apiGroups:

	  - cilium.io

	  resources:

	  - ciliumnetworkpolicies

	  - ciliumnetworkpolicies/status

	  - ciliumnetworkpolicies/finalizers

	  - ciliumclusterwidenetworkpolicies

	  - ciliumclusterwidenetworkpolicies/status

	  - ciliumclusterwidenetworkpolicies/finalizers

	  - ciliumendpoints

	  - ciliumendpoints/status

	  - ciliumendpoints/finalizers

	  - ciliumnodes

	  - ciliumnodes/status

	  - ciliumnodes/finalizers

	  - ciliumidentities

	  - ciliumidentities/finalizers

	  - ciliumlocalredirectpolicies

	  - ciliumlocalredirectpolicies/status

	  - ciliumlocalredirectpolicies/finalizers

	  verbs:

	  - '*'

	---

	# Source: cilium/templates/cilium-operator-clusterrole.yaml

	apiVersion: rbac.authorization.k8s.io/v1

	kind: ClusterRole

	metadata:

	  name: cilium-operator

	rules:

	- apiGroups:

	  - ""

	  resources:

	  # to automatically delete [core|kube]dns pods so that are starting to being

	  # managed by Cilium

	  - pods

	  verbs:

	  - get

	  - list

	  - watch

	  - delete

	- apiGroups:

	  - discovery.k8s.io

	  resources:

	  - endpointslices

	  verbs:

	  - get

	  - list

	  - watch

	- apiGroups:

	  - ""

	  resources:

	  # to perform the translation of a CNP that contains 'ToGroup' to its endpoints

	  - services

	  - endpoints

	  # to check apiserver connectivity

	  - namespaces

	  verbs:

	  - get

	  - list

	  - watch

	- apiGroups:

	  - cilium.io

	  resources:

	  - ciliumnetworkpolicies

	  - ciliumnetworkpolicies/status

	  - ciliumnetworkpolicies/finalizers

	  - ciliumclusterwidenetworkpolicies

	  - ciliumclusterwidenetworkpolicies/status

	  - ciliumclusterwidenetworkpolicies/finalizers

	  - ciliumendpoints

	  - ciliumendpoints/status

	  - ciliumendpoints/finalizers

	  - ciliumnodes

	  - ciliumnodes/status

	  - ciliumnodes/finalizers

	  - ciliumidentities

	  - ciliumidentities/status

	  - ciliumidentities/finalizers

	  - ciliumlocalredirectpolicies

	  - ciliumlocalredirectpolicies/status

	  - ciliumlocalredirectpolicies/finalizers

	  verbs:

	  - '*'

	- apiGroups:

	  - apiextensions.k8s.io

	  resources:

	  - customresourcedefinitions

	  verbs:

	  - create

	  - get

	  - list

	  - update

	  - watch

	# For cilium-operator running in HA mode.

	#

	# Cilium operator running in HA mode requires the use of ResourceLock for Leader Election

	# between multiple running instances.

	# The preferred way of doing this is to use LeasesResourceLock as edits to Leases are less

	# common and fewer objects in the cluster watch "all Leases".

	# The support for leases was introduced in coordination.k8s.io/v1 during Kubernetes 1.14 release.

	# In Cilium we currently don't support HA mode for K8s version < 1.14. This condition make sure

	# that we only authorize access to leases resources in supported K8s versions.

	- apiGroups:

	  - coordination.k8s.io

	  resources:

	  - leases

	  verbs:

	  - create

	  - get

	  - update

	---

	# Source: cilium/templates/cilium-agent-clusterrolebinding.yaml

	apiVersion: rbac.authorization.k8s.io/v1

	kind: ClusterRoleBinding

	metadata:

	  name: cilium

	roleRef:

	  apiGroup: rbac.authorization.k8s.io

	  kind: ClusterRole

	  name: cilium

	subjects:

	- kind: ServiceAccount

	  name: cilium

	  namespace: kube-system

	---

	# Source: cilium/templates/cilium-operator-clusterrolebinding.yaml

	apiVersion: rbac.authorization.k8s.io/v1

	kind: ClusterRoleBinding

	metadata:

	  name: cilium-operator

	roleRef:

	  apiGroup: rbac.authorization.k8s.io

	  kind: ClusterRole

	  name: cilium-operator

	subjects:

	- kind: ServiceAccount

	  name: cilium-operator

	  namespace: kube-system

	---

	# Source: cilium/templates/cilium-agent-daemonset.yaml

	apiVersion: apps/v1

	kind: DaemonSet

	metadata:

	  labels:

	    k8s-app: cilium

	  name: cilium

	  namespace: kube-system

	spec:

	  selector:

	    matchLabels:

	      k8s-app: cilium

	  updateStrategy:

	    rollingUpdate:

	      maxUnavailable: 2

	    type: RollingUpdate

	  template:

	    metadata:

	      annotations:

	        # This annotation plus the CriticalAddonsOnly toleration makes

	        # cilium to be a critical pod in the cluster, which ensures cilium

	        # gets priority scheduling.

	        # https://kubernetes.io/docs/tasks/administer-cluster/guaranteed-scheduling-critical-addon-pods/

	        scheduler.alpha.kubernetes.io/critical-pod: ""

	      labels:

	        k8s-app: cilium

	    spec:

	      affinity:

	        podAntiAffinity:

	          requiredDuringSchedulingIgnoredDuringExecution:

	          - labelSelector:

	              matchExpressions:

	              - key: k8s-app

	                operator: In

	                values:

	                - cilium

	            topologyKey: kubernetes.io/hostname

	      containers:

	      - args:

	        - --config-dir=/tmp/cilium/config-map

	        command:

	        - cilium-agent

	        livenessProbe:

	          httpGet:

	            host: '127.0.0.1'

	            path: /healthz

	            port: 9876

	            scheme: HTTP

	            httpHeaders:

	            - name: "brief"

	              value: "true"

	          failureThreshold: 10

	          # The initial delay for the liveness probe is intentionally large to

	          # avoid an endless kill & restart cycle if in the event that the initial

	          # bootstrapping takes longer than expected.

	          initialDelaySeconds: 120

	          periodSeconds: 30

	          successThreshold: 1

	          timeoutSeconds: 5

	        readinessProbe:

	          httpGet:

	            host: '127.0.0.1'

	            path: /healthz

	            port: 9876

	            scheme: HTTP

	            httpHeaders:

	            - name: "brief"

	              value: "true"

	          failureThreshold: 3

	          initialDelaySeconds: 5

	          periodSeconds: 30

	          successThreshold: 1

	          timeoutSeconds: 5

	        env:

	        - name: K8S_NODE_NAME

	          valueFrom:

	            fieldRef:

	              apiVersion: v1

	              fieldPath: spec.nodeName

	        - name: CILIUM_K8S_NAMESPACE

	          valueFrom:

	            fieldRef:

	              apiVersion: v1

	              fieldPath: metadata.namespace

	        - name: CILIUM_FLANNEL_MASTER_DEVICE

	          valueFrom:

	            configMapKeyRef:

	              key: flannel-master-device

	              name: cilium-config

	              optional: true

	        - name: CILIUM_FLANNEL_UNINSTALL_ON_EXIT

	          valueFrom:

	            configMapKeyRef:

	              key: flannel-uninstall-on-exit

	              name: cilium-config

	              optional: true

	        - name: CILIUM_CLUSTERMESH_CONFIG

	          value: /var/lib/cilium/clustermesh/

	        - name: CILIUM_CNI_CHAINING_MODE

	          valueFrom:

	            configMapKeyRef:

	              key: cni-chaining-mode

	              name: cilium-config

	              optional: true

	        - name: CILIUM_CUSTOM_CNI_CONF

	          valueFrom:

	            configMapKeyRef:

	              key: custom-cni-conf

	              name: cilium-config

	              optional: true

	        image: "quay.io/cilium/cilium:v1.9.9@sha256:a85d5cff13f8231c2e267d9fc3c6e43d24be4a75dac9f641c11ec46e7f17624d"

	        imagePullPolicy: IfNotPresent

	        lifecycle:

	          postStart:

	            exec:

	              command:

	              - "/cni-install.sh"

	              - "--enable-debug=false"

	          preStop:

	            exec:

	              command:

	              - /cni-uninstall.sh

	        name: cilium-agent

	        securityContext:

	          capabilities:

	            add:

	            - NET_ADMIN

	            - SYS_MODULE

	          privileged: true

	        volumeMounts:

	        - mountPath: /sys/fs/bpf

	          name: bpf-maps

	        - mountPath: /var/run/cilium

	          name: cilium-run

	        - mountPath: /host/opt/cni/bin

	          name: cni-path

	        - mountPath: /host/etc/cni/net.d

	          name: etc-cni-netd

	        - mountPath: /var/lib/cilium/clustermesh

	          name: clustermesh-secrets

	          readOnly: true

	        - mountPath: /tmp/cilium/config-map

	          name: cilium-config-path

	          readOnly: true

	          # Needed to be able to load kernel modules

	        - mountPath: /lib/modules

	          name: lib-modules

	          readOnly: true

	        - mountPath: /run/xtables.lock

	          name: xtables-lock

	        - mountPath: /var/lib/cilium/tls/hubble

	          name: hubble-tls

	          readOnly: true

	      hostNetwork: true

	      initContainers:

	      # Required to mount cgroup2 filesystem on the underlying Kubernetes node.

	      # We use nsenter command with host's cgroup and mount namespaces enabled.

	      - name: mount-cgroup

	        env:

	          - name: CGROUP_ROOT

	            value: /run/cilium/cgroupv2

	          - name: BIN_PATH

	            value: /opt/cni/bin

	        command:

	          - sh

	          - -c

	          # The statically linked Go program binary is invoked to avoid any

	          # dependency on utilities like sh and mount that can be missing on certain

	          # distros installed on the underlying host. Copy the binary to the

	          # same directory where we install cilium cni plugin so that exec permissions

	          # are available.

	          - 'cp /usr/bin/cilium-mount /hostbin/cilium-mount && nsenter --cgroup=/hostproc/1/ns/cgroup --mount=/hostproc/1/ns/mnt "${BIN_PATH}/cilium-mount" $CGROUP_ROOT; rm /hostbin/cilium-mount'

	        image: "quay.io/cilium/cilium:v1.9.9@sha256:a85d5cff13f8231c2e267d9fc3c6e43d24be4a75dac9f641c11ec46e7f17624d"

	        imagePullPolicy: IfNotPresent

	        volumeMounts:

	          - mountPath: /hostproc

	            name: hostproc

	          - mountPath: /hostbin

	            name: cni-path

	        securityContext:

	          privileged: true

	      - command:

	        - /init-container.sh

	        env:

	        - name: CILIUM_ALL_STATE

	          valueFrom:

	            configMapKeyRef:

	              key: clean-cilium-state

	              name: cilium-config

	              optional: true

	        - name: CILIUM_BPF_STATE

	          valueFrom:

	            configMapKeyRef:

	              key: clean-cilium-bpf-state

	              name: cilium-config

	              optional: true

	        - name: CILIUM_WAIT_BPF_MOUNT

	          valueFrom:

	            configMapKeyRef:

	              key: wait-bpf-mount

	              name: cilium-config

	              optional: true

	        image: "quay.io/cilium/cilium:v1.9.9@sha256:a85d5cff13f8231c2e267d9fc3c6e43d24be4a75dac9f641c11ec46e7f17624d"

	        imagePullPolicy: IfNotPresent

	        name: clean-cilium-state

	        securityContext:

	          capabilities:

	            add:

	            - NET_ADMIN

	          privileged: true

	        volumeMounts:

	        - mountPath: /sys/fs/bpf

	          name: bpf-maps

	          mountPropagation: HostToContainer

	          # Required to mount cgroup filesystem from the host to cilium agent pod

	        - mountPath: /run/cilium/cgroupv2

	          name: cilium-cgroup

	          mountPropagation: HostToContainer

	        - mountPath: /var/run/cilium

	          name: cilium-run

	        resources:

	          requests:

	            cpu: 100m

	            memory: 100Mi

	      restartPolicy: Always

	      priorityClassName: system-node-critical

	      serviceAccount: cilium

	      serviceAccountName: cilium

	      terminationGracePeriodSeconds: 1

	      tolerations:

	      - operator: Exists

	      volumes:

	        # To keep state between restarts / upgrades

	      - hostPath:

	          path: /var/run/cilium

	          type: DirectoryOrCreate

	        name: cilium-run

	        # To keep state between restarts / upgrades for bpf maps

	      - hostPath:

	          path: /sys/fs/bpf

	          type: DirectoryOrCreate

	        name: bpf-maps

	      # To mount cgroup2 filesystem on the host

	      - hostPath:

	          path: /proc

	          type: Directory

	        name: hostproc

	      # To keep state between restarts / upgrades for cgroup2 filesystem

	      - hostPath:

	          path: /run/cilium/cgroupv2

	          type: DirectoryOrCreate

	        name: cilium-cgroup

	      # To install cilium cni plugin in the host

	      - hostPath:

	          path:  /opt/cni/bin

	          type: DirectoryOrCreate

	        name: cni-path

	        # To install cilium cni configuration in the host

	      - hostPath:

	          path: /etc/cni/net.d

	          type: DirectoryOrCreate

	        name: etc-cni-netd

	        # To be able to load kernel modules

	      - hostPath:

	          path: /lib/modules

	        name: lib-modules

	        # To access iptables concurrently with other processes (e.g. kube-proxy)

	      - hostPath:

	          path: /run/xtables.lock

	          type: FileOrCreate

	        name: xtables-lock

	        # To read the clustermesh configuration

	      - name: clustermesh-secrets

	        secret:

	          defaultMode: 420

	          optional: true

	          secretName: cilium-clustermesh

	        # To read the configuration from the config map

	      - configMap:

	          name: cilium-config

	        name: cilium-config-path

	      - name: hubble-tls

	        projected:

	          sources:

	          - secret:

	              name: hubble-server-certs

	              items:

	                - key: tls.crt

	                  path: server.crt

	                - key: tls.key

	                  path: server.key

	              optional: true

	          - configMap:

	              name: hubble-ca-cert

	              items:

	                - key: ca.crt

	                  path: client-ca.crt

	              optional: true

	---

	# Source: cilium/templates/cilium-operator-deployment.yaml

	apiVersion: apps/v1

	kind: Deployment

	metadata:

	  labels:

	    io.cilium/app: operator

	    name: cilium-operator

	  name: cilium-operator

	  namespace: kube-system

	spec:

	  # We support HA mode only for Kubernetes version > 1.14

	  # See docs on ServerCapabilities.LeasesResourceLock in file pkg/k8s/version/version.go

	  # for more details.

	  replicas: 1

	  selector:

	    matchLabels:

	      io.cilium/app: operator

	      name: cilium-operator

	  strategy:

	    rollingUpdate:

	      maxSurge: 1

	      maxUnavailable: 1

	    type: RollingUpdate

	  template:

	    metadata:

	      annotations:

	      labels:

	        io.cilium/app: operator

	        name: cilium-operator

	    spec:

	      # In HA mode, cilium-operator pods must not be scheduled on the same

	      # node as they will clash with each other.

	      affinity:

	        podAntiAffinity:

	          requiredDuringSchedulingIgnoredDuringExecution:

	          - labelSelector:

	              matchExpressions:

	              - key: io.cilium/app

	                operator: In

	                values:

	                - operator

	            topologyKey: kubernetes.io/hostname

	      containers:

	      - args:

	        - --config-dir=/tmp/cilium/config-map

	        - --debug=$(CILIUM_DEBUG)

	        command:

	        - cilium-operator-generic

	        env:

	        - name: K8S_NODE_NAME

	          valueFrom:

	            fieldRef:

	              apiVersion: v1

	              fieldPath: spec.nodeName

	        - name: CILIUM_K8S_NAMESPACE

	          valueFrom:

	            fieldRef:

	              apiVersion: v1

	              fieldPath: metadata.namespace

	        - name: CILIUM_DEBUG

	          valueFrom:

	            configMapKeyRef:

	              key: debug

	              name: cilium-config

	              optional: true

	        image: "quay.io/cilium/operator-generic:v1.9.9@sha256:3726a965cd960295ca3c5e7f2b543c02096c0912c6652eb8bbb9ce54bcaa99d8"

	        imagePullPolicy: IfNotPresent

	        name: cilium-operator

	        livenessProbe:

	          httpGet:

	            host: '127.0.0.1'

	            path: /healthz

	            port: 9234

	            scheme: HTTP

	          initialDelaySeconds: 60

	          periodSeconds: 10

	          timeoutSeconds: 3

	        volumeMounts:

	        - mountPath: /tmp/cilium/config-map

	          name: cilium-config-path

	          readOnly: true

	      hostNetwork: true

	      restartPolicy: Always

	      priorityClassName: system-cluster-critical

	      serviceAccount: cilium-operator

	      serviceAccountName: cilium-operator

	      tolerations:

	      - operator: Exists

	      volumes:

	        # To read the configuration from the config map

	      - configMap:

	          name: cilium-config

	        name: cilium-config-path

	I0531 19:49:12.564956    9268 cni.go:189] applying CNI manifest using /var/lib/minikube/binaries/v1.23.6/kubectl ...

	I0531 19:49:12.564956    9268 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (23204 bytes)

	I0531 19:49:12.665855    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I0531 19:49:16.296942    9268 ssh_runner.go:235] Completed: sudo /var/lib/minikube/binaries/v1.23.6/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml: (3.6310703s)

	I0531 19:49:16.297792    9268 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0531 19:49:16.314413    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl label nodes minikube.k8s.io/version=v1.26.0-beta.1 minikube.k8s.io/commit=bd46569bd7cb517fcad2e704abdebd2826bd8454 minikube.k8s.io/name=cilium-20220531191937-2108 minikube.k8s.io/updated_at=2022_05_31T19_49_16_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:49:16.318475    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:49:16.339405    9268 ops.go:34] apiserver oom_adj: -16

	I0531 19:49:16.751966    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:49:17.464273    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:49:17.969613    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:49:18.464610    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:49:18.969412    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:49:19.470364    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:49:19.973848    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:49:20.465164    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:49:20.978673    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:49:21.465392    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:49:21.972163    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:49:22.478314    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:49:23.474313    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:49:24.461746    9268 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.6/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0531 19:49:25.247898    9268 kubeadm.go:1045] duration metric: took 8.9499934s to wait for elevateKubeSystemPrivileges.

	I0531 19:49:25.247898    9268 kubeadm.go:397] StartCluster complete in 36.1439561s

	I0531 19:49:25.248046    9268 settings.go:142] acquiring lock: {Name:mk2f48f1c2db86c45c5c20d13312e07e9c171d09 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0531 19:49:25.248549    9268 settings.go:150] Updating kubeconfig:  C:\Users\jenkins.minikube7\minikube-integration\kubeconfig

	I0531 19:49:25.251782    9268 lock.go:35] WriteFile acquiring C:\Users\jenkins.minikube7\minikube-integration\kubeconfig: {Name:mk3b9816be6135fef42a073128e9ed356868417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	W0531 19:49:25.492773    9268 kapi.go:233] failed rescaling deployment, will retry: Operation cannot be fulfilled on deployments.apps "coredns": the object has been modified; please apply your changes to the latest version and try again

	I0531 19:49:26.530833    9268 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "cilium-20220531191937-2108" rescaled to 1

	I0531 19:49:26.530833    9268 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.6/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0531 19:49:26.530833    9268 addons.go:415] enableAddons start: toEnable=map[], additional=[]

	I0531 19:49:26.530833    9268 addons.go:65] Setting storage-provisioner=true in profile "cilium-20220531191937-2108"

	I0531 19:49:26.530833    9268 addons.go:153] Setting addon storage-provisioner=true in "cilium-20220531191937-2108"

	W0531 19:49:26.530833    9268 addons.go:165] addon storage-provisioner should already be in state true

	I0531 19:49:26.530833    9268 start.go:208] Will wait 5m0s for node &{Name: IP:192.168.58.2 Port:8443 KubernetesVersion:v1.23.6 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0531 19:49:26.530833    9268 host.go:66] Checking if "cilium-20220531191937-2108" exists ...

	I0531 19:49:26.535830    9268 out.go:177] * Verifying Kubernetes components...

	I0531 19:49:26.530833    9268 addons.go:65] Setting default-storageclass=true in profile "cilium-20220531191937-2108"

	I0531 19:49:26.535830    9268 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "cilium-20220531191937-2108"

	I0531 19:49:26.531834    9268 config.go:178] Loaded profile config "cilium-20220531191937-2108": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.6

	I0531 19:49:26.562831    9268 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0531 19:49:26.565848    9268 cli_runner.go:164] Run: docker container inspect cilium-20220531191937-2108 --format={{.State.Status}}

	I0531 19:49:26.565848    9268 cli_runner.go:164] Run: docker container inspect cilium-20220531191937-2108 --format={{.State.Status}}

	I0531 19:49:27.150996    9268 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.6/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.65.2 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.23.6/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0531 19:49:27.167003    9268 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" cilium-20220531191937-2108

	I0531 19:49:28.049610    9268 cli_runner.go:217] Completed: docker container inspect cilium-20220531191937-2108 --format={{.State.Status}}: (1.4837555s)

	I0531 19:49:28.052622    9268 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0531 19:49:28.055606    9268 addons.go:348] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0531 19:49:28.055606    9268 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0531 19:49:28.060596    9268 cli_runner.go:217] Completed: docker container inspect cilium-20220531191937-2108 --format={{.State.Status}}: (1.4947412s)

	I0531 19:49:28.063598    9268 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108

	I0531 19:49:28.128802    9268 addons.go:153] Setting addon default-storageclass=true in "cilium-20220531191937-2108"

	W0531 19:49:28.128878    9268 addons.go:165] addon default-storageclass should already be in state true

	I0531 19:49:28.128993    9268 host.go:66] Checking if "cilium-20220531191937-2108" exists ...

	I0531 19:49:28.161460    9268 cli_runner.go:164] Run: docker container inspect cilium-20220531191937-2108 --format={{.State.Status}}

	I0531 19:49:28.689659    9268 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "8443/tcp") 0).HostPort}}'" cilium-20220531191937-2108: (1.5224334s)

	I0531 19:49:28.697582    9268 node_ready.go:35] waiting up to 5m0s for node "cilium-20220531191937-2108" to be "Ready" ...

	I0531 19:49:28.743185    9268 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.6/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.65.2 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.23.6/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.5921819s)

	I0531 19:49:28.743185    9268 start.go:806] {"host.minikube.internal": 192.168.65.2} host record injected into CoreDNS

	I0531 19:49:28.834064    9268 node_ready.go:49] node "cilium-20220531191937-2108" has status "Ready":"True"

	I0531 19:49:28.834064    9268 node_ready.go:38] duration metric: took 136.4814ms waiting for node "cilium-20220531191937-2108" to be "Ready" ...

	I0531 19:49:28.834064    9268 pod_ready.go:35] extra waiting up to 5m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0531 19:49:28.957945    9268 pod_ready.go:78] waiting up to 5m0s for pod "cilium-k5t52" in "kube-system" namespace to be "Ready" ...

	I0531 19:49:29.479694    9268 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108: (1.4160899s)

	I0531 19:49:29.479694    9268 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54754 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\cilium-20220531191937-2108\id_rsa Username:docker}

	I0531 19:49:29.620783    9268 cli_runner.go:217] Completed: docker container inspect cilium-20220531191937-2108 --format={{.State.Status}}: (1.4593165s)

	I0531 19:49:29.620783    9268 addons.go:348] installing /etc/kubernetes/addons/storageclass.yaml

	I0531 19:49:29.620783    9268 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0531 19:49:29.636808    9268 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108

	I0531 19:49:30.355449    9268 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0531 19:49:31.150681    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:49:31.166688    9268 cli_runner.go:217] Completed: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" cilium-20220531191937-2108: (1.5298739s)

	I0531 19:49:31.166688    9268 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:54754 SSHKeyPath:C:\Users\jenkins.minikube7\minikube-integration\.minikube\machines\cilium-20220531191937-2108\id_rsa Username:docker}

	I0531 19:49:32.173199    9268 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0531 19:49:33.437522    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:49:34.038067    9268 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.6826015s)

	I0531 19:49:38.945163    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:49:39.028728    9268 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.6/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (6.8554987s)

	I0531 19:49:39.035716    9268 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0531 19:49:39.041725    9268 addons.go:417] enableAddons completed in 12.5108375s

	I0531 19:49:43.216524    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:49:45.660397    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:49:48.147652    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:49:50.645797    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:49:53.140920    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:49:55.143006    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:49:57.145340    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:49:59.646777    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:02.332392    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:04.642744    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:06.644986    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:09.144450    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:11.642196    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:13.647209    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:15.654692    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:18.086828    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:20.146417    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:22.690233    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:25.137333    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:27.203556    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:29.657641    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:31.933017    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:34.332888    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:36.646199    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:38.772665    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:41.079065    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:43.087683    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:45.089192    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:47.102726    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:49.592858    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:52.094119    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:54.590673    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:56.597659    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:50:59.090202    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:01.585861    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:03.594656    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:06.073904    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:08.101133    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:10.586032    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:12.595767    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:14.632262    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:17.091454    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:19.585051    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:21.597865    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:24.105041    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:26.579529    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:28.595723    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:34.710626    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:39.305965    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:41.660629    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:44.084831    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:46.089411    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:48.090501    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:50.585097    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:52.601404    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:55.087146    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:51:57.585738    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:00.086100    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:02.591637    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:05.082519    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:07.111644    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:09.584011    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:11.591034    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:23.835787    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:26.126317    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:28.582937    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:30.597794    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:33.083972    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:35.086645    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:37.095700    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:39.590145    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:42.090764    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:44.583109    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:46.588323    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:48.588603    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:50.590425    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:53.082897    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:55.092486    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:52:57.589445    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:00.093596    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:02.576106    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:04.583100    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:07.093578    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:09.590835    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:12.082143    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:14.084391    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:16.090299    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:18.092088    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:20.595408    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:23.095495    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:25.164988    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:27.582989    9268 pod_ready.go:102] pod "cilium-k5t52" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:29.099077    9268 pod_ready.go:81] duration metric: took 4m0.1400756s waiting for pod "cilium-k5t52" in "kube-system" namespace to be "Ready" ...

	E0531 19:53:29.099077    9268 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting for the condition

	I0531 19:53:29.099077    9268 pod_ready.go:78] waiting up to 5m0s for pod "cilium-operator-78f49c47f-7ccp4" in "kube-system" namespace to be "Ready" ...

	I0531 19:53:29.112072    9268 pod_ready.go:92] pod "cilium-operator-78f49c47f-7ccp4" in "kube-system" namespace has status "Ready":"True"

	I0531 19:53:29.112072    9268 pod_ready.go:81] duration metric: took 12.995ms waiting for pod "cilium-operator-78f49c47f-7ccp4" in "kube-system" namespace to be "Ready" ...

	I0531 19:53:29.112072    9268 pod_ready.go:78] waiting up to 5m0s for pod "coredns-64897985d-2ksb8" in "kube-system" namespace to be "Ready" ...

	I0531 19:53:29.118076    9268 pod_ready.go:97] error getting pod "coredns-64897985d-2ksb8" in "kube-system" namespace (skipping!): pods "coredns-64897985d-2ksb8" not found

	I0531 19:53:29.118076    9268 pod_ready.go:81] duration metric: took 6.004ms waiting for pod "coredns-64897985d-2ksb8" in "kube-system" namespace to be "Ready" ...

	E0531 19:53:29.118076    9268 pod_ready.go:66] WaitExtra: waitPodCondition: error getting pod "coredns-64897985d-2ksb8" in "kube-system" namespace (skipping!): pods "coredns-64897985d-2ksb8" not found

	I0531 19:53:29.118076    9268 pod_ready.go:78] waiting up to 5m0s for pod "coredns-64897985d-nktf8" in "kube-system" namespace to be "Ready" ...

	I0531 19:53:31.171043    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:33.680672    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:36.164020    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:38.169363    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:40.175054    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:42.674804    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:44.675717    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:47.164419    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:49.167304    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:51.169173    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:53.170696    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:55.669074    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:53:57.751868    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:00.168487    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:02.673331    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:05.171251    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:07.679543    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:10.172597    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:12.177544    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:14.673026    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:17.164390    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:19.181278    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:21.670693    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:24.155293    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:26.167533    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:28.176103    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:30.671805    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:33.171691    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:35.670794    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:37.677573    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:39.677965    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:42.163647    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:44.175105    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:46.675665    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:49.176955    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:51.178121    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:53.663345    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:56.172202    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:54:58.175436    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:00.176836    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:02.666532    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:05.170498    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:07.670613    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:09.678652    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:12.187550    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:14.683238    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:17.179359    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:19.675111    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:21.730399    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:24.229391    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:26.676100    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:29.175353    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:31.194050    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:33.665151    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:35.669948    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:38.165863    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:40.664274    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:43.176392    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:45.673976    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:48.173929    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:50.177274    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:52.674717    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:55.170572    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:57.176717    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:55:59.665952    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:02.168206    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:04.175318    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:06.677868    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:09.250267    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:11.727271    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:14.170550    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:16.677035    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:19.172519    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:21.173965    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:23.662240    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:25.669983    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:28.176849    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:30.674422    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:33.179413    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:35.662738    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:37.670686    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:39.671676    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:42.165424    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:44.182800    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:46.669148    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:48.672290    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:51.166061    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:53.175432    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:55.668063    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:56:57.729726    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:57:00.167239    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:57:02.174654    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:57:04.180611    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:57:06.663118    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:57:08.665693    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:57:10.669276    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:57:12.675358    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:57:15.166823    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:57:17.173024    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:57:19.669927    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:57:21.677431    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:57:23.683965    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:57:26.169101    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:57:28.173555    9268 pod_ready.go:102] pod "coredns-64897985d-nktf8" in "kube-system" namespace has status "Ready":"False"

	I0531 19:57:29.191896    9268 pod_ready.go:81] duration metric: took 4m0.0727573s waiting for pod "coredns-64897985d-nktf8" in "kube-system" namespace to be "Ready" ...

	E0531 19:57:29.191896    9268 pod_ready.go:66] WaitExtra: waitPodCondition: timed out waiting for the condition

	I0531 19:57:29.191896    9268 pod_ready.go:38] duration metric: took 8m0.3557122s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0531 19:57:29.195871    9268 out.go:177] 

	W0531 19:57:29.197882    9268 out.go:239] X Exiting due to GUEST_START: wait 5m0s for node: extra waiting: timed out waiting 5m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"

	X Exiting due to GUEST_START: wait 5m0s for node: extra waiting: timed out waiting 5m0s for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready"

	W0531 19:57:29.197882    9268 out.go:239] * 

	* 

	W0531 19:57:29.198861    9268 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0531 19:57:29.201861    9268 out.go:177] 

** /stderr **

net_test.go:103: failed start: exit status 80

--- FAIL: TestNetworkPlugins/group/cilium/Start (610.92s)