=== RUN   TestDownloadOnly/v1.24.1-rc.0/cached-images

aaa_download_only_test.go:133: expected image file exist at "/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.24.1-rc.0" but got error: stat /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/k8s.gcr.io/kube-apiserver_v1.24.1-rc.0: no such file or directory

aaa_download_only_test.go:133: expected image file exist at "/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.24.1-rc.0" but got error: stat /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/k8s.gcr.io/kube-controller-manager_v1.24.1-rc.0: no such file or directory

aaa_download_only_test.go:133: expected image file exist at "/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.24.1-rc.0" but got error: stat /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/k8s.gcr.io/kube-scheduler_v1.24.1-rc.0: no such file or directory

aaa_download_only_test.go:133: expected image file exist at "/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.24.1-rc.0" but got error: stat /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/k8s.gcr.io/kube-proxy_v1.24.1-rc.0: no such file or directory

aaa_download_only_test.go:133: expected image file exist at "/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/k8s.gcr.io/pause_3.7" but got error: stat /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/k8s.gcr.io/pause_3.7: no such file or directory

aaa_download_only_test.go:133: expected image file exist at "/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/k8s.gcr.io/etcd_3.5.3-0" but got error: stat /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/k8s.gcr.io/etcd_3.5.3-0: no such file or directory

aaa_download_only_test.go:133: expected image file exist at "/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/k8s.gcr.io/coredns/coredns_v1.8.6" but got error: stat /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/k8s.gcr.io/coredns/coredns_v1.8.6: no such file or directory

aaa_download_only_test.go:133: expected image file exist at "/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5" but got error: stat /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/gcr.io/k8s-minikube/storage-provisioner_v5: no such file or directory

--- FAIL: TestDownloadOnly/v1.24.1-rc.0/cached-images (0.00s)

=== RUN   TestAddons/parallel/MetricsServer

=== PAUSE TestAddons/parallel/MetricsServer

=== CONT  TestAddons/parallel/MetricsServer

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:357: metrics-server stabilized in 8.727842ms

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:359: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...

=== CONT  TestAddons/parallel/MetricsServer

helpers_test.go:342: "metrics-server-5ccbd9cf46-9zwvx" [4e835545-32d0-4e32-abd8-7358d6da7010] Running / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:359: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.008658837s

addons_test.go:365: (dbg) Run:  kubectl --context addons-20220509082454-6723 top pods -n kube-system

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:365: (dbg) Non-zero exit: kubectl --context addons-20220509082454-6723 top pods -n kube-system: exit status 1 (56.029585ms)

** stderr ** 

	Error from server (ServiceUnavailable): the server is currently unable to handle the request (get pods.metrics.k8s.io)

** /stderr **

addons_test.go:365: (dbg) Run:  kubectl --context addons-20220509082454-6723 top pods -n kube-system

addons_test.go:365: (dbg) Non-zero exit: kubectl --context addons-20220509082454-6723 top pods -n kube-system: exit status 1 (59.842062ms)

** stderr ** 

	Error from server (ServiceUnavailable): the server is currently unable to handle the request (get pods.metrics.k8s.io)

** /stderr **

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:365: (dbg) Run:  kubectl --context addons-20220509082454-6723 top pods -n kube-system

addons_test.go:365: (dbg) Non-zero exit: kubectl --context addons-20220509082454-6723 top pods -n kube-system: exit status 1 (52.118854ms)

** stderr ** 

	Error from server (ServiceUnavailable): the server is currently unable to handle the request (get pods.metrics.k8s.io)

** /stderr **

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:365: (dbg) Run:  kubectl --context addons-20220509082454-6723 top pods -n kube-system

addons_test.go:365: (dbg) Non-zero exit: kubectl --context addons-20220509082454-6723 top pods -n kube-system: exit status 1 (50.30321ms)

** stderr ** 

	Error from server (ServiceUnavailable): the server is currently unable to handle the request (get pods.metrics.k8s.io)

** /stderr **

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:365: (dbg) Run:  kubectl --context addons-20220509082454-6723 top pods -n kube-system

addons_test.go:365: (dbg) Non-zero exit: kubectl --context addons-20220509082454-6723 top pods -n kube-system: exit status 1 (50.893765ms)

** stderr ** 

	Error from server (ServiceUnavailable): the server is currently unable to handle the request (get pods.metrics.k8s.io)

** /stderr **

=== CONT  TestAddons/parallel/MetricsServer

addons_test.go:365: (dbg) Run:  kubectl --context addons-20220509082454-6723 top pods -n kube-system

addons_test.go:365: (dbg) Non-zero exit: kubectl --context addons-20220509082454-6723 top pods -n kube-system: exit status 1 (47.053275ms)

** stderr ** 

	Error from server (ServiceUnavailable): the server is currently unable to handle the request (get pods.metrics.k8s.io)

** /stderr **

addons_test.go:365: (dbg) Run:  kubectl --context addons-20220509082454-6723 top pods -n kube-system

addons_test.go:365: (dbg) Non-zero exit: kubectl --context addons-20220509082454-6723 top pods -n kube-system: exit status 1 (48.833349ms)

** stderr ** 

	Error from server (ServiceUnavailable): the server is currently unable to handle the request (get pods.metrics.k8s.io)

** /stderr **

addons_test.go:365: (dbg) Run:  kubectl --context addons-20220509082454-6723 top pods -n kube-system

addons_test.go:365: (dbg) Non-zero exit: kubectl --context addons-20220509082454-6723 top pods -n kube-system: exit status 1 (48.273066ms)

** stderr ** 

	Error from server (ServiceUnavailable): the server is currently unable to handle the request (get pods.metrics.k8s.io)

** /stderr **

addons_test.go:365: (dbg) Run:  kubectl --context addons-20220509082454-6723 top pods -n kube-system

addons_test.go:365: (dbg) Non-zero exit: kubectl --context addons-20220509082454-6723 top pods -n kube-system: exit status 1 (48.486869ms)

** stderr ** 

	Error from server (ServiceUnavailable): the server is currently unable to handle the request (get pods.metrics.k8s.io)

** /stderr **

addons_test.go:365: (dbg) Run:  kubectl --context addons-20220509082454-6723 top pods -n kube-system

addons_test.go:365: (dbg) Non-zero exit: kubectl --context addons-20220509082454-6723 top pods -n kube-system: exit status 1 (49.033743ms)

** stderr ** 

	Error from server (ServiceUnavailable): the server is currently unable to handle the request (get pods.metrics.k8s.io)

** /stderr **

addons_test.go:365: (dbg) Run:  kubectl --context addons-20220509082454-6723 top pods -n kube-system

addons_test.go:365: (dbg) Non-zero exit: kubectl --context addons-20220509082454-6723 top pods -n kube-system: exit status 1 (48.090952ms)

** stderr ** 

	Error from server (ServiceUnavailable): the server is currently unable to handle the request (get pods.metrics.k8s.io)

** /stderr **

addons_test.go:379: failed checking metric server: exit status 1

addons_test.go:382: (dbg) Run:  out/minikube-linux-amd64 -p addons-20220509082454-6723 addons disable metrics-server --alsologtostderr -v=1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/MetricsServer]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect addons-20220509082454-6723

helpers_test.go:235: (dbg) docker inspect addons-20220509082454-6723:

-- stdout --

	[

	    {

	        "Id": "547be1dee1137f29a2f7b49182e52539b5483115aa1ef1aa721ca15bf6369620",

	        "Created": "2022-05-09T08:25:11.083729274Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 8627,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2022-05-09T08:25:11.482239511Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:44d43b69f3d5ba7f801dca891b535f23f9839671e82277938ec7dc42a22c50d6",

	        "ResolvConfPath": "/var/lib/docker/containers/547be1dee1137f29a2f7b49182e52539b5483115aa1ef1aa721ca15bf6369620/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/547be1dee1137f29a2f7b49182e52539b5483115aa1ef1aa721ca15bf6369620/hostname",

	        "HostsPath": "/var/lib/docker/containers/547be1dee1137f29a2f7b49182e52539b5483115aa1ef1aa721ca15bf6369620/hosts",

	        "LogPath": "/var/lib/docker/containers/547be1dee1137f29a2f7b49182e52539b5483115aa1ef1aa721ca15bf6369620/547be1dee1137f29a2f7b49182e52539b5483115aa1ef1aa721ca15bf6369620-json.log",

	        "Name": "/addons-20220509082454-6723",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "unconfined",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "addons-20220509082454-6723:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "addons-20220509082454-6723",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 0,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 0,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/9a6886679b366f24fd7eadb258a48da39c07c6bbb40a5eaf5fab66ec7c4bdb6f-init/diff:/var/lib/docker/overlay2/beaaca4c58fe6ff4bdb88567c3d78ab7a23955eafaa5637df03ee2e0482d2aa6/diff:/var/lib/docker/overlay2/7c16b810bbfa3a2abff75078fa37b4cba0b2f101ff43d49beaabc3fd2602b1c9/diff:/var/lib/docker/overlay2/60f04c0e4baa8ad1c02ae5e34e6f505db0d740e2d7dc0833b2ff3b8037c1a9b6/diff:/var/lib/docker/overlay2/a12543300ae4ff803b2f0493a60a04a921312ec5a7b6ed493e66acadf998daef/diff:/var/lib/docker/overlay2/2d68f658a64cd8b7255bce93547db5d1b20b119ef6da8b9ce06614134661f235/diff:/var/lib/docker/overlay2/0f968f210c1565f6e8c4e444c650502c06a120d8767c9fefb7b6b2a09f4af83b/diff:/var/lib/docker/overlay2/987a67893acdccd514357a50db6c11680ae1899ec07a36085367a241ba1f0545/diff:/var/lib/docker/overlay2/d5446d1adc007f4390aa6173ef257b0bf52a9c9cc6533f16dd6c577fde5334b3/diff:/var/lib/docker/overlay2/265dd0cde77d578f6412ad48596c75c3548b5e077059c0fa835e4f22775fab83/diff:/var/lib/docker/overlay2/e6b98b

08dd64e06639e2a321169f84a89e8d21cea02d673819156eeb7a4747c3/diff:/var/lib/docker/overlay2/acf7117613a840e97b7a1101bfdce3a154a335ee0ffcaf74bd7f1b27b00cdaab/diff:/var/lib/docker/overlay2/9e88fa64aa800dac6e01eddc9cfd525a0dcd906c1adf98de066be87f87a6b52c/diff:/var/lib/docker/overlay2/6c539edead197cd449ca81fd34e3c534a6ca25446a52141d0ae4484aaac05482/diff:/var/lib/docker/overlay2/866719c52f41a692b94f42071d314de55b290912f946f4ec5f3785a7a5ae40df/diff:/var/lib/docker/overlay2/1c488a9b3bad141652873f4085ce1a466e1f1e8ccbd086d03a492b45179a6064/diff:/var/lib/docker/overlay2/bce5b942da09326e5a5c8595077544ced08031b1cd9b22ff8bff0a4458540139/diff:/var/lib/docker/overlay2/ffe34c3764a4eeac791f4672d47389ec3f399f716ab6e5531d7c5e587f3ace00/diff:/var/lib/docker/overlay2/a377e0779d03467b09a26898ae35b12f325d62984304817f49c693b2146c08f4/diff:/var/lib/docker/overlay2/6092380f07b29488cf0a30cb486638d86eaa8e00ff356a7985c6ac6f2fae5c1d/diff:/var/lib/docker/overlay2/1bc014cc0cf0a91c61f131c06b0194709f853dec23defe9233cbd9cc40030c28/diff:/var/lib/d

ocker/overlay2/0c81c4db7384c48318a800165af7f811348a8081efdd9dbd912e05e55c9eb4e0/diff:/var/lib/docker/overlay2/72b0c515d90bc71e27b766a9be89e315777a5bbe643d8fc508a9ae12557a58ce/diff:/var/lib/docker/overlay2/a4d193bf8c377d4cf1357b9261d3c54d995f17bda3db5abee3ef5caec001d75e/diff:/var/lib/docker/overlay2/763c6d291074b0842ecdeec1f3842fd6a0af0cb86839c82bc38cec0f40d095ca/diff:/var/lib/docker/overlay2/e4156eb2a94ac7136eb674fb8c22ea7f6dff50cd81e4857119d81112dc5ad99d/diff:/var/lib/docker/overlay2/be7effa3bb906b8c48aefab3cc72e657931bccd42c35b03bb52c679c37c70d25/diff:/var/lib/docker/overlay2/ccf8c1a68774cc6129c43490c675e6ba0ff0c88284ad899c9efb4b7492e92a06/diff:/var/lib/docker/overlay2/55f74cddb5c8f2da1131ddd67f7f2a20b8c2be8719b71047d5185fdb4722627d/diff:/var/lib/docker/overlay2/f6c38e83545e9de87d03b1e8e9b0239079acf47784afc11291b2172a11f8296d/diff:/var/lib/docker/overlay2/24604ce83180fcb6b9e1adbaf37db6776e4949ca5e1f4f9050b8fb8dc87d7591/diff:/var/lib/docker/overlay2/b03b1952bea32e53ce88b0d92d09f78ca76ceca0a146b088628be224813

ae87c/diff:/var/lib/docker/overlay2/d7ee02a5ba355c246c3107f286c4130457358aa56e0d8feb3850d953812fe76d/diff:/var/lib/docker/overlay2/1223ae0e5105ae89c78524490f0ccc5fe6dfa373e175fa70474b06c62aad91c7/diff:/var/lib/docker/overlay2/c3209d71eed94ed66b11ba3a7573c347d5c09a5a4fedb00418e52571abb2b5f9/diff:/var/lib/docker/overlay2/d6d32632e36023dec15e643fd41f77168442327cecdead87a47e70683cb0c660/diff:/var/lib/docker/overlay2/fd413b21f1f34027c98a1b4106f7e7db83e910860edd53ef838ac699659cd451/diff:/var/lib/docker/overlay2/9768e3244c157a7a12b8ec31507c1abc0fc806a9f325099262cfeb41e23a5fe1/diff:/var/lib/docker/overlay2/f65dda9d5b79903f5e68f6b9d4a59214d62f304da77faa7e148b90b402d98ca4/diff:/var/lib/docker/overlay2/b663c2dab6b5df7b606daa62e1df5e57f4a2503c2a9a19211f47359fd685dccf/diff:/var/lib/docker/overlay2/bbd620a7e494844db80a2bcd2fd6f170080c5273f1c33a576501214dd4475464/diff:/var/lib/docker/overlay2/23de36667695cec8ea0f4c98fc580213d356d39a3eba5aaab8b6ebeeb2b71596/diff:/var/lib/docker/overlay2/bafb3e8d91e83dcf824b6d5b3f56a67c483c42

723724b009a5aedf578351154f/diff:/var/lib/docker/overlay2/2798e8ce2f51dde257a9cf2dd800492f888fd02515c5f1de4133cc787ee12928/diff:/var/lib/docker/overlay2/e69a88f2dffdd2c7f72c45eaf2e3cd1a8772e0a2af22d6f34d2695bbda62b6e9/diff:/var/lib/docker/overlay2/708816f20892c0e4b94cbe8e80b169fff54ffd870bcde395bd8163dd03b25d0f/diff",

	                "MergedDir": "/var/lib/docker/overlay2/9a6886679b366f24fd7eadb258a48da39c07c6bbb40a5eaf5fab66ec7c4bdb6f/merged",

	                "UpperDir": "/var/lib/docker/overlay2/9a6886679b366f24fd7eadb258a48da39c07c6bbb40a5eaf5fab66ec7c4bdb6f/diff",

	                "WorkDir": "/var/lib/docker/overlay2/9a6886679b366f24fd7eadb258a48da39c07c6bbb40a5eaf5fab66ec7c4bdb6f/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "addons-20220509082454-6723",

	                "Source": "/var/lib/docker/volumes/addons-20220509082454-6723/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "addons-20220509082454-6723",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "addons-20220509082454-6723",

	                "name.minikube.sigs.k8s.io": "addons-20220509082454-6723",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "09e6b2c8dfc86ebf42111cdf588d3b3df612469eca590474d43860610db3612b",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "49157"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "49156"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "49153"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "49155"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "49154"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/09e6b2c8dfc8",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "addons-20220509082454-6723": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "547be1dee113",

	                        "addons-20220509082454-6723"

	                    ],

	                    "NetworkID": "f822b2fb4ade7331a14ae0bc35ed1fe3bb560a94a7d2cf37dd621626e5f8a551",

	                    "EndpointID": "24d51883d3761769483e056396a7cc514fb2df75d39f5451ca4f64c0dd624867",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p addons-20220509082454-6723 -n addons-20220509082454-6723

helpers_test.go:244: <<< TestAddons/parallel/MetricsServer FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/MetricsServer]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p addons-20220509082454-6723 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p addons-20220509082454-6723 logs -n 25: (1.196474681s)

helpers_test.go:252: TestAddons/parallel/MetricsServer logs: 

-- stdout --

	* 

	* ==> Audit <==

	* |---------|-------------------------------------|-------------------------------------|---------|---------|---------------------|---------------------|

	| Command |                Args                 |               Profile               |  User   | Version |     Start Time      |      End Time       |

	|---------|-------------------------------------|-------------------------------------|---------|---------|---------------------|---------------------|

	| delete  | --all                               | download-only-20220509082434-6723   | jenkins | v1.25.2 | 09 May 22 08:24 UTC | 09 May 22 08:24 UTC |

	| delete  | -p                                  | download-only-20220509082434-6723   | jenkins | v1.25.2 | 09 May 22 08:24 UTC | 09 May 22 08:24 UTC |

	|         | download-only-20220509082434-6723   |                                     |         |         |                     |                     |

	| delete  | -p                                  | download-only-20220509082434-6723   | jenkins | v1.25.2 | 09 May 22 08:24 UTC | 09 May 22 08:24 UTC |

	|         | download-only-20220509082434-6723   |                                     |         |         |                     |                     |

	| delete  | -p                                  | download-docker-20220509082450-6723 | jenkins | v1.25.2 | 09 May 22 08:24 UTC | 09 May 22 08:24 UTC |

	|         | download-docker-20220509082450-6723 |                                     |         |         |                     |                     |

	| delete  | -p                                  | binary-mirror-20220509082453-6723   | jenkins | v1.25.2 | 09 May 22 08:24 UTC | 09 May 22 08:24 UTC |

	|         | binary-mirror-20220509082453-6723   |                                     |         |         |                     |                     |

	| start   | -p addons-20220509082454-6723       | addons-20220509082454-6723          | jenkins | v1.25.2 | 09 May 22 08:24 UTC | 09 May 22 08:26 UTC |

	|         | --wait=true --memory=4000           |                                     |         |         |                     |                     |

	|         | --alsologtostderr                   |                                     |         |         |                     |                     |

	|         | --addons=registry                   |                                     |         |         |                     |                     |

	|         | --addons=metrics-server             |                                     |         |         |                     |                     |

	|         | --addons=volumesnapshots            |                                     |         |         |                     |                     |

	|         | --addons=csi-hostpath-driver        |                                     |         |         |                     |                     |

	|         | --addons=gcp-auth                   |                                     |         |         |                     |                     |

	|         | --driver=docker                     |                                     |         |         |                     |                     |

	|         | --container-runtime=docker          |                                     |         |         |                     |                     |

	|         | --addons=ingress                    |                                     |         |         |                     |                     |

	|         | --addons=ingress-dns                |                                     |         |         |                     |                     |

	|         | --addons=helm-tiller                |                                     |         |         |                     |                     |

	| addons  | addons-20220509082454-6723          | addons-20220509082454-6723          | jenkins | v1.25.2 | 09 May 22 08:26 UTC | 09 May 22 08:26 UTC |

	|         | addons disable helm-tiller          |                                     |         |         |                     |                     |

	|         | --alsologtostderr -v=1              |                                     |         |         |                     |                     |

	| ip      | addons-20220509082454-6723 ip       | addons-20220509082454-6723          | jenkins | v1.25.2 | 09 May 22 08:26 UTC | 09 May 22 08:26 UTC |

	| addons  | addons-20220509082454-6723          | addons-20220509082454-6723          | jenkins | v1.25.2 | 09 May 22 08:26 UTC | 09 May 22 08:26 UTC |

	|         | addons disable registry             |                                     |         |         |                     |                     |

	|         | --alsologtostderr -v=1              |                                     |         |         |                     |                     |

	| ssh     | addons-20220509082454-6723 ssh      | addons-20220509082454-6723          | jenkins | v1.25.2 | 09 May 22 08:26 UTC | 09 May 22 08:26 UTC |

	|         | curl -s http://127.0.0.1/ -H        |                                     |         |         |                     |                     |

	|         | 'Host: nginx.example.com'           |                                     |         |         |                     |                     |

	| ip      | addons-20220509082454-6723 ip       | addons-20220509082454-6723          | jenkins | v1.25.2 | 09 May 22 08:26 UTC | 09 May 22 08:26 UTC |

	| addons  | addons-20220509082454-6723          | addons-20220509082454-6723          | jenkins | v1.25.2 | 09 May 22 08:26 UTC | 09 May 22 08:26 UTC |

	|         | addons disable ingress-dns          |                                     |         |         |                     |                     |

	|         | --alsologtostderr -v=1              |                                     |         |         |                     |                     |

	| addons  | addons-20220509082454-6723          | addons-20220509082454-6723          | jenkins | v1.25.2 | 09 May 22 08:27 UTC | 09 May 22 08:27 UTC |

	|         | addons disable                      |                                     |         |         |                     |                     |

	|         | csi-hostpath-driver                 |                                     |         |         |                     |                     |

	|         | --alsologtostderr -v=1              |                                     |         |         |                     |                     |

	| addons  | addons-20220509082454-6723          | addons-20220509082454-6723          | jenkins | v1.25.2 | 09 May 22 08:27 UTC | 09 May 22 08:27 UTC |

	|         | addons disable volumesnapshots      |                                     |         |         |                     |                     |

	|         | --alsologtostderr -v=1              |                                     |         |         |                     |                     |

	| addons  | addons-20220509082454-6723          | addons-20220509082454-6723          | jenkins | v1.25.2 | 09 May 22 08:31 UTC | 09 May 22 08:31 UTC |

	|         | addons disable metrics-server       |                                     |         |         |                     |                     |

	|         | --alsologtostderr -v=1              |                                     |         |         |                     |                     |

	|---------|-------------------------------------|-------------------------------------|---------|---------|---------------------|---------------------|

	* 

	* ==> Last Start <==

	* Log file created at: 2022/05/09 08:24:54

	Running on machine: ubuntu-20-agent-14

	Binary: Built with gc go1.18.1 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0509 08:24:54.118809    7953 out.go:296] Setting OutFile to fd 1 ...

	I0509 08:24:54.118943    7953 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0509 08:24:54.118954    7953 out.go:309] Setting ErrFile to fd 2...

	I0509 08:24:54.118962    7953 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0509 08:24:54.119081    7953 root.go:322] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/bin

	I0509 08:24:54.119413    7953 out.go:303] Setting JSON to false

	I0509 08:24:54.120176    7953 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-14","uptime":448,"bootTime":1652084246,"procs":173,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.13.0-1024-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0509 08:24:54.120251    7953 start.go:125] virtualization: kvm guest

	I0509 08:24:54.123272    7953 out.go:177] * [addons-20220509082454-6723] minikube v1.25.2 on Ubuntu 20.04 (kvm/amd64)

	I0509 08:24:54.125087    7953 out.go:177]   - MINIKUBE_LOCATION=14070

	I0509 08:24:54.125011    7953 notify.go:193] Checking for updates...

	I0509 08:24:54.126898    7953 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0509 08:24:54.128644    7953 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/kubeconfig

	I0509 08:24:54.130362    7953 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube

	I0509 08:24:54.132204    7953 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0509 08:24:54.133795    7953 driver.go:346] Setting default libvirt URI to qemu:///system

	I0509 08:24:54.169770    7953 docker.go:137] docker version: linux-20.10.15

	I0509 08:24:54.169887    7953 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0509 08:24:54.270529    7953 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:60 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:24 OomKillDisable:true NGoroutines:33 SystemTime:2022-05-09 08:24:54.196326474 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.13.0-1024-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexSer

verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662799872 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-14 Labels:[] ExperimentalBuild:false ServerVersion:20.10.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Clie

ntInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}

	I0509 08:24:54.270642    7953 docker.go:254] overlay module found

	I0509 08:24:54.273202    7953 out.go:177] * Using the docker driver based on user configuration

	I0509 08:24:54.274743    7953 start.go:284] selected driver: docker

	I0509 08:24:54.274762    7953 start.go:801] validating driver "docker" against <nil>

	I0509 08:24:54.274783    7953 start.go:812] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	W0509 08:24:54.274830    7953 oci.go:120] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W0509 08:24:54.274851    7953 out.go:239] ! Your cgroup does not allow setting memory.

	I0509 08:24:54.276398    7953 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I0509 08:24:54.278393    7953 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0509 08:24:54.381501    7953 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:60 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:24 OomKillDisable:true NGoroutines:33 SystemTime:2022-05-09 08:24:54.30564108 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.13.0-1024-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ

erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662799872 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-14 Labels:[] ExperimentalBuild:false ServerVersion:20.10.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Clien

tInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}

	I0509 08:24:54.381615    7953 start_flags.go:292] no existing cluster config was found, will generate one from the flags 

	I0509 08:24:54.381824    7953 start_flags.go:847] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0509 08:24:54.384197    7953 out.go:177] * Using Docker driver with the root privilege

	I0509 08:24:54.385691    7953 cni.go:95] Creating CNI manager for ""

	I0509 08:24:54.385710    7953 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0509 08:24:54.385720    7953 start_flags.go:306] config:

	{Name:addons-20220509082454-6723 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.0 ClusterName:addons-20220509082454-6723 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntim

e:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}

	I0509 08:24:54.387392    7953 out.go:177] * Starting control plane node addons-20220509082454-6723 in cluster addons-20220509082454-6723

	I0509 08:24:54.388757    7953 cache.go:120] Beginning downloading kic base image for docker with docker

	I0509 08:24:54.390110    7953 out.go:177] * Pulling base image ...

	I0509 08:24:54.391439    7953 preload.go:132] Checking if preload exists for k8s version v1.24.0 and runtime docker

	I0509 08:24:54.391480    7953 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.0-docker-overlay2-amd64.tar.lz4

	I0509 08:24:54.391497    7953 cache.go:57] Caching tarball of preloaded images

	I0509 08:24:54.391553    7953 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 in local docker daemon

	I0509 08:24:54.391770    7953 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0509 08:24:54.391785    7953 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.0 on docker

	I0509 08:24:54.392125    7953 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/config.json ...

	I0509 08:24:54.392155    7953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/config.json: {Name:mk4f9a6b51edc3b0597ae7eb653e84e87edcd941 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0509 08:24:54.432960    7953 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 in local docker daemon, skipping pull

	I0509 08:24:54.433002    7953 cache.go:141] gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 exists in daemon, skipping load

	I0509 08:24:54.433018    7953 cache.go:206] Successfully downloaded all kic artifacts

	I0509 08:24:54.433059    7953 start.go:352] acquiring machines lock for addons-20220509082454-6723: {Name:mk2c77102f2b9de45294dd0c7a8b5e6c80a2d64d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0509 08:24:54.433211    7953 start.go:356] acquired machines lock for "addons-20220509082454-6723" in 128.161µs

	I0509 08:24:54.433245    7953 start.go:91] Provisioning new machine with config: &{Name:addons-20220509082454-6723 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.0 ClusterName:addons-20220509082454-6723 Namespace:default APIServerName:mi

nikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetri

cs:false} &{Name: IP: Port:8443 KubernetesVersion:v1.24.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0509 08:24:54.433388    7953 start.go:131] createHost starting for "" (driver="docker")

	I0509 08:24:54.436013    7953 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...

	I0509 08:24:54.436240    7953 start.go:165] libmachine.API.Create for "addons-20220509082454-6723" (driver="docker")

	I0509 08:24:54.436273    7953 client.go:168] LocalClient.Create starting

	I0509 08:24:54.436419    7953 main.go:134] libmachine: Creating CA: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem

	I0509 08:24:54.567821    7953 main.go:134] libmachine: Creating client certificate: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/cert.pem

	I0509 08:24:54.949436    7953 cli_runner.go:164] Run: docker network inspect addons-20220509082454-6723 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0509 08:24:54.978691    7953 cli_runner.go:211] docker network inspect addons-20220509082454-6723 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0509 08:24:54.978772    7953 network_create.go:272] running [docker network inspect addons-20220509082454-6723] to gather additional debugging logs...

	I0509 08:24:54.978794    7953 cli_runner.go:164] Run: docker network inspect addons-20220509082454-6723

	W0509 08:24:55.007238    7953 cli_runner.go:211] docker network inspect addons-20220509082454-6723 returned with exit code 1

	I0509 08:24:55.007280    7953 network_create.go:275] error running [docker network inspect addons-20220509082454-6723]: docker network inspect addons-20220509082454-6723: exit status 1

	stdout:

	[]

	stderr:

	Error: No such network: addons-20220509082454-6723

	I0509 08:24:55.007304    7953 network_create.go:277] output of [docker network inspect addons-20220509082454-6723]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error: No such network: addons-20220509082454-6723

	** /stderr **

	I0509 08:24:55.007370    7953 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0509 08:24:55.037051    7953 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc00011c328] misses:0}

	I0509 08:24:55.037102    7953 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I0509 08:24:55.037118    7953 network_create.go:115] attempt to create docker network addons-20220509082454-6723 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...

	I0509 08:24:55.037169    7953 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true addons-20220509082454-6723

	I0509 08:24:55.102162    7953 network_create.go:99] docker network addons-20220509082454-6723 192.168.49.0/24 created

	I0509 08:24:55.102203    7953 kic.go:106] calculated static IP "192.168.49.2" for the "addons-20220509082454-6723" container

	I0509 08:24:55.102256    7953 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I0509 08:24:55.131781    7953 cli_runner.go:164] Run: docker volume create addons-20220509082454-6723 --label name.minikube.sigs.k8s.io=addons-20220509082454-6723 --label created_by.minikube.sigs.k8s.io=true

	I0509 08:24:55.162825    7953 oci.go:103] Successfully created a docker volume addons-20220509082454-6723

	I0509 08:24:55.162928    7953 cli_runner.go:164] Run: docker run --rm --name addons-20220509082454-6723-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-20220509082454-6723 --entrypoint /usr/bin/test -v addons-20220509082454-6723:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -d /var/lib

	I0509 08:25:04.283381    7953 cli_runner.go:217] Completed: docker run --rm --name addons-20220509082454-6723-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-20220509082454-6723 --entrypoint /usr/bin/test -v addons-20220509082454-6723:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -d /var/lib: (9.120401202s)

	I0509 08:25:04.283410    7953 oci.go:107] Successfully prepared a docker volume addons-20220509082454-6723

	I0509 08:25:04.283442    7953 preload.go:132] Checking if preload exists for k8s version v1.24.0 and runtime docker

	I0509 08:25:04.283469    7953 kic.go:179] Starting extracting preloaded images to volume ...

	I0509 08:25:04.283532    7953 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v addons-20220509082454-6723:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -I lz4 -xf /preloaded.tar -C /extractDir

	I0509 08:25:10.951138    7953 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v addons-20220509082454-6723:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -I lz4 -xf /preloaded.tar -C /extractDir: (6.66755109s)

	I0509 08:25:10.951170    7953 kic.go:188] duration metric: took 6.667698 seconds to extract preloaded images to volume

	W0509 08:25:10.951213    7953 oci.go:136] Your kernel does not support swap limit capabilities or the cgroup is not mounted.

	W0509 08:25:10.951225    7953 oci.go:120] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	I0509 08:25:10.951283    7953 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"

	I0509 08:25:11.052965    7953 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-20220509082454-6723 --name addons-20220509082454-6723 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-20220509082454-6723 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-20220509082454-6723 --network addons-20220509082454-6723 --ip 192.168.49.2 --volume addons-20220509082454-6723:/var --security-opt apparmor=unconfined --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5

	I0509 08:25:11.492022    7953 cli_runner.go:164] Run: docker container inspect addons-20220509082454-6723 --format={{.State.Running}}

	I0509 08:25:11.524500    7953 cli_runner.go:164] Run: docker container inspect addons-20220509082454-6723 --format={{.State.Status}}

	I0509 08:25:11.557976    7953 cli_runner.go:164] Run: docker exec addons-20220509082454-6723 stat /var/lib/dpkg/alternatives/iptables

	I0509 08:25:11.643411    7953 oci.go:279] the created container "addons-20220509082454-6723" has a running status.

	I0509 08:25:11.643458    7953 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa...

	I0509 08:25:11.852242    7953 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)

	I0509 08:25:11.936137    7953 cli_runner.go:164] Run: docker container inspect addons-20220509082454-6723 --format={{.State.Status}}

	I0509 08:25:11.972132    7953 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys

	I0509 08:25:11.972164    7953 kic_runner.go:114] Args: [docker exec --privileged addons-20220509082454-6723 chown docker:docker /home/docker/.ssh/authorized_keys]

	I0509 08:25:12.058937    7953 cli_runner.go:164] Run: docker container inspect addons-20220509082454-6723 --format={{.State.Status}}

	I0509 08:25:12.093005    7953 machine.go:88] provisioning docker machine ...

	I0509 08:25:12.093055    7953 ubuntu.go:169] provisioning hostname "addons-20220509082454-6723"

	I0509 08:25:12.093124    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:12.127175    7953 main.go:134] libmachine: Using SSH client type: native

	I0509 08:25:12.127353    7953 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7d8f60] 0x7dbfc0 <nil>  [] 0s} 127.0.0.1 49157 <nil> <nil>}

	I0509 08:25:12.127376    7953 main.go:134] libmachine: About to run SSH command:

	sudo hostname addons-20220509082454-6723 && echo "addons-20220509082454-6723" | sudo tee /etc/hostname

	I0509 08:25:12.286593    7953 main.go:134] libmachine: SSH cmd err, output: <nil>: addons-20220509082454-6723

	I0509 08:25:12.286693    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:12.323287    7953 main.go:134] libmachine: Using SSH client type: native

	I0509 08:25:12.323461    7953 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7d8f60] 0x7dbfc0 <nil>  [] 0s} 127.0.0.1 49157 <nil> <nil>}

	I0509 08:25:12.323495    7953 main.go:134] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-20220509082454-6723' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-20220509082454-6723/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-20220509082454-6723' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0509 08:25:12.444658    7953 main.go:134] libmachine: SSH cmd err, output: <nil>: 

	I0509 08:25:12.444694    7953 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/key.pem ServerCertR

emotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube}

	I0509 08:25:12.444747    7953 ubuntu.go:177] setting up certificates

	I0509 08:25:12.444763    7953 provision.go:83] configureAuth start

	I0509 08:25:12.444820    7953 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-20220509082454-6723

	I0509 08:25:12.481585    7953 provision.go:138] copyHostCerts

	I0509 08:25:12.481660    7953 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.pem (1078 bytes)

	I0509 08:25:12.481770    7953 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cert.pem (1123 bytes)

	I0509 08:25:12.481845    7953 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/key.pem (1679 bytes)

	I0509 08:25:12.481901    7953 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca-key.pem org=jenkins.addons-20220509082454-6723 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube addons-20220509082454-6723]

	I0509 08:25:12.584131    7953 provision.go:172] copyRemoteCerts

	I0509 08:25:12.584185    7953 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0509 08:25:12.584232    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:12.616710    7953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa Username:docker}

	I0509 08:25:12.703930    7953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0509 08:25:12.726348    7953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0509 08:25:12.744883    7953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server.pem --> /etc/docker/server.pem (1253 bytes)

	I0509 08:25:12.763117    7953 provision.go:86] duration metric: configureAuth took 318.336767ms

	I0509 08:25:12.763153    7953 ubuntu.go:193] setting minikube options for container-runtime

	I0509 08:25:12.763301    7953 config.go:178] Loaded profile config "addons-20220509082454-6723": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.0

	I0509 08:25:12.763355    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:12.795916    7953 main.go:134] libmachine: Using SSH client type: native

	I0509 08:25:12.796054    7953 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7d8f60] 0x7dbfc0 <nil>  [] 0s} 127.0.0.1 49157 <nil> <nil>}

	I0509 08:25:12.796067    7953 main.go:134] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0509 08:25:12.918305    7953 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay

	I0509 08:25:12.918328    7953 ubuntu.go:71] root file system type: overlay

	I0509 08:25:12.918454    7953 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0509 08:25:12.918504    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:12.948278    7953 main.go:134] libmachine: Using SSH client type: native

	I0509 08:25:12.948424    7953 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7d8f60] 0x7dbfc0 <nil>  [] 0s} 127.0.0.1 49157 <nil> <nil>}

	I0509 08:25:12.948484    7953 main.go:134] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0509 08:25:13.081710    7953 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0509 08:25:13.081781    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:13.111973    7953 main.go:134] libmachine: Using SSH client type: native

	I0509 08:25:13.112126    7953 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7d8f60] 0x7dbfc0 <nil>  [] 0s} 127.0.0.1 49157 <nil> <nil>}

	I0509 08:25:13.112153    7953 main.go:134] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0509 08:25:13.800969    7953 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2022-03-10 14:05:44.000000000 +0000

	+++ /lib/systemd/system/docker.service.new	2022-05-09 08:25:13.073994334 +0000

	@@ -1,30 +1,32 @@

	 [Unit]

	 Description=Docker Application Container Engine

	 Documentation=https://docs.docker.com

	-After=network-online.target docker.socket firewalld.service containerd.service

	+BindsTo=containerd.service

	+After=network-online.target firewalld.service containerd.service

	 Wants=network-online.target

	-Requires=docker.socket containerd.service

	+Requires=docker.socket

	+StartLimitBurst=3

	+StartLimitIntervalSec=60

	 [Service]

	 Type=notify

	-# the default is not to use systemd for cgroups because the delegate issues still

	-# exists and systemd currently does not support the cgroup feature set required

	-# for containers run by docker

	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

	-ExecReload=/bin/kill -s HUP $MAINPID

	-TimeoutSec=0

	-RestartSec=2

	-Restart=always

	-

	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.

	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location

	-# to make them work for either version of systemd.

	-StartLimitBurst=3

	+Restart=on-failure

	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.

	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make

	-# this option work for either version of systemd.

	-StartLimitInterval=60s

	+

	+

	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	+# The base configuration already specifies an 'ExecStart=...' command. The first directive

	+# here is to clear out that command inherited from the base configuration. Without this,

	+# the command from the base configuration and the command specified here are treated as

	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	+# will catch this invalid input and refuse to start the service with an error like:

	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	+

	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	+ExecStart=

	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	+ExecReload=/bin/kill -s HUP $MAINPID

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	@@ -32,16 +34,16 @@

	 LimitNPROC=infinity

	 LimitCORE=infinity

	-# Comment TasksMax if your systemd version does not support it.

	-# Only systemd 226 and above support this option.

	+# Uncomment TasksMax if your systemd version supports it.

	+# Only systemd 226 and above support this version.

	 TasksMax=infinity

	+TimeoutStartSec=0

	 # set delegate yes so that systemd does not reset the cgroups of docker containers

	 Delegate=yes

	 # kill only the docker process, not all processes in the cgroup

	 KillMode=process

	-OOMScoreAdjust=-500

	 [Install]

	 WantedBy=multi-user.target

	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install enable docker

	I0509 08:25:13.800999    7953 machine.go:91] provisioned docker machine in 1.707968205s

	I0509 08:25:13.801009    7953 client.go:171] LocalClient.Create took 19.364726085s

	I0509 08:25:13.801029    7953 start.go:173] duration metric: libmachine.API.Create for "addons-20220509082454-6723" took 19.364788711s

	I0509 08:25:13.801041    7953 start.go:306] post-start starting for "addons-20220509082454-6723" (driver="docker")

	I0509 08:25:13.801050    7953 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0509 08:25:13.801109    7953 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0509 08:25:13.801148    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:13.832810    7953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa Username:docker}

	I0509 08:25:13.921976    7953 ssh_runner.go:195] Run: cat /etc/os-release

	I0509 08:25:13.924827    7953 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I0509 08:25:13.924855    7953 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I0509 08:25:13.924864    7953 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I0509 08:25:13.924871    7953 info.go:137] Remote host: Ubuntu 20.04.4 LTS

	I0509 08:25:13.924880    7953 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/addons for local assets ...

	I0509 08:25:13.924936    7953 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/files for local assets ...

	I0509 08:25:13.924958    7953 start.go:309] post-start completed in 123.910765ms

	I0509 08:25:13.925240    7953 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-20220509082454-6723

	I0509 08:25:13.955555    7953 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/config.json ...

	I0509 08:25:13.955802    7953 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0509 08:25:13.955842    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:13.986250    7953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa Username:docker}

	I0509 08:25:14.069076    7953 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0509 08:25:14.073030    7953 start.go:134] duration metric: createHost completed in 19.639627472s

	I0509 08:25:14.073058    7953 start.go:81] releasing machines lock for "addons-20220509082454-6723", held for 19.639829387s

	I0509 08:25:14.073144    7953 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-20220509082454-6723

	I0509 08:25:14.103542    7953 ssh_runner.go:195] Run: systemctl --version

	I0509 08:25:14.103564    7953 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0509 08:25:14.103617    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:14.103630    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:14.138449    7953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa Username:docker}

	I0509 08:25:14.138604    7953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa Username:docker}

	I0509 08:25:14.225066    7953 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0509 08:25:14.317947    7953 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0509 08:25:14.327731    7953 cruntime.go:273] skipping containerd shutdown because we are bound to it

	I0509 08:25:14.327785    7953 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0509 08:25:14.338061    7953 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	image-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0509 08:25:14.350854    7953 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0509 08:25:14.428165    7953 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0509 08:25:14.502875    7953 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0509 08:25:14.512035    7953 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0509 08:25:14.590929    7953 ssh_runner.go:195] Run: sudo systemctl start docker

	I0509 08:25:14.600754    7953 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0509 08:25:14.681521    7953 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0509 08:25:14.756977    7953 ssh_runner.go:195] Run: sudo systemctl start cri-docker.socket

	I0509 08:25:14.768683    7953 start.go:447] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0509 08:25:14.768799    7953 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:25:14.772016    7953 start.go:468] Will wait 60s for crictl version

	I0509 08:25:14.772077    7953 ssh_runner.go:195] Run: sudo crictl version

	I0509 08:25:15.112238    7953 start.go:477] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  20.10.13

	RuntimeApiVersion:  1.41.0

	I0509 08:25:15.112307    7953 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0509 08:25:15.287001    7953 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0509 08:25:15.332488    7953 out.go:204] * Preparing Kubernetes v1.24.0 on Docker 20.10.13 ...

	I0509 08:25:15.332580    7953 cli_runner.go:164] Run: docker network inspect addons-20220509082454-6723 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0509 08:25:15.362466    7953 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts

	I0509 08:25:15.365713    7953 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0509 08:25:15.375143    7953 preload.go:132] Checking if preload exists for k8s version v1.24.0 and runtime docker

	I0509 08:25:15.375201    7953 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0509 08:25:15.407812    7953 docker.go:610] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.24.0

	k8s.gcr.io/kube-proxy:v1.24.0

	k8s.gcr.io/kube-controller-manager:v1.24.0

	k8s.gcr.io/kube-scheduler:v1.24.0

	k8s.gcr.io/etcd:3.5.3-0

	k8s.gcr.io/pause:3.7

	k8s.gcr.io/coredns/coredns:v1.8.6

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0509 08:25:15.407841    7953 docker.go:541] Images already preloaded, skipping extraction

	I0509 08:25:15.407898    7953 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0509 08:25:15.439906    7953 docker.go:610] Got preloaded images: -- stdout --

	k8s.gcr.io/kube-apiserver:v1.24.0

	k8s.gcr.io/kube-proxy:v1.24.0

	k8s.gcr.io/kube-scheduler:v1.24.0

	k8s.gcr.io/kube-controller-manager:v1.24.0

	k8s.gcr.io/etcd:3.5.3-0

	k8s.gcr.io/pause:3.7

	k8s.gcr.io/coredns/coredns:v1.8.6

	gcr.io/k8s-minikube/storage-provisioner:v5

	-- /stdout --

	I0509 08:25:15.439932    7953 cache_images.go:84] Images are preloaded, skipping loading

	I0509 08:25:15.439999    7953 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0509 08:25:15.789118    7953 cni.go:95] Creating CNI manager for ""

	I0509 08:25:15.789153    7953 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0509 08:25:15.789166    7953 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I0509 08:25:15.789186    7953 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.24.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-20220509082454-6723 NodeName:addons-20220509082454-6723 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/m

inikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]}

	I0509 08:25:15.789360    7953 kubeadm.go:162] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: /var/run/cri-dockerd.sock

	  name: "addons-20220509082454-6723"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.24.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0509 08:25:15.789462    7953 kubeadm.go:936] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.24.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=/var/run/cri-dockerd.sock --hostname-override=addons-20220509082454-6723 --image-service-endpoint=/var/run/cri-dockerd.sock --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2 --runtime-request-timeout=15m

	[Install]

	 config:

	{KubernetesVersion:v1.24.0 ClusterName:addons-20220509082454-6723 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I0509 08:25:15.789524    7953 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.24.0

	I0509 08:25:15.799590    7953 binaries.go:44] Found k8s binaries, skipping transfer

	I0509 08:25:15.799646    7953 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0509 08:25:15.806969    7953 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (488 bytes)

	I0509 08:25:15.820895    7953 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0509 08:25:15.834161    7953 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2049 bytes)

	I0509 08:25:15.847842    7953 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I0509 08:25:15.851153    7953 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0509 08:25:15.861328    7953 certs.go:54] Setting up /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723 for IP: 192.168.49.2

	I0509 08:25:15.861377    7953 certs.go:187] generating minikubeCA CA: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.key

	I0509 08:25:15.934618    7953 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.crt ...

	I0509 08:25:15.934655    7953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.crt: {Name:mkd9a442b54ebc8753a00e898a3aa6675d6e3bf9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0509 08:25:15.934851    7953 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.key ...

	I0509 08:25:15.934865    7953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.key: {Name:mk4abe997e1fc503b1f93d4acce34cf67b343de1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0509 08:25:15.934951    7953 certs.go:187] generating proxyClientCA CA: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/proxy-client-ca.key

	I0509 08:25:15.999282    7953 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/proxy-client-ca.crt ...

	I0509 08:25:15.999317    7953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/proxy-client-ca.crt: {Name:mk10787a7bb55bbe56945a658ffa72ebe047c5d4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0509 08:25:15.999497    7953 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/proxy-client-ca.key ...

	I0509 08:25:15.999512    7953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/proxy-client-ca.key: {Name:mkf8556c61c00c9156ee96aca56d9ede55b2e5b3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0509 08:25:15.999624    7953 certs.go:302] generating minikube-user signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/client.key

	I0509 08:25:15.999640    7953 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/client.crt with IP's: []

	I0509 08:25:16.407614    7953 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/client.crt ...

	I0509 08:25:16.407652    7953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/client.crt: {Name:mk99f7ec019fd403d05758bb11043bad30d717a7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0509 08:25:16.407854    7953 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/client.key ...

	I0509 08:25:16.407867    7953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/client.key: {Name:mk25c854c8691ee49f00d1befb6ab0410524ad27 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0509 08:25:16.407946    7953 certs.go:302] generating minikube signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/apiserver.key.dd3b5fb2

	I0509 08:25:16.407964    7953 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I0509 08:25:16.539779    7953 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/apiserver.crt.dd3b5fb2 ...

	I0509 08:25:16.539818    7953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/apiserver.crt.dd3b5fb2: {Name:mk2f69a255730a5f04d2379d842ceda4e860880a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0509 08:25:16.540024    7953 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/apiserver.key.dd3b5fb2 ...

	I0509 08:25:16.540037    7953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/apiserver.key.dd3b5fb2: {Name:mk03bb23969627b95ac347f9fda7e84c9c656f2c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0509 08:25:16.540116    7953 certs.go:320] copying /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/apiserver.crt

	I0509 08:25:16.540181    7953 certs.go:324] copying /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/apiserver.key

	I0509 08:25:16.540223    7953 certs.go:302] generating aggregator signed cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/proxy-client.key

	I0509 08:25:16.540239    7953 crypto.go:68] Generating cert /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/proxy-client.crt with IP's: []

	I0509 08:25:16.649442    7953 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/proxy-client.crt ...

	I0509 08:25:16.649479    7953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/proxy-client.crt: {Name:mk07f3cf25782f21460b338ac960624baff30ea1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0509 08:25:16.649667    7953 crypto.go:164] Writing key to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/proxy-client.key ...

	I0509 08:25:16.649681    7953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/proxy-client.key: {Name:mk0622327bc130f7a5afca45d666bef34296193f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0509 08:25:16.649839    7953 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca-key.pem (1679 bytes)

	I0509 08:25:16.649875    7953 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem (1078 bytes)

	I0509 08:25:16.649902    7953 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/cert.pem (1123 bytes)

	I0509 08:25:16.649927    7953 certs.go:388] found cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/key.pem (1679 bytes)

	I0509 08:25:16.650463    7953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I0509 08:25:16.670109    7953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0509 08:25:16.689128    7953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0509 08:25:16.707982    7953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/addons-20220509082454-6723/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0509 08:25:16.726298    7953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0509 08:25:16.744045    7953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I0509 08:25:16.761903    7953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0509 08:25:16.780129    7953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0509 08:25:16.798322    7953 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0509 08:25:16.817289    7953 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0509 08:25:16.831594    7953 ssh_runner.go:195] Run: openssl version

	I0509 08:25:16.842019    7953 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0509 08:25:16.853169    7953 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0509 08:25:16.856521    7953 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 May  9 08:25 /usr/share/ca-certificates/minikubeCA.pem

	I0509 08:25:16.856575    7953 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0509 08:25:16.861857    7953 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0509 08:25:16.869985    7953 kubeadm.go:391] StartCluster: {Name:addons-20220509082454-6723 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.0 ClusterName:addons-20220509082454-6723 Namespace:default APIServerName:minikubeCA APIServerName

s:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.24.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}

	I0509 08:25:16.870123    7953 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0509 08:25:16.901686    7953 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0509 08:25:16.909239    7953 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0509 08:25:16.916728    7953 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver

	I0509 08:25:16.916791    7953 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0509 08:25:16.923716    7953 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0509 08:25:16.923761    7953 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.24.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I0509 08:25:30.984664    7953 out.go:204]   - Generating certificates and keys ...

	I0509 08:25:30.988154    7953 out.go:204]   - Booting up control plane ...

	I0509 08:25:30.991175    7953 out.go:204]   - Configuring RBAC rules ...

	I0509 08:25:30.993142    7953 cni.go:95] Creating CNI manager for ""

	I0509 08:25:30.993166    7953 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0509 08:25:30.993206    7953 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0509 08:25:30.993258    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:30.993283    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl label nodes minikube.k8s.io/version=v1.25.2 minikube.k8s.io/commit=3bac68e23e7013f03af5baca398608c8c8001fab minikube.k8s.io/name=addons-20220509082454-6723 minikube.k8s.io/updated_at=2022_05_09T08_25_30_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:31.007573    7953 ops.go:34] apiserver oom_adj: -16

	I0509 08:25:31.392053    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:31.946815    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:32.446289    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:32.946190    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:33.446516    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:33.946883    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:34.446977    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:34.947170    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:35.447227    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:35.946798    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:36.446302    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:36.946909    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:37.446296    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:37.946221    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:38.446511    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:38.946920    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:39.446535    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:39.946289    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:40.447128    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:40.946215    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:41.447109    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:41.946595    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:42.446251    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:42.946586    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:43.446351    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:43.946353    7953 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.24.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0509 08:25:44.005141    7953 kubeadm.go:1020] duration metric: took 13.011928695s to wait for elevateKubeSystemPrivileges.

	I0509 08:25:44.005170    7953 kubeadm.go:393] StartCluster complete in 27.135195316s

	I0509 08:25:44.005192    7953 settings.go:142] acquiring lock: {Name:mk0059ab96b71199ca0a558b9bc695696bca2ea4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0509 08:25:44.005351    7953 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/kubeconfig

	I0509 08:25:44.005808    7953 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/kubeconfig: {Name:mk1330d0f99a2286cbe8cc1ffbe430ce56d1dfc8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0509 08:25:44.522538    7953 kapi.go:244] deployment "coredns" in namespace "kube-system" and context "addons-20220509082454-6723" rescaled to 1

	I0509 08:25:44.522602    7953 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.24.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0509 08:25:44.525044    7953 out.go:177] * Verifying Kubernetes components...

	I0509 08:25:44.522636    7953 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0509 08:25:44.522659    7953 addons.go:415] enableAddons start: toEnable=map[], additional=[registry metrics-server volumesnapshots csi-hostpath-driver gcp-auth ingress ingress-dns helm-tiller]

	I0509 08:25:44.522815    7953 config.go:178] Loaded profile config "addons-20220509082454-6723": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.0

	I0509 08:25:44.526758    7953 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0509 08:25:44.526807    7953 addons.go:65] Setting ingress=true in profile "addons-20220509082454-6723"

	I0509 08:25:44.526821    7953 addons.go:65] Setting ingress-dns=true in profile "addons-20220509082454-6723"

	I0509 08:25:44.526835    7953 addons.go:153] Setting addon ingress-dns=true in "addons-20220509082454-6723"

	I0509 08:25:44.526835    7953 addons.go:153] Setting addon ingress=true in "addons-20220509082454-6723"

	I0509 08:25:44.526852    7953 addons.go:65] Setting registry=true in profile "addons-20220509082454-6723"

	I0509 08:25:44.526874    7953 addons.go:153] Setting addon registry=true in "addons-20220509082454-6723"

	I0509 08:25:44.526904    7953 host.go:66] Checking if "addons-20220509082454-6723" exists ...

	I0509 08:25:44.526916    7953 addons.go:65] Setting csi-hostpath-driver=true in profile "addons-20220509082454-6723"

	I0509 08:25:44.526920    7953 host.go:66] Checking if "addons-20220509082454-6723" exists ...

	I0509 08:25:44.526933    7953 addons.go:65] Setting metrics-server=true in profile "addons-20220509082454-6723"

	I0509 08:25:44.526946    7953 addons.go:153] Setting addon csi-hostpath-driver=true in "addons-20220509082454-6723"

	I0509 08:25:44.526950    7953 addons.go:153] Setting addon metrics-server=true in "addons-20220509082454-6723"

	I0509 08:25:44.526970    7953 addons.go:65] Setting gcp-auth=true in profile "addons-20220509082454-6723"

	I0509 08:25:44.526986    7953 host.go:66] Checking if "addons-20220509082454-6723" exists ...

	I0509 08:25:44.526990    7953 mustload.go:65] Loading cluster: addons-20220509082454-6723

	I0509 08:25:44.526989    7953 addons.go:65] Setting storage-provisioner=true in profile "addons-20220509082454-6723"

	I0509 08:25:44.527016    7953 addons.go:153] Setting addon storage-provisioner=true in "addons-20220509082454-6723"

	W0509 08:25:44.527025    7953 addons.go:165] addon storage-provisioner should already be in state true

	I0509 08:25:44.526905    7953 host.go:66] Checking if "addons-20220509082454-6723" exists ...

	I0509 08:25:44.527041    7953 addons.go:65] Setting helm-tiller=true in profile "addons-20220509082454-6723"

	I0509 08:25:44.527064    7953 host.go:66] Checking if "addons-20220509082454-6723" exists ...

	I0509 08:25:44.527067    7953 addons.go:153] Setting addon helm-tiller=true in "addons-20220509082454-6723"

	I0509 08:25:44.527117    7953 host.go:66] Checking if "addons-20220509082454-6723" exists ...

	I0509 08:25:44.527151    7953 config.go:178] Loaded profile config "addons-20220509082454-6723": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.0

	I0509 08:25:44.527389    7953 cli_runner.go:164] Run: docker container inspect addons-20220509082454-6723 --format={{.State.Status}}

	I0509 08:25:44.527427    7953 cli_runner.go:164] Run: docker container inspect addons-20220509082454-6723 --format={{.State.Status}}

	I0509 08:25:44.527455    7953 cli_runner.go:164] Run: docker container inspect addons-20220509082454-6723 --format={{.State.Status}}

	I0509 08:25:44.527480    7953 cli_runner.go:164] Run: docker container inspect addons-20220509082454-6723 --format={{.State.Status}}

	I0509 08:25:44.527456    7953 cli_runner.go:164] Run: docker container inspect addons-20220509082454-6723 --format={{.State.Status}}

	I0509 08:25:44.527548    7953 cli_runner.go:164] Run: docker container inspect addons-20220509082454-6723 --format={{.State.Status}}

	I0509 08:25:44.526807    7953 addons.go:65] Setting volumesnapshots=true in profile "addons-20220509082454-6723"

	I0509 08:25:44.527597    7953 addons.go:153] Setting addon volumesnapshots=true in "addons-20220509082454-6723"

	I0509 08:25:44.527632    7953 host.go:66] Checking if "addons-20220509082454-6723" exists ...

	I0509 08:25:44.527686    7953 addons.go:65] Setting default-storageclass=true in profile "addons-20220509082454-6723"

	I0509 08:25:44.527731    7953 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-20220509082454-6723"

	I0509 08:25:44.527816    7953 cli_runner.go:164] Run: docker container inspect addons-20220509082454-6723 --format={{.State.Status}}

	I0509 08:25:44.528031    7953 cli_runner.go:164] Run: docker container inspect addons-20220509082454-6723 --format={{.State.Status}}

	I0509 08:25:44.528045    7953 cli_runner.go:164] Run: docker container inspect addons-20220509082454-6723 --format={{.State.Status}}

	I0509 08:25:44.528173    7953 host.go:66] Checking if "addons-20220509082454-6723" exists ...

	I0509 08:25:44.528638    7953 cli_runner.go:164] Run: docker container inspect addons-20220509082454-6723 --format={{.State.Status}}

	I0509 08:25:44.636693    7953 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2

	I0509 08:25:44.638483    7953 addons.go:348] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0509 08:25:44.638508    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I0509 08:25:44.638583    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:44.640226    7953 out.go:177]   - Using image ghcr.io/helm/tiller:v2.17.0

	I0509 08:25:44.641985    7953 addons.go:348] installing /etc/kubernetes/addons/helm-tiller-dp.yaml

	I0509 08:25:44.642009    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-dp.yaml (2422 bytes)

	I0509 08:25:44.642075    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:44.657142    7953 out.go:177]   - Using image k8s.gcr.io/sig-storage/snapshot-controller:v4.0.0

	I0509 08:25:44.659060    7953 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0509 08:25:44.662141    7953 out.go:177]   - Using image k8s.gcr.io/metrics-server/metrics-server:v0.6.1

	I0509 08:25:44.663996    7953 addons.go:348] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0509 08:25:44.664015    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0509 08:25:44.664076    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:44.662735    7953 addons.go:153] Setting addon default-storageclass=true in "addons-20220509082454-6723"

	W0509 08:25:44.664228    7953 addons.go:165] addon default-storageclass should already be in state true

	I0509 08:25:44.664262    7953 host.go:66] Checking if "addons-20220509082454-6723" exists ...

	I0509 08:25:44.668167    7953 addons.go:348] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0509 08:25:44.668190    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0509 08:25:44.668248    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:44.661934    7953 host.go:66] Checking if "addons-20220509082454-6723" exists ...

	I0509 08:25:44.659066    7953 addons.go:348] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0509 08:25:44.671053    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0509 08:25:44.671134    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:44.664899    7953 cli_runner.go:164] Run: docker container inspect addons-20220509082454-6723 --format={{.State.Status}}

	I0509 08:25:44.673237    7953 out.go:177]   - Using image registry:2.7.1

	I0509 08:25:44.675721    7953 out.go:177]   - Using image gcr.io/google_containers/kube-registry-proxy:0.4

	I0509 08:25:44.697408    7953 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-resizer:v1.1.0

	I0509 08:25:44.696928    7953 addons.go:348] installing /etc/kubernetes/addons/registry-rc.yaml

	I0509 08:25:44.704947    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (788 bytes)

	I0509 08:25:44.707276    7953 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-attacher:v3.1.0

	I0509 08:25:44.705008    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:44.716545    7953 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-provisioner:v2.1.0

	I0509 08:25:44.716516    7953 out.go:177]   - Using image k8s.gcr.io/ingress-nginx/kube-webhook-certgen:v1.1.1

	I0509 08:25:44.718671    7953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa Username:docker}

	I0509 08:25:44.721673    7953 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0509 08:25:44.723562    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:44.726427    7953 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.0.1

	I0509 08:25:44.726551    7953 out.go:177]   - Using image k8s.gcr.io/ingress-nginx/controller:v1.2.0

	I0509 08:25:44.729932    7953 out.go:177]   - Using image k8s.gcr.io/ingress-nginx/kube-webhook-certgen:v1.1.1

	I0509 08:25:44.729870    7953 out.go:177]   - Using image k8s.gcr.io/sig-storage/hostpathplugin:v1.6.0

	I0509 08:25:44.731777    7953 addons.go:348] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I0509 08:25:44.733235    7953 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-external-health-monitor-controller:v0.2.0

	I0509 08:25:44.733253    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (15567 bytes)

	I0509 08:25:44.735992    7953 out.go:177]   - Using image k8s.gcr.io/sig-storage/livenessprobe:v2.2.0

	I0509 08:25:44.736037    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:44.738834    7953 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-snapshotter:v4.0.0

	I0509 08:25:44.737139    7953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa Username:docker}

	I0509 08:25:44.742206    7953 out.go:177]   - Using image k8s.gcr.io/sig-storage/csi-external-health-monitor-agent:v0.2.0

	I0509 08:25:44.740876    7953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa Username:docker}

	I0509 08:25:44.743676    7953 addons.go:348] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I0509 08:25:44.743697    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I0509 08:25:44.743756    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:44.744020    7953 addons.go:348] installing /etc/kubernetes/addons/storageclass.yaml

	I0509 08:25:44.744039    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0509 08:25:44.744084    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:44.754590    7953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa Username:docker}

	I0509 08:25:44.760515    7953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa Username:docker}

	I0509 08:25:44.785929    7953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa Username:docker}

	I0509 08:25:44.798589    7953 node_ready.go:35] waiting up to 6m0s for node "addons-20220509082454-6723" to be "Ready" ...

	I0509 08:25:44.799038    7953 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0509 08:25:44.800030    7953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa Username:docker}

	I0509 08:25:44.803977    7953 node_ready.go:49] node "addons-20220509082454-6723" has status "Ready":"True"

	I0509 08:25:44.803999    7953 node_ready.go:38] duration metric: took 5.376444ms waiting for node "addons-20220509082454-6723" to be "Ready" ...

	I0509 08:25:44.804009    7953 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0509 08:25:44.804580    7953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa Username:docker}

	I0509 08:25:44.813123    7953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa Username:docker}

	I0509 08:25:44.819897    7953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa Username:docker}

	I0509 08:25:44.865042    7953 pod_ready.go:78] waiting up to 6m0s for pod "coredns-6d4b75cb6d-pskmq" in "kube-system" namespace to be "Ready" ...

	I0509 08:25:45.091940    7953 addons.go:348] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0509 08:25:45.091972    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0509 08:25:45.264659    7953 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0509 08:25:45.272641    7953 addons.go:348] installing /etc/kubernetes/addons/rbac-external-health-monitor-agent.yaml

	I0509 08:25:45.272674    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-agent.yaml (2203 bytes)

	I0509 08:25:45.278915    7953 addons.go:348] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0509 08:25:45.278946    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1931 bytes)

	I0509 08:25:45.361665    7953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0509 08:25:45.361978    7953 addons.go:348] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0509 08:25:45.362001    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0509 08:25:45.362324    7953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	I0509 08:25:45.363389    7953 addons.go:348] installing /etc/kubernetes/addons/helm-tiller-rbac.yaml

	I0509 08:25:45.363412    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-rbac.yaml (1188 bytes)

	I0509 08:25:45.366059    7953 addons.go:153] Setting addon gcp-auth=true in "addons-20220509082454-6723"

	I0509 08:25:45.366116    7953 host.go:66] Checking if "addons-20220509082454-6723" exists ...

	I0509 08:25:45.366632    7953 cli_runner.go:164] Run: docker container inspect addons-20220509082454-6723 --format={{.State.Status}}

	I0509 08:25:45.367208    7953 addons.go:348] installing /etc/kubernetes/addons/registry-svc.yaml

	I0509 08:25:45.367232    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I0509 08:25:45.377336    7953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0509 08:25:45.378542    7953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0509 08:25:45.384379    7953 addons.go:348] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I0509 08:25:45.384406    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3037 bytes)

	I0509 08:25:45.407165    7953 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0509 08:25:45.407220    7953 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-20220509082454-6723

	I0509 08:25:45.439238    7953 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49157 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/addons-20220509082454-6723/id_rsa Username:docker}

	I0509 08:25:45.468267    7953 addons.go:348] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0509 08:25:45.468300    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19584 bytes)

	I0509 08:25:45.469261    7953 addons.go:348] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0509 08:25:45.469283    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0509 08:25:45.563608    7953 addons.go:348] installing /etc/kubernetes/addons/registry-proxy.yaml

	I0509 08:25:45.563631    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (950 bytes)

	I0509 08:25:45.568599    7953 addons.go:348] installing /etc/kubernetes/addons/helm-tiller-svc.yaml

	I0509 08:25:45.568645    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-svc.yaml (951 bytes)

	I0509 08:25:45.583156    7953 addons.go:348] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I0509 08:25:45.583185    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (3666 bytes)

	I0509 08:25:45.666170    7953 addons.go:348] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0509 08:25:45.666196    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0509 08:25:45.774401    7953 addons.go:348] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0509 08:25:45.774435    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3428 bytes)

	I0509 08:25:45.777982    7953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml

	I0509 08:25:45.782209    7953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0509 08:25:45.860762    7953 addons.go:348] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I0509 08:25:45.860847    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2944 bytes)

	I0509 08:25:45.869901    7953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I0509 08:25:45.884211    7953 addons.go:348] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0509 08:25:45.884238    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1071 bytes)

	I0509 08:25:45.962492    7953 addons.go:348] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I0509 08:25:45.962519    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3194 bytes)

	I0509 08:25:46.060685    7953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0509 08:25:46.067980    7953 addons.go:348] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I0509 08:25:46.068010    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2421 bytes)

	I0509 08:25:46.173073    7953 addons.go:348] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I0509 08:25:46.173104    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1034 bytes)

	I0509 08:25:46.274280    7953 addons.go:348] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I0509 08:25:46.274310    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (6710 bytes)

	I0509 08:25:46.365815    7953 addons.go:348] installing /etc/kubernetes/addons/csi-hostpath-provisioner.yaml

	I0509 08:25:46.365842    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-provisioner.yaml (2555 bytes)

	I0509 08:25:46.381678    7953 addons.go:348] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I0509 08:25:46.381702    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2469 bytes)

	I0509 08:25:46.396865    7953 addons.go:348] installing /etc/kubernetes/addons/csi-hostpath-snapshotter.yaml

	I0509 08:25:46.396886    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotter.yaml (2555 bytes)

	I0509 08:25:46.411575    7953 addons.go:348] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0509 08:25:46.411597    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I0509 08:25:46.464283    7953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-agent.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-provisioner.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0509 08:25:46.966755    7953 pod_ready.go:102] pod "coredns-6d4b75cb6d-pskmq" in "kube-system" namespace has status "Ready":"False"

	I0509 08:25:47.662463    7953 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.24.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' | sudo /var/lib/minikube/binaries/v1.24.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.863389743s)

	I0509 08:25:47.662501    7953 start.go:783] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS

	I0509 08:25:47.880063    7953 pod_ready.go:92] pod "coredns-6d4b75cb6d-pskmq" in "kube-system" namespace has status "Ready":"True"

	I0509 08:25:47.880146    7953 pod_ready.go:81] duration metric: took 3.015061159s waiting for pod "coredns-6d4b75cb6d-pskmq" in "kube-system" namespace to be "Ready" ...

	I0509 08:25:47.880172    7953 pod_ready.go:78] waiting up to 6m0s for pod "coredns-6d4b75cb6d-qcc2z" in "kube-system" namespace to be "Ready" ...

	I0509 08:25:47.881711    7953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (2.520006129s)

	I0509 08:25:47.967799    7953 pod_ready.go:92] pod "coredns-6d4b75cb6d-qcc2z" in "kube-system" namespace has status "Ready":"True"

	I0509 08:25:47.967878    7953 pod_ready.go:81] duration metric: took 87.679395ms waiting for pod "coredns-6d4b75cb6d-qcc2z" in "kube-system" namespace to be "Ready" ...

	I0509 08:25:47.967905    7953 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-20220509082454-6723" in "kube-system" namespace to be "Ready" ...

	I0509 08:25:47.980463    7953 pod_ready.go:92] pod "etcd-addons-20220509082454-6723" in "kube-system" namespace has status "Ready":"True"

	I0509 08:25:47.980491    7953 pod_ready.go:81] duration metric: took 12.56877ms waiting for pod "etcd-addons-20220509082454-6723" in "kube-system" namespace to be "Ready" ...

	I0509 08:25:47.980517    7953 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-20220509082454-6723" in "kube-system" namespace to be "Ready" ...

	I0509 08:25:48.063826    7953 pod_ready.go:92] pod "kube-apiserver-addons-20220509082454-6723" in "kube-system" namespace has status "Ready":"True"

	I0509 08:25:48.063859    7953 pod_ready.go:81] duration metric: took 83.332412ms waiting for pod "kube-apiserver-addons-20220509082454-6723" in "kube-system" namespace to be "Ready" ...

	I0509 08:25:48.063873    7953 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-20220509082454-6723" in "kube-system" namespace to be "Ready" ...

	I0509 08:25:48.081212    7953 pod_ready.go:92] pod "kube-controller-manager-addons-20220509082454-6723" in "kube-system" namespace has status "Ready":"True"

	I0509 08:25:48.081307    7953 pod_ready.go:81] duration metric: took 17.422617ms waiting for pod "kube-controller-manager-addons-20220509082454-6723" in "kube-system" namespace to be "Ready" ...

	I0509 08:25:48.081351    7953 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-8ch85" in "kube-system" namespace to be "Ready" ...

	I0509 08:25:48.283989    7953 pod_ready.go:92] pod "kube-proxy-8ch85" in "kube-system" namespace has status "Ready":"True"

	I0509 08:25:48.284015    7953 pod_ready.go:81] duration metric: took 202.644254ms waiting for pod "kube-proxy-8ch85" in "kube-system" namespace to be "Ready" ...

	I0509 08:25:48.284029    7953 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-20220509082454-6723" in "kube-system" namespace to be "Ready" ...

	I0509 08:25:48.683699    7953 pod_ready.go:92] pod "kube-scheduler-addons-20220509082454-6723" in "kube-system" namespace has status "Ready":"True"

	I0509 08:25:48.683733    7953 pod_ready.go:81] duration metric: took 399.695438ms waiting for pod "kube-scheduler-addons-20220509082454-6723" in "kube-system" namespace to be "Ready" ...

	I0509 08:25:48.683744    7953 pod_ready.go:38] duration metric: took 3.879721678s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0509 08:25:48.683770    7953 api_server.go:51] waiting for apiserver process to appear ...

	I0509 08:25:48.683812    7953 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0509 08:25:49.572904    7953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (4.210536532s)

	I0509 08:25:49.572944    7953 addons.go:386] Verifying addon ingress=true in "addons-20220509082454-6723"

	I0509 08:25:49.572949    7953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (4.195562318s)

	I0509 08:25:49.573039    7953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (4.194473257s)

	I0509 08:25:49.573106    7953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml: (3.795033273s)

	I0509 08:25:49.575061    7953 out.go:177] * Verifying ingress addon...

	I0509 08:25:49.573237    7953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (3.790977557s)

	I0509 08:25:49.573279    7953 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (4.166087519s)

	I0509 08:25:49.573326    7953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (3.703396945s)

	I0509 08:25:49.573436    7953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (3.512712148s)

	W0509 08:25:49.577341    7953 addons.go:369] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0509 08:25:49.577371    7953 retry.go:31] will retry after 276.165072ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0509 08:25:49.577412    7953 addons.go:386] Verifying addon metrics-server=true in "addons-20220509082454-6723"

	I0509 08:25:49.577465    7953 addons.go:386] Verifying addon registry=true in "addons-20220509082454-6723"

	I0509 08:25:49.580351    7953 out.go:177]   - Using image k8s.gcr.io/ingress-nginx/kube-webhook-certgen:v1.0

	I0509 08:25:49.578207    7953 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0509 08:25:49.582165    7953 out.go:177] * Verifying registry addon...

	I0509 08:25:49.585228    7953 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0509 08:25:49.587076    7953 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.0.8

	I0509 08:25:49.586209    7953 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0509 08:25:49.588763    7953 addons.go:348] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0509 08:25:49.587158    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:49.588801    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0509 08:25:49.590740    7953 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I0509 08:25:49.590768    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:49.686473    7953 addons.go:348] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0509 08:25:49.686502    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0509 08:25:49.783020    7953 addons.go:348] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0509 08:25:49.783047    7953 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (4842 bytes)

	I0509 08:25:49.854163    7953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0509 08:25:49.967115    7953 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0509 08:25:50.176316    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:50.179168    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:50.669535    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:50.670796    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:50.676590    7953 ssh_runner.go:235] Completed: sudo pgrep -xnf kube-apiserver.*minikube.*: (1.992749673s)

	I0509 08:25:50.676652    7953 api_server.go:71] duration metric: took 6.154024095s to wait for apiserver process to appear ...

	I0509 08:25:50.676664    7953 api_server.go:87] waiting for apiserver healthz status ...

	I0509 08:25:50.676678    7953 api_server.go:240] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...

	I0509 08:25:50.677039    7953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-agent.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-provisioner.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (4.212707354s)

	I0509 08:25:50.677075    7953 addons.go:386] Verifying addon csi-hostpath-driver=true in "addons-20220509082454-6723"

	I0509 08:25:50.680275    7953 out.go:177] * Verifying csi-hostpath-driver addon...

	I0509 08:25:50.682925    7953 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0509 08:25:50.688372    7953 api_server.go:266] https://192.168.49.2:8443/healthz returned 200:

	ok

	I0509 08:25:50.761438    7953 api_server.go:140] control plane version: v1.24.0

	I0509 08:25:50.761481    7953 api_server.go:130] duration metric: took 84.799245ms to wait for apiserver health ...

	I0509 08:25:50.761493    7953 system_pods.go:43] waiting for kube-system pods to appear ...

	I0509 08:25:50.763279    7953 kapi.go:86] Found 5 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0509 08:25:50.763309    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:50.772200    7953 system_pods.go:59] 20 kube-system pods found

	I0509 08:25:50.772238    7953 system_pods.go:61] "coredns-6d4b75cb6d-pskmq" [a672e2ee-2d2f-4a73-918f-6ac4dc004553] Running

	I0509 08:25:50.772243    7953 system_pods.go:61] "coredns-6d4b75cb6d-qcc2z" [f0867568-f3fb-47c4-b170-7b0799b33e1b] Running

	I0509 08:25:50.772251    7953 system_pods.go:61] "csi-hostpath-attacher-0" [59811fcf-64cc-4090-a191-6b614b2af974] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) didn't match pod affinity rules. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)

	I0509 08:25:50.772257    7953 system_pods.go:61] "csi-hostpath-provisioner-0" [7f263878-835f-4f1d-b653-ffd8313013f4] Pending

	I0509 08:25:50.772261    7953 system_pods.go:61] "csi-hostpath-resizer-0" [16fef44e-9db8-4c34-b13f-6b8379ac994f] Pending

	I0509 08:25:50.772265    7953 system_pods.go:61] "csi-hostpath-snapshotter-0" [1102d29b-b164-4fac-bc85-c6c2f01cec06] Pending

	I0509 08:25:50.772270    7953 system_pods.go:61] "csi-hostpathplugin-0" [2409cf91-e015-4768-9da8-499654716767] Pending

	I0509 08:25:50.772277    7953 system_pods.go:61] "etcd-addons-20220509082454-6723" [d22609af-4a35-46b2-bc30-cd8e96ece69a] Running

	I0509 08:25:50.772283    7953 system_pods.go:61] "kube-apiserver-addons-20220509082454-6723" [eca1da2a-fc78-4c09-b3b7-8d03e87dab77] Running

	I0509 08:25:50.772298    7953 system_pods.go:61] "kube-controller-manager-addons-20220509082454-6723" [7027dd6f-f76d-43e1-88dd-2d02c6717189] Running

	I0509 08:25:50.772306    7953 system_pods.go:61] "kube-ingress-dns-minikube" [1b6cc3b0-fb8f-45bc-bada-1c24b3f8a196] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])

	I0509 08:25:50.772317    7953 system_pods.go:61] "kube-proxy-8ch85" [16590b4c-b95c-417a-a6ef-9cd8a394f903] Running

	I0509 08:25:50.772328    7953 system_pods.go:61] "kube-scheduler-addons-20220509082454-6723" [20ad36c6-1ca1-42cd-a13d-f864724520b9] Running

	I0509 08:25:50.772346    7953 system_pods.go:61] "metrics-server-5ccbd9cf46-9zwvx" [4e835545-32d0-4e32-abd8-7358d6da7010] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0509 08:25:50.772359    7953 system_pods.go:61] "registry-kqqf6" [32385d42-0e88-434c-9d19-dd305fc24814] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])

	I0509 08:25:50.772373    7953 system_pods.go:61] "registry-proxy-bg6kd" [ce2e10d6-c702-46ae-9765-101df2d2ef68] Pending

	I0509 08:25:50.772381    7953 system_pods.go:61] "snapshot-controller-557749dccd-pp4pp" [f73e5506-b698-4743-96a1-07749a6622c6] Pending

	I0509 08:25:50.772394    7953 system_pods.go:61] "snapshot-controller-557749dccd-zs6dp" [87d6ef26-dbec-4a75-a8dd-0617b84e2b81] Pending

	I0509 08:25:50.772407    7953 system_pods.go:61] "storage-provisioner" [88e48a1a-2f4b-443f-b620-36dbd12fa287] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0509 08:25:50.772420    7953 system_pods.go:61] "tiller-deploy-c7d76457b-4zmrh" [f2654535-302c-4b23-ae19-29761a0720e7] Pending / Ready:ContainersNotReady (containers with unready status: [tiller]) / ContainersReady:ContainersNotReady (containers with unready status: [tiller])

	I0509 08:25:50.772433    7953 system_pods.go:74] duration metric: took 10.933159ms to wait for pod list to return data ...

	I0509 08:25:50.772447    7953 default_sa.go:34] waiting for default service account to be created ...

	I0509 08:25:50.775570    7953 default_sa.go:45] found service account: "default"

	I0509 08:25:50.775597    7953 default_sa.go:55] duration metric: took 3.140182ms for default service account to be created ...

	I0509 08:25:50.775605    7953 system_pods.go:116] waiting for k8s-apps to be running ...

	I0509 08:25:50.784647    7953 system_pods.go:86] 20 kube-system pods found

	I0509 08:25:50.784684    7953 system_pods.go:89] "coredns-6d4b75cb6d-pskmq" [a672e2ee-2d2f-4a73-918f-6ac4dc004553] Running

	I0509 08:25:50.784693    7953 system_pods.go:89] "coredns-6d4b75cb6d-qcc2z" [f0867568-f3fb-47c4-b170-7b0799b33e1b] Running

	I0509 08:25:50.784702    7953 system_pods.go:89] "csi-hostpath-attacher-0" [59811fcf-64cc-4090-a191-6b614b2af974] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) didn't match pod affinity rules. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.)

	I0509 08:25:50.784710    7953 system_pods.go:89] "csi-hostpath-provisioner-0" [7f263878-835f-4f1d-b653-ffd8313013f4] Pending

	I0509 08:25:50.784730    7953 system_pods.go:89] "csi-hostpath-resizer-0" [16fef44e-9db8-4c34-b13f-6b8379ac994f] Pending

	I0509 08:25:50.784748    7953 system_pods.go:89] "csi-hostpath-snapshotter-0" [1102d29b-b164-4fac-bc85-c6c2f01cec06] Pending

	I0509 08:25:50.784754    7953 system_pods.go:89] "csi-hostpathplugin-0" [2409cf91-e015-4768-9da8-499654716767] Pending

	I0509 08:25:50.784764    7953 system_pods.go:89] "etcd-addons-20220509082454-6723" [d22609af-4a35-46b2-bc30-cd8e96ece69a] Running

	I0509 08:25:50.784772    7953 system_pods.go:89] "kube-apiserver-addons-20220509082454-6723" [eca1da2a-fc78-4c09-b3b7-8d03e87dab77] Running

	I0509 08:25:50.784784    7953 system_pods.go:89] "kube-controller-manager-addons-20220509082454-6723" [7027dd6f-f76d-43e1-88dd-2d02c6717189] Running

	I0509 08:25:50.784793    7953 system_pods.go:89] "kube-ingress-dns-minikube" [1b6cc3b0-fb8f-45bc-bada-1c24b3f8a196] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])

	I0509 08:25:50.784804    7953 system_pods.go:89] "kube-proxy-8ch85" [16590b4c-b95c-417a-a6ef-9cd8a394f903] Running

	I0509 08:25:50.784811    7953 system_pods.go:89] "kube-scheduler-addons-20220509082454-6723" [20ad36c6-1ca1-42cd-a13d-f864724520b9] Running

	I0509 08:25:50.784823    7953 system_pods.go:89] "metrics-server-5ccbd9cf46-9zwvx" [4e835545-32d0-4e32-abd8-7358d6da7010] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])

	I0509 08:25:50.784832    7953 system_pods.go:89] "registry-kqqf6" [32385d42-0e88-434c-9d19-dd305fc24814] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])

	I0509 08:25:50.784842    7953 system_pods.go:89] "registry-proxy-bg6kd" [ce2e10d6-c702-46ae-9765-101df2d2ef68] Pending

	I0509 08:25:50.784848    7953 system_pods.go:89] "snapshot-controller-557749dccd-pp4pp" [f73e5506-b698-4743-96a1-07749a6622c6] Pending

	I0509 08:25:50.784858    7953 system_pods.go:89] "snapshot-controller-557749dccd-zs6dp" [87d6ef26-dbec-4a75-a8dd-0617b84e2b81] Pending

	I0509 08:25:50.784872    7953 system_pods.go:89] "storage-provisioner" [88e48a1a-2f4b-443f-b620-36dbd12fa287] Pending / Ready:ContainersNotReady (containers with unready status: [storage-provisioner]) / ContainersReady:ContainersNotReady (containers with unready status: [storage-provisioner])

	I0509 08:25:50.784892    7953 system_pods.go:89] "tiller-deploy-c7d76457b-4zmrh" [f2654535-302c-4b23-ae19-29761a0720e7] Pending / Ready:ContainersNotReady (containers with unready status: [tiller]) / ContainersReady:ContainersNotReady (containers with unready status: [tiller])

	I0509 08:25:50.784901    7953 system_pods.go:126] duration metric: took 9.290621ms to wait for k8s-apps to be running ...

	I0509 08:25:50.784910    7953 system_svc.go:44] waiting for kubelet service to be running ....

	I0509 08:25:50.784957    7953 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0509 08:25:51.163576    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:51.164522    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:51.272411    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:51.663121    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:51.664041    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:51.772841    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:52.166692    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:52.167615    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:52.270639    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:52.665897    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:52.666667    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:52.773918    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:53.178436    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:53.178501    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:53.269310    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:53.667093    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:53.667406    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:53.772476    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:54.167310    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:54.169009    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:54.273450    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:54.662598    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:54.664651    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:54.771040    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:54.964677    7953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (5.110454114s)

	I0509 08:25:54.964797    7953 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.24.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (4.997594852s)

	I0509 08:25:54.965093    7953 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (4.180117862s)

	I0509 08:25:54.965113    7953 system_svc.go:56] duration metric: took 4.180201161s WaitForService to wait for kubelet.

	I0509 08:25:54.965123    7953 kubeadm.go:548] duration metric: took 10.44249441s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I0509 08:25:54.965156    7953 node_conditions.go:102] verifying NodePressure condition ...

	I0509 08:25:54.966788    7953 addons.go:386] Verifying addon gcp-auth=true in "addons-20220509082454-6723"

	I0509 08:25:54.969187    7953 out.go:177] * Verifying gcp-auth addon...

	I0509 08:25:54.967675    7953 node_conditions.go:122] node storage ephemeral capacity is 304695084Ki

	I0509 08:25:54.971024    7953 node_conditions.go:123] node cpu capacity is 8

	I0509 08:25:54.971057    7953 node_conditions.go:105] duration metric: took 5.895308ms to run NodePressure ...

	I0509 08:25:54.971079    7953 start.go:213] waiting for startup goroutines ...

	I0509 08:25:54.972062    7953 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0509 08:25:54.974618    7953 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0509 08:25:54.974644    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:25:55.093407    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:55.095489    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:55.270257    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:55.478404    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:25:55.593304    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:55.595925    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:55.769802    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:55.980159    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:25:56.163815    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:56.164551    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:56.270091    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:56.478952    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:25:56.594191    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:56.663094    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:56.769684    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:56.978620    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:25:57.093511    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:57.095857    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:57.269205    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:57.478193    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:25:57.592724    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:57.597599    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:57.770299    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:57.978761    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:25:58.093768    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:58.094850    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:58.269682    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:58.478731    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:25:58.593633    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:58.594914    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:58.769322    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:58.981095    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:25:59.093230    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:59.094873    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:59.269459    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:25:59.478729    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:25:59.593891    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:25:59.595931    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:25:59.770205    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:00.050048    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:00.186282    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:00.186518    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:00.269766    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:00.478077    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:00.592446    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:00.595131    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:00.770112    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:00.978641    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:01.093151    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:01.095865    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:01.268693    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:01.479411    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:01.593469    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:01.594969    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:01.769842    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:01.980403    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:02.093162    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:02.097544    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:02.270162    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:02.478809    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:02.593430    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:02.595557    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:02.770098    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:02.978107    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:03.269928    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:03.270101    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:03.270713    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:03.478316    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:03.593187    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:03.595645    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:03.770393    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:03.979282    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:04.093316    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:04.095331    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:04.270265    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:04.478901    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:04.593509    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:04.595561    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:04.769121    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:04.978405    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:05.094008    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:05.095757    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:05.269535    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:05.478475    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:05.593593    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:05.599803    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:05.770489    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:05.977813    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:06.093927    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:06.164517    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:06.271468    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:06.478552    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:06.593611    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:06.597293    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:06.769441    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:06.978127    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:07.093217    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:07.095679    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:07.269195    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:07.478009    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:07.593636    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:07.595587    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:07.772652    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:07.978700    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:08.093302    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:08.095614    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:08.270284    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:08.478550    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:08.593986    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:08.594899    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:08.769126    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:08.978562    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:09.094805    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:09.097032    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:09.270165    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:09.478299    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:09.593364    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:09.595714    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:09.770032    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:09.978656    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:10.093268    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:10.095314    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:10.269377    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:10.478592    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:10.593632    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:10.595779    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:10.769422    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:10.977946    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:11.165871    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:11.166021    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:11.269916    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:11.478524    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:11.593415    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:11.595547    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0509 08:26:11.770566    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:12.056368    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:12.093928    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:12.095751    7953 kapi.go:108] duration metric: took 22.510517909s to wait for kubernetes.io/minikube-addons=registry ...

	I0509 08:26:12.270101    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:12.478980    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:12.593895    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:12.768551    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:12.979274    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:13.094057    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:13.271399    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:13.478469    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:13.593207    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:13.770087    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:13.977624    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:14.092895    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:14.270319    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:14.478306    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:14.594793    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:14.770489    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:14.978164    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:15.093325    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:15.270584    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:15.478018    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:15.593909    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:15.770275    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:15.978503    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:16.118458    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:16.269452    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:16.477960    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:16.593036    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:16.769898    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:16.978479    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:17.095438    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:17.321347    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:17.478021    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:17.593410    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:17.769359    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:17.979020    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:18.094032    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:18.270094    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:18.478452    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:18.593528    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:18.769098    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:18.978281    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:19.094003    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:19.271688    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:19.479067    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:19.641560    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:19.769626    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:19.978942    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:20.093746    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:20.269515    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:20.478398    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:20.593394    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:20.769938    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:21.018078    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:21.095159    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:21.269837    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:21.478754    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:21.594223    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:21.768969    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:21.978782    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:22.093998    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:22.270490    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:22.478542    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:22.593018    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:22.770541    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:22.978557    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:23.094345    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:23.269932    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:23.478876    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:23.593904    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:23.770363    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:23.978035    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:24.093948    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:24.269603    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:24.478469    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:24.763473    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:24.768983    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:24.978792    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:25.093672    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:25.271031    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:25.478738    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:25.593813    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:25.770003    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:25.978216    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:26.094559    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:26.271295    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:26.479160    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:26.594111    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:26.769540    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:26.978752    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:27.094208    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:27.269356    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:27.478954    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:27.594035    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:27.770069    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:27.978633    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:28.093639    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:28.270184    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:28.478754    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:28.593487    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:28.769776    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:28.978500    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:29.093372    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:29.269738    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:29.478720    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:29.593816    7953 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0509 08:26:29.769695    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:29.978387    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:30.093530    7953 kapi.go:108] duration metric: took 40.515318863s to wait for app.kubernetes.io/name=ingress-nginx ...

	I0509 08:26:30.269181    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:30.478419    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:30.769855    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:30.979172    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:31.269929    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:31.479008    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:31.770458    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:31.978594    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0509 08:26:32.269954    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:32.479150    7953 kapi.go:108] duration metric: took 37.507081238s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0509 08:26:32.481296    7953 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-20220509082454-6723 cluster.

	I0509 08:26:32.483274    7953 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0509 08:26:32.484823    7953 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0509 08:26:32.785471    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:33.270735    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:33.768475    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:34.268495    7953 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0509 08:26:34.769169    7953 kapi.go:108] duration metric: took 44.086240045s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0509 08:26:34.772057    7953 out.go:177] * Enabled addons: default-storageclass, ingress-dns, storage-provisioner, helm-tiller, metrics-server, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver

	I0509 08:26:34.774014    7953 addons.go:417] enableAddons completed in 50.251349938s

	I0509 08:26:34.812989    7953 start.go:499] kubectl: 1.24.0, cluster: 1.24.0 (minor skew: 0)

	I0509 08:26:34.815321    7953 out.go:177] * Done! kubectl is now configured to use "addons-20220509082454-6723" cluster and "default" namespace by default

	* 

	* ==> Docker <==

	* -- Logs begin at Mon 2022-05-09 08:25:11 UTC, end at Mon 2022-05-09 08:31:45 UTC. --

	May 09 08:27:00 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:00.780377326Z" level=info msg="Container failed to exit within 1s of signal 15 - using the force" container=19f6c457b9b0115837c8d9be4fa0b6d57a729b0de79f62fa9e3aa97c7898fd9b

	May 09 08:27:00 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:00.870487825Z" level=info msg="ignoring event" container=19f6c457b9b0115837c8d9be4fa0b6d57a729b0de79f62fa9e3aa97c7898fd9b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:00 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:00.930012097Z" level=info msg="ignoring event" container=f0c955958fc4c8f631892e1164c1a20f80785dddc7daab7390804fc3c1184089 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:09 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:09.751608689Z" level=info msg="ignoring event" container=b49681b6cf0a205f0dd7359eb0cc02f341adb38d834ca7f4e2742faae4572e9b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:09 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:09.809863866Z" level=info msg="ignoring event" container=853d84fa4791643812f9dcbed1647177aaa387dd1b40bf335fdb09a542db2c1b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:11 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:11.176018180Z" level=info msg="ignoring event" container=0ac26640659d780ab449bd2334568d3d906c2550cf473b22fb80b3645f205b18 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:11 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:11.476842735Z" level=info msg="ignoring event" container=3af14f8207794dbff7e8cfe7e711744c9e2862946784a186bdac4b8d18c8b1e1 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:11 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:11.580193294Z" level=info msg="ignoring event" container=4079e4f65e803972ec38241aec79b6c138739dfe48058622f449c37364bfb3e0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:11 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:11.580242340Z" level=info msg="ignoring event" container=6f6681fad9a68625012129439036998011f3a1660cacd0af216af25ac9b2c1ea module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:11 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:11.580469580Z" level=info msg="ignoring event" container=e461d693a1a2dad86f27c412f917f82eca31381068ddc5699147e2154cbace1a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:11 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:11.582073890Z" level=info msg="ignoring event" container=f6fc5a8ddb17f664612411f0dbf861851b5c67166c54b77f07012a3a3cb252ab module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:11 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:11.662049217Z" level=info msg="ignoring event" container=f9afb7a04d25926ed1f12dd6ba2997f3fa8680ded3eb479b150e434139cf51d9 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:11 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:11.671781417Z" level=info msg="ignoring event" container=b1e7170bd3e0597503359727edeaa3453ee1128bb3d0f75d6d3346f641dc2d90 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:11 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:11.675322820Z" level=info msg="ignoring event" container=7aed26f4aff5d2d3210f3b9f92ea05e39d4e096861c3ca09f32d8adbe76d9037 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:11 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:11.762748547Z" level=info msg="ignoring event" container=10fef6303f90b02f5e7150e8b950fa95aafae2ffc753fd5211f2effd324bbd79 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:11 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:11.877521535Z" level=info msg="ignoring event" container=14338d0819f824ff82f04dde0793f397f3c53d840513d472c8d63ac3c4a89fae module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:11 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:11.886094289Z" level=info msg="ignoring event" container=20fd2d5d29eee9e080660ac8e3f36b3d1f357bfedc100d40c65eec3d0e98b2e8 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:11 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:11.893568687Z" level=info msg="ignoring event" container=6661a7fa2376ad4137834066f4afed449f5a79e5f709b3481748a8232d032b4e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:11 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:11.967200181Z" level=info msg="ignoring event" container=4604afab3e3d2c818076a0d7c79fb0252937c4be3bfdd54ec76ea662727531e0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:17 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:17.983022664Z" level=info msg="ignoring event" container=170684d7549141af5651c1f1ecee5851229d082fdddced44fcef2ac66c364a7c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:17 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:17.987612373Z" level=info msg="ignoring event" container=006a5b36e9365a0cf1e6488860297077168d91babf0a362e835b876f0ee94f8f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:18 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:18.106043791Z" level=info msg="ignoring event" container=70a23ef23094d05bdde93fdd12fd0f712bb559411b239a4d76892b82d1876229 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:27:18 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:27:18.110624372Z" level=info msg="ignoring event" container=7052a4ccc49826cf4aebbd7e98831658a1b5426172673fd089d99ffaa87e00ef module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:31:44 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:31:44.776915488Z" level=info msg="ignoring event" container=33cc200a076b4d8de3454a783afa49504e228728635746147ee971e9ae8cff08 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	May 09 08:31:44 addons-20220509082454-6723 dockerd[465]: time="2022-05-09T08:31:44.880321944Z" level=info msg="ignoring event" container=aa8b1cfd395b3cffa918ed9570e9b7e045863c09f6299252a4679161a99fc499 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	* 

	* ==> container status <==

	* CONTAINER           IMAGE                                                                                                          CREATED             STATE               NAME                      ATTEMPT             POD ID

	f861911212cf0       gcr.io/google-samples/hello-app@sha256:88b205d7995332e10e836514fbfd59ecaf8976fc15060cd66e85cdcebe7fb356        4 minutes ago       Running             hello-world-app           0                   e4d0b44f3fdb7

	7e1eae536132c       nginx@sha256:5a0df7fb7c8c03e4158ae9974bfbd6a15da2bdfdeded4fb694367ec812325d31                                  4 minutes ago       Running             nginx                     0                   da17c3c1c0837

	386693e96fe63       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:26c7b2454f1c946d7c80839251d939606620f37c2f275be2796c1ffd96c438f6   5 minutes ago       Running             gcp-auth                  0                   2338676026fb0

	df61303e3702a       6e38f40d628db                                                                                                  5 minutes ago       Running             storage-provisioner       0                   1afb9d73160b8

	8f8557d20e22e       a4ca41631cc7a                                                                                                  6 minutes ago       Running             coredns                   0                   5c98e7302a0f6

	a742f842d6bf5       77b49675beae1                                                                                                  6 minutes ago       Running             kube-proxy                0                   389cb08f0e2c5

	1529212668f56       529072250ccc6                                                                                                  6 minutes ago       Running             kube-apiserver            0                   dbf0d69422ac4

	f36f49cc6c9ba       88784fb4ac2f6                                                                                                  6 minutes ago       Running             kube-controller-manager   0                   ef67ca56c2920

	3aa8ad5c52e2a       aebe758cef4cd                                                                                                  6 minutes ago       Running             etcd                      0                   b860b3a9f3573

	318787268d544       e3ed7dee73e93                                                                                                  6 minutes ago       Running             kube-scheduler            0                   512838da0ec04

	* 

	* ==> coredns [8f8557d20e22] <==

	* .:53

	[INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7

	CoreDNS-1.8.6

	linux/amd64, go1.17.1, 13a9191

	[INFO] Reloading

	[INFO] plugin/health: Going into lameduck mode for 5s

	[INFO] plugin/reload: Running configuration MD5 = cec3c60eb1cc4909fd4579a8d79ea031

	[INFO] Reloading complete

	* 

	* ==> describe nodes <==

	* Name:               addons-20220509082454-6723

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=addons-20220509082454-6723

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=3bac68e23e7013f03af5baca398608c8c8001fab

	                    minikube.k8s.io/name=addons-20220509082454-6723

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2022_05_09T08_25_30_0700

	                    minikube.k8s.io/version=v1.25.2

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	                    topology.hostpath.csi/node=addons-20220509082454-6723

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 09 May 2022 08:25:28 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-20220509082454-6723

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 09 May 2022 08:31:39 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 09 May 2022 08:27:13 +0000   Mon, 09 May 2022 08:25:26 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 09 May 2022 08:27:13 +0000   Mon, 09 May 2022 08:25:26 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 09 May 2022 08:27:13 +0000   Mon, 09 May 2022 08:25:26 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 09 May 2022 08:27:13 +0000   Mon, 09 May 2022 08:25:41 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.49.2

	  Hostname:    addons-20220509082454-6723

	Capacity:

	  cpu:                8

	  ephemeral-storage:  304695084Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             32873828Ki

	  pods:               110

	Allocatable:

	  cpu:                8

	  ephemeral-storage:  304695084Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  memory:             32873828Ki

	  pods:               110

	System Info:

	  Machine ID:                 140a143b31184b58be947b52a01fff83

	  System UUID:                5a67426b-3cc4-4ada-b8e4-3fe90a7fc207

	  Boot ID:                    3b893569-87e6-48ef-ba82-8bed0b9b0671

	  Kernel Version:             5.13.0-1024-gcp

	  OS Image:                   Ubuntu 20.04.4 LTS

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://20.10.13

	  Kubelet Version:            v1.24.0

	  Kube-Proxy Version:         v1.24.0

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (10 in total)

	  Namespace                   Name                                                  CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                                  ------------  ----------  ---------------  -------------  ---

	  default                     hello-world-app-794ff86bf-p5l4p                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m48s

	  default                     nginx                                                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m

	  gcp-auth                    gcp-auth-7865585679-zlvx9                             0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m52s

	  kube-system                 coredns-6d4b75cb6d-qcc2z                              100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (0%!)(MISSING)     6m3s

	  kube-system                 etcd-addons-20220509082454-6723                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         6m15s

	  kube-system                 kube-apiserver-addons-20220509082454-6723             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m15s

	  kube-system                 kube-controller-manager-addons-20220509082454-6723    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m15s

	  kube-system                 kube-proxy-8ch85                                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m3s

	  kube-system                 kube-scheduler-addons-20220509082454-6723             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m15s

	  kube-system                 storage-provisioner                                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m58s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (9%!)(MISSING)   0 (0%!)(MISSING)

	  memory             170Mi (0%!)(MISSING)  170Mi (0%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 6m1s                   kube-proxy       

	  Normal  Starting                 6m26s                  kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  6m26s (x3 over 6m26s)  kubelet          Node addons-20220509082454-6723 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m26s (x3 over 6m26s)  kubelet          Node addons-20220509082454-6723 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     6m26s (x3 over 6m26s)  kubelet          Node addons-20220509082454-6723 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  6m26s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  6m16s                  kubelet          Node addons-20220509082454-6723 status is now: NodeHasSufficientMemory

	  Normal  Starting                 6m16s                  kubelet          Starting kubelet.

	  Normal  NodeHasNoDiskPressure    6m16s                  kubelet          Node addons-20220509082454-6723 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     6m16s                  kubelet          Node addons-20220509082454-6723 status is now: NodeHasSufficientPID

	  Normal  NodeNotReady             6m15s                  kubelet          Node addons-20220509082454-6723 status is now: NodeNotReady

	  Normal  NodeAllocatableEnforced  6m15s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeReady                6m5s                   kubelet          Node addons-20220509082454-6723 status is now: NodeReady

	  Normal  RegisteredNode           6m4s                   node-controller  Node addons-20220509082454-6723 event: Registered Node addons-20220509082454-6723 in Controller

	* 

	* ==> dmesg <==

	* [May 9 08:17]  #2

	[  +0.001790]  #3

	[  +0.002285]  #4

	[  +0.001345] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details.

	[  +0.002170] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details.

	[  +0.002206]  #5

	[  +0.002136]  #6

	[  +0.001398]  #7

	[  +0.053456] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +0.541684] i8042: Warning: Keylock active

	[  +0.011880] platform eisa.0: EISA: Cannot allocate resource for mainboard

	[  +0.001120] platform eisa.0: Cannot allocate resource for EISA slot 1

	[  +0.000843] platform eisa.0: Cannot allocate resource for EISA slot 2

	[  +0.000947] platform eisa.0: Cannot allocate resource for EISA slot 3

	[  +0.000823] platform eisa.0: Cannot allocate resource for EISA slot 4

	[  +0.000918] platform eisa.0: Cannot allocate resource for EISA slot 5

	[  +0.000916] platform eisa.0: Cannot allocate resource for EISA slot 6

	[  +0.000913] platform eisa.0: Cannot allocate resource for EISA slot 7

	[  +0.000944] platform eisa.0: Cannot allocate resource for EISA slot 8

	[  +9.060268] kauditd_printk_skb: 32 callbacks suppressed

	* 

	* ==> etcd [3aa8ad5c52e2] <==

	* {"level":"info","ts":"2022-05-09T08:25:25.390Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}

	{"level":"info","ts":"2022-05-09T08:25:25.390Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}

	{"level":"info","ts":"2022-05-09T08:25:25.390Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}

	{"level":"info","ts":"2022-05-09T08:25:25.390Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}

	{"level":"info","ts":"2022-05-09T08:25:25.390Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}

	{"level":"info","ts":"2022-05-09T08:25:25.390Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}

	{"level":"info","ts":"2022-05-09T08:25:25.390Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}

	{"level":"info","ts":"2022-05-09T08:25:25.390Z","caller":"etcdserver/server.go:2042","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-20220509082454-6723 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}

	{"level":"info","ts":"2022-05-09T08:25:25.390Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}

	{"level":"info","ts":"2022-05-09T08:25:25.390Z","caller":"etcdserver/server.go:2507","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2022-05-09T08:25:25.390Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"}

	{"level":"info","ts":"2022-05-09T08:25:25.390Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2022-05-09T08:25:25.390Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2022-05-09T08:25:25.391Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}

	{"level":"info","ts":"2022-05-09T08:25:25.391Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2022-05-09T08:25:25.391Z","caller":"etcdserver/server.go:2531","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2022-05-09T08:25:25.392Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.49.2:2379"}

	{"level":"info","ts":"2022-05-09T08:25:25.392Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2022-05-09T08:26:00.183Z","caller":"traceutil/trace.go:171","msg":"trace[553055693] transaction","detail":"{read_only:false; response_revision:758; number_of_response:1; }","duration":"121.118832ms","start":"2022-05-09T08:26:00.062Z","end":"2022-05-09T08:26:00.183Z","steps":["trace[553055693] 'process raft request'  (duration: 90.545209ms)","trace[553055693] 'compare'  (duration: 30.454148ms)"],"step_count":2}

	{"level":"warn","ts":"2022-05-09T08:26:03.266Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"175.496928ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/ingress-nginx/\" range_end:\"/registry/pods/ingress-nginx0\" ","response":"range_response_count:3 size:12801"}

	{"level":"info","ts":"2022-05-09T08:26:03.266Z","caller":"traceutil/trace.go:171","msg":"trace[330179958] range","detail":"{range_begin:/registry/pods/ingress-nginx/; range_end:/registry/pods/ingress-nginx0; response_count:3; response_revision:774; }","duration":"175.625199ms","start":"2022-05-09T08:26:03.091Z","end":"2022-05-09T08:26:03.266Z","steps":["trace[330179958] 'range keys from in-memory index tree'  (duration: 175.345985ms)"],"step_count":1}

	{"level":"warn","ts":"2022-05-09T08:26:03.267Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"174.784982ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/\" range_end:\"/registry/pods/kube-system0\" ","response":"range_response_count:19 size:85313"}

	{"level":"info","ts":"2022-05-09T08:26:03.267Z","caller":"traceutil/trace.go:171","msg":"trace[1647984900] range","detail":"{range_begin:/registry/pods/kube-system/; range_end:/registry/pods/kube-system0; response_count:19; response_revision:774; }","duration":"174.838921ms","start":"2022-05-09T08:26:03.092Z","end":"2022-05-09T08:26:03.267Z","steps":["trace[1647984900] 'range keys from in-memory index tree'  (duration: 174.471631ms)"],"step_count":1}

	{"level":"warn","ts":"2022-05-09T08:26:24.760Z","caller":"etcdserver/util.go:166","msg":"apply request took too long","took":"169.777492ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/ingress-nginx/\" range_end:\"/registry/pods/ingress-nginx0\" ","response":"range_response_count:3 size:13395"}

	{"level":"info","ts":"2022-05-09T08:26:24.760Z","caller":"traceutil/trace.go:171","msg":"trace[1063404224] range","detail":"{range_begin:/registry/pods/ingress-nginx/; range_end:/registry/pods/ingress-nginx0; response_count:3; response_revision:907; }","duration":"169.899031ms","start":"2022-05-09T08:26:24.590Z","end":"2022-05-09T08:26:24.760Z","steps":["trace[1063404224] 'agreement among raft nodes before linearized reading'  (duration: 77.709508ms)","trace[1063404224] 'range keys from in-memory index tree'  (duration: 91.995741ms)"],"step_count":2}

	* 

	* ==> kernel <==

	*  08:31:46 up 14 min,  0 users,  load average: 0.07, 0.49, 0.32

	Linux addons-20220509082454-6723 5.13.0-1024-gcp #29~20.04.1-Ubuntu SMP Thu Apr 14 23:15:00 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

	PRETTY_NAME="Ubuntu 20.04.4 LTS"

	* 

	* ==> kube-apiserver [1529212668f5] <==

	* W0509 08:27:18.868408       1 cacher.go:150] Terminating all watchers from cacher *unstructured.Unstructured

	W0509 08:27:18.875312       1 cacher.go:150] Terminating all watchers from cacher *unstructured.Unstructured

	E0509 08:28:28.947259       1 controller.go:113] loading OpenAPI spec for "" failed with: APIService  does not exist for update

	I0509 08:28:28.947290       1 controller.go:126] OpenAPI AggregationController: action for item : Rate Limited Requeue.

	W0509 08:28:49.075939       1 handler_proxy.go:102] no RequestInfo found in the context

	E0509 08:28:49.075982       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService

	I0509 08:28:49.075989       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	W0509 08:28:49.077104       1 handler_proxy.go:102] no RequestInfo found in the context

	E0509 08:28:49.077183       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	I0509 08:28:49.077224       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	W0509 08:30:28.995629       1 handler_proxy.go:102] no RequestInfo found in the context

	W0509 08:30:28.995659       1 handler_proxy.go:102] no RequestInfo found in the context

	E0509 08:30:28.995674       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService

	I0509 08:30:28.995682       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	E0509 08:30:28.995696       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	I0509 08:30:28.996802       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	W0509 08:31:28.996171       1 handler_proxy.go:102] no RequestInfo found in the context

	E0509 08:31:28.996217       1 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService

	I0509 08:31:28.996227       1 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	W0509 08:31:28.997298       1 handler_proxy.go:102] no RequestInfo found in the context

	E0509 08:31:28.997359       1 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	I0509 08:31:28.997378       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	* 

	* ==> kube-controller-manager [f36f49cc6c9b] <==

	* W0509 08:29:43.781887       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E0509 08:30:13.372181       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	W0509 08:30:13.795115       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	W0509 08:30:17.767978       1 reflector.go:324] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0509 08:30:17.768011       1 reflector.go:138] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W0509 08:30:21.688035       1 reflector.go:324] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0509 08:30:21.688064       1 reflector.go:138] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W0509 08:30:25.466621       1 reflector.go:324] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0509 08:30:25.466649       1 reflector.go:138] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0509 08:30:29.244282       1 namespace_controller.go:162] deletion of namespace ingress-nginx failed: unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	E0509 08:30:43.384389       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	W0509 08:30:43.809566       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	E0509 08:30:47.937077       1 namespace_controller.go:162] deletion of namespace ingress-nginx failed: unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	W0509 08:30:57.711951       1 reflector.go:324] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0509 08:30:57.711980       1 reflector.go:138] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W0509 08:30:59.461720       1 reflector.go:324] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0509 08:30:59.461752       1 reflector.go:138] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0509 08:31:13.393006       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	W0509 08:31:13.823039       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	W0509 08:31:21.466568       1 reflector.go:324] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0509 08:31:21.466600       1 reflector.go:138] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W0509 08:31:31.044077       1 reflector.go:324] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0509 08:31:31.044106       1 reflector.go:138] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:90: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E0509 08:31:43.404158       1 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request

	W0509 08:31:43.836862       1 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]

	* 

	* ==> kube-proxy [a742f842d6bf] <==

	* I0509 08:25:44.367372       1 node.go:163] Successfully retrieved node IP: 192.168.49.2

	I0509 08:25:44.367449       1 server_others.go:138] "Detected node IP" address="192.168.49.2"

	I0509 08:25:44.367482       1 server_others.go:578] "Unknown proxy mode, assuming iptables proxy" proxyMode=""

	I0509 08:25:44.390715       1 server_others.go:206] "Using iptables Proxier"

	I0509 08:25:44.390752       1 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4

	I0509 08:25:44.390762       1 server_others.go:214] "Creating dualStackProxier for iptables"

	I0509 08:25:44.390780       1 server_others.go:501] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6"

	I0509 08:25:44.390804       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"

	I0509 08:25:44.391037       1 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"

	I0509 08:25:44.391262       1 server.go:661] "Version info" version="v1.24.0"

	I0509 08:25:44.391286       1 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0509 08:25:44.391760       1 config.go:317] "Starting service config controller"

	I0509 08:25:44.392082       1 shared_informer.go:255] Waiting for caches to sync for service config

	I0509 08:25:44.392125       1 config.go:226] "Starting endpoint slice config controller"

	I0509 08:25:44.392132       1 shared_informer.go:255] Waiting for caches to sync for endpoint slice config

	I0509 08:25:44.392302       1 config.go:444] "Starting node config controller"

	I0509 08:25:44.392317       1 shared_informer.go:255] Waiting for caches to sync for node config

	I0509 08:25:44.492699       1 shared_informer.go:262] Caches are synced for node config

	I0509 08:25:44.492729       1 shared_informer.go:262] Caches are synced for service config

	I0509 08:25:44.492732       1 shared_informer.go:262] Caches are synced for endpoint slice config

	* 

	* ==> kube-scheduler [318787268d54] <==

	* W0509 08:25:28.078952       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0509 08:25:28.078986       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0509 08:25:28.078987       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0509 08:25:28.079013       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	W0509 08:25:28.079048       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0509 08:25:28.079081       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W0509 08:25:28.079177       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0509 08:25:28.079208       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W0509 08:25:28.079246       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0509 08:25:28.079287       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W0509 08:25:28.079341       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0509 08:25:28.079356       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W0509 08:25:28.997258       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0509 08:25:28.997288       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0509 08:25:29.004565       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0509 08:25:29.004625       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	W0509 08:25:29.021525       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0509 08:25:29.021555       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W0509 08:25:29.090400       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0509 08:25:29.090435       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0509 08:25:29.093308       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0509 08:25:29.093340       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	W0509 08:25:29.227969       1 reflector.go:324] vendor/k8s.io/client-go/informers/factory.go:134: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0509 08:25:29.228000       1 reflector.go:138] vendor/k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	I0509 08:25:29.673933       1 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	* 

	* ==> kubelet <==

	* -- Logs begin at Mon 2022-05-09 08:25:11 UTC, end at Mon 2022-05-09 08:31:46 UTC. --

	May 09 08:27:18 addons-20220509082454-6723 kubelet[1927]: I0509 08:27:18.777737    1927 scope.go:110] "RemoveContainer" containerID="006a5b36e9365a0cf1e6488860297077168d91babf0a362e835b876f0ee94f8f"

	May 09 08:27:18 addons-20220509082454-6723 kubelet[1927]: I0509 08:27:18.794107    1927 scope.go:110] "RemoveContainer" containerID="006a5b36e9365a0cf1e6488860297077168d91babf0a362e835b876f0ee94f8f"

	May 09 08:27:18 addons-20220509082454-6723 kubelet[1927]: E0509 08:27:18.795035    1927 remote_runtime.go:578] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error: No such container: 006a5b36e9365a0cf1e6488860297077168d91babf0a362e835b876f0ee94f8f" containerID="006a5b36e9365a0cf1e6488860297077168d91babf0a362e835b876f0ee94f8f"

	May 09 08:27:18 addons-20220509082454-6723 kubelet[1927]: I0509 08:27:18.795093    1927 pod_container_deletor.go:52] "DeleteContainer returned error" containerID={Type:docker ID:006a5b36e9365a0cf1e6488860297077168d91babf0a362e835b876f0ee94f8f} err="failed to get container status \"006a5b36e9365a0cf1e6488860297077168d91babf0a362e835b876f0ee94f8f\": rpc error: code = Unknown desc = Error: No such container: 006a5b36e9365a0cf1e6488860297077168d91babf0a362e835b876f0ee94f8f"

	May 09 08:27:19 addons-20220509082454-6723 kubelet[1927]: I0509 08:27:19.095774    1927 kubelet_volumes.go:160] "Cleaned up orphaned pod volumes dir" podUID=87d6ef26-dbec-4a75-a8dd-0617b84e2b81 path="/var/lib/kubelet/pods/87d6ef26-dbec-4a75-a8dd-0617b84e2b81/volumes"

	May 09 08:27:19 addons-20220509082454-6723 kubelet[1927]: I0509 08:27:19.096221    1927 kubelet_volumes.go:160] "Cleaned up orphaned pod volumes dir" podUID=f73e5506-b698-4743-96a1-07749a6622c6 path="/var/lib/kubelet/pods/f73e5506-b698-4743-96a1-07749a6622c6/volumes"

	May 09 08:27:31 addons-20220509082454-6723 kubelet[1927]: I0509 08:27:31.086867    1927 scope.go:110] "RemoveContainer" containerID="68c6765acb1f69c79a32e1512ac51487577580b39bf34f0af7e54b109a15dd04"

	May 09 08:27:31 addons-20220509082454-6723 kubelet[1927]: I0509 08:27:31.099861    1927 scope.go:110] "RemoveContainer" containerID="4ef7c321d13c129e7e4b8760f4820f074a468a2071939531cf9753d6648d755b"

	May 09 08:27:31 addons-20220509082454-6723 kubelet[1927]: I0509 08:27:31.113185    1927 scope.go:110] "RemoveContainer" containerID="fd2dec8d2805ba7af46f7f1fe9a10246e72eda341eb17092753cbbe0f4107e30"

	May 09 08:27:31 addons-20220509082454-6723 kubelet[1927]: I0509 08:27:31.126135    1927 scope.go:110] "RemoveContainer" containerID="f24f5a39b853bba85358d78af848510d2f8f41be7e3374b2866de758939b98db"

	May 09 08:27:31 addons-20220509082454-6723 kubelet[1927]: I0509 08:27:31.139861    1927 scope.go:110] "RemoveContainer" containerID="7fe0d152461abd32a219b8915d18b660f90fdb4e7699a169338f2ad8aee2fde8"

	May 09 08:27:31 addons-20220509082454-6723 kubelet[1927]: I0509 08:27:31.154050    1927 scope.go:110] "RemoveContainer" containerID="2ff600bdb24f517db23519bd6d4c94372f024a7645d74eee77f2fe3bf444a513"

	May 09 08:27:34 addons-20220509082454-6723 kubelet[1927]: E0509 08:27:34.310900    1927 cri_stats_provider.go:669] "Unable to fetch container log stats" err="open /var/log/pods/kube-system_snapshot-controller-557749dccd-pp4pp_f73e5506-b698-4743-96a1-07749a6622c6/volume-snapshot-controller: no such file or directory" containerName="volume-snapshot-controller"

	May 09 08:27:34 addons-20220509082454-6723 kubelet[1927]: E0509 08:27:34.310955    1927 cri_stats_provider.go:669] "Unable to fetch container log stats" err="open /var/log/pods/kube-system_snapshot-controller-557749dccd-zs6dp_87d6ef26-dbec-4a75-a8dd-0617b84e2b81/volume-snapshot-controller: no such file or directory" containerName="volume-snapshot-controller"

	May 09 08:31:45 addons-20220509082454-6723 kubelet[1927]: I0509 08:31:45.162153    1927 reconciler.go:192] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnct4\" (UniqueName: \"kubernetes.io/projected/4e835545-32d0-4e32-abd8-7358d6da7010-kube-api-access-bnct4\") pod \"4e835545-32d0-4e32-abd8-7358d6da7010\" (UID: \"4e835545-32d0-4e32-abd8-7358d6da7010\") "

	May 09 08:31:45 addons-20220509082454-6723 kubelet[1927]: I0509 08:31:45.162226    1927 reconciler.go:192] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e835545-32d0-4e32-abd8-7358d6da7010-tmp-dir\") pod \"4e835545-32d0-4e32-abd8-7358d6da7010\" (UID: \"4e835545-32d0-4e32-abd8-7358d6da7010\") "

	May 09 08:31:45 addons-20220509082454-6723 kubelet[1927]: W0509 08:31:45.162438    1927 empty_dir.go:519] Warning: Failed to clear quota on /var/lib/kubelet/pods/4e835545-32d0-4e32-abd8-7358d6da7010/volumes/kubernetes.io~empty-dir/tmp-dir: clearQuota called, but quotas disabled

	May 09 08:31:45 addons-20220509082454-6723 kubelet[1927]: I0509 08:31:45.162553    1927 operation_generator.go:856] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e835545-32d0-4e32-abd8-7358d6da7010-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4e835545-32d0-4e32-abd8-7358d6da7010" (UID: "4e835545-32d0-4e32-abd8-7358d6da7010"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGidValue ""

	May 09 08:31:45 addons-20220509082454-6723 kubelet[1927]: I0509 08:31:45.164436    1927 operation_generator.go:856] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e835545-32d0-4e32-abd8-7358d6da7010-kube-api-access-bnct4" (OuterVolumeSpecName: "kube-api-access-bnct4") pod "4e835545-32d0-4e32-abd8-7358d6da7010" (UID: "4e835545-32d0-4e32-abd8-7358d6da7010"). InnerVolumeSpecName "kube-api-access-bnct4". PluginName "kubernetes.io/projected", VolumeGidValue ""

	May 09 08:31:45 addons-20220509082454-6723 kubelet[1927]: I0509 08:31:45.263431    1927 reconciler.go:312] "Volume detached for volume \"kube-api-access-bnct4\" (UniqueName: \"kubernetes.io/projected/4e835545-32d0-4e32-abd8-7358d6da7010-kube-api-access-bnct4\") on node \"addons-20220509082454-6723\" DevicePath \"\""

	May 09 08:31:45 addons-20220509082454-6723 kubelet[1927]: I0509 08:31:45.263472    1927 reconciler.go:312] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e835545-32d0-4e32-abd8-7358d6da7010-tmp-dir\") on node \"addons-20220509082454-6723\" DevicePath \"\""

	May 09 08:31:45 addons-20220509082454-6723 kubelet[1927]: I0509 08:31:45.781058    1927 scope.go:110] "RemoveContainer" containerID="33cc200a076b4d8de3454a783afa49504e228728635746147ee971e9ae8cff08"

	May 09 08:31:45 addons-20220509082454-6723 kubelet[1927]: I0509 08:31:45.798979    1927 scope.go:110] "RemoveContainer" containerID="33cc200a076b4d8de3454a783afa49504e228728635746147ee971e9ae8cff08"

	May 09 08:31:45 addons-20220509082454-6723 kubelet[1927]: E0509 08:31:45.800144    1927 remote_runtime.go:578] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error: No such container: 33cc200a076b4d8de3454a783afa49504e228728635746147ee971e9ae8cff08" containerID="33cc200a076b4d8de3454a783afa49504e228728635746147ee971e9ae8cff08"

	May 09 08:31:45 addons-20220509082454-6723 kubelet[1927]: I0509 08:31:45.800190    1927 pod_container_deletor.go:52] "DeleteContainer returned error" containerID={Type:docker ID:33cc200a076b4d8de3454a783afa49504e228728635746147ee971e9ae8cff08} err="failed to get container status \"33cc200a076b4d8de3454a783afa49504e228728635746147ee971e9ae8cff08\": rpc error: code = Unknown desc = Error: No such container: 33cc200a076b4d8de3454a783afa49504e228728635746147ee971e9ae8cff08"

	* 

	* ==> storage-provisioner [df61303e3702] <==

	* I0509 08:25:50.765855       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0509 08:25:50.775377       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0509 08:25:50.775456       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0509 08:25:50.790388       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0509 08:25:50.790570       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-20220509082454-6723_49abdbcf-c01c-4901-b0c5-8aa25fd89b16!

	I0509 08:25:50.791710       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"8c96e7e1-d24c-4205-9d77-efe6633a4ff8", APIVersion:"v1", ResourceVersion:"669", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-20220509082454-6723_49abdbcf-c01c-4901-b0c5-8aa25fd89b16 became leader

	I0509 08:25:50.960384       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-20220509082454-6723_49abdbcf-c01c-4901-b0c5-8aa25fd89b16!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-20220509082454-6723 -n addons-20220509082454-6723

helpers_test.go:261: (dbg) Run:  kubectl --context addons-20220509082454-6723 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:270: non-running pods: 

helpers_test.go:272: ======> post-mortem[TestAddons/parallel/MetricsServer]: describe non-running pods <======

helpers_test.go:275: (dbg) Run:  kubectl --context addons-20220509082454-6723 describe pod 

helpers_test.go:275: (dbg) Non-zero exit: kubectl --context addons-20220509082454-6723 describe pod : exit status 1 (60.56935ms)

** stderr ** 

	error: resource name may not be empty

** /stderr **

helpers_test.go:277: kubectl --context addons-20220509082454-6723 describe pod : exit status 1

--- FAIL: TestAddons/parallel/MetricsServer (312.23s)

=== RUN   TestForceSystemdFlag

=== PAUSE TestForceSystemdFlag

=== CONT  TestForceSystemdFlag

docker_test.go:85: (dbg) Run:  out/minikube-linux-amd64 start -p force-systemd-flag-20220509085506-6723 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker

=== CONT  TestForceSystemdFlag

docker_test.go:85: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p force-systemd-flag-20220509085506-6723 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: exit status 90 (1m10.123346206s)

-- stdout --

	* [force-systemd-flag-20220509085506-6723] minikube v1.25.2 on Ubuntu 20.04 (kvm/amd64)

	  - MINIKUBE_LOCATION=14070

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/kubeconfig

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	* Using the docker driver based on user configuration

	  - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	* Using Docker driver with the root privilege

	* Starting control plane node force-systemd-flag-20220509085506-6723 in cluster force-systemd-flag-20220509085506-6723

	* Pulling base image ...

	* Creating docker container (CPUs=2, Memory=2048MB) ...

-- /stdout --

** stderr ** 

	I0509 08:55:06.457658  186275 out.go:296] Setting OutFile to fd 1 ...

	I0509 08:55:06.457828  186275 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0509 08:55:06.457839  186275 out.go:309] Setting ErrFile to fd 2...

	I0509 08:55:06.457847  186275 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0509 08:55:06.457986  186275 root.go:322] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/bin

	I0509 08:55:06.458278  186275 out.go:303] Setting JSON to false

	I0509 08:55:06.460850  186275 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-14","uptime":2260,"bootTime":1652084246,"procs":984,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.13.0-1024-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0509 08:55:06.460958  186275 start.go:125] virtualization: kvm guest

	I0509 08:55:06.463767  186275 out.go:177] * [force-systemd-flag-20220509085506-6723] minikube v1.25.2 on Ubuntu 20.04 (kvm/amd64)

	I0509 08:55:06.465996  186275 out.go:177]   - MINIKUBE_LOCATION=14070

	I0509 08:55:06.466013  186275 preload.go:306] deleting older generation preload /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v2-v1.18.0-docker-overlay2-amd64.tar.lz4.checksum

	I0509 08:55:06.465954  186275 notify.go:193] Checking for updates...

	I0509 08:55:06.469235  186275 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0509 08:55:06.471315  186275 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/kubeconfig

	I0509 08:55:06.473020  186275 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube

	I0509 08:55:06.474646  186275 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0509 08:55:06.476818  186275 config.go:178] Loaded profile config "kubernetes-upgrade-20220509085441-6723": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0

	I0509 08:55:06.476959  186275 config.go:178] Loaded profile config "missing-upgrade-20220509085336-6723": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	I0509 08:55:06.477059  186275 config.go:178] Loaded profile config "running-upgrade-20220509085501-6723": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	I0509 08:55:06.477125  186275 driver.go:346] Setting default libvirt URI to qemu:///system

	I0509 08:55:06.522409  186275 docker.go:137] docker version: linux-20.10.15

	I0509 08:55:06.522521  186275 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0509 08:55:06.641477  186275 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:2 ContainersRunning:1 ContainersPaused:0 ContainersStopped:1 Images:60 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:40 OomKillDisable:true NGoroutines:52 SystemTime:2022-05-09 08:55:06.553916854 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.13.0-1024-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexSer

verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662799872 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-14 Labels:[] ExperimentalBuild:false ServerVersion:20.10.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Clie

ntInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}

	I0509 08:55:06.641613  186275 docker.go:254] overlay module found

	I0509 08:55:06.643893  186275 out.go:177] * Using the docker driver based on user configuration

	I0509 08:55:06.645295  186275 start.go:284] selected driver: docker

	I0509 08:55:06.645316  186275 start.go:801] validating driver "docker" against <nil>

	I0509 08:55:06.645343  186275 start.go:812] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	W0509 08:55:06.645417  186275 oci.go:120] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W0509 08:55:06.645441  186275 out.go:239] ! Your cgroup does not allow setting memory.

	! Your cgroup does not allow setting memory.

	I0509 08:55:06.646864  186275 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I0509 08:55:06.648701  186275 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0509 08:55:06.777855  186275 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:2 ContainersRunning:2 ContainersPaused:0 ContainersStopped:0 Images:60 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:38 OomKillDisable:true NGoroutines:42 SystemTime:2022-05-09 08:55:06.679882341 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.13.0-1024-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexSer

verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662799872 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-14 Labels:[] ExperimentalBuild:false ServerVersion:20.10.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Clie

ntInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}

	I0509 08:55:06.777994  186275 start_flags.go:292] no existing cluster config was found, will generate one from the flags 

	I0509 08:55:06.778168  186275 start_flags.go:829] Wait components to verify : map[apiserver:true system_pods:true]

	I0509 08:55:06.780470  186275 out.go:177] * Using Docker driver with the root privilege

	I0509 08:55:06.781841  186275 cni.go:95] Creating CNI manager for ""

	I0509 08:55:06.781878  186275 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0509 08:55:06.781891  186275 start_flags.go:306] config:

	{Name:force-systemd-flag-20220509085506-6723 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.0 ClusterName:force-systemd-flag-20220509085506-6723 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clust

er.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}

	I0509 08:55:06.783957  186275 out.go:177] * Starting control plane node force-systemd-flag-20220509085506-6723 in cluster force-systemd-flag-20220509085506-6723

	I0509 08:55:06.785393  186275 cache.go:120] Beginning downloading kic base image for docker with docker

	I0509 08:55:06.786731  186275 out.go:177] * Pulling base image ...

	I0509 08:55:06.788079  186275 preload.go:132] Checking if preload exists for k8s version v1.24.0 and runtime docker

	I0509 08:55:06.788130  186275 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.0-docker-overlay2-amd64.tar.lz4

	I0509 08:55:06.788150  186275 cache.go:57] Caching tarball of preloaded images

	I0509 08:55:06.788128  186275 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 in local docker daemon

	I0509 08:55:06.788426  186275 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0509 08:55:06.788448  186275 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.0 on docker

	I0509 08:55:06.788574  186275 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/force-systemd-flag-20220509085506-6723/config.json ...

	I0509 08:55:06.788599  186275 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/force-systemd-flag-20220509085506-6723/config.json: {Name:mk9aed9988c0e5019e3f23652e4ea57b3c44414a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0509 08:55:06.838503  186275 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 in local docker daemon, skipping pull

	I0509 08:55:06.838537  186275 cache.go:141] gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 exists in daemon, skipping load

	I0509 08:55:06.838555  186275 cache.go:206] Successfully downloaded all kic artifacts

	I0509 08:55:06.838592  186275 start.go:352] acquiring machines lock for force-systemd-flag-20220509085506-6723: {Name:mk0f86bbd9d5220c32089d0083184e884fb202b1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0509 08:55:06.838725  186275 start.go:356] acquired machines lock for "force-systemd-flag-20220509085506-6723" in 110.48µs

	I0509 08:55:06.838763  186275 start.go:91] Provisioning new machine with config: &{Name:force-systemd-flag-20220509085506-6723 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.0 ClusterName:force-systemd-flag-20220509085506-6723 Namespace:

default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false} &{Name: IP: Port:8443 KubernetesVersion:

v1.24.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0509 08:55:06.838862  186275 start.go:131] createHost starting for "" (driver="docker")

	I0509 08:55:06.841380  186275 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...

	I0509 08:55:06.841739  186275 start.go:165] libmachine.API.Create for "force-systemd-flag-20220509085506-6723" (driver="docker")

	I0509 08:55:06.841790  186275 client.go:168] LocalClient.Create starting

	I0509 08:55:06.841864  186275 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem

	I0509 08:55:06.841904  186275 main.go:134] libmachine: Decoding PEM data...

	I0509 08:55:06.841931  186275 main.go:134] libmachine: Parsing certificate...

	I0509 08:55:06.842022  186275 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/cert.pem

	I0509 08:55:06.842052  186275 main.go:134] libmachine: Decoding PEM data...

	I0509 08:55:06.842079  186275 main.go:134] libmachine: Parsing certificate...

	I0509 08:55:06.842513  186275 cli_runner.go:164] Run: docker network inspect force-systemd-flag-20220509085506-6723 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0509 08:55:06.882692  186275 cli_runner.go:211] docker network inspect force-systemd-flag-20220509085506-6723 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0509 08:55:06.882767  186275 network_create.go:272] running [docker network inspect force-systemd-flag-20220509085506-6723] to gather additional debugging logs...

	I0509 08:55:06.882791  186275 cli_runner.go:164] Run: docker network inspect force-systemd-flag-20220509085506-6723

	W0509 08:55:06.924457  186275 cli_runner.go:211] docker network inspect force-systemd-flag-20220509085506-6723 returned with exit code 1

	I0509 08:55:06.924512  186275 network_create.go:275] error running [docker network inspect force-systemd-flag-20220509085506-6723]: docker network inspect force-systemd-flag-20220509085506-6723: exit status 1

	stdout:

	[]

	stderr:

	Error: No such network: force-systemd-flag-20220509085506-6723

	I0509 08:55:06.924545  186275 network_create.go:277] output of [docker network inspect force-systemd-flag-20220509085506-6723]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error: No such network: force-systemd-flag-20220509085506-6723

	** /stderr **

	I0509 08:55:06.924711  186275 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0509 08:55:06.965591  186275 network.go:288] reserving subnet 192.168.49.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.49.0:0xc000010238] misses:0}

	I0509 08:55:06.965686  186275 network.go:235] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I0509 08:55:06.965720  186275 network_create.go:115] attempt to create docker network force-systemd-flag-20220509085506-6723 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...

	I0509 08:55:06.965819  186275 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true force-systemd-flag-20220509085506-6723

	I0509 08:55:07.118711  186275 network_create.go:99] docker network force-systemd-flag-20220509085506-6723 192.168.49.0/24 created

	I0509 08:55:07.118756  186275 kic.go:106] calculated static IP "192.168.49.2" for the "force-systemd-flag-20220509085506-6723" container

	I0509 08:55:07.118830  186275 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I0509 08:55:07.166615  186275 cli_runner.go:164] Run: docker volume create force-systemd-flag-20220509085506-6723 --label name.minikube.sigs.k8s.io=force-systemd-flag-20220509085506-6723 --label created_by.minikube.sigs.k8s.io=true

	I0509 08:55:07.212474  186275 oci.go:103] Successfully created a docker volume force-systemd-flag-20220509085506-6723

	I0509 08:55:07.212567  186275 cli_runner.go:164] Run: docker run --rm --name force-systemd-flag-20220509085506-6723-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-flag-20220509085506-6723 --entrypoint /usr/bin/test -v force-systemd-flag-20220509085506-6723:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -d /var/lib

	I0509 08:55:08.116349  186275 oci.go:107] Successfully prepared a docker volume force-systemd-flag-20220509085506-6723

	I0509 08:55:08.116399  186275 preload.go:132] Checking if preload exists for k8s version v1.24.0 and runtime docker

	I0509 08:55:08.116436  186275 kic.go:179] Starting extracting preloaded images to volume ...

	I0509 08:55:08.116507  186275 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v force-systemd-flag-20220509085506-6723:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -I lz4 -xf /preloaded.tar -C /extractDir

	I0509 08:55:13.330878  186275 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v force-systemd-flag-20220509085506-6723:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -I lz4 -xf /preloaded.tar -C /extractDir: (5.214300297s)

	I0509 08:55:13.330942  186275 kic.go:188] duration metric: took 5.214503 seconds to extract preloaded images to volume

	W0509 08:55:13.330991  186275 oci.go:136] Your kernel does not support swap limit capabilities or the cgroup is not mounted.

	W0509 08:55:13.331007  186275 oci.go:120] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	I0509 08:55:13.331064  186275 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"

	I0509 08:55:13.476744  186275 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname force-systemd-flag-20220509085506-6723 --name force-systemd-flag-20220509085506-6723 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-flag-20220509085506-6723 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=force-systemd-flag-20220509085506-6723 --network force-systemd-flag-20220509085506-6723 --ip 192.168.49.2 --volume force-systemd-flag-20220509085506-6723:/var --security-opt apparmor=unconfined --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5

	I0509 08:55:14.086928  186275 cli_runner.go:164] Run: docker container inspect force-systemd-flag-20220509085506-6723 --format={{.State.Running}}

	I0509 08:55:14.141734  186275 cli_runner.go:164] Run: docker container inspect force-systemd-flag-20220509085506-6723 --format={{.State.Status}}

	I0509 08:55:14.224812  186275 cli_runner.go:164] Run: docker exec force-systemd-flag-20220509085506-6723 stat /var/lib/dpkg/alternatives/iptables

	I0509 08:55:14.321744  186275 oci.go:279] the created container "force-systemd-flag-20220509085506-6723" has a running status.

	I0509 08:55:14.321796  186275 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/force-systemd-flag-20220509085506-6723/id_rsa...

	I0509 08:55:14.568900  186275 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/force-systemd-flag-20220509085506-6723/id_rsa.pub -> /home/docker/.ssh/authorized_keys

	I0509 08:55:14.568974  186275 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/force-systemd-flag-20220509085506-6723/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)

	I0509 08:55:14.713449  186275 cli_runner.go:164] Run: docker container inspect force-systemd-flag-20220509085506-6723 --format={{.State.Status}}

	I0509 08:55:14.764761  186275 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys

	I0509 08:55:14.764789  186275 kic_runner.go:114] Args: [docker exec --privileged force-systemd-flag-20220509085506-6723 chown docker:docker /home/docker/.ssh/authorized_keys]

	I0509 08:55:14.885682  186275 cli_runner.go:164] Run: docker container inspect force-systemd-flag-20220509085506-6723 --format={{.State.Status}}

	I0509 08:55:14.935495  186275 machine.go:88] provisioning docker machine ...

	I0509 08:55:14.935552  186275 ubuntu.go:169] provisioning hostname "force-systemd-flag-20220509085506-6723"

	I0509 08:55:14.935616  186275 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-20220509085506-6723

	I0509 08:55:14.980400  186275 main.go:134] libmachine: Using SSH client type: native

	I0509 08:55:14.980731  186275 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7d8f60] 0x7dbfc0 <nil>  [] 0s} 127.0.0.1 49329 <nil> <nil>}

	I0509 08:55:14.980766  186275 main.go:134] libmachine: About to run SSH command:

	sudo hostname force-systemd-flag-20220509085506-6723 && echo "force-systemd-flag-20220509085506-6723" | sudo tee /etc/hostname

	I0509 08:55:15.119785  186275 main.go:134] libmachine: SSH cmd err, output: <nil>: force-systemd-flag-20220509085506-6723

	I0509 08:55:15.119867  186275 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-20220509085506-6723

	I0509 08:55:15.159924  186275 main.go:134] libmachine: Using SSH client type: native

	I0509 08:55:15.160116  186275 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7d8f60] 0x7dbfc0 <nil>  [] 0s} 127.0.0.1 49329 <nil> <nil>}

	I0509 08:55:15.160146  186275 main.go:134] libmachine: About to run SSH command:

			if ! grep -xq '.*\sforce-systemd-flag-20220509085506-6723' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 force-systemd-flag-20220509085506-6723/g' /etc/hosts;

				else 

					echo '127.0.1.1 force-systemd-flag-20220509085506-6723' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0509 08:55:15.300956  186275 main.go:134] libmachine: SSH cmd err, output: <nil>: 

	I0509 08:55:15.300991  186275 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/key.pem ServerCertR

emotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube}

	I0509 08:55:15.301018  186275 ubuntu.go:177] setting up certificates

	I0509 08:55:15.301029  186275 provision.go:83] configureAuth start

	I0509 08:55:15.301072  186275 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" force-systemd-flag-20220509085506-6723

	I0509 08:55:15.352977  186275 provision.go:138] copyHostCerts

	I0509 08:55:15.353020  186275 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.pem

	I0509 08:55:15.353043  186275 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.pem, removing ...

	I0509 08:55:15.353055  186275 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.pem

	I0509 08:55:15.353125  186275 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.pem (1078 bytes)

	I0509 08:55:15.353186  186275 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cert.pem

	I0509 08:55:15.353208  186275 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cert.pem, removing ...

	I0509 08:55:15.353220  186275 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cert.pem

	I0509 08:55:15.353257  186275 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cert.pem (1123 bytes)

	I0509 08:55:15.353299  186275 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/key.pem

	I0509 08:55:15.353314  186275 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/key.pem, removing ...

	I0509 08:55:15.353321  186275 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/key.pem

	I0509 08:55:15.353340  186275 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/key.pem (1679 bytes)

	I0509 08:55:15.353382  186275 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca-key.pem org=jenkins.force-systemd-flag-20220509085506-6723 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube force-systemd-flag-20220509085506-6723]

	I0509 08:55:15.517949  186275 provision.go:172] copyRemoteCerts

	I0509 08:55:15.518010  186275 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0509 08:55:15.518053  186275 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-20220509085506-6723

	I0509 08:55:15.569619  186275 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49329 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/force-systemd-flag-20220509085506-6723/id_rsa Username:docker}

	I0509 08:55:15.681827  186275 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0509 08:55:15.681912  186275 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0509 08:55:15.707674  186275 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0509 08:55:15.707735  186275 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server.pem --> /etc/docker/server.pem (1285 bytes)

	I0509 08:55:15.737606  186275 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0509 08:55:15.737677  186275 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0509 08:55:15.762082  186275 provision.go:86] duration metric: configureAuth took 461.04055ms

	I0509 08:55:15.762110  186275 ubuntu.go:193] setting minikube options for container-runtime

	I0509 08:55:15.762286  186275 config.go:178] Loaded profile config "force-systemd-flag-20220509085506-6723": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.0

	I0509 08:55:15.762345  186275 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-20220509085506-6723

	I0509 08:55:15.812781  186275 main.go:134] libmachine: Using SSH client type: native

	I0509 08:55:15.812978  186275 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7d8f60] 0x7dbfc0 <nil>  [] 0s} 127.0.0.1 49329 <nil> <nil>}

	I0509 08:55:15.813008  186275 main.go:134] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0509 08:55:15.966477  186275 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay

	I0509 08:55:15.966509  186275 ubuntu.go:71] root file system type: overlay

	I0509 08:55:15.966734  186275 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0509 08:55:15.966813  186275 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-20220509085506-6723

	I0509 08:55:16.020918  186275 main.go:134] libmachine: Using SSH client type: native

	I0509 08:55:16.021126  186275 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7d8f60] 0x7dbfc0 <nil>  [] 0s} 127.0.0.1 49329 <nil> <nil>}

	I0509 08:55:16.021228  186275 main.go:134] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0509 08:55:16.167496  186275 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0509 08:55:16.167591  186275 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-20220509085506-6723

	I0509 08:55:16.215652  186275 main.go:134] libmachine: Using SSH client type: native

	I0509 08:55:16.215844  186275 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7d8f60] 0x7dbfc0 <nil>  [] 0s} 127.0.0.1 49329 <nil> <nil>}

	I0509 08:55:16.215878  186275 main.go:134] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0509 08:55:19.293895  186275 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2022-03-10 14:05:44.000000000 +0000

	+++ /lib/systemd/system/docker.service.new	2022-05-09 08:55:16.164254667 +0000

	@@ -1,30 +1,32 @@

	 [Unit]

	 Description=Docker Application Container Engine

	 Documentation=https://docs.docker.com

	-After=network-online.target docker.socket firewalld.service containerd.service

	+BindsTo=containerd.service

	+After=network-online.target firewalld.service containerd.service

	 Wants=network-online.target

	-Requires=docker.socket containerd.service

	+Requires=docker.socket

	+StartLimitBurst=3

	+StartLimitIntervalSec=60

	 [Service]

	 Type=notify

	-# the default is not to use systemd for cgroups because the delegate issues still

	-# exists and systemd currently does not support the cgroup feature set required

	-# for containers run by docker

	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

	-ExecReload=/bin/kill -s HUP $MAINPID

	-TimeoutSec=0

	-RestartSec=2

	-Restart=always

	-

	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.

	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location

	-# to make them work for either version of systemd.

	-StartLimitBurst=3

	+Restart=on-failure

	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.

	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make

	-# this option work for either version of systemd.

	-StartLimitInterval=60s

	+

	+

	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	+# The base configuration already specifies an 'ExecStart=...' command. The first directive

	+# here is to clear out that command inherited from the base configuration. Without this,

	+# the command from the base configuration and the command specified here are treated as

	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	+# will catch this invalid input and refuse to start the service with an error like:

	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	+

	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	+ExecStart=

	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	+ExecReload=/bin/kill -s HUP $MAINPID

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	@@ -32,16 +34,16 @@

	 LimitNPROC=infinity

	 LimitCORE=infinity

	-# Comment TasksMax if your systemd version does not support it.

	-# Only systemd 226 and above support this option.

	+# Uncomment TasksMax if your systemd version supports it.

	+# Only systemd 226 and above support this version.

	 TasksMax=infinity

	+TimeoutStartSec=0

	 # set delegate yes so that systemd does not reset the cgroups of docker containers

	 Delegate=yes

	 # kill only the docker process, not all processes in the cgroup

	 KillMode=process

	-OOMScoreAdjust=-500

	 [Install]

	 WantedBy=multi-user.target

	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install enable docker

	I0509 08:55:19.293931  186275 machine.go:91] provisioned docker machine in 4.358406045s

	I0509 08:55:19.293943  186275 client.go:171] LocalClient.Create took 12.452142175s

	I0509 08:55:19.293961  186275 start.go:173] duration metric: libmachine.API.Create for "force-systemd-flag-20220509085506-6723" took 12.452224315s

	I0509 08:55:19.293978  186275 start.go:306] post-start starting for "force-systemd-flag-20220509085506-6723" (driver="docker")

	I0509 08:55:19.293986  186275 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0509 08:55:19.294044  186275 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0509 08:55:19.294096  186275 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-20220509085506-6723

	I0509 08:55:19.344535  186275 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49329 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/force-systemd-flag-20220509085506-6723/id_rsa Username:docker}

	I0509 08:55:19.437964  186275 ssh_runner.go:195] Run: cat /etc/os-release

	I0509 08:55:19.441284  186275 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I0509 08:55:19.441316  186275 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I0509 08:55:19.441329  186275 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I0509 08:55:19.441337  186275 info.go:137] Remote host: Ubuntu 20.04.4 LTS

	I0509 08:55:19.441349  186275 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/addons for local assets ...

	I0509 08:55:19.441412  186275 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/files for local assets ...

	I0509 08:55:19.441502  186275 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/files/etc/ssl/certs/67232.pem -> 67232.pem in /etc/ssl/certs

	I0509 08:55:19.441515  186275 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/files/etc/ssl/certs/67232.pem -> /etc/ssl/certs/67232.pem

	I0509 08:55:19.441619  186275 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0509 08:55:19.449445  186275 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/files/etc/ssl/certs/67232.pem --> /etc/ssl/certs/67232.pem (1708 bytes)

	I0509 08:55:19.468900  186275 start.go:309] post-start completed in 174.907279ms

	I0509 08:55:19.469269  186275 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" force-systemd-flag-20220509085506-6723

	I0509 08:55:19.504166  186275 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/force-systemd-flag-20220509085506-6723/config.json ...

	I0509 08:55:19.504490  186275 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0509 08:55:19.504543  186275 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-20220509085506-6723

	I0509 08:55:19.542630  186275 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49329 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/force-systemd-flag-20220509085506-6723/id_rsa Username:docker}

	I0509 08:55:19.629858  186275 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0509 08:55:19.634631  186275 start.go:134] duration metric: createHost completed in 12.795752948s

	I0509 08:55:19.634679  186275 start.go:81] releasing machines lock for "force-systemd-flag-20220509085506-6723", held for 12.795931664s

	I0509 08:55:19.634779  186275 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" force-systemd-flag-20220509085506-6723

	I0509 08:55:19.672020  186275 ssh_runner.go:195] Run: systemctl --version

	I0509 08:55:19.672079  186275 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-20220509085506-6723

	I0509 08:55:19.672081  186275 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0509 08:55:19.672139  186275 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-flag-20220509085506-6723

	I0509 08:55:19.712645  186275 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49329 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/force-systemd-flag-20220509085506-6723/id_rsa Username:docker}

	I0509 08:55:19.713066  186275 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49329 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/force-systemd-flag-20220509085506-6723/id_rsa Username:docker}

	I0509 08:55:19.820313  186275 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0509 08:55:19.831294  186275 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0509 08:55:19.842177  186275 cruntime.go:273] skipping containerd shutdown because we are bound to it

	I0509 08:55:19.842249  186275 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0509 08:55:19.854707  186275 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	image-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0509 08:55:19.869905  186275 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0509 08:55:19.959248  186275 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0509 08:55:20.048233  186275 docker.go:510] Forcing docker to use systemd as cgroup manager...

	I0509 08:55:20.048266  186275 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (143 bytes)

	I0509 08:55:20.063726  186275 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0509 08:55:20.147830  186275 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0509 08:55:20.749199  186275 start.go:447] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0509 08:55:20.749275  186275 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:55:20.755395  186275 retry.go:31] will retry after 1.104660288s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:55:21.860210  186275 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:55:21.863895  186275 retry.go:31] will retry after 2.160763633s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:55:24.025799  186275 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:55:24.029483  186275 retry.go:31] will retry after 2.62026012s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:55:26.650216  186275 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:55:26.654165  186275 retry.go:31] will retry after 3.164785382s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:55:29.820733  186275 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:55:29.824573  186275 retry.go:31] will retry after 4.680977329s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:55:34.505793  186275 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:55:34.509492  186275 retry.go:31] will retry after 9.01243771s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:55:43.522903  186275 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:55:43.527712  186275 retry.go:31] will retry after 6.442959172s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:55:49.972765  186275 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:55:49.976326  186275 retry.go:31] will retry after 11.217246954s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:56:01.196808  186275 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:56:01.201324  186275 retry.go:31] will retry after 15.299675834s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:56:16.502128  186275 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:56:16.508537  186275 out.go:177] 

	W0509 08:56:16.510239  186275 out.go:239] X Exiting due to RUNTIME_ENABLE: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	X Exiting due to RUNTIME_ENABLE: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	W0509 08:56:16.510263  186275 out.go:239] * 

	* 

	W0509 08:56:16.511076  186275 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0509 08:56:16.512488  186275 out.go:177] 

** /stderr **

docker_test.go:87: failed to start minikube with args: "out/minikube-linux-amd64 start -p force-systemd-flag-20220509085506-6723 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=docker" : exit status 90

docker_test.go:104: (dbg) Run:  out/minikube-linux-amd64 -p force-systemd-flag-20220509085506-6723 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:100: *** TestForceSystemdFlag FAILED at 2022-05-09 08:56:17.06529034 +0000 UTC m=+1902.508870957

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestForceSystemdFlag]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect force-systemd-flag-20220509085506-6723

helpers_test.go:235: (dbg) docker inspect force-systemd-flag-20220509085506-6723:

-- stdout --

	[

	    {

	        "Id": "634cae78b95cf095c727bac389d6ad9415afc177a570f6c5ac3f33406f8ab9bb",

	        "Created": "2022-05-09T08:55:13.536771398Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 188949,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2022-05-09T08:55:14.07419285Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:44d43b69f3d5ba7f801dca891b535f23f9839671e82277938ec7dc42a22c50d6",

	        "ResolvConfPath": "/var/lib/docker/containers/634cae78b95cf095c727bac389d6ad9415afc177a570f6c5ac3f33406f8ab9bb/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/634cae78b95cf095c727bac389d6ad9415afc177a570f6c5ac3f33406f8ab9bb/hostname",

	        "HostsPath": "/var/lib/docker/containers/634cae78b95cf095c727bac389d6ad9415afc177a570f6c5ac3f33406f8ab9bb/hosts",

	        "LogPath": "/var/lib/docker/containers/634cae78b95cf095c727bac389d6ad9415afc177a570f6c5ac3f33406f8ab9bb/634cae78b95cf095c727bac389d6ad9415afc177a570f6c5ac3f33406f8ab9bb-json.log",

	        "Name": "/force-systemd-flag-20220509085506-6723",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "unconfined",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "force-systemd-flag-20220509085506-6723:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "force-systemd-flag-20220509085506-6723",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 0,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 0,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/a0a76f03907cc4fdd862105b9e5582d69bb80683fdad91fdcaf84f129aafa90a-init/diff:/var/lib/docker/overlay2/beaaca4c58fe6ff4bdb88567c3d78ab7a23955eafaa5637df03ee2e0482d2aa6/diff:/var/lib/docker/overlay2/7c16b810bbfa3a2abff75078fa37b4cba0b2f101ff43d49beaabc3fd2602b1c9/diff:/var/lib/docker/overlay2/60f04c0e4baa8ad1c02ae5e34e6f505db0d740e2d7dc0833b2ff3b8037c1a9b6/diff:/var/lib/docker/overlay2/a12543300ae4ff803b2f0493a60a04a921312ec5a7b6ed493e66acadf998daef/diff:/var/lib/docker/overlay2/2d68f658a64cd8b7255bce93547db5d1b20b119ef6da8b9ce06614134661f235/diff:/var/lib/docker/overlay2/0f968f210c1565f6e8c4e444c650502c06a120d8767c9fefb7b6b2a09f4af83b/diff:/var/lib/docker/overlay2/987a67893acdccd514357a50db6c11680ae1899ec07a36085367a241ba1f0545/diff:/var/lib/docker/overlay2/d5446d1adc007f4390aa6173ef257b0bf52a9c9cc6533f16dd6c577fde5334b3/diff:/var/lib/docker/overlay2/265dd0cde77d578f6412ad48596c75c3548b5e077059c0fa835e4f22775fab83/diff:/var/lib/docker/overlay2/e6b98b

08dd64e06639e2a321169f84a89e8d21cea02d673819156eeb7a4747c3/diff:/var/lib/docker/overlay2/acf7117613a840e97b7a1101bfdce3a154a335ee0ffcaf74bd7f1b27b00cdaab/diff:/var/lib/docker/overlay2/9e88fa64aa800dac6e01eddc9cfd525a0dcd906c1adf98de066be87f87a6b52c/diff:/var/lib/docker/overlay2/6c539edead197cd449ca81fd34e3c534a6ca25446a52141d0ae4484aaac05482/diff:/var/lib/docker/overlay2/866719c52f41a692b94f42071d314de55b290912f946f4ec5f3785a7a5ae40df/diff:/var/lib/docker/overlay2/1c488a9b3bad141652873f4085ce1a466e1f1e8ccbd086d03a492b45179a6064/diff:/var/lib/docker/overlay2/bce5b942da09326e5a5c8595077544ced08031b1cd9b22ff8bff0a4458540139/diff:/var/lib/docker/overlay2/ffe34c3764a4eeac791f4672d47389ec3f399f716ab6e5531d7c5e587f3ace00/diff:/var/lib/docker/overlay2/a377e0779d03467b09a26898ae35b12f325d62984304817f49c693b2146c08f4/diff:/var/lib/docker/overlay2/6092380f07b29488cf0a30cb486638d86eaa8e00ff356a7985c6ac6f2fae5c1d/diff:/var/lib/docker/overlay2/1bc014cc0cf0a91c61f131c06b0194709f853dec23defe9233cbd9cc40030c28/diff:/var/lib/d

ocker/overlay2/0c81c4db7384c48318a800165af7f811348a8081efdd9dbd912e05e55c9eb4e0/diff:/var/lib/docker/overlay2/72b0c515d90bc71e27b766a9be89e315777a5bbe643d8fc508a9ae12557a58ce/diff:/var/lib/docker/overlay2/a4d193bf8c377d4cf1357b9261d3c54d995f17bda3db5abee3ef5caec001d75e/diff:/var/lib/docker/overlay2/763c6d291074b0842ecdeec1f3842fd6a0af0cb86839c82bc38cec0f40d095ca/diff:/var/lib/docker/overlay2/e4156eb2a94ac7136eb674fb8c22ea7f6dff50cd81e4857119d81112dc5ad99d/diff:/var/lib/docker/overlay2/be7effa3bb906b8c48aefab3cc72e657931bccd42c35b03bb52c679c37c70d25/diff:/var/lib/docker/overlay2/ccf8c1a68774cc6129c43490c675e6ba0ff0c88284ad899c9efb4b7492e92a06/diff:/var/lib/docker/overlay2/55f74cddb5c8f2da1131ddd67f7f2a20b8c2be8719b71047d5185fdb4722627d/diff:/var/lib/docker/overlay2/f6c38e83545e9de87d03b1e8e9b0239079acf47784afc11291b2172a11f8296d/diff:/var/lib/docker/overlay2/24604ce83180fcb6b9e1adbaf37db6776e4949ca5e1f4f9050b8fb8dc87d7591/diff:/var/lib/docker/overlay2/b03b1952bea32e53ce88b0d92d09f78ca76ceca0a146b088628be224813

ae87c/diff:/var/lib/docker/overlay2/d7ee02a5ba355c246c3107f286c4130457358aa56e0d8feb3850d953812fe76d/diff:/var/lib/docker/overlay2/1223ae0e5105ae89c78524490f0ccc5fe6dfa373e175fa70474b06c62aad91c7/diff:/var/lib/docker/overlay2/c3209d71eed94ed66b11ba3a7573c347d5c09a5a4fedb00418e52571abb2b5f9/diff:/var/lib/docker/overlay2/d6d32632e36023dec15e643fd41f77168442327cecdead87a47e70683cb0c660/diff:/var/lib/docker/overlay2/fd413b21f1f34027c98a1b4106f7e7db83e910860edd53ef838ac699659cd451/diff:/var/lib/docker/overlay2/9768e3244c157a7a12b8ec31507c1abc0fc806a9f325099262cfeb41e23a5fe1/diff:/var/lib/docker/overlay2/f65dda9d5b79903f5e68f6b9d4a59214d62f304da77faa7e148b90b402d98ca4/diff:/var/lib/docker/overlay2/b663c2dab6b5df7b606daa62e1df5e57f4a2503c2a9a19211f47359fd685dccf/diff:/var/lib/docker/overlay2/bbd620a7e494844db80a2bcd2fd6f170080c5273f1c33a576501214dd4475464/diff:/var/lib/docker/overlay2/23de36667695cec8ea0f4c98fc580213d356d39a3eba5aaab8b6ebeeb2b71596/diff:/var/lib/docker/overlay2/bafb3e8d91e83dcf824b6d5b3f56a67c483c42

723724b009a5aedf578351154f/diff:/var/lib/docker/overlay2/2798e8ce2f51dde257a9cf2dd800492f888fd02515c5f1de4133cc787ee12928/diff:/var/lib/docker/overlay2/e69a88f2dffdd2c7f72c45eaf2e3cd1a8772e0a2af22d6f34d2695bbda62b6e9/diff:/var/lib/docker/overlay2/708816f20892c0e4b94cbe8e80b169fff54ffd870bcde395bd8163dd03b25d0f/diff",

	                "MergedDir": "/var/lib/docker/overlay2/a0a76f03907cc4fdd862105b9e5582d69bb80683fdad91fdcaf84f129aafa90a/merged",

	                "UpperDir": "/var/lib/docker/overlay2/a0a76f03907cc4fdd862105b9e5582d69bb80683fdad91fdcaf84f129aafa90a/diff",

	                "WorkDir": "/var/lib/docker/overlay2/a0a76f03907cc4fdd862105b9e5582d69bb80683fdad91fdcaf84f129aafa90a/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "force-systemd-flag-20220509085506-6723",

	                "Source": "/var/lib/docker/volumes/force-systemd-flag-20220509085506-6723/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "force-systemd-flag-20220509085506-6723",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "force-systemd-flag-20220509085506-6723",

	                "name.minikube.sigs.k8s.io": "force-systemd-flag-20220509085506-6723",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "556cc68177b6a263ee513219619b3591844711c76f258619c80756964e9f0259",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "49329"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "49328"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "49325"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "49327"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "49326"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/556cc68177b6",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "force-systemd-flag-20220509085506-6723": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "634cae78b95c",

	                        "force-systemd-flag-20220509085506-6723"

	                    ],

	                    "NetworkID": "05654064b3d63fa7cb6d2a2f0ea78450dcaad1a8649d00f514687ff9fc963d05",

	                    "EndpointID": "fb589fa24bdef5dd5c68f1f4c2ef008422e8b2c17aaf546738d2ad69938990f4",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p force-systemd-flag-20220509085506-6723 -n force-systemd-flag-20220509085506-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p force-systemd-flag-20220509085506-6723 -n force-systemd-flag-20220509085506-6723: exit status 6 (451.913557ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0509 08:56:17.544962  207933 status.go:413] kubeconfig endpoint: extract IP: "force-systemd-flag-20220509085506-6723" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "force-systemd-flag-20220509085506-6723" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

helpers_test.go:175: Cleaning up "force-systemd-flag-20220509085506-6723" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p force-systemd-flag-20220509085506-6723

helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-flag-20220509085506-6723: (2.186382921s)

--- FAIL: TestForceSystemdFlag (73.35s)

=== RUN   TestForceSystemdEnv

=== PAUSE TestForceSystemdEnv

=== CONT  TestForceSystemdEnv

docker_test.go:150: (dbg) Run:  out/minikube-linux-amd64 start -p force-systemd-env-20220509085537-6723 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker

=== CONT  TestForceSystemdEnv

docker_test.go:150: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p force-systemd-env-20220509085537-6723 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker: exit status 90 (1m9.877336272s)

-- stdout --

	* [force-systemd-env-20220509085537-6723] minikube v1.25.2 on Ubuntu 20.04 (kvm/amd64)

	  - MINIKUBE_LOCATION=14070

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/kubeconfig

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_FORCE_SYSTEMD=true

	* Using the docker driver based on user configuration

	  - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	* Using Docker driver with the root privilege

	* Starting control plane node force-systemd-env-20220509085537-6723 in cluster force-systemd-env-20220509085537-6723

	* Pulling base image ...

	* Creating docker container (CPUs=2, Memory=2048MB) ...

-- /stdout --

** stderr ** 

	I0509 08:55:37.703700  196368 out.go:296] Setting OutFile to fd 1 ...

	I0509 08:55:37.703818  196368 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0509 08:55:37.703826  196368 out.go:309] Setting ErrFile to fd 2...

	I0509 08:55:37.703831  196368 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0509 08:55:37.703932  196368 root.go:322] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/bin

	I0509 08:55:37.704216  196368 out.go:303] Setting JSON to false

	I0509 08:55:37.705891  196368 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-14","uptime":2292,"bootTime":1652084246,"procs":1137,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.13.0-1024-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0509 08:55:37.705964  196368 start.go:125] virtualization: kvm guest

	I0509 08:55:37.709069  196368 out.go:177] * [force-systemd-env-20220509085537-6723] minikube v1.25.2 on Ubuntu 20.04 (kvm/amd64)

	I0509 08:55:37.710815  196368 notify.go:193] Checking for updates...

	I0509 08:55:37.712575  196368 out.go:177]   - MINIKUBE_LOCATION=14070

	I0509 08:55:37.714489  196368 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0509 08:55:37.716261  196368 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/kubeconfig

	I0509 08:55:37.718013  196368 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube

	I0509 08:55:37.719620  196368 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0509 08:55:37.721388  196368 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true

	I0509 08:55:37.723503  196368 config.go:178] Loaded profile config "force-systemd-flag-20220509085506-6723": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.0

	I0509 08:55:37.723593  196368 config.go:178] Loaded profile config "kubernetes-upgrade-20220509085441-6723": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.1-rc.0

	I0509 08:55:37.723672  196368 config.go:178] Loaded profile config "running-upgrade-20220509085501-6723": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.18.0

	I0509 08:55:37.723736  196368 driver.go:346] Setting default libvirt URI to qemu:///system

	I0509 08:55:37.769991  196368 docker.go:137] docker version: linux-20.10.15

	I0509 08:55:37.770107  196368 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0509 08:55:37.886554  196368 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:60 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:59 SystemTime:2022-05-09 08:55:37.803693218 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.13.0-1024-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexSer

verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662799872 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-14 Labels:[] ExperimentalBuild:false ServerVersion:20.10.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Clie

ntInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}

	I0509 08:55:37.886688  196368 docker.go:254] overlay module found

	I0509 08:55:37.889012  196368 out.go:177] * Using the docker driver based on user configuration

	I0509 08:55:37.890729  196368 start.go:284] selected driver: docker

	I0509 08:55:37.890746  196368 start.go:801] validating driver "docker" against <nil>

	I0509 08:55:37.890772  196368 start.go:812] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	W0509 08:55:37.890826  196368 oci.go:120] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W0509 08:55:37.890851  196368 out.go:239] ! Your cgroup does not allow setting memory.

	! Your cgroup does not allow setting memory.

	I0509 08:55:37.892419  196368 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I0509 08:55:37.894573  196368 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0509 08:55:38.010131  196368 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:60 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:59 SystemTime:2022-05-09 08:55:37.925613578 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.13.0-1024-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexSer

verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662799872 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-14 Labels:[] ExperimentalBuild:false ServerVersion:20.10.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Clie

ntInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}

	I0509 08:55:38.010254  196368 start_flags.go:292] no existing cluster config was found, will generate one from the flags 

	I0509 08:55:38.010426  196368 start_flags.go:829] Wait components to verify : map[apiserver:true system_pods:true]

	I0509 08:55:38.012852  196368 out.go:177] * Using Docker driver with the root privilege

	I0509 08:55:38.014495  196368 cni.go:95] Creating CNI manager for ""

	I0509 08:55:38.014517  196368 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0509 08:55:38.014533  196368 start_flags.go:306] config:

	{Name:force-systemd-env-20220509085537-6723 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.0 ClusterName:force-systemd-env-20220509085537-6723 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster

.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}

	I0509 08:55:38.016699  196368 out.go:177] * Starting control plane node force-systemd-env-20220509085537-6723 in cluster force-systemd-env-20220509085537-6723

	I0509 08:55:38.018297  196368 cache.go:120] Beginning downloading kic base image for docker with docker

	I0509 08:55:38.019765  196368 out.go:177] * Pulling base image ...

	I0509 08:55:38.021243  196368 preload.go:132] Checking if preload exists for k8s version v1.24.0 and runtime docker

	I0509 08:55:38.021292  196368 preload.go:148] Found local preload: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.0-docker-overlay2-amd64.tar.lz4

	I0509 08:55:38.021315  196368 cache.go:57] Caching tarball of preloaded images

	I0509 08:55:38.021346  196368 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 in local docker daemon

	I0509 08:55:38.021563  196368 preload.go:174] Found /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0509 08:55:38.021588  196368 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.0 on docker

	I0509 08:55:38.021695  196368 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/force-systemd-env-20220509085537-6723/config.json ...

	I0509 08:55:38.021726  196368 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/force-systemd-env-20220509085537-6723/config.json: {Name:mk10b892bd3145ed5729c135fc9d141fe4000a6d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0509 08:55:38.066796  196368 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 in local docker daemon, skipping pull

	I0509 08:55:38.066831  196368 cache.go:141] gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 exists in daemon, skipping load

	I0509 08:55:38.066853  196368 cache.go:206] Successfully downloaded all kic artifacts

	I0509 08:55:38.066883  196368 start.go:352] acquiring machines lock for force-systemd-env-20220509085537-6723: {Name:mk86ae22ada434fcb6df3584d0f985a8229f2ce0 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0509 08:55:38.067770  196368 start.go:356] acquired machines lock for "force-systemd-env-20220509085537-6723" in 862.689µs

	I0509 08:55:38.067813  196368 start.go:91] Provisioning new machine with config: &{Name:force-systemd-env-20220509085537-6723 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 Memory:2048 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.0 ClusterName:force-systemd-env-20220509085537-6723 Namespace:de

fault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false} &{Name: IP: Port:8443 KubernetesVersion:v1

.24.0 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0509 08:55:38.067923  196368 start.go:131] createHost starting for "" (driver="docker")

	I0509 08:55:38.070129  196368 out.go:204] * Creating docker container (CPUs=2, Memory=2048MB) ...

	I0509 08:55:38.070378  196368 start.go:165] libmachine.API.Create for "force-systemd-env-20220509085537-6723" (driver="docker")

	I0509 08:55:38.070413  196368 client.go:168] LocalClient.Create starting

	I0509 08:55:38.070491  196368 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem

	I0509 08:55:38.070528  196368 main.go:134] libmachine: Decoding PEM data...

	I0509 08:55:38.070552  196368 main.go:134] libmachine: Parsing certificate...

	I0509 08:55:38.070630  196368 main.go:134] libmachine: Reading certificate data from /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/cert.pem

	I0509 08:55:38.070657  196368 main.go:134] libmachine: Decoding PEM data...

	I0509 08:55:38.070670  196368 main.go:134] libmachine: Parsing certificate...

	I0509 08:55:38.071004  196368 cli_runner.go:164] Run: docker network inspect force-systemd-env-20220509085537-6723 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W0509 08:55:38.107366  196368 cli_runner.go:211] docker network inspect force-systemd-env-20220509085537-6723 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I0509 08:55:38.107469  196368 network_create.go:272] running [docker network inspect force-systemd-env-20220509085537-6723] to gather additional debugging logs...

	I0509 08:55:38.107498  196368 cli_runner.go:164] Run: docker network inspect force-systemd-env-20220509085537-6723

	W0509 08:55:38.141798  196368 cli_runner.go:211] docker network inspect force-systemd-env-20220509085537-6723 returned with exit code 1

	I0509 08:55:38.141838  196368 network_create.go:275] error running [docker network inspect force-systemd-env-20220509085537-6723]: docker network inspect force-systemd-env-20220509085537-6723: exit status 1

	stdout:

	[]

	stderr:

	Error: No such network: force-systemd-env-20220509085537-6723

	I0509 08:55:38.141859  196368 network_create.go:277] output of [docker network inspect force-systemd-env-20220509085537-6723]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error: No such network: force-systemd-env-20220509085537-6723

	** /stderr **

	I0509 08:55:38.141906  196368 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I0509 08:55:38.199301  196368 network.go:240] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName:br-05654064b3d6 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:d0:03:24:57}}

	I0509 08:55:38.200015  196368 network.go:288] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.58.0:0xc0006184e0] misses:0}

	I0509 08:55:38.200063  196368 network.go:235] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}

	I0509 08:55:38.200084  196368 network_create.go:115] attempt to create docker network force-systemd-env-20220509085537-6723 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ...

	I0509 08:55:38.200147  196368 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true force-systemd-env-20220509085537-6723

	I0509 08:55:38.280367  196368 network_create.go:99] docker network force-systemd-env-20220509085537-6723 192.168.58.0/24 created

	I0509 08:55:38.280407  196368 kic.go:106] calculated static IP "192.168.58.2" for the "force-systemd-env-20220509085537-6723" container

	I0509 08:55:38.280475  196368 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I0509 08:55:38.344181  196368 cli_runner.go:164] Run: docker volume create force-systemd-env-20220509085537-6723 --label name.minikube.sigs.k8s.io=force-systemd-env-20220509085537-6723 --label created_by.minikube.sigs.k8s.io=true

	I0509 08:55:38.382960  196368 oci.go:103] Successfully created a docker volume force-systemd-env-20220509085537-6723

	I0509 08:55:38.383049  196368 cli_runner.go:164] Run: docker run --rm --name force-systemd-env-20220509085537-6723-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-env-20220509085537-6723 --entrypoint /usr/bin/test -v force-systemd-env-20220509085537-6723:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -d /var/lib

	I0509 08:55:40.809302  196368 cli_runner.go:217] Completed: docker run --rm --name force-systemd-env-20220509085537-6723-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-env-20220509085537-6723 --entrypoint /usr/bin/test -v force-systemd-env-20220509085537-6723:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -d /var/lib: (2.426207207s)

	I0509 08:55:40.809336  196368 oci.go:107] Successfully prepared a docker volume force-systemd-env-20220509085537-6723

	I0509 08:55:40.809383  196368 preload.go:132] Checking if preload exists for k8s version v1.24.0 and runtime docker

	I0509 08:55:40.809409  196368 kic.go:179] Starting extracting preloaded images to volume ...

	I0509 08:55:40.809480  196368 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v force-systemd-env-20220509085537-6723:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -I lz4 -xf /preloaded.tar -C /extractDir

	I0509 08:55:47.766458  196368 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.0-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v force-systemd-env-20220509085537-6723:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 -I lz4 -xf /preloaded.tar -C /extractDir: (6.956920871s)

	I0509 08:55:47.766503  196368 kic.go:188] duration metric: took 6.957088 seconds to extract preloaded images to volume

	W0509 08:55:47.766554  196368 oci.go:136] Your kernel does not support swap limit capabilities or the cgroup is not mounted.

	W0509 08:55:47.766568  196368 oci.go:120] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	I0509 08:55:47.766620  196368 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"

	I0509 08:55:47.877765  196368 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname force-systemd-env-20220509085537-6723 --name force-systemd-env-20220509085537-6723 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=force-systemd-env-20220509085537-6723 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=force-systemd-env-20220509085537-6723 --network force-systemd-env-20220509085537-6723 --ip 192.168.58.2 --volume force-systemd-env-20220509085537-6723:/var --security-opt apparmor=unconfined --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5

	I0509 08:55:48.344543  196368 cli_runner.go:164] Run: docker container inspect force-systemd-env-20220509085537-6723 --format={{.State.Running}}

	I0509 08:55:48.379539  196368 cli_runner.go:164] Run: docker container inspect force-systemd-env-20220509085537-6723 --format={{.State.Status}}

	I0509 08:55:48.415667  196368 cli_runner.go:164] Run: docker exec force-systemd-env-20220509085537-6723 stat /var/lib/dpkg/alternatives/iptables

	I0509 08:55:48.479300  196368 oci.go:279] the created container "force-systemd-env-20220509085537-6723" has a running status.

	I0509 08:55:48.479375  196368 kic.go:210] Creating ssh key for kic: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/force-systemd-env-20220509085537-6723/id_rsa...

	I0509 08:55:48.605398  196368 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/force-systemd-env-20220509085537-6723/id_rsa.pub -> /home/docker/.ssh/authorized_keys

	I0509 08:55:48.605454  196368 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/force-systemd-env-20220509085537-6723/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)

	I0509 08:55:48.716015  196368 cli_runner.go:164] Run: docker container inspect force-systemd-env-20220509085537-6723 --format={{.State.Status}}

	I0509 08:55:48.758880  196368 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys

	I0509 08:55:48.758907  196368 kic_runner.go:114] Args: [docker exec --privileged force-systemd-env-20220509085537-6723 chown docker:docker /home/docker/.ssh/authorized_keys]

	I0509 08:55:48.864819  196368 cli_runner.go:164] Run: docker container inspect force-systemd-env-20220509085537-6723 --format={{.State.Status}}

	I0509 08:55:48.907919  196368 machine.go:88] provisioning docker machine ...

	I0509 08:55:48.907966  196368 ubuntu.go:169] provisioning hostname "force-systemd-env-20220509085537-6723"

	I0509 08:55:48.908041  196368 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-20220509085537-6723

	I0509 08:55:48.945952  196368 main.go:134] libmachine: Using SSH client type: native

	I0509 08:55:48.946126  196368 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7d8f60] 0x7dbfc0 <nil>  [] 0s} 127.0.0.1 49334 <nil> <nil>}

	I0509 08:55:48.946144  196368 main.go:134] libmachine: About to run SSH command:

	sudo hostname force-systemd-env-20220509085537-6723 && echo "force-systemd-env-20220509085537-6723" | sudo tee /etc/hostname

	I0509 08:55:49.090740  196368 main.go:134] libmachine: SSH cmd err, output: <nil>: force-systemd-env-20220509085537-6723

	I0509 08:55:49.090838  196368 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-20220509085537-6723

	I0509 08:55:49.126542  196368 main.go:134] libmachine: Using SSH client type: native

	I0509 08:55:49.126691  196368 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7d8f60] 0x7dbfc0 <nil>  [] 0s} 127.0.0.1 49334 <nil> <nil>}

	I0509 08:55:49.126712  196368 main.go:134] libmachine: About to run SSH command:

			if ! grep -xq '.*\sforce-systemd-env-20220509085537-6723' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 force-systemd-env-20220509085537-6723/g' /etc/hosts;

				else 

					echo '127.0.1.1 force-systemd-env-20220509085537-6723' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0509 08:55:49.252900  196368 main.go:134] libmachine: SSH cmd err, output: <nil>: 

	I0509 08:55:49.252933  196368 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube CaCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/key.pem ServerCertR

emotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube}

	I0509 08:55:49.252991  196368 ubuntu.go:177] setting up certificates

	I0509 08:55:49.253008  196368 provision.go:83] configureAuth start

	I0509 08:55:49.253077  196368 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" force-systemd-env-20220509085537-6723

	I0509 08:55:49.291741  196368 provision.go:138] copyHostCerts

	I0509 08:55:49.291789  196368 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.pem

	I0509 08:55:49.291823  196368 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.pem, removing ...

	I0509 08:55:49.291832  196368 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.pem

	I0509 08:55:49.291915  196368 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/ca.pem (1078 bytes)

	I0509 08:55:49.292001  196368 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cert.pem

	I0509 08:55:49.292031  196368 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cert.pem, removing ...

	I0509 08:55:49.292038  196368 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cert.pem

	I0509 08:55:49.292076  196368 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cert.pem (1123 bytes)

	I0509 08:55:49.292128  196368 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/key.pem

	I0509 08:55:49.292151  196368 exec_runner.go:144] found /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/key.pem, removing ...

	I0509 08:55:49.292157  196368 exec_runner.go:207] rm: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/key.pem

	I0509 08:55:49.292200  196368 exec_runner.go:151] cp: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/key.pem (1679 bytes)

	I0509 08:55:49.292285  196368 provision.go:112] generating server cert: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca-key.pem org=jenkins.force-systemd-env-20220509085537-6723 san=[192.168.58.2 127.0.0.1 localhost 127.0.0.1 minikube force-systemd-env-20220509085537-6723]

	I0509 08:55:49.356514  196368 provision.go:172] copyRemoteCerts

	I0509 08:55:49.356589  196368 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0509 08:55:49.356645  196368 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-20220509085537-6723

	I0509 08:55:49.395783  196368 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49334 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/force-systemd-env-20220509085537-6723/id_rsa Username:docker}

	I0509 08:55:49.491123  196368 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0509 08:55:49.491203  196368 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0509 08:55:49.509862  196368 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0509 08:55:49.509921  196368 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server.pem --> /etc/docker/server.pem (1281 bytes)

	I0509 08:55:49.527412  196368 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0509 08:55:49.527479  196368 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0509 08:55:49.545053  196368 provision.go:86] duration metric: configureAuth took 292.027386ms

	I0509 08:55:49.545089  196368 ubuntu.go:193] setting minikube options for container-runtime

	I0509 08:55:49.545232  196368 config.go:178] Loaded profile config "force-systemd-env-20220509085537-6723": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.24.0

	I0509 08:55:49.545279  196368 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-20220509085537-6723

	I0509 08:55:49.582582  196368 main.go:134] libmachine: Using SSH client type: native

	I0509 08:55:49.582797  196368 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7d8f60] 0x7dbfc0 <nil>  [] 0s} 127.0.0.1 49334 <nil> <nil>}

	I0509 08:55:49.582818  196368 main.go:134] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0509 08:55:49.705852  196368 main.go:134] libmachine: SSH cmd err, output: <nil>: overlay

	I0509 08:55:49.705879  196368 ubuntu.go:71] root file system type: overlay

	I0509 08:55:49.706052  196368 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ...

	I0509 08:55:49.706121  196368 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-20220509085537-6723

	I0509 08:55:49.741030  196368 main.go:134] libmachine: Using SSH client type: native

	I0509 08:55:49.741181  196368 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7d8f60] 0x7dbfc0 <nil>  [] 0s} 127.0.0.1 49334 <nil> <nil>}

	I0509 08:55:49.741247  196368 main.go:134] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0509 08:55:49.870685  196368 main.go:134] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	BindsTo=containerd.service

	After=network-online.target firewalld.service containerd.service

	Wants=network-online.target

	Requires=docker.socket

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0509 08:55:49.870772  196368 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-20220509085537-6723

	I0509 08:55:49.903746  196368 main.go:134] libmachine: Using SSH client type: native

	I0509 08:55:49.903914  196368 main.go:134] libmachine: &{{{<nil> 0 [] [] []} docker [0x7d8f60] 0x7dbfc0 <nil>  [] 0s} 127.0.0.1 49334 <nil> <nil>}

	I0509 08:55:49.903943  196368 main.go:134] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0509 08:55:50.644341  196368 main.go:134] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service	2022-03-10 14:05:44.000000000 +0000

	+++ /lib/systemd/system/docker.service.new	2022-05-09 08:55:49.867436341 +0000

	@@ -1,30 +1,32 @@

	 [Unit]

	 Description=Docker Application Container Engine

	 Documentation=https://docs.docker.com

	-After=network-online.target docker.socket firewalld.service containerd.service

	+BindsTo=containerd.service

	+After=network-online.target firewalld.service containerd.service

	 Wants=network-online.target

	-Requires=docker.socket containerd.service

	+Requires=docker.socket

	+StartLimitBurst=3

	+StartLimitIntervalSec=60

	 [Service]

	 Type=notify

	-# the default is not to use systemd for cgroups because the delegate issues still

	-# exists and systemd currently does not support the cgroup feature set required

	-# for containers run by docker

	-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock

	-ExecReload=/bin/kill -s HUP $MAINPID

	-TimeoutSec=0

	-RestartSec=2

	-Restart=always

	-

	-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.

	-# Both the old, and new location are accepted by systemd 229 and up, so using the old location

	-# to make them work for either version of systemd.

	-StartLimitBurst=3

	+Restart=on-failure

	-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.

	-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make

	-# this option work for either version of systemd.

	-StartLimitInterval=60s

	+

	+

	+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	+# The base configuration already specifies an 'ExecStart=...' command. The first directive

	+# here is to clear out that command inherited from the base configuration. Without this,

	+# the command from the base configuration and the command specified here are treated as

	+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	+# will catch this invalid input and refuse to start the service with an error like:

	+#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	+

	+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	+ExecStart=

	+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 

	+ExecReload=/bin/kill -s HUP $MAINPID

	 # Having non-zero Limit*s causes performance problems due to accounting overhead

	 # in the kernel. We recommend using cgroups to do container-local accounting.

	@@ -32,16 +34,16 @@

	 LimitNPROC=infinity

	 LimitCORE=infinity

	-# Comment TasksMax if your systemd version does not support it.

	-# Only systemd 226 and above support this option.

	+# Uncomment TasksMax if your systemd version supports it.

	+# Only systemd 226 and above support this version.

	 TasksMax=infinity

	+TimeoutStartSec=0

	 # set delegate yes so that systemd does not reset the cgroups of docker containers

	 Delegate=yes

	 # kill only the docker process, not all processes in the cgroup

	 KillMode=process

	-OOMScoreAdjust=-500

	 [Install]

	 WantedBy=multi-user.target

	Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.

	Executing: /lib/systemd/systemd-sysv-install enable docker

	I0509 08:55:50.644381  196368 machine.go:91] provisioned docker machine in 1.736433606s

	I0509 08:55:50.644392  196368 client.go:171] LocalClient.Create took 12.573966653s

	I0509 08:55:50.644405  196368 start.go:173] duration metric: libmachine.API.Create for "force-systemd-env-20220509085537-6723" took 12.574027437s

	I0509 08:55:50.644419  196368 start.go:306] post-start starting for "force-systemd-env-20220509085537-6723" (driver="docker")

	I0509 08:55:50.644425  196368 start.go:316] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0509 08:55:50.644490  196368 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0509 08:55:50.644538  196368 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-20220509085537-6723

	I0509 08:55:50.680061  196368 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49334 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/force-systemd-env-20220509085537-6723/id_rsa Username:docker}

	I0509 08:55:50.773248  196368 ssh_runner.go:195] Run: cat /etc/os-release

	I0509 08:55:50.776455  196368 main.go:134] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I0509 08:55:50.776487  196368 main.go:134] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I0509 08:55:50.776500  196368 main.go:134] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I0509 08:55:50.776507  196368 info.go:137] Remote host: Ubuntu 20.04.4 LTS

	I0509 08:55:50.776524  196368 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/addons for local assets ...

	I0509 08:55:50.776588  196368 filesync.go:126] Scanning /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/files for local assets ...

	I0509 08:55:50.776718  196368 filesync.go:149] local asset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/files/etc/ssl/certs/67232.pem -> 67232.pem in /etc/ssl/certs

	I0509 08:55:50.776742  196368 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/files/etc/ssl/certs/67232.pem -> /etc/ssl/certs/67232.pem

	I0509 08:55:50.776849  196368 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0509 08:55:50.785725  196368 ssh_runner.go:362] scp /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/files/etc/ssl/certs/67232.pem --> /etc/ssl/certs/67232.pem (1708 bytes)

	I0509 08:55:50.809266  196368 start.go:309] post-start completed in 164.834174ms

	I0509 08:55:50.809673  196368 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" force-systemd-env-20220509085537-6723

	I0509 08:55:50.841875  196368 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/force-systemd-env-20220509085537-6723/config.json ...

	I0509 08:55:50.842118  196368 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0509 08:55:50.842165  196368 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-20220509085537-6723

	I0509 08:55:50.880732  196368 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49334 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/force-systemd-env-20220509085537-6723/id_rsa Username:docker}

	I0509 08:55:50.969884  196368 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0509 08:55:50.974997  196368 start.go:134] duration metric: createHost completed in 12.907058732s

	I0509 08:55:50.976810  196368 start.go:81] releasing machines lock for "force-systemd-env-20220509085537-6723", held for 12.908991953s

	I0509 08:55:50.977113  196368 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" force-systemd-env-20220509085537-6723

	I0509 08:55:51.016442  196368 ssh_runner.go:195] Run: systemctl --version

	I0509 08:55:51.016505  196368 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-20220509085537-6723

	I0509 08:55:51.016512  196368 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/

	I0509 08:55:51.016590  196368 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" force-systemd-env-20220509085537-6723

	I0509 08:55:51.049390  196368 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49334 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/force-systemd-env-20220509085537-6723/id_rsa Username:docker}

	I0509 08:55:51.049559  196368 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:49334 SSHKeyPath:/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/machines/force-systemd-env-20220509085537-6723/id_rsa Username:docker}

	I0509 08:55:51.154858  196368 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0509 08:55:51.165817  196368 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0509 08:55:51.176584  196368 cruntime.go:273] skipping containerd shutdown because we are bound to it

	I0509 08:55:51.176690  196368 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0509 08:55:51.188961  196368 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	image-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0509 08:55:51.205886  196368 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0509 08:55:51.289731  196368 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0509 08:55:51.377840  196368 docker.go:510] Forcing docker to use systemd as cgroup manager...

	I0509 08:55:51.377883  196368 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (143 bytes)

	I0509 08:55:51.397122  196368 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0509 08:55:51.476037  196368 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0509 08:55:51.750454  196368 start.go:447] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0509 08:55:51.750524  196368 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:55:51.757126  196368 retry.go:31] will retry after 1.104660288s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:55:52.862310  196368 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:55:52.866400  196368 retry.go:31] will retry after 2.160763633s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:55:55.028753  196368 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:55:55.032562  196368 retry.go:31] will retry after 2.62026012s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:55:57.653803  196368 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:55:57.657821  196368 retry.go:31] will retry after 3.164785382s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:56:00.824736  196368 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:56:00.828379  196368 retry.go:31] will retry after 4.680977329s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:56:05.510054  196368 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:56:05.513776  196368 retry.go:31] will retry after 9.01243771s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:56:14.527678  196368 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:56:14.531945  196368 retry.go:31] will retry after 6.442959172s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:56:20.976821  196368 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:56:20.981151  196368 retry.go:31] will retry after 11.217246954s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:56:32.200767  196368 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:56:32.204709  196368 retry.go:31] will retry after 15.299675834s: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	I0509 08:56:47.504771  196368 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0509 08:56:47.511505  196368 out.go:177] 

	W0509 08:56:47.513345  196368 out.go:239] X Exiting due to RUNTIME_ENABLE: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	X Exiting due to RUNTIME_ENABLE: stat /var/run/cri-dockerd.sock: Process exited with status 1

	stdout:

	stderr:

	stat: cannot stat '/var/run/cri-dockerd.sock': No such file or directory

	W0509 08:56:47.513377  196368 out.go:239] * 

	* 

	W0509 08:56:47.514144  196368 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0509 08:56:47.515704  196368 out.go:177] 

** /stderr **

docker_test.go:152: failed to start minikube with args: "out/minikube-linux-amd64 start -p force-systemd-env-20220509085537-6723 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=docker" : exit status 90

docker_test.go:104: (dbg) Run:  out/minikube-linux-amd64 -p force-systemd-env-20220509085537-6723 ssh "docker info --format {{.CgroupDriver}}"

docker_test.go:161: *** TestForceSystemdEnv FAILED at 2022-05-09 08:56:48.075608514 +0000 UTC m=+1933.519189129

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestForceSystemdEnv]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect force-systemd-env-20220509085537-6723

helpers_test.go:235: (dbg) docker inspect force-systemd-env-20220509085537-6723:

-- stdout --

	[

	    {

	        "Id": "7faf13aee668810657bc38da03e782404edd02cc3bdcc367d5e43eeb9de138cd",

	        "Created": "2022-05-09T08:55:47.915608725Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 198845,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2022-05-09T08:55:48.333527068Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:44d43b69f3d5ba7f801dca891b535f23f9839671e82277938ec7dc42a22c50d6",

	        "ResolvConfPath": "/var/lib/docker/containers/7faf13aee668810657bc38da03e782404edd02cc3bdcc367d5e43eeb9de138cd/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/7faf13aee668810657bc38da03e782404edd02cc3bdcc367d5e43eeb9de138cd/hostname",

	        "HostsPath": "/var/lib/docker/containers/7faf13aee668810657bc38da03e782404edd02cc3bdcc367d5e43eeb9de138cd/hosts",

	        "LogPath": "/var/lib/docker/containers/7faf13aee668810657bc38da03e782404edd02cc3bdcc367d5e43eeb9de138cd/7faf13aee668810657bc38da03e782404edd02cc3bdcc367d5e43eeb9de138cd-json.log",

	        "Name": "/force-systemd-env-20220509085537-6723",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "unconfined",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "force-systemd-env-20220509085537-6723:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "force-systemd-env-20220509085537-6723",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 0,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 0,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/2e69a9b27bacdb52367e9be11f9690d0b792694998b22f018de0a9812af62737-init/diff:/var/lib/docker/overlay2/beaaca4c58fe6ff4bdb88567c3d78ab7a23955eafaa5637df03ee2e0482d2aa6/diff:/var/lib/docker/overlay2/7c16b810bbfa3a2abff75078fa37b4cba0b2f101ff43d49beaabc3fd2602b1c9/diff:/var/lib/docker/overlay2/60f04c0e4baa8ad1c02ae5e34e6f505db0d740e2d7dc0833b2ff3b8037c1a9b6/diff:/var/lib/docker/overlay2/a12543300ae4ff803b2f0493a60a04a921312ec5a7b6ed493e66acadf998daef/diff:/var/lib/docker/overlay2/2d68f658a64cd8b7255bce93547db5d1b20b119ef6da8b9ce06614134661f235/diff:/var/lib/docker/overlay2/0f968f210c1565f6e8c4e444c650502c06a120d8767c9fefb7b6b2a09f4af83b/diff:/var/lib/docker/overlay2/987a67893acdccd514357a50db6c11680ae1899ec07a36085367a241ba1f0545/diff:/var/lib/docker/overlay2/d5446d1adc007f4390aa6173ef257b0bf52a9c9cc6533f16dd6c577fde5334b3/diff:/var/lib/docker/overlay2/265dd0cde77d578f6412ad48596c75c3548b5e077059c0fa835e4f22775fab83/diff:/var/lib/docker/overlay2/e6b98b

08dd64e06639e2a321169f84a89e8d21cea02d673819156eeb7a4747c3/diff:/var/lib/docker/overlay2/acf7117613a840e97b7a1101bfdce3a154a335ee0ffcaf74bd7f1b27b00cdaab/diff:/var/lib/docker/overlay2/9e88fa64aa800dac6e01eddc9cfd525a0dcd906c1adf98de066be87f87a6b52c/diff:/var/lib/docker/overlay2/6c539edead197cd449ca81fd34e3c534a6ca25446a52141d0ae4484aaac05482/diff:/var/lib/docker/overlay2/866719c52f41a692b94f42071d314de55b290912f946f4ec5f3785a7a5ae40df/diff:/var/lib/docker/overlay2/1c488a9b3bad141652873f4085ce1a466e1f1e8ccbd086d03a492b45179a6064/diff:/var/lib/docker/overlay2/bce5b942da09326e5a5c8595077544ced08031b1cd9b22ff8bff0a4458540139/diff:/var/lib/docker/overlay2/ffe34c3764a4eeac791f4672d47389ec3f399f716ab6e5531d7c5e587f3ace00/diff:/var/lib/docker/overlay2/a377e0779d03467b09a26898ae35b12f325d62984304817f49c693b2146c08f4/diff:/var/lib/docker/overlay2/6092380f07b29488cf0a30cb486638d86eaa8e00ff356a7985c6ac6f2fae5c1d/diff:/var/lib/docker/overlay2/1bc014cc0cf0a91c61f131c06b0194709f853dec23defe9233cbd9cc40030c28/diff:/var/lib/d

ocker/overlay2/0c81c4db7384c48318a800165af7f811348a8081efdd9dbd912e05e55c9eb4e0/diff:/var/lib/docker/overlay2/72b0c515d90bc71e27b766a9be89e315777a5bbe643d8fc508a9ae12557a58ce/diff:/var/lib/docker/overlay2/a4d193bf8c377d4cf1357b9261d3c54d995f17bda3db5abee3ef5caec001d75e/diff:/var/lib/docker/overlay2/763c6d291074b0842ecdeec1f3842fd6a0af0cb86839c82bc38cec0f40d095ca/diff:/var/lib/docker/overlay2/e4156eb2a94ac7136eb674fb8c22ea7f6dff50cd81e4857119d81112dc5ad99d/diff:/var/lib/docker/overlay2/be7effa3bb906b8c48aefab3cc72e657931bccd42c35b03bb52c679c37c70d25/diff:/var/lib/docker/overlay2/ccf8c1a68774cc6129c43490c675e6ba0ff0c88284ad899c9efb4b7492e92a06/diff:/var/lib/docker/overlay2/55f74cddb5c8f2da1131ddd67f7f2a20b8c2be8719b71047d5185fdb4722627d/diff:/var/lib/docker/overlay2/f6c38e83545e9de87d03b1e8e9b0239079acf47784afc11291b2172a11f8296d/diff:/var/lib/docker/overlay2/24604ce83180fcb6b9e1adbaf37db6776e4949ca5e1f4f9050b8fb8dc87d7591/diff:/var/lib/docker/overlay2/b03b1952bea32e53ce88b0d92d09f78ca76ceca0a146b088628be224813

ae87c/diff:/var/lib/docker/overlay2/d7ee02a5ba355c246c3107f286c4130457358aa56e0d8feb3850d953812fe76d/diff:/var/lib/docker/overlay2/1223ae0e5105ae89c78524490f0ccc5fe6dfa373e175fa70474b06c62aad91c7/diff:/var/lib/docker/overlay2/c3209d71eed94ed66b11ba3a7573c347d5c09a5a4fedb00418e52571abb2b5f9/diff:/var/lib/docker/overlay2/d6d32632e36023dec15e643fd41f77168442327cecdead87a47e70683cb0c660/diff:/var/lib/docker/overlay2/fd413b21f1f34027c98a1b4106f7e7db83e910860edd53ef838ac699659cd451/diff:/var/lib/docker/overlay2/9768e3244c157a7a12b8ec31507c1abc0fc806a9f325099262cfeb41e23a5fe1/diff:/var/lib/docker/overlay2/f65dda9d5b79903f5e68f6b9d4a59214d62f304da77faa7e148b90b402d98ca4/diff:/var/lib/docker/overlay2/b663c2dab6b5df7b606daa62e1df5e57f4a2503c2a9a19211f47359fd685dccf/diff:/var/lib/docker/overlay2/bbd620a7e494844db80a2bcd2fd6f170080c5273f1c33a576501214dd4475464/diff:/var/lib/docker/overlay2/23de36667695cec8ea0f4c98fc580213d356d39a3eba5aaab8b6ebeeb2b71596/diff:/var/lib/docker/overlay2/bafb3e8d91e83dcf824b6d5b3f56a67c483c42

723724b009a5aedf578351154f/diff:/var/lib/docker/overlay2/2798e8ce2f51dde257a9cf2dd800492f888fd02515c5f1de4133cc787ee12928/diff:/var/lib/docker/overlay2/e69a88f2dffdd2c7f72c45eaf2e3cd1a8772e0a2af22d6f34d2695bbda62b6e9/diff:/var/lib/docker/overlay2/708816f20892c0e4b94cbe8e80b169fff54ffd870bcde395bd8163dd03b25d0f/diff",

	                "MergedDir": "/var/lib/docker/overlay2/2e69a9b27bacdb52367e9be11f9690d0b792694998b22f018de0a9812af62737/merged",

	                "UpperDir": "/var/lib/docker/overlay2/2e69a9b27bacdb52367e9be11f9690d0b792694998b22f018de0a9812af62737/diff",

	                "WorkDir": "/var/lib/docker/overlay2/2e69a9b27bacdb52367e9be11f9690d0b792694998b22f018de0a9812af62737/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "force-systemd-env-20220509085537-6723",

	                "Source": "/var/lib/docker/volumes/force-systemd-env-20220509085537-6723/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "force-systemd-env-20220509085537-6723",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "force-systemd-env-20220509085537-6723",

	                "name.minikube.sigs.k8s.io": "force-systemd-env-20220509085537-6723",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "81ff9db1c4dead6edf835c240df1a91ef8282049955a0524b5f26fbdd3924f56",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "49334"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "49333"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "49330"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "49332"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "49331"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/81ff9db1c4de",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "force-systemd-env-20220509085537-6723": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.58.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "7faf13aee668",

	                        "force-systemd-env-20220509085537-6723"

	                    ],

	                    "NetworkID": "010984d42916aa4062269c1b5f71c7d96c1b1b58a0d12df1d65abb048a73a54d",

	                    "EndpointID": "b37e72efa617abdec318b406922b62a4193d6544c5354f004c7b66e0b15b296b",

	                    "Gateway": "192.168.58.1",

	                    "IPAddress": "192.168.58.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:3a:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p force-systemd-env-20220509085537-6723 -n force-systemd-env-20220509085537-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p force-systemd-env-20220509085537-6723 -n force-systemd-env-20220509085537-6723: exit status 6 (448.611476ms)

-- stdout --

	Running

	WARNING: Your kubectl is pointing to stale minikube-vm.

	To fix the kubectl context, run `minikube update-context`

-- /stdout --

** stderr ** 

	E0509 08:56:48.565252  215869 status.go:413] kubeconfig endpoint: extract IP: "force-systemd-env-20220509085537-6723" does not appear in /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/kubeconfig

** /stderr **

helpers_test.go:239: status error: exit status 6 (may be ok)

helpers_test.go:241: "force-systemd-env-20220509085537-6723" host is not running, skipping log retrieval (state="Running\nWARNING: Your kubectl is pointing to stale minikube-vm.\nTo fix the kubectl context, run `minikube update-context`")

helpers_test.go:175: Cleaning up "force-systemd-env-20220509085537-6723" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p force-systemd-env-20220509085537-6723

helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-env-20220509085537-6723: (2.255150768s)

--- FAIL: TestForceSystemdEnv (73.19s)

=== RUN   TestKubernetesUpgrade

=== PAUSE TestKubernetesUpgrade

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:229: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-20220509085441-6723 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:229: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-20220509085441-6723 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: (42.462160384s)

version_upgrade_test.go:234: (dbg) Run:  out/minikube-linux-amd64 stop -p kubernetes-upgrade-20220509085441-6723

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:234: (dbg) Done: out/minikube-linux-amd64 stop -p kubernetes-upgrade-20220509085441-6723: (11.256988315s)

version_upgrade_test.go:239: (dbg) Run:  out/minikube-linux-amd64 -p kubernetes-upgrade-20220509085441-6723 status --format={{.Host}}

version_upgrade_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 -p kubernetes-upgrade-20220509085441-6723 status --format={{.Host}}: exit status 7 (132.152986ms)

-- stdout --

	Stopped

-- /stdout --

version_upgrade_test.go:241: status error: exit status 7 (may be ok)

version_upgrade_test.go:250: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-20220509085441-6723 --memory=2200 --kubernetes-version=v1.24.1-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker

=== CONT  TestKubernetesUpgrade

version_upgrade_test.go:250: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p kubernetes-upgrade-20220509085441-6723 --memory=2200 --kubernetes-version=v1.24.1-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker: exit status 80 (15.974032823s)

-- stdout --

	* [kubernetes-upgrade-20220509085441-6723] minikube v1.25.2 on Ubuntu 20.04 (kvm/amd64)

	  - MINIKUBE_LOCATION=14070

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/kubeconfig

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	* Using the docker driver based on existing profile

	  - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	  - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	* Starting control plane node kubernetes-upgrade-20220509085441-6723 in cluster kubernetes-upgrade-20220509085441-6723

	* Pulling base image ...

	* Restarting existing docker container for "kubernetes-upgrade-20220509085441-6723" ...

	* Restarting existing docker container for "kubernetes-upgrade-20220509085441-6723" ...

-- /stdout --

** stderr ** 

	I0509 08:55:35.711295  195809 out.go:296] Setting OutFile to fd 1 ...

	I0509 08:55:35.711434  195809 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0509 08:55:35.711446  195809 out.go:309] Setting ErrFile to fd 2...

	I0509 08:55:35.711455  195809 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0509 08:55:35.711620  195809 root.go:322] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/bin

	I0509 08:55:35.711945  195809 out.go:303] Setting JSON to false

	I0509 08:55:35.714222  195809 start.go:115] hostinfo: {"hostname":"ubuntu-20-agent-14","uptime":2290,"bootTime":1652084246,"procs":1138,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.13.0-1024-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0509 08:55:35.714317  195809 start.go:125] virtualization: kvm guest

	I0509 08:55:35.717775  195809 out.go:177] * [kubernetes-upgrade-20220509085441-6723] minikube v1.25.2 on Ubuntu 20.04 (kvm/amd64)

	I0509 08:55:35.719610  195809 out.go:177]   - MINIKUBE_LOCATION=14070

	I0509 08:55:35.719552  195809 notify.go:193] Checking for updates...

	I0509 08:55:35.722772  195809 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0509 08:55:35.724381  195809 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/kubeconfig

	I0509 08:55:35.725979  195809 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube

	I0509 08:55:35.727691  195809 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0509 08:55:35.729731  195809 config.go:178] Loaded profile config "kubernetes-upgrade-20220509085441-6723": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.16.0

	I0509 08:55:35.730391  195809 driver.go:346] Setting default libvirt URI to qemu:///system

	I0509 08:55:35.779271  195809 docker.go:137] docker version: linux-20.10.15

	I0509 08:55:35.779389  195809 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0509 08:55:35.901041  195809 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:60 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:61 SystemTime:2022-05-09 08:55:35.81254138 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.13.0-1024-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexServ

erAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662799872 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-14 Labels:[] ExperimentalBuild:false ServerVersion:20.10.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Clien

tInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}

	I0509 08:55:35.901203  195809 docker.go:254] overlay module found

	I0509 08:55:35.904120  195809 out.go:177] * Using the docker driver based on existing profile

	I0509 08:55:35.905546  195809 start.go:284] selected driver: docker

	I0509 08:55:35.905569  195809 start.go:801] validating driver "docker" against &{Name:kubernetes-upgrade-20220509085441-6723 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:kubernetes-upgrade-20220509085441-6723 Namespace:de

fault APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.58.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Di

sableMetrics:false}

	I0509 08:55:35.905701  195809 start.go:812] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	W0509 08:55:35.905745  195809 oci.go:120] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W0509 08:55:35.905770  195809 out.go:239] ! Your cgroup does not allow setting memory.

	! Your cgroup does not allow setting memory.

	I0509 08:55:35.907167  195809 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I0509 08:55:35.909287  195809 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0509 08:55:36.032732  195809 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:60 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:59 SystemTime:2022-05-09 08:55:35.943765594 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.13.0-1024-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexSer

verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662799872 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-14 Labels:[] ExperimentalBuild:false ServerVersion:20.10.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Clie

ntInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}

	W0509 08:55:36.032932  195809 oci.go:120] Your kernel does not support memory limit capabilities or the cgroup is not mounted.

	W0509 08:55:36.032958  195809 out.go:239] ! Your cgroup does not allow setting memory.

	! Your cgroup does not allow setting memory.

	I0509 08:55:36.035313  195809 out.go:177]   - More information: https://docs.docker.com/engine/install/linux-postinstall/#your-kernel-does-not-support-cgroup-swap-limit-capabilities

	I0509 08:55:36.036974  195809 cni.go:95] Creating CNI manager for ""

	I0509 08:55:36.037006  195809 cni.go:169] CNI unnecessary in this configuration, recommending no CNI

	I0509 08:55:36.037019  195809 start_flags.go:306] config:

	{Name:kubernetes-upgrade-20220509085441-6723 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1-rc.0 ClusterName:kubernetes-upgrade-20220509085441-6723 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:

cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.58.2 Port:8443 KubernetesVersion:v1.16.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false}

	I0509 08:55:36.038914  195809 out.go:177] * Starting control plane node kubernetes-upgrade-20220509085441-6723 in cluster kubernetes-upgrade-20220509085441-6723

	I0509 08:55:36.040286  195809 cache.go:120] Beginning downloading kic base image for docker with docker

	I0509 08:55:36.041998  195809 out.go:177] * Pulling base image ...

	I0509 08:55:36.043365  195809 preload.go:132] Checking if preload exists for k8s version v1.24.1-rc.0 and runtime docker

	I0509 08:55:36.043488  195809 image.go:75] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 in local docker daemon

	I0509 08:55:36.087201  195809 image.go:79] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 in local docker daemon, skipping pull

	I0509 08:55:36.087230  195809 cache.go:141] gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5 exists in daemon, skipping load

	W0509 08:55:36.137322  195809 preload.go:115] https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.24.1-rc.0/preloaded-images-k8s-v18-v1.24.1-rc.0-docker-overlay2-amd64.tar.lz4 status code: 404

	I0509 08:55:36.137474  195809 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/kubernetes-upgrade-20220509085441-6723/config.json ...

	I0509 08:55:36.137532  195809 cache.go:107] acquiring lock: {Name:mk1569f6206cc0716265219e09c430414472b598 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0509 08:55:36.137584  195809 cache.go:107] acquiring lock: {Name:mk75fa60ea4c6bd12e5117018b2138616318dcf6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0509 08:55:36.137582  195809 cache.go:107] acquiring lock: {Name:mk02b239292b1330548320cb0856f2d5bd377dd7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0509 08:55:36.137628  195809 cache.go:107] acquiring lock: {Name:mk69f40cd6bee92acb0de362041daeb54b4baad2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0509 08:55:36.137550  195809 cache.go:107] acquiring lock: {Name:mk2079e3af58e09016e3aa56ce438b7135b6a1e8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0509 08:55:36.137662  195809 cache.go:107] acquiring lock: {Name:mk0034a75f0a91d03aa12d52ea9bd59e9bf92418 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0509 08:55:36.137662  195809 cache.go:107] acquiring lock: {Name:mk3fd38b6eabac2624d636789aa7e8b99c525e7d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0509 08:55:36.137758  195809 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists

	I0509 08:55:36.137781  195809 cache.go:206] Successfully downloaded all kic artifacts

	I0509 08:55:36.137781  195809 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 258.521µs

	I0509 08:55:36.137794  195809 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded

	I0509 08:55:36.137795  195809 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/coredns/coredns_v1.8.6 exists

	I0509 08:55:36.137551  195809 cache.go:107] acquiring lock: {Name:mk7b0f925d4840d486112d2d0a793ba574df1329 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0509 08:55:36.137810  195809 start.go:352] acquiring machines lock for kubernetes-upgrade-20220509085441-6723: {Name:mk4b33cce4d6cf1758fd22377d4a179c0c038c8f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0509 08:55:36.137819  195809 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/kube-scheduler_v1.24.1-rc.0 exists

	I0509 08:55:36.137826  195809 cache.go:96] cache image "k8s.gcr.io/coredns/coredns:v1.8.6" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/coredns/coredns_v1.8.6" took 165.244µs

	I0509 08:55:36.137844  195809 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/etcd_3.5.3-0 exists

	I0509 08:55:36.137851  195809 cache.go:80] save to tar file k8s.gcr.io/coredns/coredns:v1.8.6 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/coredns/coredns_v1.8.6 succeeded

	I0509 08:55:36.137834  195809 cache.go:96] cache image "k8s.gcr.io/kube-scheduler:v1.24.1-rc.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/kube-scheduler_v1.24.1-rc.0" took 251.87µs

	I0509 08:55:36.137865  195809 cache.go:80] save to tar file k8s.gcr.io/kube-scheduler:v1.24.1-rc.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/kube-scheduler_v1.24.1-rc.0 succeeded

	I0509 08:55:36.137859  195809 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/pause_3.7 exists

	I0509 08:55:36.137873  195809 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/kube-apiserver_v1.24.1-rc.0 exists

	I0509 08:55:36.137879  195809 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/kube-proxy_v1.24.1-rc.0 exists

	I0509 08:55:36.137868  195809 cache.go:96] cache image "k8s.gcr.io/etcd:3.5.3-0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/etcd_3.5.3-0" took 327.253µs

	I0509 08:55:36.137891  195809 cache.go:80] save to tar file k8s.gcr.io/etcd:3.5.3-0 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/etcd_3.5.3-0 succeeded

	I0509 08:55:36.137880  195809 start.go:356] acquired machines lock for "kubernetes-upgrade-20220509085441-6723" in 58.016µs

	I0509 08:55:36.137891  195809 cache.go:96] cache image "k8s.gcr.io/pause:3.7" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/pause_3.7" took 310.854µs

	I0509 08:55:36.137903  195809 cache.go:80] save to tar file k8s.gcr.io/pause:3.7 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/pause_3.7 succeeded

	I0509 08:55:36.137907  195809 start.go:94] Skipping create...Using existing machine configuration

	I0509 08:55:36.137898  195809 cache.go:96] cache image "k8s.gcr.io/kube-proxy:v1.24.1-rc.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/kube-proxy_v1.24.1-rc.0" took 371.35µs

	I0509 08:55:36.137897  195809 cache.go:96] cache image "k8s.gcr.io/kube-apiserver:v1.24.1-rc.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/kube-apiserver_v1.24.1-rc.0" took 238.149µs

	I0509 08:55:36.137915  195809 fix.go:55] fixHost starting: 

	I0509 08:55:36.137918  195809 cache.go:80] save to tar file k8s.gcr.io/kube-proxy:v1.24.1-rc.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/kube-proxy_v1.24.1-rc.0 succeeded

	I0509 08:55:36.137919  195809 cache.go:80] save to tar file k8s.gcr.io/kube-apiserver:v1.24.1-rc.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/kube-apiserver_v1.24.1-rc.0 succeeded

	I0509 08:55:36.137877  195809 cache.go:115] /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/kube-controller-manager_v1.24.1-rc.0 exists

	I0509 08:55:36.138019  195809 cache.go:96] cache image "k8s.gcr.io/kube-controller-manager:v1.24.1-rc.0" -> "/home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/kube-controller-manager_v1.24.1-rc.0" took 427.663µs

	I0509 08:55:36.138034  195809 cache.go:80] save to tar file k8s.gcr.io/kube-controller-manager:v1.24.1-rc.0 -> /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/cache/images/amd64/k8s.gcr.io/kube-controller-manager_v1.24.1-rc.0 succeeded

	I0509 08:55:36.138049  195809 cache.go:87] Successfully saved all images to host disk.

	I0509 08:55:36.138177  195809 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220509085441-6723 --format={{.State.Status}}

	I0509 08:55:36.175148  195809 fix.go:103] recreateIfNeeded on kubernetes-upgrade-20220509085441-6723: state=Stopped err=<nil>

	W0509 08:55:36.175202  195809 fix.go:129] unexpected machine state, will restart: <nil>

	I0509 08:55:36.179233  195809 out.go:177] * Restarting existing docker container for "kubernetes-upgrade-20220509085441-6723" ...

	I0509 08:55:36.180919  195809 cli_runner.go:164] Run: docker start kubernetes-upgrade-20220509085441-6723

	W0509 08:55:36.371515  195809 cli_runner.go:211] docker start kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:36.371624  195809 cli_runner.go:164] Run: docker inspect kubernetes-upgrade-20220509085441-6723

	I0509 08:55:36.405999  195809 errors.go:84] Postmortem inspect ("docker inspect kubernetes-upgrade-20220509085441-6723"): -- stdout --

	[

	    {

	        "Id": "9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55",

	        "Created": "2022-05-09T08:54:48.053286897Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "exited",

	            "Running": false,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 0,

	            "ExitCode": 130,

	            "Error": "network ab3dc0e987463e0d1919f0f30610dba9f36f6956dd59c0979fddc98d5b653e0f not found",

	            "StartedAt": "2022-05-09T08:54:48.472807369Z",

	            "FinishedAt": "2022-05-09T08:55:34.933426699Z"

	        },

	        "Image": "sha256:44d43b69f3d5ba7f801dca891b535f23f9839671e82277938ec7dc42a22c50d6",

	        "ResolvConfPath": "/var/lib/docker/containers/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55/hostname",

	        "HostsPath": "/var/lib/docker/containers/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55/hosts",

	        "LogPath": "/var/lib/docker/containers/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55-json.log",

	        "Name": "/kubernetes-upgrade-20220509085441-6723",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "unconfined",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "kubernetes-upgrade-20220509085441-6723:/var",

	                "/lib/modules:/lib/modules:ro"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "kubernetes-upgrade-20220509085441-6723",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 0,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 0,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/4c80c52a664c1dfd1bf7928b1d2ccd53938fa6eb9de02e184ba37e8eb872a866-init/diff:/var/lib/docker/overlay2/beaaca4c58fe6ff4bdb88567c3d78ab7a23955eafaa5637df03ee2e0482d2aa6/diff:/var/lib/docker/overlay2/7c16b810bbfa3a2abff75078fa37b4cba0b2f101ff43d49beaabc3fd2602b1c9/diff:/var/lib/docker/overlay2/60f04c0e4baa8ad1c02ae5e34e6f505db0d740e2d7dc0833b2ff3b8037c1a9b6/diff:/var/lib/docker/overlay2/a12543300ae4ff803b2f0493a60a04a921312ec5a7b6ed493e66acadf998daef/diff:/var/lib/docker/overlay2/2d68f658a64cd8b7255bce93547db5d1b20b119ef6da8b9ce06614134661f235/diff:/var/lib/docker/overlay2/0f968f210c1565f6e8c4e444c650502c06a120d8767c9fefb7b6b2a09f4af83b/diff:/var/lib/docker/overlay2/987a67893acdccd514357a50db6c11680ae1899ec07a36085367a241ba1f0545/diff:/var/lib/docker/overlay2/d5446d1adc007f4390aa6173ef257b0bf52a9c9cc6533f16dd6c577fde5334b3/diff:/var/lib/docker/overlay2/265dd0cde77d578f6412ad48596c75c3548b5e077059c0fa835e4f22775fab83/diff:/var/lib/docker/overlay2/e6b98b

08dd64e06639e2a321169f84a89e8d21cea02d673819156eeb7a4747c3/diff:/var/lib/docker/overlay2/acf7117613a840e97b7a1101bfdce3a154a335ee0ffcaf74bd7f1b27b00cdaab/diff:/var/lib/docker/overlay2/9e88fa64aa800dac6e01eddc9cfd525a0dcd906c1adf98de066be87f87a6b52c/diff:/var/lib/docker/overlay2/6c539edead197cd449ca81fd34e3c534a6ca25446a52141d0ae4484aaac05482/diff:/var/lib/docker/overlay2/866719c52f41a692b94f42071d314de55b290912f946f4ec5f3785a7a5ae40df/diff:/var/lib/docker/overlay2/1c488a9b3bad141652873f4085ce1a466e1f1e8ccbd086d03a492b45179a6064/diff:/var/lib/docker/overlay2/bce5b942da09326e5a5c8595077544ced08031b1cd9b22ff8bff0a4458540139/diff:/var/lib/docker/overlay2/ffe34c3764a4eeac791f4672d47389ec3f399f716ab6e5531d7c5e587f3ace00/diff:/var/lib/docker/overlay2/a377e0779d03467b09a26898ae35b12f325d62984304817f49c693b2146c08f4/diff:/var/lib/docker/overlay2/6092380f07b29488cf0a30cb486638d86eaa8e00ff356a7985c6ac6f2fae5c1d/diff:/var/lib/docker/overlay2/1bc014cc0cf0a91c61f131c06b0194709f853dec23defe9233cbd9cc40030c28/diff:/var/lib/d

ocker/overlay2/0c81c4db7384c48318a800165af7f811348a8081efdd9dbd912e05e55c9eb4e0/diff:/var/lib/docker/overlay2/72b0c515d90bc71e27b766a9be89e315777a5bbe643d8fc508a9ae12557a58ce/diff:/var/lib/docker/overlay2/a4d193bf8c377d4cf1357b9261d3c54d995f17bda3db5abee3ef5caec001d75e/diff:/var/lib/docker/overlay2/763c6d291074b0842ecdeec1f3842fd6a0af0cb86839c82bc38cec0f40d095ca/diff:/var/lib/docker/overlay2/e4156eb2a94ac7136eb674fb8c22ea7f6dff50cd81e4857119d81112dc5ad99d/diff:/var/lib/docker/overlay2/be7effa3bb906b8c48aefab3cc72e657931bccd42c35b03bb52c679c37c70d25/diff:/var/lib/docker/overlay2/ccf8c1a68774cc6129c43490c675e6ba0ff0c88284ad899c9efb4b7492e92a06/diff:/var/lib/docker/overlay2/55f74cddb5c8f2da1131ddd67f7f2a20b8c2be8719b71047d5185fdb4722627d/diff:/var/lib/docker/overlay2/f6c38e83545e9de87d03b1e8e9b0239079acf47784afc11291b2172a11f8296d/diff:/var/lib/docker/overlay2/24604ce83180fcb6b9e1adbaf37db6776e4949ca5e1f4f9050b8fb8dc87d7591/diff:/var/lib/docker/overlay2/b03b1952bea32e53ce88b0d92d09f78ca76ceca0a146b088628be224813

ae87c/diff:/var/lib/docker/overlay2/d7ee02a5ba355c246c3107f286c4130457358aa56e0d8feb3850d953812fe76d/diff:/var/lib/docker/overlay2/1223ae0e5105ae89c78524490f0ccc5fe6dfa373e175fa70474b06c62aad91c7/diff:/var/lib/docker/overlay2/c3209d71eed94ed66b11ba3a7573c347d5c09a5a4fedb00418e52571abb2b5f9/diff:/var/lib/docker/overlay2/d6d32632e36023dec15e643fd41f77168442327cecdead87a47e70683cb0c660/diff:/var/lib/docker/overlay2/fd413b21f1f34027c98a1b4106f7e7db83e910860edd53ef838ac699659cd451/diff:/var/lib/docker/overlay2/9768e3244c157a7a12b8ec31507c1abc0fc806a9f325099262cfeb41e23a5fe1/diff:/var/lib/docker/overlay2/f65dda9d5b79903f5e68f6b9d4a59214d62f304da77faa7e148b90b402d98ca4/diff:/var/lib/docker/overlay2/b663c2dab6b5df7b606daa62e1df5e57f4a2503c2a9a19211f47359fd685dccf/diff:/var/lib/docker/overlay2/bbd620a7e494844db80a2bcd2fd6f170080c5273f1c33a576501214dd4475464/diff:/var/lib/docker/overlay2/23de36667695cec8ea0f4c98fc580213d356d39a3eba5aaab8b6ebeeb2b71596/diff:/var/lib/docker/overlay2/bafb3e8d91e83dcf824b6d5b3f56a67c483c42

723724b009a5aedf578351154f/diff:/var/lib/docker/overlay2/2798e8ce2f51dde257a9cf2dd800492f888fd02515c5f1de4133cc787ee12928/diff:/var/lib/docker/overlay2/e69a88f2dffdd2c7f72c45eaf2e3cd1a8772e0a2af22d6f34d2695bbda62b6e9/diff:/var/lib/docker/overlay2/708816f20892c0e4b94cbe8e80b169fff54ffd870bcde395bd8163dd03b25d0f/diff",

	                "MergedDir": "/var/lib/docker/overlay2/4c80c52a664c1dfd1bf7928b1d2ccd53938fa6eb9de02e184ba37e8eb872a866/merged",

	                "UpperDir": "/var/lib/docker/overlay2/4c80c52a664c1dfd1bf7928b1d2ccd53938fa6eb9de02e184ba37e8eb872a866/diff",

	                "WorkDir": "/var/lib/docker/overlay2/4c80c52a664c1dfd1bf7928b1d2ccd53938fa6eb9de02e184ba37e8eb872a866/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "volume",

	                "Name": "kubernetes-upgrade-20220509085441-6723",

	                "Source": "/var/lib/docker/volumes/kubernetes-upgrade-20220509085441-6723/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            },

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            }

	        ],

	        "Config": {

	            "Hostname": "kubernetes-upgrade-20220509085441-6723",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "kubernetes-upgrade-20220509085441-6723",

	                "name.minikube.sigs.k8s.io": "kubernetes-upgrade-20220509085441-6723",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "4d9bdd6efabd7d19b0c4b1317d302d4bdff4657c9fa9a1027917f2a96a3ba380",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {},

	            "SandboxKey": "/var/run/docker/netns/4d9bdd6efabd",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "kubernetes-upgrade-20220509085441-6723": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.58.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "9eeef2af4bd8",

	                        "kubernetes-upgrade-20220509085441-6723"

	                    ],

	                    "NetworkID": "ab3dc0e987463e0d1919f0f30610dba9f36f6956dd59c0979fddc98d5b653e0f",

	                    "EndpointID": "",

	                    "Gateway": "",

	                    "IPAddress": "",

	                    "IPPrefixLen": 0,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

	-- /stdout --

	I0509 08:55:36.406088  195809 cli_runner.go:164] Run: docker logs --timestamps --details kubernetes-upgrade-20220509085441-6723

	I0509 08:55:36.447221  195809 errors.go:91] Postmortem logs ("docker logs --timestamps --details kubernetes-upgrade-20220509085441-6723"): -- stdout --

	2022-05-09T08:54:48.471260248Z  + userns=

	2022-05-09T08:54:48.471300634Z  + grep -Eqv '0[[:space:]]+0[[:space:]]+4294967295' /proc/self/uid_map

	2022-05-09T08:54:48.474122330Z  + validate_userns

	2022-05-09T08:54:48.474168246Z  + [[ -z '' ]]

	2022-05-09T08:54:48.474173803Z  + return

	2022-05-09T08:54:48.474177777Z  + configure_containerd

	2022-05-09T08:54:48.474507815Z  ++ stat -f -c %T /kind

	2022-05-09T08:54:48.475796885Z  + [[ overlayfs == \z\f\s ]]

	2022-05-09T08:54:48.475826600Z  + configure_proxy

	2022-05-09T08:54:48.475831768Z  + mkdir -p /etc/systemd/system.conf.d/

	2022-05-09T08:54:48.477517626Z  + [[ ! -z '' ]]

	2022-05-09T08:54:48.478304723Z  + cat

	2022-05-09T08:54:48.479273664Z  + fix_kmsg

	2022-05-09T08:54:48.479288630Z  + [[ ! -e /dev/kmsg ]]

	2022-05-09T08:54:48.479292377Z  + fix_mount

	2022-05-09T08:54:48.479295903Z  + echo 'INFO: ensuring we can execute mount/umount even with userns-remap'

	2022-05-09T08:54:48.479299826Z  INFO: ensuring we can execute mount/umount even with userns-remap

	2022-05-09T08:54:48.479708646Z  ++ which mount

	2022-05-09T08:54:48.481144595Z  ++ which umount

	2022-05-09T08:54:48.481900596Z  + chown root:root /usr/bin/mount /usr/bin/umount

	2022-05-09T08:54:48.488289063Z  ++ which mount

	2022-05-09T08:54:48.490367491Z  ++ which umount

	2022-05-09T08:54:48.490389164Z  + chmod -s /usr/bin/mount /usr/bin/umount

	2022-05-09T08:54:48.492038039Z  +++ which mount

	2022-05-09T08:54:48.493067021Z  ++ stat -f -c %T /usr/bin/mount

	2022-05-09T08:54:48.497479312Z  + [[ overlayfs == \a\u\f\s ]]

	2022-05-09T08:54:48.497502256Z  + [[ -z '' ]]

	2022-05-09T08:54:48.497506840Z  + echo 'INFO: remounting /sys read-only'

	2022-05-09T08:54:48.497510298Z  INFO: remounting /sys read-only

	2022-05-09T08:54:48.497513782Z  + mount -o remount,ro /sys

	2022-05-09T08:54:48.499860533Z  + echo 'INFO: making mounts shared'

	2022-05-09T08:54:48.499970184Z  INFO: making mounts shared

	2022-05-09T08:54:48.500098327Z  + mount --make-rshared /

	2022-05-09T08:54:48.502999281Z  + retryable_fix_cgroup

	2022-05-09T08:54:48.503018220Z  ++ seq 0 10

	2022-05-09T08:54:48.503314614Z  + for i in $(seq 0 10)

	2022-05-09T08:54:48.503325876Z  + fix_cgroup

	2022-05-09T08:54:48.503418417Z  + [[ -f /sys/fs/cgroup/cgroup.controllers ]]

	2022-05-09T08:54:48.503435857Z  + echo 'INFO: detected cgroup v1'

	2022-05-09T08:54:48.503440024Z  INFO: detected cgroup v1

	2022-05-09T08:54:48.505852156Z  + echo 'INFO: fix cgroup mounts for all subsystems'

	2022-05-09T08:54:48.505874933Z  INFO: fix cgroup mounts for all subsystems

	2022-05-09T08:54:48.505893332Z  + local current_cgroup

	2022-05-09T08:54:48.505897149Z  ++ cut -d: -f3

	2022-05-09T08:54:48.505900717Z  ++ grep -E '^[^:]*:([^:]*,)?cpu(,[^,:]*)?:.*' /proc/self/cgroup

	2022-05-09T08:54:48.506496662Z  + current_cgroup=/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.506514273Z  + local cgroup_subsystems

	2022-05-09T08:54:48.507099718Z  ++ findmnt -lun -o source,target -t cgroup

	2022-05-09T08:54:48.507378391Z  ++ grep /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.507587122Z  ++ awk '{print $2}'

	2022-05-09T08:54:48.510297098Z  + cgroup_subsystems='/sys/fs/cgroup/systemd

	2022-05-09T08:54:48.510313375Z  /sys/fs/cgroup/net_cls,net_prio

	2022-05-09T08:54:48.510317236Z  /sys/fs/cgroup/pids

	2022-05-09T08:54:48.510320633Z  /sys/fs/cgroup/blkio

	2022-05-09T08:54:48.510324192Z  /sys/fs/cgroup/cpu,cpuacct

	2022-05-09T08:54:48.510327641Z  /sys/fs/cgroup/freezer

	2022-05-09T08:54:48.510330968Z  /sys/fs/cgroup/rdma

	2022-05-09T08:54:48.510334467Z  /sys/fs/cgroup/memory

	2022-05-09T08:54:48.510338489Z  /sys/fs/cgroup/devices

	2022-05-09T08:54:48.510340858Z  /sys/fs/cgroup/cpuset

	2022-05-09T08:54:48.510342979Z  /sys/fs/cgroup/hugetlb

	2022-05-09T08:54:48.510345057Z  /sys/fs/cgroup/perf_event'

	2022-05-09T08:54:48.510347956Z  + local cgroup_mounts

	2022-05-09T08:54:48.512398069Z  ++ grep -E -o '/[[:alnum:]].* /sys/fs/cgroup.*.*cgroup' /proc/self/mountinfo

	2022-05-09T08:54:48.512413387Z  + cgroup_mounts='/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/systemd rw,nosuid,nodev,noexec,relatime shared:383 master:9 - cgroup cgroup

	2022-05-09T08:54:48.512418877Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/net_cls,net_prio rw,nosuid,nodev,noexec,relatime shared:388 master:16 - cgroup cgroup

	2022-05-09T08:54:48.512423102Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/pids rw,nosuid,nodev,noexec,relatime shared:389 master:17 - cgroup cgroup

	2022-05-09T08:54:48.512427285Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/blkio rw,nosuid,nodev,noexec,relatime shared:403 master:18 - cgroup cgroup

	2022-05-09T08:54:48.512431215Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/cpu,cpuacct rw,nosuid,nodev,noexec,relatime shared:404 master:19 - cgroup cgroup

	2022-05-09T08:54:48.512438201Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/freezer rw,nosuid,nodev,noexec,relatime shared:405 master:20 - cgroup cgroup

	2022-05-09T08:54:48.512442056Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/rdma rw,nosuid,nodev,noexec,relatime shared:406 master:21 - cgroup cgroup

	2022-05-09T08:54:48.512458710Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/memory rw,nosuid,nodev,noexec,relatime shared:407 master:22 - cgroup cgroup

	2022-05-09T08:54:48.512462814Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/devices rw,nosuid,nodev,noexec,relatime shared:408 master:23 - cgroup cgroup

	2022-05-09T08:54:48.512466523Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/cpuset rw,nosuid,nodev,noexec,relatime shared:409 master:24 - cgroup cgroup

	2022-05-09T08:54:48.512470016Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/hugetlb rw,nosuid,nodev,noexec,relatime shared:424 master:25 - cgroup cgroup

	2022-05-09T08:54:48.512475266Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/perf_event rw,nosuid,nodev,noexec,relatime shared:425 master:26 - cgroup cgroup'

	2022-05-09T08:54:48.512478724Z  + [[ -n /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/systemd rw,nosuid,nodev,noexec,relatime shared:383 master:9 - cgroup cgroup

	2022-05-09T08:54:48.512482419Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/net_cls,net_prio rw,nosuid,nodev,noexec,relatime shared:388 master:16 - cgroup cgroup

	2022-05-09T08:54:48.512486367Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/pids rw,nosuid,nodev,noexec,relatime shared:389 master:17 - cgroup cgroup

	2022-05-09T08:54:48.512490051Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/blkio rw,nosuid,nodev,noexec,relatime shared:403 master:18 - cgroup cgroup

	2022-05-09T08:54:48.512493777Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/cpu,cpuacct rw,nosuid,nodev,noexec,relatime shared:404 master:19 - cgroup cgroup

	2022-05-09T08:54:48.512497218Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/freezer rw,nosuid,nodev,noexec,relatime shared:405 master:20 - cgroup cgroup

	2022-05-09T08:54:48.512500751Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/rdma rw,nosuid,nodev,noexec,relatime shared:406 master:21 - cgroup cgroup

	2022-05-09T08:54:48.512504301Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/memory rw,nosuid,nodev,noexec,relatime shared:407 master:22 - cgroup cgroup

	2022-05-09T08:54:48.512507809Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/devices rw,nosuid,nodev,noexec,relatime shared:408 master:23 - cgroup cgroup

	2022-05-09T08:54:48.512511212Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/cpuset rw,nosuid,nodev,noexec,relatime shared:409 master:24 - cgroup cgroup

	2022-05-09T08:54:48.512515161Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/hugetlb rw,nosuid,nodev,noexec,relatime shared:424 master:25 - cgroup cgroup

	2022-05-09T08:54:48.512517993Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/perf_event rw,nosuid,nodev,noexec,relatime shared:425 master:26 - cgroup cgroup ]]

	2022-05-09T08:54:48.512520323Z  + local mount_root

	2022-05-09T08:54:48.513098271Z  ++ head -n 1

	2022-05-09T08:54:48.513247350Z  ++ cut '-d ' -f1

	2022-05-09T08:54:48.514855693Z  + mount_root=/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.515628508Z  ++ echo '/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/systemd rw,nosuid,nodev,noexec,relatime shared:383 master:9 - cgroup cgroup

	2022-05-09T08:54:48.515643884Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/net_cls,net_prio rw,nosuid,nodev,noexec,relatime shared:388 master:16 - cgroup cgroup

	2022-05-09T08:54:48.515648480Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/pids rw,nosuid,nodev,noexec,relatime shared:389 master:17 - cgroup cgroup

	2022-05-09T08:54:48.515652395Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/blkio rw,nosuid,nodev,noexec,relatime shared:403 master:18 - cgroup cgroup

	2022-05-09T08:54:48.515656142Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/cpu,cpuacct rw,nosuid,nodev,noexec,relatime shared:404 master:19 - cgroup cgroup

	2022-05-09T08:54:48.515659817Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/freezer rw,nosuid,nodev,noexec,relatime shared:405 master:20 - cgroup cgroup

	2022-05-09T08:54:48.515663264Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/rdma rw,nosuid,nodev,noexec,relatime shared:406 master:21 - cgroup cgroup

	2022-05-09T08:54:48.515667045Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/memory rw,nosuid,nodev,noexec,relatime shared:407 master:22 - cgroup cgroup

	2022-05-09T08:54:48.515670224Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/devices rw,nosuid,nodev,noexec,relatime shared:408 master:23 - cgroup cgroup

	2022-05-09T08:54:48.515674419Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/cpuset rw,nosuid,nodev,noexec,relatime shared:409 master:24 - cgroup cgroup

	2022-05-09T08:54:48.515678065Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/hugetlb rw,nosuid,nodev,noexec,relatime shared:424 master:25 - cgroup cgroup

	2022-05-09T08:54:48.515681567Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/perf_event rw,nosuid,nodev,noexec,relatime shared:425 master:26 - cgroup cgroup'

	2022-05-09T08:54:48.515685160Z  ++ cut '-d ' -f 2

	2022-05-09T08:54:48.516591908Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.516645425Z  + local target=/sys/fs/cgroup/systemd/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.516651252Z  + findmnt /sys/fs/cgroup/systemd/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.519106998Z  + mkdir -p /sys/fs/cgroup/systemd/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.520529803Z  + mount --bind /sys/fs/cgroup/systemd /sys/fs/cgroup/systemd/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.522379054Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.522395958Z  + local target=/sys/fs/cgroup/net_cls,net_prio/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.522400516Z  + findmnt /sys/fs/cgroup/net_cls,net_prio/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.524330806Z  + mkdir -p /sys/fs/cgroup/net_cls,net_prio/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.525477673Z  + mount --bind /sys/fs/cgroup/net_cls,net_prio /sys/fs/cgroup/net_cls,net_prio/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.526982499Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.526999060Z  + local target=/sys/fs/cgroup/pids/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.527003545Z  + findmnt /sys/fs/cgroup/pids/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.528845140Z  + mkdir -p /sys/fs/cgroup/pids/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.529882718Z  + mount --bind /sys/fs/cgroup/pids /sys/fs/cgroup/pids/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.531050445Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.531070607Z  + local target=/sys/fs/cgroup/blkio/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.531127184Z  + findmnt /sys/fs/cgroup/blkio/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.533028373Z  + mkdir -p /sys/fs/cgroup/blkio/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.534462055Z  + mount --bind /sys/fs/cgroup/blkio /sys/fs/cgroup/blkio/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.536092612Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.536110411Z  + local target=/sys/fs/cgroup/cpu,cpuacct/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.536115415Z  + findmnt /sys/fs/cgroup/cpu,cpuacct/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.538673739Z  + mkdir -p /sys/fs/cgroup/cpu,cpuacct/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.539915877Z  + mount --bind /sys/fs/cgroup/cpu,cpuacct /sys/fs/cgroup/cpu,cpuacct/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.541437087Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.541455190Z  + local target=/sys/fs/cgroup/freezer/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.541460132Z  + findmnt /sys/fs/cgroup/freezer/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.543391313Z  + mkdir -p /sys/fs/cgroup/freezer/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.545772098Z  + mount --bind /sys/fs/cgroup/freezer /sys/fs/cgroup/freezer/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.547248575Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.547267260Z  + local target=/sys/fs/cgroup/rdma/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.547272562Z  + findmnt /sys/fs/cgroup/rdma/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.549630691Z  + mkdir -p /sys/fs/cgroup/rdma/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.550641817Z  + mount --bind /sys/fs/cgroup/rdma /sys/fs/cgroup/rdma/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.551961871Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.551974887Z  + local target=/sys/fs/cgroup/memory/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.551979418Z  + findmnt /sys/fs/cgroup/memory/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.553965667Z  + mkdir -p /sys/fs/cgroup/memory/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.555098664Z  + mount --bind /sys/fs/cgroup/memory /sys/fs/cgroup/memory/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.556707022Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.556726328Z  + local target=/sys/fs/cgroup/devices/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.556730861Z  + findmnt /sys/fs/cgroup/devices/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.558608335Z  + mkdir -p /sys/fs/cgroup/devices/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.559691381Z  + mount --bind /sys/fs/cgroup/devices /sys/fs/cgroup/devices/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.561100946Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.561116387Z  + local target=/sys/fs/cgroup/cpuset/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.561120903Z  + findmnt /sys/fs/cgroup/cpuset/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.562920076Z  + mkdir -p /sys/fs/cgroup/cpuset/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.597307309Z  + mount --bind /sys/fs/cgroup/cpuset /sys/fs/cgroup/cpuset/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.598832008Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.598864762Z  + local target=/sys/fs/cgroup/hugetlb/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.598869311Z  + findmnt /sys/fs/cgroup/hugetlb/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.600653125Z  + mkdir -p /sys/fs/cgroup/hugetlb/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.601936277Z  + mount --bind /sys/fs/cgroup/hugetlb /sys/fs/cgroup/hugetlb/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.603327936Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.603345656Z  + local target=/sys/fs/cgroup/perf_event/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.603356206Z  + findmnt /sys/fs/cgroup/perf_event/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.605703733Z  + mkdir -p /sys/fs/cgroup/perf_event/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.606930655Z  + mount --bind /sys/fs/cgroup/perf_event /sys/fs/cgroup/perf_event/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.608352931Z  + mount --make-rprivate /sys/fs/cgroup

	2022-05-09T08:54:48.610192609Z  + echo '/sys/fs/cgroup/systemd

	2022-05-09T08:54:48.610206857Z  /sys/fs/cgroup/net_cls,net_prio

	2022-05-09T08:54:48.610220939Z  /sys/fs/cgroup/pids

	2022-05-09T08:54:48.610224594Z  /sys/fs/cgroup/blkio

	2022-05-09T08:54:48.610228030Z  /sys/fs/cgroup/cpu,cpuacct

	2022-05-09T08:54:48.610231475Z  /sys/fs/cgroup/freezer

	2022-05-09T08:54:48.610234947Z  /sys/fs/cgroup/rdma

	2022-05-09T08:54:48.610238274Z  /sys/fs/cgroup/memory

	2022-05-09T08:54:48.610252110Z  /sys/fs/cgroup/devices

	2022-05-09T08:54:48.610255784Z  /sys/fs/cgroup/cpuset

	2022-05-09T08:54:48.610259138Z  /sys/fs/cgroup/hugetlb

	2022-05-09T08:54:48.610262284Z  /sys/fs/cgroup/perf_event'

	2022-05-09T08:54:48.610272595Z  + IFS=

	2022-05-09T08:54:48.610276540Z  + read -r subsystem

	2022-05-09T08:54:48.610371307Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/systemd

	2022-05-09T08:54:48.610393767Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.610447245Z  + local subsystem=/sys/fs/cgroup/systemd

	2022-05-09T08:54:48.610464114Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.610513753Z  + mkdir -p /sys/fs/cgroup/systemd//kubelet

	2022-05-09T08:54:48.611508052Z  + '[' /sys/fs/cgroup/systemd == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.611534686Z  + mount --bind /sys/fs/cgroup/systemd//kubelet /sys/fs/cgroup/systemd//kubelet

	2022-05-09T08:54:48.612962535Z  + IFS=

	2022-05-09T08:54:48.612979492Z  + read -r subsystem

	2022-05-09T08:54:48.612985176Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/net_cls,net_prio

	2022-05-09T08:54:48.613001130Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.613006620Z  + local subsystem=/sys/fs/cgroup/net_cls,net_prio

	2022-05-09T08:54:48.613245064Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.613257642Z  + mkdir -p /sys/fs/cgroup/net_cls,net_prio//kubelet

	2022-05-09T08:54:48.614415224Z  + '[' /sys/fs/cgroup/net_cls,net_prio == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.614430406Z  + mount --bind /sys/fs/cgroup/net_cls,net_prio//kubelet /sys/fs/cgroup/net_cls,net_prio//kubelet

	2022-05-09T08:54:48.616087283Z  + IFS=

	2022-05-09T08:54:48.616101283Z  + read -r subsystem

	2022-05-09T08:54:48.616105704Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/pids

	2022-05-09T08:54:48.616108868Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.616141544Z  + local subsystem=/sys/fs/cgroup/pids

	2022-05-09T08:54:48.616155294Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.616159239Z  + mkdir -p /sys/fs/cgroup/pids//kubelet

	2022-05-09T08:54:48.617284882Z  + '[' /sys/fs/cgroup/pids == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.617303449Z  + mount --bind /sys/fs/cgroup/pids//kubelet /sys/fs/cgroup/pids//kubelet

	2022-05-09T08:54:48.618668985Z  + IFS=

	2022-05-09T08:54:48.618683956Z  + read -r subsystem

	2022-05-09T08:54:48.618688310Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/blkio

	2022-05-09T08:54:48.618691995Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.618728923Z  + local subsystem=/sys/fs/cgroup/blkio

	2022-05-09T08:54:48.618750290Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.618753462Z  + mkdir -p /sys/fs/cgroup/blkio//kubelet

	2022-05-09T08:54:48.619763460Z  + '[' /sys/fs/cgroup/blkio == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.619770759Z  + mount --bind /sys/fs/cgroup/blkio//kubelet /sys/fs/cgroup/blkio//kubelet

	2022-05-09T08:54:48.621114013Z  + IFS=

	2022-05-09T08:54:48.621127858Z  + read -r subsystem

	2022-05-09T08:54:48.621131952Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/cpu,cpuacct

	2022-05-09T08:54:48.621135451Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.621139093Z  + local subsystem=/sys/fs/cgroup/cpu,cpuacct

	2022-05-09T08:54:48.621191001Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.621204858Z  + mkdir -p /sys/fs/cgroup/cpu,cpuacct//kubelet

	2022-05-09T08:54:48.622435221Z  + '[' /sys/fs/cgroup/cpu,cpuacct == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.622450554Z  + mount --bind /sys/fs/cgroup/cpu,cpuacct//kubelet /sys/fs/cgroup/cpu,cpuacct//kubelet

	2022-05-09T08:54:48.623904570Z  + IFS=

	2022-05-09T08:54:48.623919652Z  + read -r subsystem

	2022-05-09T08:54:48.623924396Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/freezer

	2022-05-09T08:54:48.623954773Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.623959048Z  + local subsystem=/sys/fs/cgroup/freezer

	2022-05-09T08:54:48.623962278Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.623965670Z  + mkdir -p /sys/fs/cgroup/freezer//kubelet

	2022-05-09T08:54:48.625029116Z  + '[' /sys/fs/cgroup/freezer == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.625046744Z  + mount --bind /sys/fs/cgroup/freezer//kubelet /sys/fs/cgroup/freezer//kubelet

	2022-05-09T08:54:48.626317951Z  + IFS=

	2022-05-09T08:54:48.626332395Z  + read -r subsystem

	2022-05-09T08:54:48.626336767Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/rdma

	2022-05-09T08:54:48.626340462Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.626343634Z  + local subsystem=/sys/fs/cgroup/rdma

	2022-05-09T08:54:48.626346895Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.626350010Z  + mkdir -p /sys/fs/cgroup/rdma//kubelet

	2022-05-09T08:54:48.627496152Z  + '[' /sys/fs/cgroup/rdma == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.627511352Z  + mount --bind /sys/fs/cgroup/rdma//kubelet /sys/fs/cgroup/rdma//kubelet

	2022-05-09T08:54:48.628631281Z  + IFS=

	2022-05-09T08:54:48.628647043Z  + read -r subsystem

	2022-05-09T08:54:48.628650828Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/memory

	2022-05-09T08:54:48.628653940Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.628693466Z  + local subsystem=/sys/fs/cgroup/memory

	2022-05-09T08:54:48.628698453Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.628701999Z  + mkdir -p /sys/fs/cgroup/memory//kubelet

	2022-05-09T08:54:48.632741012Z  + '[' /sys/fs/cgroup/memory == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.632758647Z  + mount --bind /sys/fs/cgroup/memory//kubelet /sys/fs/cgroup/memory//kubelet

	2022-05-09T08:54:48.632761680Z  + IFS=

	2022-05-09T08:54:48.632763932Z  + read -r subsystem

	2022-05-09T08:54:48.632766097Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/devices

	2022-05-09T08:54:48.632768604Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.632770748Z  + local subsystem=/sys/fs/cgroup/devices

	2022-05-09T08:54:48.632772777Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.632774857Z  + mkdir -p /sys/fs/cgroup/devices//kubelet

	2022-05-09T08:54:48.632776920Z  + '[' /sys/fs/cgroup/devices == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.632779220Z  + mount --bind /sys/fs/cgroup/devices//kubelet /sys/fs/cgroup/devices//kubelet

	2022-05-09T08:54:48.633518582Z  + IFS=

	2022-05-09T08:54:48.633533342Z  + read -r subsystem

	2022-05-09T08:54:48.633537608Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/cpuset

	2022-05-09T08:54:48.633554800Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.633557325Z  + local subsystem=/sys/fs/cgroup/cpuset

	2022-05-09T08:54:48.633559354Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.633561358Z  + mkdir -p /sys/fs/cgroup/cpuset//kubelet

	2022-05-09T08:54:48.634676883Z  + '[' /sys/fs/cgroup/cpuset == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.634691047Z  + cat /sys/fs/cgroup/cpuset/cpuset.cpus

	2022-05-09T08:54:48.635753652Z  + cat /sys/fs/cgroup/cpuset/cpuset.mems

	2022-05-09T08:54:48.636819371Z  + mount --bind /sys/fs/cgroup/cpuset//kubelet /sys/fs/cgroup/cpuset//kubelet

	2022-05-09T08:54:48.638369533Z  + IFS=

	2022-05-09T08:54:48.638382618Z  + read -r subsystem

	2022-05-09T08:54:48.638386744Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/hugetlb

	2022-05-09T08:54:48.638480846Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.638497058Z  + local subsystem=/sys/fs/cgroup/hugetlb

	2022-05-09T08:54:48.638501381Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.638504676Z  + mkdir -p /sys/fs/cgroup/hugetlb//kubelet

	2022-05-09T08:54:48.639580000Z  + '[' /sys/fs/cgroup/hugetlb == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.639593873Z  + mount --bind /sys/fs/cgroup/hugetlb//kubelet /sys/fs/cgroup/hugetlb//kubelet

	2022-05-09T08:54:48.641233270Z  + IFS=

	2022-05-09T08:54:48.641249737Z  + read -r subsystem

	2022-05-09T08:54:48.641254116Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/perf_event

	2022-05-09T08:54:48.641257739Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.641261106Z  + local subsystem=/sys/fs/cgroup/perf_event

	2022-05-09T08:54:48.641299852Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.641312761Z  + mkdir -p /sys/fs/cgroup/perf_event//kubelet

	2022-05-09T08:54:48.642292336Z  + '[' /sys/fs/cgroup/perf_event == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.642300239Z  + mount --bind /sys/fs/cgroup/perf_event//kubelet /sys/fs/cgroup/perf_event//kubelet

	2022-05-09T08:54:48.643522811Z  + IFS=

	2022-05-09T08:54:48.643537566Z  + read -r subsystem

	2022-05-09T08:54:48.643924011Z  + return

	2022-05-09T08:54:48.643944798Z  + fix_machine_id

	2022-05-09T08:54:48.643948943Z  + echo 'INFO: clearing and regenerating /etc/machine-id'

	2022-05-09T08:54:48.643984496Z  INFO: clearing and regenerating /etc/machine-id

	2022-05-09T08:54:48.643996949Z  + rm -f /etc/machine-id

	2022-05-09T08:54:48.644897924Z  + systemd-machine-id-setup

	2022-05-09T08:54:48.648696420Z  Initializing machine ID from D-Bus machine ID.

	2022-05-09T08:54:48.652007275Z  + fix_product_name

	2022-05-09T08:54:48.652029499Z  + [[ -f /sys/class/dmi/id/product_name ]]

	2022-05-09T08:54:48.652166407Z  + echo 'INFO: faking /sys/class/dmi/id/product_name to be "kind"'

	2022-05-09T08:54:48.652188535Z  INFO: faking /sys/class/dmi/id/product_name to be "kind"

	2022-05-09T08:54:48.652193280Z  + echo kind

	2022-05-09T08:54:48.652317652Z  + mount -o ro,bind /kind/product_name /sys/class/dmi/id/product_name

	2022-05-09T08:54:48.654576894Z  + fix_product_uuid

	2022-05-09T08:54:48.654920962Z  + [[ ! -f /kind/product_uuid ]]

	2022-05-09T08:54:48.654936501Z  + cat /proc/sys/kernel/random/uuid

	2022-05-09T08:54:48.656224502Z  + [[ -f /sys/class/dmi/id/product_uuid ]]

	2022-05-09T08:54:48.656480423Z  + echo 'INFO: faking /sys/class/dmi/id/product_uuid to be random'

	2022-05-09T08:54:48.656811969Z  INFO: faking /sys/class/dmi/id/product_uuid to be random

	2022-05-09T08:54:48.657012896Z  + mount -o ro,bind /kind/product_uuid /sys/class/dmi/id/product_uuid

	2022-05-09T08:54:48.658849907Z  + [[ -f /sys/devices/virtual/dmi/id/product_uuid ]]

	2022-05-09T08:54:48.658922027Z  + echo 'INFO: faking /sys/devices/virtual/dmi/id/product_uuid as well'

	2022-05-09T08:54:48.658928802Z  INFO: faking /sys/devices/virtual/dmi/id/product_uuid as well

	2022-05-09T08:54:48.658933089Z  + mount -o ro,bind /kind/product_uuid /sys/devices/virtual/dmi/id/product_uuid

	2022-05-09T08:54:48.660598758Z  + select_iptables

	2022-05-09T08:54:48.660640772Z  + local mode=nft

	2022-05-09T08:54:48.662524997Z  ++ wc -l

	2022-05-09T08:54:48.668976711Z  ++ grep '^-'

	2022-05-09T08:54:48.670423709Z  + num_legacy_lines=6

	2022-05-09T08:54:48.670444339Z  + '[' 6 -ge 10 ']'

	2022-05-09T08:54:48.671409455Z  ++ grep '^-'

	2022-05-09T08:54:48.671472590Z  ++ wc -l

	2022-05-09T08:54:48.676259391Z  ++ true

	2022-05-09T08:54:48.676528455Z  + num_nft_lines=0

	2022-05-09T08:54:48.676641878Z  + '[' 6 -ge 0 ']'

	2022-05-09T08:54:48.676654457Z  + mode=legacy

	2022-05-09T08:54:48.676659525Z  + echo 'INFO: setting iptables to detected mode: legacy'

	2022-05-09T08:54:48.676663297Z  INFO: setting iptables to detected mode: legacy

	2022-05-09T08:54:48.676668168Z  + update-alternatives --set iptables /usr/sbin/iptables-legacy

	2022-05-09T08:54:48.676711079Z  + echo 'retryable update-alternatives: --set iptables /usr/sbin/iptables-legacy'

	2022-05-09T08:54:48.676716691Z  + local 'args=--set iptables /usr/sbin/iptables-legacy'

	2022-05-09T08:54:48.677129110Z  ++ seq 0 15

	2022-05-09T08:54:48.677887760Z  + for i in $(seq 0 15)

	2022-05-09T08:54:48.677923378Z  + /usr/bin/update-alternatives --set iptables /usr/sbin/iptables-legacy

	2022-05-09T08:54:48.682231290Z  + return

	2022-05-09T08:54:48.682257261Z  + update-alternatives --set ip6tables /usr/sbin/ip6tables-legacy

	2022-05-09T08:54:48.682269494Z  + echo 'retryable update-alternatives: --set ip6tables /usr/sbin/ip6tables-legacy'

	2022-05-09T08:54:48.682301012Z  + local 'args=--set ip6tables /usr/sbin/ip6tables-legacy'

	2022-05-09T08:54:48.682763162Z  ++ seq 0 15

	2022-05-09T08:54:48.683704961Z  + for i in $(seq 0 15)

	2022-05-09T08:54:48.683751511Z  + /usr/bin/update-alternatives --set ip6tables /usr/sbin/ip6tables-legacy

	2022-05-09T08:54:48.687089186Z  + return

	2022-05-09T08:54:48.687110450Z  + enable_network_magic

	2022-05-09T08:54:48.687155319Z  + local docker_embedded_dns_ip=127.0.0.11

	2022-05-09T08:54:48.687171375Z  + local docker_host_ip

	2022-05-09T08:54:48.688428728Z  ++ cut '-d ' -f1

	2022-05-09T08:54:48.688441794Z  ++ head -n1 /dev/fd/63

	2022-05-09T08:54:48.688541379Z  +++ getent ahostsv4 host.docker.internal

	2022-05-09T08:54:48.704892876Z  + docker_host_ip=

	2022-05-09T08:54:48.704927706Z  + [[ -z '' ]]

	2022-05-09T08:54:48.705672035Z  ++ ip -4 route show default

	2022-05-09T08:54:48.705697608Z  ++ cut '-d ' -f3

	2022-05-09T08:54:48.707997158Z  + docker_host_ip=192.168.58.1

	2022-05-09T08:54:48.708291965Z  + iptables-save

	2022-05-09T08:54:48.708673076Z  + iptables-restore

	2022-05-09T08:54:48.710278828Z  + sed -e 's/-d 127.0.0.11/-d 192.168.58.1/g' -e 's/-A OUTPUT \(.*\) -j DOCKER_OUTPUT/\0\n-A PREROUTING \1 -j DOCKER_OUTPUT/' -e 's/--to-source :53/--to-source 192.168.58.1:53/g'

	2022-05-09T08:54:48.713519355Z  + cp /etc/resolv.conf /etc/resolv.conf.original

	2022-05-09T08:54:48.715214009Z  + sed -e s/127.0.0.11/192.168.58.1/g /etc/resolv.conf.original

	2022-05-09T08:54:48.721381801Z  ++ cut '-d ' -f1

	2022-05-09T08:54:48.721495582Z  ++ head -n1 /dev/fd/63

	2022-05-09T08:54:48.722167585Z  ++++ hostname

	2022-05-09T08:54:48.722925563Z  +++ getent ahostsv4 kubernetes-upgrade-20220509085441-6723

	2022-05-09T08:54:48.725827211Z  + curr_ipv4=192.168.58.2

	2022-05-09T08:54:48.725843524Z  + echo 'INFO: Detected IPv4 address: 192.168.58.2'

	2022-05-09T08:54:48.725847584Z  INFO: Detected IPv4 address: 192.168.58.2

	2022-05-09T08:54:48.725850354Z  + '[' -f /kind/old-ipv4 ']'

	2022-05-09T08:54:48.725963468Z  + [[ -n 192.168.58.2 ]]

	2022-05-09T08:54:48.725978216Z  + echo -n 192.168.58.2

	2022-05-09T08:54:48.727205326Z  ++ cut '-d ' -f1

	2022-05-09T08:54:48.727336070Z  ++ head -n1 /dev/fd/63

	2022-05-09T08:54:48.728589155Z  ++++ hostname

	2022-05-09T08:54:48.729390159Z  +++ getent ahostsv6 kubernetes-upgrade-20220509085441-6723

	2022-05-09T08:54:48.731247255Z  + curr_ipv6=

	2022-05-09T08:54:48.731361196Z  + echo 'INFO: Detected IPv6 address: '

	2022-05-09T08:54:48.731538731Z  INFO: Detected IPv6 address: 

	2022-05-09T08:54:48.731559946Z  + '[' -f /kind/old-ipv6 ']'

	2022-05-09T08:54:48.731563664Z  + [[ -n '' ]]

	2022-05-09T08:54:48.732112224Z  ++ uname -a

	2022-05-09T08:54:48.732929561Z  + echo 'entrypoint completed: Linux kubernetes-upgrade-20220509085441-6723 5.13.0-1024-gcp #29~20.04.1-Ubuntu SMP Thu Apr 14 23:15:00 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux'

	2022-05-09T08:54:48.733021973Z  entrypoint completed: Linux kubernetes-upgrade-20220509085441-6723 5.13.0-1024-gcp #29~20.04.1-Ubuntu SMP Thu Apr 14 23:15:00 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

	2022-05-09T08:54:48.733125482Z  + exec /sbin/init

	2022-05-09T08:54:48.741524396Z  systemd 245.4-4ubuntu3.15 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid)

	2022-05-09T08:54:48.741551150Z  Detected virtualization docker.

	2022-05-09T08:54:48.741554542Z  Detected architecture x86-64.

	2022-05-09T08:54:48.742168314Z  

	2022-05-09T08:54:48.742187397Z  Welcome to Ubuntu 20.04.4 LTS!

	2022-05-09T08:54:48.742192333Z  

	2022-05-09T08:54:48.742247475Z  Set hostname to <kubernetes-upgrade-20220509085441-6723>.

	2022-05-09T08:54:48.800205113Z  [  OK  ] Started Dispatch Password …ts to Console Directory Watch.

	2022-05-09T08:54:48.800438379Z  [  OK  ] Set up automount Arbitrary…s File System Automount Point.

	2022-05-09T08:54:48.800459193Z  [  OK  ] Reached target Local Encrypted Volumes.

	2022-05-09T08:54:48.800464673Z  [  OK  ] Reached target Network is Online.

	2022-05-09T08:54:48.800583296Z  [  OK  ] Reached target Paths.

	2022-05-09T08:54:48.800589856Z  [  OK  ] Reached target Slices.

	2022-05-09T08:54:48.800594456Z  [  OK  ] Reached target Swap.

	2022-05-09T08:54:48.800966471Z  [  OK  ] Listening on Journal Audit Socket.

	2022-05-09T08:54:48.801111687Z  [  OK  ] Listening on Journal Socket (/dev/log).

	2022-05-09T08:54:48.801292328Z  [  OK  ] Listening on Journal Socket.

	2022-05-09T08:54:48.803726050Z           Mounting Huge Pages File System...

	2022-05-09T08:54:48.805730665Z           Mounting Kernel Debug File System...

	2022-05-09T08:54:48.809219084Z           Mounting Kernel Trace File System...

	2022-05-09T08:54:48.811132246Z           Starting Journal Service...

	2022-05-09T08:54:48.851486030Z           Starting Create list of st…odes for the current kernel...

	2022-05-09T08:54:48.851541489Z           Mounting FUSE Control File System...

	2022-05-09T08:54:48.853491712Z           Starting Remount Root and Kernel File Systems...

	2022-05-09T08:54:48.863171459Z           Starting Apply Kernel Variables...

	2022-05-09T08:54:48.864697038Z  [  OK  ] Started Journal Service.

	2022-05-09T08:54:48.865160056Z  [  OK  ] Mounted Huge Pages File System.

	2022-05-09T08:54:48.865336584Z  [  OK  ] Mounted Kernel Debug File System.

	2022-05-09T08:54:48.865446089Z  [  OK  ] Mounted Kernel Trace File System.

	2022-05-09T08:54:48.866423358Z  [  OK  ] Finished Create list of st… nodes for the current kernel.

	2022-05-09T08:54:48.868044100Z  [  OK  ] Mounted FUSE Control File System.

	2022-05-09T08:54:48.868058259Z  [  OK  ] Finished Remount Root and Kernel File Systems.

	2022-05-09T08:54:48.869309096Z           Starting Flush Journal to Persistent Storage...

	2022-05-09T08:54:48.870576065Z           Starting Create System Users...

	2022-05-09T08:54:48.872015600Z           Starting Update UTMP about System Boot/Shutdown...

	2022-05-09T08:54:48.874644249Z  [  OK  ] Finished Apply Kernel Variables.

	2022-05-09T08:54:48.876972947Z  [  OK  ] Finished Flush Journal to Persistent Storage.

	2022-05-09T08:54:48.884175971Z  [  OK  ] Finished Update UTMP about System Boot/Shutdown.

	2022-05-09T08:54:48.894060711Z  [  OK  ] Finished Create System Users.

	2022-05-09T08:54:48.895689953Z           Starting Create Static Device Nodes in /dev...

	2022-05-09T08:54:48.902614909Z  [  OK  ] Finished Create Static Device Nodes in /dev.

	2022-05-09T08:54:48.902714982Z  [  OK  ] Reached target Local File Systems (Pre).

	2022-05-09T08:54:48.902867181Z  [  OK  ] Reached target Local File Systems.

	2022-05-09T08:54:48.903012035Z  [  OK  ] Reached target System Initialization.

	2022-05-09T08:54:48.903032663Z  [  OK  ] Started Daily Cleanup of Temporary Directories.

	2022-05-09T08:54:48.903077708Z  [  OK  ] Reached target Timers.

	2022-05-09T08:54:48.903254013Z  [  OK  ] Listening on BuildKit.

	2022-05-09T08:54:48.903375631Z  [  OK  ] Listening on D-Bus System Message Bus Socket.

	2022-05-09T08:54:48.904730907Z           Starting Docker Socket for the API.

	2022-05-09T08:54:48.907043709Z           Starting Podman API Socket.

	2022-05-09T08:54:48.907454928Z  [  OK  ] Listening on Docker Socket for the API.

	2022-05-09T08:54:48.908446763Z  [  OK  ] Listening on Podman API Socket.

	2022-05-09T08:54:48.908461725Z  [  OK  ] Reached target Sockets.

	2022-05-09T08:54:48.908467114Z  [  OK  ] Reached target Basic System.

	2022-05-09T08:54:48.909647516Z           Starting containerd container runtime...

	2022-05-09T08:54:48.911079878Z  [  OK  ] Started D-Bus System Message Bus.

	2022-05-09T08:54:48.914052209Z           Starting minikube automount...

	2022-05-09T08:54:48.915380293Z           Starting OpenBSD Secure Shell server...

	2022-05-09T08:54:48.942091320Z  [  OK  ] Finished minikube automount.

	2022-05-09T08:54:48.980803941Z  [  OK  ] Started OpenBSD Secure Shell server.

	2022-05-09T08:54:49.025097606Z  [  OK  ] Started containerd container runtime.

	2022-05-09T08:54:49.028943848Z           Starting Docker Application Container Engine...

	2022-05-09T08:54:49.388449759Z  [  OK  ] Started Docker Application Container Engine.

	2022-05-09T08:54:49.388489289Z  [  OK  ] Reached target Multi-User System.

	2022-05-09T08:54:49.388495868Z  [  OK  ] Reached target Graphical Interface.

	2022-05-09T08:54:49.390075201Z           Starting Update UTMP about System Runlevel Changes...

	2022-05-09T08:54:49.399372972Z  [  OK  ] Finished Update UTMP about System Runlevel Changes.

	2022-05-09T08:55:24.515684789Z  [  OK  ] Stopped target Graphical Interface.

	2022-05-09T08:55:24.515867703Z  [  OK  ] Stopped target Multi-User System.

	2022-05-09T08:55:24.516069122Z  [  OK  ] Stopped target Timers.

	2022-05-09T08:55:24.516232339Z  [  OK  ] Stopped Daily Cleanup of Temporary Directories.

	2022-05-09T08:55:24.519316635Z           Stopping D-Bus System Message Bus...

	2022-05-09T08:55:24.519582766Z           Stopping Docker Application Container Engine...

	2022-05-09T08:55:24.519843067Z           Stopping kubelet: The Kubernetes Node Agent...

	2022-05-09T08:55:24.520056189Z           Stopping OpenBSD Secure Shell server...

	2022-05-09T08:55:24.521788264Z  [  OK  ] Stopped D-Bus System Message Bus.

	2022-05-09T08:55:24.523074666Z  [  OK  ] Stopped OpenBSD Secure Shell server.

	2022-05-09T08:55:24.566159260Z  [  OK  ] Stopped kubelet: The Kubernetes Node Agent.

	2022-05-09T08:55:24.869124769Z  [  OK  ] Unmounted /var/lib/docker/…ee005ef76b2749893a3738/merged.

	2022-05-09T08:55:24.893760964Z  [  OK  ] Unmounted /var/lib/docker/…a0eb1c8e5d2467b89a7e07/merged.

	2022-05-09T08:55:24.910495067Z  [  OK  ] Unmounted /var/lib/docker/…538a4f4e67e2c7821c1139/merged.

	2022-05-09T08:55:24.915653406Z  [  OK  ] Unmounted /var/lib/docker/…050dba3b2923467dbe065d/merged.

	2022-05-09T08:55:24.919648050Z  [  OK  ] Unmounted /var/lib/docker/…ffae74027356e06d4f50f9/merged.

	2022-05-09T08:55:24.920955023Z  [  OK  ] Unmounted /var/lib/docker/…6b32c73da71531b6a3/mounts/shm.

	2022-05-09T08:55:24.921002151Z  [  OK  ] Unmounted /var/lib/docker/…c64a6ca6534a56da9795ba/merged.

	2022-05-09T08:55:24.928125021Z  [  OK  ] Unmounted /var/lib/docker/…8835f4b20ae9f34d9a/mounts/shm.

	2022-05-09T08:55:24.928151735Z  [  OK  ] Unmounted /var/lib/docker/…39f73d9ad064762af314d9/merged.

	2022-05-09T08:55:24.965615143Z  [  OK  ] Unmounted /var/lib/docker/…46f3b6963233d8fc86/mounts/shm.

	2022-05-09T08:55:24.966643475Z  [  OK  ] Unmounted /var/lib/docker/…63c55b66636b13c700df78/merged.

	2022-05-09T08:55:24.971831772Z  [  OK  ] Unmounted /var/lib/docker/…9a93d5503632eea0bd/mounts/shm.

	2022-05-09T08:55:24.973331139Z  [  OK  ] Unmounted /var/lib/docker/…fb16684640e9f42e2d6fa8/merged.

	2022-05-09T08:55:24.981349077Z  [  OK  ] Unmounted /var/lib/docker/…1995469e919e04d7a8/mounts/shm.

	2022-05-09T08:55:24.981464910Z  [  OK  ] Unmounted /var/lib/docker/…484bcb070061b068af436c/merged.

	2022-05-09T08:55:24.981636453Z  [  OK  ] Unmounted /var/lib/docker/…ecd58c34f93cbafa82/mounts/shm.

	2022-05-09T08:55:24.984855002Z  [  OK  ] Unmounted /var/lib/docker/…9550b71290b8c9796e0e98/merged.

	2022-05-09T08:55:27.946224275Z  [*     ] A stop job is running for Docker Ap…n Container Engine (1s / 1min 28s)

	2022-05-09T08:55:28.446217891Z  M
[**    ] A stop job is running for Docker Ap…n Container Engine (2s / 1min 28s)

	2022-05-09T08:55:28.946206312Z  M
[***   ] A stop job is running for Docker Ap…n Container Engine (2s / 1min 28s)

	2022-05-09T08:55:29.446197101Z  M
[ ***  ] A stop job is running for Docker Ap…n Container Engine (3s / 1min 28s)

	2022-05-09T08:55:29.946174641Z  M
[  *** ] A stop job is running for Docker Ap…n Container Engine (3s / 1min 28s)

	2022-05-09T08:55:30.446202226Z  M
[   ***] A stop job is running for Docker Ap…n Container Engine (4s / 1min 28s)

	2022-05-09T08:55:30.946343866Z  M
[    **] A stop job is running for Docker Ap…n Container Engine (4s / 1min 28s)

	2022-05-09T08:55:31.446240569Z  M
[     *] A stop job is running for Docker Ap…n Container Engine (5s / 1min 28s)

	2022-05-09T08:55:31.946210252Z  M
[    **] A stop job is running for Docker Ap…n Container Engine (5s / 1min 28s)

	2022-05-09T08:55:32.446244845Z  M
[   ***] A stop job is running for Docker Ap…n Container Engine (6s / 1min 28s)

	2022-05-09T08:55:32.946266274Z  M
[  *** ] A stop job is running for Docker Ap…n Container Engine (6s / 1min 28s)

	2022-05-09T08:55:33.446269782Z  M
[ ***  ] A stop job is running for Docker Ap…n Container Engine (7s / 1min 28s)

	2022-05-09T08:55:33.946217519Z  M
[***   ] A stop job is running for Docker Ap…n Container Engine (7s / 1min 28s)

	2022-05-09T08:55:34.446221269Z  M
[**    ] A stop job is running for Docker Ap…n Container Engine (8s / 1min 28s)

	2022-05-09T08:55:34.741819053Z  M
[  OK  ] Unmounted /var/lib/docker/…4d90fcc19c9dd2185e8206/merged.

	2022-05-09T08:55:34.762903828Z  [  OK  ] Stopped Docker Application Container Engine.

	2022-05-09T08:55:34.763006369Z  [  OK  ] Stopped target Network is Online.

	2022-05-09T08:55:34.763073811Z           Stopping containerd container runtime...

	2022-05-09T08:55:34.763801528Z  [  OK  ] Stopped minikube automount.

	2022-05-09T08:55:34.767383402Z  [  OK  ] Stopped containerd container runtime.

	2022-05-09T08:55:34.767535024Z  [  OK  ] Stopped target Basic System.

	2022-05-09T08:55:34.767551301Z  [  OK  ] Stopped target Paths.

	2022-05-09T08:55:34.767613735Z  [  OK  ] Stopped target Slices.

	2022-05-09T08:55:34.767641754Z  [  OK  ] Stopped target Sockets.

	2022-05-09T08:55:34.768262704Z  [  OK  ] Closed BuildKit.

	2022-05-09T08:55:34.768843514Z  [  OK  ] Closed D-Bus System Message Bus Socket.

	2022-05-09T08:55:34.769371617Z  [  OK  ] Closed Docker Socket for the API.

	2022-05-09T08:55:34.769908808Z  [  OK  ] Closed Podman API Socket.

	2022-05-09T08:55:34.769915903Z  [  OK  ] Stopped target System Initialization.

	2022-05-09T08:55:34.769948889Z  [  OK  ] Stopped target Local Encrypted Volumes.

	2022-05-09T08:55:34.785642278Z  [  OK  ] Stopped Dispatch Password …ts to Console Directory Watch.

	2022-05-09T08:55:34.785987158Z  [  OK  ] Stopped target Local File Systems.

	2022-05-09T08:55:34.787006032Z           Unmounting /data...

	2022-05-09T08:55:34.790417016Z           Unmounting /etc/hostname...

	2022-05-09T08:55:34.790441045Z           Unmounting /etc/hosts...

	2022-05-09T08:55:34.790445391Z           Unmounting /etc/resolv.conf...

	2022-05-09T08:55:34.790640208Z           Unmounting /kind/product_uuid...

	2022-05-09T08:55:34.792699462Z           Unmounting /run/docker/netns/default...

	2022-05-09T08:55:34.794912239Z           Unmounting /tmp/hostpath-provisioner...

	2022-05-09T08:55:34.797678077Z           Unmounting /tmp/hostpath_pv...

	2022-05-09T08:55:34.798619944Z           Unmounting /usr/lib/modules...

	2022-05-09T08:55:34.800275815Z           Unmounting /var/lib/kubele…cret/kube-proxy-token-cgwjt...

	2022-05-09T08:55:34.802011240Z           Unmounting /var/lib/kubele…~secret/coredns-token-6fhnf...

	2022-05-09T08:55:34.803417213Z           Unmounting /var/lib/kubele…age-provisioner-token-p8vbs...

	2022-05-09T08:55:34.804104710Z  [  OK  ] Stopped Apply Kernel Variables.

	2022-05-09T08:55:34.804963727Z           Stopping Update UTMP about System Boot/Shutdown...

	2022-05-09T08:55:34.808097022Z  [  OK  ] Unmounted /data.

	2022-05-09T08:55:34.808887823Z  [  OK  ] Unmounted /etc/hostname.

	2022-05-09T08:55:34.809561466Z  [  OK  ] Unmounted /etc/hosts.

	2022-05-09T08:55:34.810423733Z  [  OK  ] Unmounted /etc/resolv.conf.

	2022-05-09T08:55:34.811154862Z  [  OK  ] Unmounted /kind/product_uuid.

	2022-05-09T08:55:34.811897053Z  [  OK  ] Unmounted /run/docker/netns/default.

	2022-05-09T08:55:34.812589174Z  [  OK  ] Unmounted /tmp/hostpath-provisioner.

	2022-05-09T08:55:34.813609878Z  [  OK  ] Unmounted /tmp/hostpath_pv.

	2022-05-09T08:55:34.814478125Z  [  OK  ] Unmounted /usr/lib/modules.

	2022-05-09T08:55:34.815328236Z  [  OK  ] Unmounted /var/lib/kubelet…secret/kube-proxy-token-cgwjt.

	2022-05-09T08:55:34.816365714Z  [  OK  ] Unmounted /var/lib/kubelet…io~secret/coredns-token-6fhnf.

	2022-05-09T08:55:34.817679811Z  [  OK  ] Unmounted /var/lib/kubelet…orage-provisioner-token-p8vbs.

	2022-05-09T08:55:34.820457428Z           Unmounting /tmp...

	2022-05-09T08:55:34.824128102Z  [  OK  ] Stopped Update UTMP about System Boot/Shutdown.

	2022-05-09T08:55:34.825867452Z  [  OK  ] Unmounted /tmp.

	2022-05-09T08:55:34.826089373Z  [  OK  ] Stopped target Swap.

	2022-05-09T08:55:34.826902988Z           Unmounting /var...

	2022-05-09T08:55:34.831108502Z  [  OK  ] Unmounted /var.

	2022-05-09T08:55:34.831294727Z  [  OK  ] Stopped target Local File Systems (Pre).

	2022-05-09T08:55:34.831375743Z  [  OK  ] Reached target Unmount All Filesystems.

	2022-05-09T08:55:34.832107670Z  [  OK  ] Stopped Create Static Device Nodes in /dev.

	2022-05-09T08:55:34.832891870Z  [  OK  ] Stopped Create System Users.

	2022-05-09T08:55:34.833667869Z  [  OK  ] Stopped Remount Root and Kernel File Systems.

	2022-05-09T08:55:34.833743159Z  [  OK  ] Reached target Shutdown.

	2022-05-09T08:55:34.833751217Z  [  OK  ] Reached target Final Step.

	2022-05-09T08:55:34.838833342Z           Starting Halt...

	2022-05-09T08:55:34.838855197Z  [  OK  ] Finished Power-Off.

	2022-05-09T08:55:34.838861739Z  [  OK  ] Reached target Power-Off.

	-- /stdout --

	I0509 08:55:36.447350  195809 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0509 08:55:36.577232  195809 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:60 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:59 SystemTime:2022-05-09 08:55:36.479101126 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.13.0-1024-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexSer

verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662799872 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-14 Labels:[] ExperimentalBuild:false ServerVersion:20.10.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Clie

ntInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}

	I0509 08:55:36.577340  195809 errors.go:98] postmortem docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:60 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:55 OomKillDisable:true NGoroutines:59 SystemTime:2022-05-09 08:55:36.479101126 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.13.0-1024-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86

_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662799872 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-14 Labels:[] ExperimentalBuild:false ServerVersion:20.10.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerEr

rors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}

	I0509 08:55:36.577415  195809 network_create.go:272] running [docker network inspect kubernetes-upgrade-20220509085441-6723] to gather additional debugging logs...

	I0509 08:55:36.577435  195809 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-20220509085441-6723

	W0509 08:55:36.634921  195809 cli_runner.go:211] docker network inspect kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:36.634967  195809 network_create.go:275] error running [docker network inspect kubernetes-upgrade-20220509085441-6723]: docker network inspect kubernetes-upgrade-20220509085441-6723: exit status 1

	stdout:

	[]

	stderr:

	Error: No such network: kubernetes-upgrade-20220509085441-6723

	I0509 08:55:36.635004  195809 network_create.go:277] output of [docker network inspect kubernetes-upgrade-20220509085441-6723]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error: No such network: kubernetes-upgrade-20220509085441-6723

	** /stderr **

	I0509 08:55:36.635163  195809 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0509 08:55:36.770942  195809 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:60 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:59 SystemTime:2022-05-09 08:55:36.670602141 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.13.0-1024-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexSer

verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662799872 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-14 Labels:[] ExperimentalBuild:false ServerVersion:20.10.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Clie

ntInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}

	I0509 08:55:36.771352  195809 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20220509085441-6723

	I0509 08:55:36.810854  195809 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/kubernetes-upgrade-20220509085441-6723/config.json ...

	I0509 08:55:36.811131  195809 machine.go:88] provisioning docker machine ...

	I0509 08:55:36.811162  195809 ubuntu.go:169] provisioning hostname "kubernetes-upgrade-20220509085441-6723"

	I0509 08:55:36.811224  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:36.846821  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:36.846903  195809 machine.go:91] provisioned docker machine in 35.754634ms

	I0509 08:55:36.846973  195809 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0509 08:55:36.847024  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:36.884481  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:36.884633  195809 retry.go:31] will retry after 276.165072ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:37.161092  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:37.197720  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:37.197839  195809 retry.go:31] will retry after 540.190908ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:37.738568  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:37.777633  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:37.777742  195809 retry.go:31] will retry after 655.06503ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:38.433573  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:38.473894  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	W0509 08:55:38.474014  195809 start.go:281] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	W0509 08:55:38.474063  195809 start.go:248] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:38.474108  195809 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0509 08:55:38.474160  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:38.531963  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:38.532083  195809 retry.go:31] will retry after 231.159374ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:38.764376  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:38.798422  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:38.798520  195809 retry.go:31] will retry after 445.058653ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:39.244144  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:39.277681  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:39.277802  195809 retry.go:31] will retry after 318.170823ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:39.596203  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:39.640159  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:39.640310  195809 retry.go:31] will retry after 553.938121ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:40.195180  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:40.229165  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	W0509 08:55:40.229273  195809 start.go:296] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	W0509 08:55:40.229300  195809 start.go:253] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:40.229326  195809 fix.go:57] fixHost completed within 4.091404079s

	I0509 08:55:40.229336  195809 start.go:81] releasing machines lock for "kubernetes-upgrade-20220509085441-6723", held for 4.091437904s

	W0509 08:55:40.229365  195809 start.go:576] error starting host: provision: get ssh host-port: unable to inspect a not running container to get SSH port

	W0509 08:55:40.229512  195809 out.go:239] ! StartHost failed, but will try again: provision: get ssh host-port: unable to inspect a not running container to get SSH port

	! StartHost failed, but will try again: provision: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:40.229532  195809 start.go:591] Will try again in 5 seconds ...

	I0509 08:55:45.232716  195809 start.go:352] acquiring machines lock for kubernetes-upgrade-20220509085441-6723: {Name:mk4b33cce4d6cf1758fd22377d4a179c0c038c8f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0509 08:55:45.232898  195809 start.go:356] acquired machines lock for "kubernetes-upgrade-20220509085441-6723" in 128.597µs

	I0509 08:55:45.232930  195809 start.go:94] Skipping create...Using existing machine configuration

	I0509 08:55:45.232936  195809 fix.go:55] fixHost starting: 

	I0509 08:55:45.233180  195809 cli_runner.go:164] Run: docker container inspect kubernetes-upgrade-20220509085441-6723 --format={{.State.Status}}

	I0509 08:55:45.265890  195809 fix.go:103] recreateIfNeeded on kubernetes-upgrade-20220509085441-6723: state=Stopped err=<nil>

	W0509 08:55:45.265931  195809 fix.go:129] unexpected machine state, will restart: <nil>

	I0509 08:55:45.643274  195809 out.go:177] * Restarting existing docker container for "kubernetes-upgrade-20220509085441-6723" ...

	I0509 08:55:45.771788  195809 cli_runner.go:164] Run: docker start kubernetes-upgrade-20220509085441-6723

	W0509 08:55:47.753393  195809 cli_runner.go:211] docker start kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:47.753426  195809 cli_runner.go:217] Completed: docker start kubernetes-upgrade-20220509085441-6723: (1.891165098s)

	I0509 08:55:47.753488  195809 cli_runner.go:164] Run: docker inspect kubernetes-upgrade-20220509085441-6723

	I0509 08:55:47.787646  195809 errors.go:84] Postmortem inspect ("docker inspect kubernetes-upgrade-20220509085441-6723"): -- stdout --

	[

	    {

	        "Id": "9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55",

	        "Created": "2022-05-09T08:54:48.053286897Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "exited",

	            "Running": false,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 0,

	            "ExitCode": 130,

	            "Error": "network ab3dc0e987463e0d1919f0f30610dba9f36f6956dd59c0979fddc98d5b653e0f not found",

	            "StartedAt": "2022-05-09T08:54:48.472807369Z",

	            "FinishedAt": "2022-05-09T08:55:34.933426699Z"

	        },

	        "Image": "sha256:44d43b69f3d5ba7f801dca891b535f23f9839671e82277938ec7dc42a22c50d6",

	        "ResolvConfPath": "/var/lib/docker/containers/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55/hostname",

	        "HostsPath": "/var/lib/docker/containers/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55/hosts",

	        "LogPath": "/var/lib/docker/containers/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55-json.log",

	        "Name": "/kubernetes-upgrade-20220509085441-6723",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "unconfined",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "kubernetes-upgrade-20220509085441-6723:/var",

	                "/lib/modules:/lib/modules:ro"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "kubernetes-upgrade-20220509085441-6723",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 0,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 0,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/4c80c52a664c1dfd1bf7928b1d2ccd53938fa6eb9de02e184ba37e8eb872a866-init/diff:/var/lib/docker/overlay2/beaaca4c58fe6ff4bdb88567c3d78ab7a23955eafaa5637df03ee2e0482d2aa6/diff:/var/lib/docker/overlay2/7c16b810bbfa3a2abff75078fa37b4cba0b2f101ff43d49beaabc3fd2602b1c9/diff:/var/lib/docker/overlay2/60f04c0e4baa8ad1c02ae5e34e6f505db0d740e2d7dc0833b2ff3b8037c1a9b6/diff:/var/lib/docker/overlay2/a12543300ae4ff803b2f0493a60a04a921312ec5a7b6ed493e66acadf998daef/diff:/var/lib/docker/overlay2/2d68f658a64cd8b7255bce93547db5d1b20b119ef6da8b9ce06614134661f235/diff:/var/lib/docker/overlay2/0f968f210c1565f6e8c4e444c650502c06a120d8767c9fefb7b6b2a09f4af83b/diff:/var/lib/docker/overlay2/987a67893acdccd514357a50db6c11680ae1899ec07a36085367a241ba1f0545/diff:/var/lib/docker/overlay2/d5446d1adc007f4390aa6173ef257b0bf52a9c9cc6533f16dd6c577fde5334b3/diff:/var/lib/docker/overlay2/265dd0cde77d578f6412ad48596c75c3548b5e077059c0fa835e4f22775fab83/diff:/var/lib/docker/overlay2/e6b98b

08dd64e06639e2a321169f84a89e8d21cea02d673819156eeb7a4747c3/diff:/var/lib/docker/overlay2/acf7117613a840e97b7a1101bfdce3a154a335ee0ffcaf74bd7f1b27b00cdaab/diff:/var/lib/docker/overlay2/9e88fa64aa800dac6e01eddc9cfd525a0dcd906c1adf98de066be87f87a6b52c/diff:/var/lib/docker/overlay2/6c539edead197cd449ca81fd34e3c534a6ca25446a52141d0ae4484aaac05482/diff:/var/lib/docker/overlay2/866719c52f41a692b94f42071d314de55b290912f946f4ec5f3785a7a5ae40df/diff:/var/lib/docker/overlay2/1c488a9b3bad141652873f4085ce1a466e1f1e8ccbd086d03a492b45179a6064/diff:/var/lib/docker/overlay2/bce5b942da09326e5a5c8595077544ced08031b1cd9b22ff8bff0a4458540139/diff:/var/lib/docker/overlay2/ffe34c3764a4eeac791f4672d47389ec3f399f716ab6e5531d7c5e587f3ace00/diff:/var/lib/docker/overlay2/a377e0779d03467b09a26898ae35b12f325d62984304817f49c693b2146c08f4/diff:/var/lib/docker/overlay2/6092380f07b29488cf0a30cb486638d86eaa8e00ff356a7985c6ac6f2fae5c1d/diff:/var/lib/docker/overlay2/1bc014cc0cf0a91c61f131c06b0194709f853dec23defe9233cbd9cc40030c28/diff:/var/lib/d

ocker/overlay2/0c81c4db7384c48318a800165af7f811348a8081efdd9dbd912e05e55c9eb4e0/diff:/var/lib/docker/overlay2/72b0c515d90bc71e27b766a9be89e315777a5bbe643d8fc508a9ae12557a58ce/diff:/var/lib/docker/overlay2/a4d193bf8c377d4cf1357b9261d3c54d995f17bda3db5abee3ef5caec001d75e/diff:/var/lib/docker/overlay2/763c6d291074b0842ecdeec1f3842fd6a0af0cb86839c82bc38cec0f40d095ca/diff:/var/lib/docker/overlay2/e4156eb2a94ac7136eb674fb8c22ea7f6dff50cd81e4857119d81112dc5ad99d/diff:/var/lib/docker/overlay2/be7effa3bb906b8c48aefab3cc72e657931bccd42c35b03bb52c679c37c70d25/diff:/var/lib/docker/overlay2/ccf8c1a68774cc6129c43490c675e6ba0ff0c88284ad899c9efb4b7492e92a06/diff:/var/lib/docker/overlay2/55f74cddb5c8f2da1131ddd67f7f2a20b8c2be8719b71047d5185fdb4722627d/diff:/var/lib/docker/overlay2/f6c38e83545e9de87d03b1e8e9b0239079acf47784afc11291b2172a11f8296d/diff:/var/lib/docker/overlay2/24604ce83180fcb6b9e1adbaf37db6776e4949ca5e1f4f9050b8fb8dc87d7591/diff:/var/lib/docker/overlay2/b03b1952bea32e53ce88b0d92d09f78ca76ceca0a146b088628be224813

ae87c/diff:/var/lib/docker/overlay2/d7ee02a5ba355c246c3107f286c4130457358aa56e0d8feb3850d953812fe76d/diff:/var/lib/docker/overlay2/1223ae0e5105ae89c78524490f0ccc5fe6dfa373e175fa70474b06c62aad91c7/diff:/var/lib/docker/overlay2/c3209d71eed94ed66b11ba3a7573c347d5c09a5a4fedb00418e52571abb2b5f9/diff:/var/lib/docker/overlay2/d6d32632e36023dec15e643fd41f77168442327cecdead87a47e70683cb0c660/diff:/var/lib/docker/overlay2/fd413b21f1f34027c98a1b4106f7e7db83e910860edd53ef838ac699659cd451/diff:/var/lib/docker/overlay2/9768e3244c157a7a12b8ec31507c1abc0fc806a9f325099262cfeb41e23a5fe1/diff:/var/lib/docker/overlay2/f65dda9d5b79903f5e68f6b9d4a59214d62f304da77faa7e148b90b402d98ca4/diff:/var/lib/docker/overlay2/b663c2dab6b5df7b606daa62e1df5e57f4a2503c2a9a19211f47359fd685dccf/diff:/var/lib/docker/overlay2/bbd620a7e494844db80a2bcd2fd6f170080c5273f1c33a576501214dd4475464/diff:/var/lib/docker/overlay2/23de36667695cec8ea0f4c98fc580213d356d39a3eba5aaab8b6ebeeb2b71596/diff:/var/lib/docker/overlay2/bafb3e8d91e83dcf824b6d5b3f56a67c483c42

723724b009a5aedf578351154f/diff:/var/lib/docker/overlay2/2798e8ce2f51dde257a9cf2dd800492f888fd02515c5f1de4133cc787ee12928/diff:/var/lib/docker/overlay2/e69a88f2dffdd2c7f72c45eaf2e3cd1a8772e0a2af22d6f34d2695bbda62b6e9/diff:/var/lib/docker/overlay2/708816f20892c0e4b94cbe8e80b169fff54ffd870bcde395bd8163dd03b25d0f/diff",

	                "MergedDir": "/var/lib/docker/overlay2/4c80c52a664c1dfd1bf7928b1d2ccd53938fa6eb9de02e184ba37e8eb872a866/merged",

	                "UpperDir": "/var/lib/docker/overlay2/4c80c52a664c1dfd1bf7928b1d2ccd53938fa6eb9de02e184ba37e8eb872a866/diff",

	                "WorkDir": "/var/lib/docker/overlay2/4c80c52a664c1dfd1bf7928b1d2ccd53938fa6eb9de02e184ba37e8eb872a866/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "volume",

	                "Name": "kubernetes-upgrade-20220509085441-6723",

	                "Source": "/var/lib/docker/volumes/kubernetes-upgrade-20220509085441-6723/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            },

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            }

	        ],

	        "Config": {

	            "Hostname": "kubernetes-upgrade-20220509085441-6723",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "kubernetes-upgrade-20220509085441-6723",

	                "name.minikube.sigs.k8s.io": "kubernetes-upgrade-20220509085441-6723",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "4d9bdd6efabd7d19b0c4b1317d302d4bdff4657c9fa9a1027917f2a96a3ba380",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {},

	            "SandboxKey": "/var/run/docker/netns/4d9bdd6efabd",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "kubernetes-upgrade-20220509085441-6723": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.58.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "9eeef2af4bd8",

	                        "kubernetes-upgrade-20220509085441-6723"

	                    ],

	                    "NetworkID": "ab3dc0e987463e0d1919f0f30610dba9f36f6956dd59c0979fddc98d5b653e0f",

	                    "EndpointID": "",

	                    "Gateway": "",

	                    "IPAddress": "",

	                    "IPPrefixLen": 0,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

	-- /stdout --

	I0509 08:55:47.787728  195809 cli_runner.go:164] Run: docker logs --timestamps --details kubernetes-upgrade-20220509085441-6723

	I0509 08:55:47.825514  195809 errors.go:91] Postmortem logs ("docker logs --timestamps --details kubernetes-upgrade-20220509085441-6723"): -- stdout --

	2022-05-09T08:54:48.471260248Z  + userns=

	2022-05-09T08:54:48.471300634Z  + grep -Eqv '0[[:space:]]+0[[:space:]]+4294967295' /proc/self/uid_map

	2022-05-09T08:54:48.474122330Z  + validate_userns

	2022-05-09T08:54:48.474168246Z  + [[ -z '' ]]

	2022-05-09T08:54:48.474173803Z  + return

	2022-05-09T08:54:48.474177777Z  + configure_containerd

	2022-05-09T08:54:48.474507815Z  ++ stat -f -c %T /kind

	2022-05-09T08:54:48.475796885Z  + [[ overlayfs == \z\f\s ]]

	2022-05-09T08:54:48.475826600Z  + configure_proxy

	2022-05-09T08:54:48.475831768Z  + mkdir -p /etc/systemd/system.conf.d/

	2022-05-09T08:54:48.477517626Z  + [[ ! -z '' ]]

	2022-05-09T08:54:48.478304723Z  + cat

	2022-05-09T08:54:48.479273664Z  + fix_kmsg

	2022-05-09T08:54:48.479288630Z  + [[ ! -e /dev/kmsg ]]

	2022-05-09T08:54:48.479292377Z  + fix_mount

	2022-05-09T08:54:48.479295903Z  + echo 'INFO: ensuring we can execute mount/umount even with userns-remap'

	2022-05-09T08:54:48.479299826Z  INFO: ensuring we can execute mount/umount even with userns-remap

	2022-05-09T08:54:48.479708646Z  ++ which mount

	2022-05-09T08:54:48.481144595Z  ++ which umount

	2022-05-09T08:54:48.481900596Z  + chown root:root /usr/bin/mount /usr/bin/umount

	2022-05-09T08:54:48.488289063Z  ++ which mount

	2022-05-09T08:54:48.490367491Z  ++ which umount

	2022-05-09T08:54:48.490389164Z  + chmod -s /usr/bin/mount /usr/bin/umount

	2022-05-09T08:54:48.492038039Z  +++ which mount

	2022-05-09T08:54:48.493067021Z  ++ stat -f -c %T /usr/bin/mount

	2022-05-09T08:54:48.497479312Z  + [[ overlayfs == \a\u\f\s ]]

	2022-05-09T08:54:48.497502256Z  + [[ -z '' ]]

	2022-05-09T08:54:48.497506840Z  + echo 'INFO: remounting /sys read-only'

	2022-05-09T08:54:48.497510298Z  INFO: remounting /sys read-only

	2022-05-09T08:54:48.497513782Z  + mount -o remount,ro /sys

	2022-05-09T08:54:48.499860533Z  + echo 'INFO: making mounts shared'

	2022-05-09T08:54:48.499970184Z  INFO: making mounts shared

	2022-05-09T08:54:48.500098327Z  + mount --make-rshared /

	2022-05-09T08:54:48.502999281Z  + retryable_fix_cgroup

	2022-05-09T08:54:48.503018220Z  ++ seq 0 10

	2022-05-09T08:54:48.503314614Z  + for i in $(seq 0 10)

	2022-05-09T08:54:48.503325876Z  + fix_cgroup

	2022-05-09T08:54:48.503418417Z  + [[ -f /sys/fs/cgroup/cgroup.controllers ]]

	2022-05-09T08:54:48.503435857Z  + echo 'INFO: detected cgroup v1'

	2022-05-09T08:54:48.503440024Z  INFO: detected cgroup v1

	2022-05-09T08:54:48.505852156Z  + echo 'INFO: fix cgroup mounts for all subsystems'

	2022-05-09T08:54:48.505874933Z  INFO: fix cgroup mounts for all subsystems

	2022-05-09T08:54:48.505893332Z  + local current_cgroup

	2022-05-09T08:54:48.505897149Z  ++ cut -d: -f3

	2022-05-09T08:54:48.505900717Z  ++ grep -E '^[^:]*:([^:]*,)?cpu(,[^,:]*)?:.*' /proc/self/cgroup

	2022-05-09T08:54:48.506496662Z  + current_cgroup=/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.506514273Z  + local cgroup_subsystems

	2022-05-09T08:54:48.507099718Z  ++ findmnt -lun -o source,target -t cgroup

	2022-05-09T08:54:48.507378391Z  ++ grep /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.507587122Z  ++ awk '{print $2}'

	2022-05-09T08:54:48.510297098Z  + cgroup_subsystems='/sys/fs/cgroup/systemd

	2022-05-09T08:54:48.510313375Z  /sys/fs/cgroup/net_cls,net_prio

	2022-05-09T08:54:48.510317236Z  /sys/fs/cgroup/pids

	2022-05-09T08:54:48.510320633Z  /sys/fs/cgroup/blkio

	2022-05-09T08:54:48.510324192Z  /sys/fs/cgroup/cpu,cpuacct

	2022-05-09T08:54:48.510327641Z  /sys/fs/cgroup/freezer

	2022-05-09T08:54:48.510330968Z  /sys/fs/cgroup/rdma

	2022-05-09T08:54:48.510334467Z  /sys/fs/cgroup/memory

	2022-05-09T08:54:48.510338489Z  /sys/fs/cgroup/devices

	2022-05-09T08:54:48.510340858Z  /sys/fs/cgroup/cpuset

	2022-05-09T08:54:48.510342979Z  /sys/fs/cgroup/hugetlb

	2022-05-09T08:54:48.510345057Z  /sys/fs/cgroup/perf_event'

	2022-05-09T08:54:48.510347956Z  + local cgroup_mounts

	2022-05-09T08:54:48.512398069Z  ++ grep -E -o '/[[:alnum:]].* /sys/fs/cgroup.*.*cgroup' /proc/self/mountinfo

	2022-05-09T08:54:48.512413387Z  + cgroup_mounts='/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/systemd rw,nosuid,nodev,noexec,relatime shared:383 master:9 - cgroup cgroup

	2022-05-09T08:54:48.512418877Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/net_cls,net_prio rw,nosuid,nodev,noexec,relatime shared:388 master:16 - cgroup cgroup

	2022-05-09T08:54:48.512423102Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/pids rw,nosuid,nodev,noexec,relatime shared:389 master:17 - cgroup cgroup

	2022-05-09T08:54:48.512427285Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/blkio rw,nosuid,nodev,noexec,relatime shared:403 master:18 - cgroup cgroup

	2022-05-09T08:54:48.512431215Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/cpu,cpuacct rw,nosuid,nodev,noexec,relatime shared:404 master:19 - cgroup cgroup

	2022-05-09T08:54:48.512438201Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/freezer rw,nosuid,nodev,noexec,relatime shared:405 master:20 - cgroup cgroup

	2022-05-09T08:54:48.512442056Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/rdma rw,nosuid,nodev,noexec,relatime shared:406 master:21 - cgroup cgroup

	2022-05-09T08:54:48.512458710Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/memory rw,nosuid,nodev,noexec,relatime shared:407 master:22 - cgroup cgroup

	2022-05-09T08:54:48.512462814Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/devices rw,nosuid,nodev,noexec,relatime shared:408 master:23 - cgroup cgroup

	2022-05-09T08:54:48.512466523Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/cpuset rw,nosuid,nodev,noexec,relatime shared:409 master:24 - cgroup cgroup

	2022-05-09T08:54:48.512470016Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/hugetlb rw,nosuid,nodev,noexec,relatime shared:424 master:25 - cgroup cgroup

	2022-05-09T08:54:48.512475266Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/perf_event rw,nosuid,nodev,noexec,relatime shared:425 master:26 - cgroup cgroup'

	2022-05-09T08:54:48.512478724Z  + [[ -n /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/systemd rw,nosuid,nodev,noexec,relatime shared:383 master:9 - cgroup cgroup

	2022-05-09T08:54:48.512482419Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/net_cls,net_prio rw,nosuid,nodev,noexec,relatime shared:388 master:16 - cgroup cgroup

	2022-05-09T08:54:48.512486367Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/pids rw,nosuid,nodev,noexec,relatime shared:389 master:17 - cgroup cgroup

	2022-05-09T08:54:48.512490051Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/blkio rw,nosuid,nodev,noexec,relatime shared:403 master:18 - cgroup cgroup

	2022-05-09T08:54:48.512493777Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/cpu,cpuacct rw,nosuid,nodev,noexec,relatime shared:404 master:19 - cgroup cgroup

	2022-05-09T08:54:48.512497218Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/freezer rw,nosuid,nodev,noexec,relatime shared:405 master:20 - cgroup cgroup

	2022-05-09T08:54:48.512500751Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/rdma rw,nosuid,nodev,noexec,relatime shared:406 master:21 - cgroup cgroup

	2022-05-09T08:54:48.512504301Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/memory rw,nosuid,nodev,noexec,relatime shared:407 master:22 - cgroup cgroup

	2022-05-09T08:54:48.512507809Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/devices rw,nosuid,nodev,noexec,relatime shared:408 master:23 - cgroup cgroup

	2022-05-09T08:54:48.512511212Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/cpuset rw,nosuid,nodev,noexec,relatime shared:409 master:24 - cgroup cgroup

	2022-05-09T08:54:48.512515161Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/hugetlb rw,nosuid,nodev,noexec,relatime shared:424 master:25 - cgroup cgroup

	2022-05-09T08:54:48.512517993Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/perf_event rw,nosuid,nodev,noexec,relatime shared:425 master:26 - cgroup cgroup ]]

	2022-05-09T08:54:48.512520323Z  + local mount_root

	2022-05-09T08:54:48.513098271Z  ++ head -n 1

	2022-05-09T08:54:48.513247350Z  ++ cut '-d ' -f1

	2022-05-09T08:54:48.514855693Z  + mount_root=/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.515628508Z  ++ echo '/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/systemd rw,nosuid,nodev,noexec,relatime shared:383 master:9 - cgroup cgroup

	2022-05-09T08:54:48.515643884Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/net_cls,net_prio rw,nosuid,nodev,noexec,relatime shared:388 master:16 - cgroup cgroup

	2022-05-09T08:54:48.515648480Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/pids rw,nosuid,nodev,noexec,relatime shared:389 master:17 - cgroup cgroup

	2022-05-09T08:54:48.515652395Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/blkio rw,nosuid,nodev,noexec,relatime shared:403 master:18 - cgroup cgroup

	2022-05-09T08:54:48.515656142Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/cpu,cpuacct rw,nosuid,nodev,noexec,relatime shared:404 master:19 - cgroup cgroup

	2022-05-09T08:54:48.515659817Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/freezer rw,nosuid,nodev,noexec,relatime shared:405 master:20 - cgroup cgroup

	2022-05-09T08:54:48.515663264Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/rdma rw,nosuid,nodev,noexec,relatime shared:406 master:21 - cgroup cgroup

	2022-05-09T08:54:48.515667045Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/memory rw,nosuid,nodev,noexec,relatime shared:407 master:22 - cgroup cgroup

	2022-05-09T08:54:48.515670224Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/devices rw,nosuid,nodev,noexec,relatime shared:408 master:23 - cgroup cgroup

	2022-05-09T08:54:48.515674419Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/cpuset rw,nosuid,nodev,noexec,relatime shared:409 master:24 - cgroup cgroup

	2022-05-09T08:54:48.515678065Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/hugetlb rw,nosuid,nodev,noexec,relatime shared:424 master:25 - cgroup cgroup

	2022-05-09T08:54:48.515681567Z  /docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55 /sys/fs/cgroup/perf_event rw,nosuid,nodev,noexec,relatime shared:425 master:26 - cgroup cgroup'

	2022-05-09T08:54:48.515685160Z  ++ cut '-d ' -f 2

	2022-05-09T08:54:48.516591908Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.516645425Z  + local target=/sys/fs/cgroup/systemd/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.516651252Z  + findmnt /sys/fs/cgroup/systemd/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.519106998Z  + mkdir -p /sys/fs/cgroup/systemd/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.520529803Z  + mount --bind /sys/fs/cgroup/systemd /sys/fs/cgroup/systemd/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.522379054Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.522395958Z  + local target=/sys/fs/cgroup/net_cls,net_prio/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.522400516Z  + findmnt /sys/fs/cgroup/net_cls,net_prio/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.524330806Z  + mkdir -p /sys/fs/cgroup/net_cls,net_prio/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.525477673Z  + mount --bind /sys/fs/cgroup/net_cls,net_prio /sys/fs/cgroup/net_cls,net_prio/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.526982499Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.526999060Z  + local target=/sys/fs/cgroup/pids/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.527003545Z  + findmnt /sys/fs/cgroup/pids/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.528845140Z  + mkdir -p /sys/fs/cgroup/pids/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.529882718Z  + mount --bind /sys/fs/cgroup/pids /sys/fs/cgroup/pids/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.531050445Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.531070607Z  + local target=/sys/fs/cgroup/blkio/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.531127184Z  + findmnt /sys/fs/cgroup/blkio/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.533028373Z  + mkdir -p /sys/fs/cgroup/blkio/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.534462055Z  + mount --bind /sys/fs/cgroup/blkio /sys/fs/cgroup/blkio/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.536092612Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.536110411Z  + local target=/sys/fs/cgroup/cpu,cpuacct/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.536115415Z  + findmnt /sys/fs/cgroup/cpu,cpuacct/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.538673739Z  + mkdir -p /sys/fs/cgroup/cpu,cpuacct/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.539915877Z  + mount --bind /sys/fs/cgroup/cpu,cpuacct /sys/fs/cgroup/cpu,cpuacct/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.541437087Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.541455190Z  + local target=/sys/fs/cgroup/freezer/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.541460132Z  + findmnt /sys/fs/cgroup/freezer/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.543391313Z  + mkdir -p /sys/fs/cgroup/freezer/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.545772098Z  + mount --bind /sys/fs/cgroup/freezer /sys/fs/cgroup/freezer/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.547248575Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.547267260Z  + local target=/sys/fs/cgroup/rdma/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.547272562Z  + findmnt /sys/fs/cgroup/rdma/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.549630691Z  + mkdir -p /sys/fs/cgroup/rdma/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.550641817Z  + mount --bind /sys/fs/cgroup/rdma /sys/fs/cgroup/rdma/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.551961871Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.551974887Z  + local target=/sys/fs/cgroup/memory/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.551979418Z  + findmnt /sys/fs/cgroup/memory/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.553965667Z  + mkdir -p /sys/fs/cgroup/memory/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.555098664Z  + mount --bind /sys/fs/cgroup/memory /sys/fs/cgroup/memory/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.556707022Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.556726328Z  + local target=/sys/fs/cgroup/devices/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.556730861Z  + findmnt /sys/fs/cgroup/devices/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.558608335Z  + mkdir -p /sys/fs/cgroup/devices/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.559691381Z  + mount --bind /sys/fs/cgroup/devices /sys/fs/cgroup/devices/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.561100946Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.561116387Z  + local target=/sys/fs/cgroup/cpuset/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.561120903Z  + findmnt /sys/fs/cgroup/cpuset/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.562920076Z  + mkdir -p /sys/fs/cgroup/cpuset/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.597307309Z  + mount --bind /sys/fs/cgroup/cpuset /sys/fs/cgroup/cpuset/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.598832008Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.598864762Z  + local target=/sys/fs/cgroup/hugetlb/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.598869311Z  + findmnt /sys/fs/cgroup/hugetlb/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.600653125Z  + mkdir -p /sys/fs/cgroup/hugetlb/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.601936277Z  + mount --bind /sys/fs/cgroup/hugetlb /sys/fs/cgroup/hugetlb/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.603327936Z  + for mount_point in $(echo "${cgroup_mounts}" | cut -d' ' -f 2)

	2022-05-09T08:54:48.603345656Z  + local target=/sys/fs/cgroup/perf_event/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.603356206Z  + findmnt /sys/fs/cgroup/perf_event/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.605703733Z  + mkdir -p /sys/fs/cgroup/perf_event/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.606930655Z  + mount --bind /sys/fs/cgroup/perf_event /sys/fs/cgroup/perf_event/docker/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55

	2022-05-09T08:54:48.608352931Z  + mount --make-rprivate /sys/fs/cgroup

	2022-05-09T08:54:48.610192609Z  + echo '/sys/fs/cgroup/systemd

	2022-05-09T08:54:48.610206857Z  /sys/fs/cgroup/net_cls,net_prio

	2022-05-09T08:54:48.610220939Z  /sys/fs/cgroup/pids

	2022-05-09T08:54:48.610224594Z  /sys/fs/cgroup/blkio

	2022-05-09T08:54:48.610228030Z  /sys/fs/cgroup/cpu,cpuacct

	2022-05-09T08:54:48.610231475Z  /sys/fs/cgroup/freezer

	2022-05-09T08:54:48.610234947Z  /sys/fs/cgroup/rdma

	2022-05-09T08:54:48.610238274Z  /sys/fs/cgroup/memory

	2022-05-09T08:54:48.610252110Z  /sys/fs/cgroup/devices

	2022-05-09T08:54:48.610255784Z  /sys/fs/cgroup/cpuset

	2022-05-09T08:54:48.610259138Z  /sys/fs/cgroup/hugetlb

	2022-05-09T08:54:48.610262284Z  /sys/fs/cgroup/perf_event'

	2022-05-09T08:54:48.610272595Z  + IFS=

	2022-05-09T08:54:48.610276540Z  + read -r subsystem

	2022-05-09T08:54:48.610371307Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/systemd

	2022-05-09T08:54:48.610393767Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.610447245Z  + local subsystem=/sys/fs/cgroup/systemd

	2022-05-09T08:54:48.610464114Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.610513753Z  + mkdir -p /sys/fs/cgroup/systemd//kubelet

	2022-05-09T08:54:48.611508052Z  + '[' /sys/fs/cgroup/systemd == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.611534686Z  + mount --bind /sys/fs/cgroup/systemd//kubelet /sys/fs/cgroup/systemd//kubelet

	2022-05-09T08:54:48.612962535Z  + IFS=

	2022-05-09T08:54:48.612979492Z  + read -r subsystem

	2022-05-09T08:54:48.612985176Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/net_cls,net_prio

	2022-05-09T08:54:48.613001130Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.613006620Z  + local subsystem=/sys/fs/cgroup/net_cls,net_prio

	2022-05-09T08:54:48.613245064Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.613257642Z  + mkdir -p /sys/fs/cgroup/net_cls,net_prio//kubelet

	2022-05-09T08:54:48.614415224Z  + '[' /sys/fs/cgroup/net_cls,net_prio == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.614430406Z  + mount --bind /sys/fs/cgroup/net_cls,net_prio//kubelet /sys/fs/cgroup/net_cls,net_prio//kubelet

	2022-05-09T08:54:48.616087283Z  + IFS=

	2022-05-09T08:54:48.616101283Z  + read -r subsystem

	2022-05-09T08:54:48.616105704Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/pids

	2022-05-09T08:54:48.616108868Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.616141544Z  + local subsystem=/sys/fs/cgroup/pids

	2022-05-09T08:54:48.616155294Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.616159239Z  + mkdir -p /sys/fs/cgroup/pids//kubelet

	2022-05-09T08:54:48.617284882Z  + '[' /sys/fs/cgroup/pids == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.617303449Z  + mount --bind /sys/fs/cgroup/pids//kubelet /sys/fs/cgroup/pids//kubelet

	2022-05-09T08:54:48.618668985Z  + IFS=

	2022-05-09T08:54:48.618683956Z  + read -r subsystem

	2022-05-09T08:54:48.618688310Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/blkio

	2022-05-09T08:54:48.618691995Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.618728923Z  + local subsystem=/sys/fs/cgroup/blkio

	2022-05-09T08:54:48.618750290Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.618753462Z  + mkdir -p /sys/fs/cgroup/blkio//kubelet

	2022-05-09T08:54:48.619763460Z  + '[' /sys/fs/cgroup/blkio == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.619770759Z  + mount --bind /sys/fs/cgroup/blkio//kubelet /sys/fs/cgroup/blkio//kubelet

	2022-05-09T08:54:48.621114013Z  + IFS=

	2022-05-09T08:54:48.621127858Z  + read -r subsystem

	2022-05-09T08:54:48.621131952Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/cpu,cpuacct

	2022-05-09T08:54:48.621135451Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.621139093Z  + local subsystem=/sys/fs/cgroup/cpu,cpuacct

	2022-05-09T08:54:48.621191001Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.621204858Z  + mkdir -p /sys/fs/cgroup/cpu,cpuacct//kubelet

	2022-05-09T08:54:48.622435221Z  + '[' /sys/fs/cgroup/cpu,cpuacct == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.622450554Z  + mount --bind /sys/fs/cgroup/cpu,cpuacct//kubelet /sys/fs/cgroup/cpu,cpuacct//kubelet

	2022-05-09T08:54:48.623904570Z  + IFS=

	2022-05-09T08:54:48.623919652Z  + read -r subsystem

	2022-05-09T08:54:48.623924396Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/freezer

	2022-05-09T08:54:48.623954773Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.623959048Z  + local subsystem=/sys/fs/cgroup/freezer

	2022-05-09T08:54:48.623962278Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.623965670Z  + mkdir -p /sys/fs/cgroup/freezer//kubelet

	2022-05-09T08:54:48.625029116Z  + '[' /sys/fs/cgroup/freezer == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.625046744Z  + mount --bind /sys/fs/cgroup/freezer//kubelet /sys/fs/cgroup/freezer//kubelet

	2022-05-09T08:54:48.626317951Z  + IFS=

	2022-05-09T08:54:48.626332395Z  + read -r subsystem

	2022-05-09T08:54:48.626336767Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/rdma

	2022-05-09T08:54:48.626340462Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.626343634Z  + local subsystem=/sys/fs/cgroup/rdma

	2022-05-09T08:54:48.626346895Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.626350010Z  + mkdir -p /sys/fs/cgroup/rdma//kubelet

	2022-05-09T08:54:48.627496152Z  + '[' /sys/fs/cgroup/rdma == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.627511352Z  + mount --bind /sys/fs/cgroup/rdma//kubelet /sys/fs/cgroup/rdma//kubelet

	2022-05-09T08:54:48.628631281Z  + IFS=

	2022-05-09T08:54:48.628647043Z  + read -r subsystem

	2022-05-09T08:54:48.628650828Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/memory

	2022-05-09T08:54:48.628653940Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.628693466Z  + local subsystem=/sys/fs/cgroup/memory

	2022-05-09T08:54:48.628698453Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.628701999Z  + mkdir -p /sys/fs/cgroup/memory//kubelet

	2022-05-09T08:54:48.632741012Z  + '[' /sys/fs/cgroup/memory == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.632758647Z  + mount --bind /sys/fs/cgroup/memory//kubelet /sys/fs/cgroup/memory//kubelet

	2022-05-09T08:54:48.632761680Z  + IFS=

	2022-05-09T08:54:48.632763932Z  + read -r subsystem

	2022-05-09T08:54:48.632766097Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/devices

	2022-05-09T08:54:48.632768604Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.632770748Z  + local subsystem=/sys/fs/cgroup/devices

	2022-05-09T08:54:48.632772777Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.632774857Z  + mkdir -p /sys/fs/cgroup/devices//kubelet

	2022-05-09T08:54:48.632776920Z  + '[' /sys/fs/cgroup/devices == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.632779220Z  + mount --bind /sys/fs/cgroup/devices//kubelet /sys/fs/cgroup/devices//kubelet

	2022-05-09T08:54:48.633518582Z  + IFS=

	2022-05-09T08:54:48.633533342Z  + read -r subsystem

	2022-05-09T08:54:48.633537608Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/cpuset

	2022-05-09T08:54:48.633554800Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.633557325Z  + local subsystem=/sys/fs/cgroup/cpuset

	2022-05-09T08:54:48.633559354Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.633561358Z  + mkdir -p /sys/fs/cgroup/cpuset//kubelet

	2022-05-09T08:54:48.634676883Z  + '[' /sys/fs/cgroup/cpuset == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.634691047Z  + cat /sys/fs/cgroup/cpuset/cpuset.cpus

	2022-05-09T08:54:48.635753652Z  + cat /sys/fs/cgroup/cpuset/cpuset.mems

	2022-05-09T08:54:48.636819371Z  + mount --bind /sys/fs/cgroup/cpuset//kubelet /sys/fs/cgroup/cpuset//kubelet

	2022-05-09T08:54:48.638369533Z  + IFS=

	2022-05-09T08:54:48.638382618Z  + read -r subsystem

	2022-05-09T08:54:48.638386744Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/hugetlb

	2022-05-09T08:54:48.638480846Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.638497058Z  + local subsystem=/sys/fs/cgroup/hugetlb

	2022-05-09T08:54:48.638501381Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.638504676Z  + mkdir -p /sys/fs/cgroup/hugetlb//kubelet

	2022-05-09T08:54:48.639580000Z  + '[' /sys/fs/cgroup/hugetlb == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.639593873Z  + mount --bind /sys/fs/cgroup/hugetlb//kubelet /sys/fs/cgroup/hugetlb//kubelet

	2022-05-09T08:54:48.641233270Z  + IFS=

	2022-05-09T08:54:48.641249737Z  + read -r subsystem

	2022-05-09T08:54:48.641254116Z  + mount_kubelet_cgroup_root /kubelet /sys/fs/cgroup/perf_event

	2022-05-09T08:54:48.641257739Z  + local cgroup_root=/kubelet

	2022-05-09T08:54:48.641261106Z  + local subsystem=/sys/fs/cgroup/perf_event

	2022-05-09T08:54:48.641299852Z  + '[' -z /kubelet ']'

	2022-05-09T08:54:48.641312761Z  + mkdir -p /sys/fs/cgroup/perf_event//kubelet

	2022-05-09T08:54:48.642292336Z  + '[' /sys/fs/cgroup/perf_event == /sys/fs/cgroup/cpuset ']'

	2022-05-09T08:54:48.642300239Z  + mount --bind /sys/fs/cgroup/perf_event//kubelet /sys/fs/cgroup/perf_event//kubelet

	2022-05-09T08:54:48.643522811Z  + IFS=

	2022-05-09T08:54:48.643537566Z  + read -r subsystem

	2022-05-09T08:54:48.643924011Z  + return

	2022-05-09T08:54:48.643944798Z  + fix_machine_id

	2022-05-09T08:54:48.643948943Z  + echo 'INFO: clearing and regenerating /etc/machine-id'

	2022-05-09T08:54:48.643984496Z  INFO: clearing and regenerating /etc/machine-id

	2022-05-09T08:54:48.643996949Z  + rm -f /etc/machine-id

	2022-05-09T08:54:48.644897924Z  + systemd-machine-id-setup

	2022-05-09T08:54:48.648696420Z  Initializing machine ID from D-Bus machine ID.

	2022-05-09T08:54:48.652007275Z  + fix_product_name

	2022-05-09T08:54:48.652029499Z  + [[ -f /sys/class/dmi/id/product_name ]]

	2022-05-09T08:54:48.652166407Z  + echo 'INFO: faking /sys/class/dmi/id/product_name to be "kind"'

	2022-05-09T08:54:48.652188535Z  INFO: faking /sys/class/dmi/id/product_name to be "kind"

	2022-05-09T08:54:48.652193280Z  + echo kind

	2022-05-09T08:54:48.652317652Z  + mount -o ro,bind /kind/product_name /sys/class/dmi/id/product_name

	2022-05-09T08:54:48.654576894Z  + fix_product_uuid

	2022-05-09T08:54:48.654920962Z  + [[ ! -f /kind/product_uuid ]]

	2022-05-09T08:54:48.654936501Z  + cat /proc/sys/kernel/random/uuid

	2022-05-09T08:54:48.656224502Z  + [[ -f /sys/class/dmi/id/product_uuid ]]

	2022-05-09T08:54:48.656480423Z  + echo 'INFO: faking /sys/class/dmi/id/product_uuid to be random'

	2022-05-09T08:54:48.656811969Z  INFO: faking /sys/class/dmi/id/product_uuid to be random

	2022-05-09T08:54:48.657012896Z  + mount -o ro,bind /kind/product_uuid /sys/class/dmi/id/product_uuid

	2022-05-09T08:54:48.658849907Z  + [[ -f /sys/devices/virtual/dmi/id/product_uuid ]]

	2022-05-09T08:54:48.658922027Z  + echo 'INFO: faking /sys/devices/virtual/dmi/id/product_uuid as well'

	2022-05-09T08:54:48.658928802Z  INFO: faking /sys/devices/virtual/dmi/id/product_uuid as well

	2022-05-09T08:54:48.658933089Z  + mount -o ro,bind /kind/product_uuid /sys/devices/virtual/dmi/id/product_uuid

	2022-05-09T08:54:48.660598758Z  + select_iptables

	2022-05-09T08:54:48.660640772Z  + local mode=nft

	2022-05-09T08:54:48.662524997Z  ++ wc -l

	2022-05-09T08:54:48.668976711Z  ++ grep '^-'

	2022-05-09T08:54:48.670423709Z  + num_legacy_lines=6

	2022-05-09T08:54:48.670444339Z  + '[' 6 -ge 10 ']'

	2022-05-09T08:54:48.671409455Z  ++ grep '^-'

	2022-05-09T08:54:48.671472590Z  ++ wc -l

	2022-05-09T08:54:48.676259391Z  ++ true

	2022-05-09T08:54:48.676528455Z  + num_nft_lines=0

	2022-05-09T08:54:48.676641878Z  + '[' 6 -ge 0 ']'

	2022-05-09T08:54:48.676654457Z  + mode=legacy

	2022-05-09T08:54:48.676659525Z  + echo 'INFO: setting iptables to detected mode: legacy'

	2022-05-09T08:54:48.676663297Z  INFO: setting iptables to detected mode: legacy

	2022-05-09T08:54:48.676668168Z  + update-alternatives --set iptables /usr/sbin/iptables-legacy

	2022-05-09T08:54:48.676711079Z  + echo 'retryable update-alternatives: --set iptables /usr/sbin/iptables-legacy'

	2022-05-09T08:54:48.676716691Z  + local 'args=--set iptables /usr/sbin/iptables-legacy'

	2022-05-09T08:54:48.677129110Z  ++ seq 0 15

	2022-05-09T08:54:48.677887760Z  + for i in $(seq 0 15)

	2022-05-09T08:54:48.677923378Z  + /usr/bin/update-alternatives --set iptables /usr/sbin/iptables-legacy

	2022-05-09T08:54:48.682231290Z  + return

	2022-05-09T08:54:48.682257261Z  + update-alternatives --set ip6tables /usr/sbin/ip6tables-legacy

	2022-05-09T08:54:48.682269494Z  + echo 'retryable update-alternatives: --set ip6tables /usr/sbin/ip6tables-legacy'

	2022-05-09T08:54:48.682301012Z  + local 'args=--set ip6tables /usr/sbin/ip6tables-legacy'

	2022-05-09T08:54:48.682763162Z  ++ seq 0 15

	2022-05-09T08:54:48.683704961Z  + for i in $(seq 0 15)

	2022-05-09T08:54:48.683751511Z  + /usr/bin/update-alternatives --set ip6tables /usr/sbin/ip6tables-legacy

	2022-05-09T08:54:48.687089186Z  + return

	2022-05-09T08:54:48.687110450Z  + enable_network_magic

	2022-05-09T08:54:48.687155319Z  + local docker_embedded_dns_ip=127.0.0.11

	2022-05-09T08:54:48.687171375Z  + local docker_host_ip

	2022-05-09T08:54:48.688428728Z  ++ cut '-d ' -f1

	2022-05-09T08:54:48.688441794Z  ++ head -n1 /dev/fd/63

	2022-05-09T08:54:48.688541379Z  +++ getent ahostsv4 host.docker.internal

	2022-05-09T08:54:48.704892876Z  + docker_host_ip=

	2022-05-09T08:54:48.704927706Z  + [[ -z '' ]]

	2022-05-09T08:54:48.705672035Z  ++ ip -4 route show default

	2022-05-09T08:54:48.705697608Z  ++ cut '-d ' -f3

	2022-05-09T08:54:48.707997158Z  + docker_host_ip=192.168.58.1

	2022-05-09T08:54:48.708291965Z  + iptables-save

	2022-05-09T08:54:48.708673076Z  + iptables-restore

	2022-05-09T08:54:48.710278828Z  + sed -e 's/-d 127.0.0.11/-d 192.168.58.1/g' -e 's/-A OUTPUT \(.*\) -j DOCKER_OUTPUT/\0\n-A PREROUTING \1 -j DOCKER_OUTPUT/' -e 's/--to-source :53/--to-source 192.168.58.1:53/g'

	2022-05-09T08:54:48.713519355Z  + cp /etc/resolv.conf /etc/resolv.conf.original

	2022-05-09T08:54:48.715214009Z  + sed -e s/127.0.0.11/192.168.58.1/g /etc/resolv.conf.original

	2022-05-09T08:54:48.721381801Z  ++ cut '-d ' -f1

	2022-05-09T08:54:48.721495582Z  ++ head -n1 /dev/fd/63

	2022-05-09T08:54:48.722167585Z  ++++ hostname

	2022-05-09T08:54:48.722925563Z  +++ getent ahostsv4 kubernetes-upgrade-20220509085441-6723

	2022-05-09T08:54:48.725827211Z  + curr_ipv4=192.168.58.2

	2022-05-09T08:54:48.725843524Z  + echo 'INFO: Detected IPv4 address: 192.168.58.2'

	2022-05-09T08:54:48.725847584Z  INFO: Detected IPv4 address: 192.168.58.2

	2022-05-09T08:54:48.725850354Z  + '[' -f /kind/old-ipv4 ']'

	2022-05-09T08:54:48.725963468Z  + [[ -n 192.168.58.2 ]]

	2022-05-09T08:54:48.725978216Z  + echo -n 192.168.58.2

	2022-05-09T08:54:48.727205326Z  ++ cut '-d ' -f1

	2022-05-09T08:54:48.727336070Z  ++ head -n1 /dev/fd/63

	2022-05-09T08:54:48.728589155Z  ++++ hostname

	2022-05-09T08:54:48.729390159Z  +++ getent ahostsv6 kubernetes-upgrade-20220509085441-6723

	2022-05-09T08:54:48.731247255Z  + curr_ipv6=

	2022-05-09T08:54:48.731361196Z  + echo 'INFO: Detected IPv6 address: '

	2022-05-09T08:54:48.731538731Z  INFO: Detected IPv6 address: 

	2022-05-09T08:54:48.731559946Z  + '[' -f /kind/old-ipv6 ']'

	2022-05-09T08:54:48.731563664Z  + [[ -n '' ]]

	2022-05-09T08:54:48.732112224Z  ++ uname -a

	2022-05-09T08:54:48.732929561Z  + echo 'entrypoint completed: Linux kubernetes-upgrade-20220509085441-6723 5.13.0-1024-gcp #29~20.04.1-Ubuntu SMP Thu Apr 14 23:15:00 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux'

	2022-05-09T08:54:48.733021973Z  entrypoint completed: Linux kubernetes-upgrade-20220509085441-6723 5.13.0-1024-gcp #29~20.04.1-Ubuntu SMP Thu Apr 14 23:15:00 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

	2022-05-09T08:54:48.733125482Z  + exec /sbin/init

	2022-05-09T08:54:48.741524396Z  systemd 245.4-4ubuntu3.15 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid)

	2022-05-09T08:54:48.741551150Z  Detected virtualization docker.

	2022-05-09T08:54:48.741554542Z  Detected architecture x86-64.

	2022-05-09T08:54:48.742168314Z  

	2022-05-09T08:54:48.742187397Z  Welcome to Ubuntu 20.04.4 LTS!

	2022-05-09T08:54:48.742192333Z  

	2022-05-09T08:54:48.742247475Z  Set hostname to <kubernetes-upgrade-20220509085441-6723>.

	2022-05-09T08:54:48.800205113Z  [  OK  ] Started Dispatch Password …ts to Console Directory Watch.

	2022-05-09T08:54:48.800438379Z  [  OK  ] Set up automount Arbitrary…s File System Automount Point.

	2022-05-09T08:54:48.800459193Z  [  OK  ] Reached target Local Encrypted Volumes.

	2022-05-09T08:54:48.800464673Z  [  OK  ] Reached target Network is Online.

	2022-05-09T08:54:48.800583296Z  [  OK  ] Reached target Paths.

	2022-05-09T08:54:48.800589856Z  [  OK  ] Reached target Slices.

	2022-05-09T08:54:48.800594456Z  [  OK  ] Reached target Swap.

	2022-05-09T08:54:48.800966471Z  [  OK  ] Listening on Journal Audit Socket.

	2022-05-09T08:54:48.801111687Z  [  OK  ] Listening on Journal Socket (/dev/log).

	2022-05-09T08:54:48.801292328Z  [  OK  ] Listening on Journal Socket.

	2022-05-09T08:54:48.803726050Z           Mounting Huge Pages File System...

	2022-05-09T08:54:48.805730665Z           Mounting Kernel Debug File System...

	2022-05-09T08:54:48.809219084Z           Mounting Kernel Trace File System...

	2022-05-09T08:54:48.811132246Z           Starting Journal Service...

	2022-05-09T08:54:48.851486030Z           Starting Create list of st…odes for the current kernel...

	2022-05-09T08:54:48.851541489Z           Mounting FUSE Control File System...

	2022-05-09T08:54:48.853491712Z           Starting Remount Root and Kernel File Systems...

	2022-05-09T08:54:48.863171459Z           Starting Apply Kernel Variables...

	2022-05-09T08:54:48.864697038Z  [  OK  ] Started Journal Service.

	2022-05-09T08:54:48.865160056Z  [  OK  ] Mounted Huge Pages File System.

	2022-05-09T08:54:48.865336584Z  [  OK  ] Mounted Kernel Debug File System.

	2022-05-09T08:54:48.865446089Z  [  OK  ] Mounted Kernel Trace File System.

	2022-05-09T08:54:48.866423358Z  [  OK  ] Finished Create list of st… nodes for the current kernel.

	2022-05-09T08:54:48.868044100Z  [  OK  ] Mounted FUSE Control File System.

	2022-05-09T08:54:48.868058259Z  [  OK  ] Finished Remount Root and Kernel File Systems.

	2022-05-09T08:54:48.869309096Z           Starting Flush Journal to Persistent Storage...

	2022-05-09T08:54:48.870576065Z           Starting Create System Users...

	2022-05-09T08:54:48.872015600Z           Starting Update UTMP about System Boot/Shutdown...

	2022-05-09T08:54:48.874644249Z  [  OK  ] Finished Apply Kernel Variables.

	2022-05-09T08:54:48.876972947Z  [  OK  ] Finished Flush Journal to Persistent Storage.

	2022-05-09T08:54:48.884175971Z  [  OK  ] Finished Update UTMP about System Boot/Shutdown.

	2022-05-09T08:54:48.894060711Z  [  OK  ] Finished Create System Users.

	2022-05-09T08:54:48.895689953Z           Starting Create Static Device Nodes in /dev...

	2022-05-09T08:54:48.902614909Z  [  OK  ] Finished Create Static Device Nodes in /dev.

	2022-05-09T08:54:48.902714982Z  [  OK  ] Reached target Local File Systems (Pre).

	2022-05-09T08:54:48.902867181Z  [  OK  ] Reached target Local File Systems.

	2022-05-09T08:54:48.903012035Z  [  OK  ] Reached target System Initialization.

	2022-05-09T08:54:48.903032663Z  [  OK  ] Started Daily Cleanup of Temporary Directories.

	2022-05-09T08:54:48.903077708Z  [  OK  ] Reached target Timers.

	2022-05-09T08:54:48.903254013Z  [  OK  ] Listening on BuildKit.

	2022-05-09T08:54:48.903375631Z  [  OK  ] Listening on D-Bus System Message Bus Socket.

	2022-05-09T08:54:48.904730907Z           Starting Docker Socket for the API.

	2022-05-09T08:54:48.907043709Z           Starting Podman API Socket.

	2022-05-09T08:54:48.907454928Z  [  OK  ] Listening on Docker Socket for the API.

	2022-05-09T08:54:48.908446763Z  [  OK  ] Listening on Podman API Socket.

	2022-05-09T08:54:48.908461725Z  [  OK  ] Reached target Sockets.

	2022-05-09T08:54:48.908467114Z  [  OK  ] Reached target Basic System.

	2022-05-09T08:54:48.909647516Z           Starting containerd container runtime...

	2022-05-09T08:54:48.911079878Z  [  OK  ] Started D-Bus System Message Bus.

	2022-05-09T08:54:48.914052209Z           Starting minikube automount...

	2022-05-09T08:54:48.915380293Z           Starting OpenBSD Secure Shell server...

	2022-05-09T08:54:48.942091320Z  [  OK  ] Finished minikube automount.

	2022-05-09T08:54:48.980803941Z  [  OK  ] Started OpenBSD Secure Shell server.

	2022-05-09T08:54:49.025097606Z  [  OK  ] Started containerd container runtime.

	2022-05-09T08:54:49.028943848Z           Starting Docker Application Container Engine...

	2022-05-09T08:54:49.388449759Z  [  OK  ] Started Docker Application Container Engine.

	2022-05-09T08:54:49.388489289Z  [  OK  ] Reached target Multi-User System.

	2022-05-09T08:54:49.388495868Z  [  OK  ] Reached target Graphical Interface.

	2022-05-09T08:54:49.390075201Z           Starting Update UTMP about System Runlevel Changes...

	2022-05-09T08:54:49.399372972Z  [  OK  ] Finished Update UTMP about System Runlevel Changes.

	2022-05-09T08:55:24.515684789Z  [  OK  ] Stopped target Graphical Interface.

	2022-05-09T08:55:24.515867703Z  [  OK  ] Stopped target Multi-User System.

	2022-05-09T08:55:24.516069122Z  [  OK  ] Stopped target Timers.

	2022-05-09T08:55:24.516232339Z  [  OK  ] Stopped Daily Cleanup of Temporary Directories.

	2022-05-09T08:55:24.519316635Z           Stopping D-Bus System Message Bus...

	2022-05-09T08:55:24.519582766Z           Stopping Docker Application Container Engine...

	2022-05-09T08:55:24.519843067Z           Stopping kubelet: The Kubernetes Node Agent...

	2022-05-09T08:55:24.520056189Z           Stopping OpenBSD Secure Shell server...

	2022-05-09T08:55:24.521788264Z  [  OK  ] Stopped D-Bus System Message Bus.

	2022-05-09T08:55:24.523074666Z  [  OK  ] Stopped OpenBSD Secure Shell server.

	2022-05-09T08:55:24.566159260Z  [  OK  ] Stopped kubelet: The Kubernetes Node Agent.

	2022-05-09T08:55:24.869124769Z  [  OK  ] Unmounted /var/lib/docker/…ee005ef76b2749893a3738/merged.

	2022-05-09T08:55:24.893760964Z  [  OK  ] Unmounted /var/lib/docker/…a0eb1c8e5d2467b89a7e07/merged.

	2022-05-09T08:55:24.910495067Z  [  OK  ] Unmounted /var/lib/docker/…538a4f4e67e2c7821c1139/merged.

	2022-05-09T08:55:24.915653406Z  [  OK  ] Unmounted /var/lib/docker/…050dba3b2923467dbe065d/merged.

	2022-05-09T08:55:24.919648050Z  [  OK  ] Unmounted /var/lib/docker/…ffae74027356e06d4f50f9/merged.

	2022-05-09T08:55:24.920955023Z  [  OK  ] Unmounted /var/lib/docker/…6b32c73da71531b6a3/mounts/shm.

	2022-05-09T08:55:24.921002151Z  [  OK  ] Unmounted /var/lib/docker/…c64a6ca6534a56da9795ba/merged.

	2022-05-09T08:55:24.928125021Z  [  OK  ] Unmounted /var/lib/docker/…8835f4b20ae9f34d9a/mounts/shm.

	2022-05-09T08:55:24.928151735Z  [  OK  ] Unmounted /var/lib/docker/…39f73d9ad064762af314d9/merged.

	2022-05-09T08:55:24.965615143Z  [  OK  ] Unmounted /var/lib/docker/…46f3b6963233d8fc86/mounts/shm.

	2022-05-09T08:55:24.966643475Z  [  OK  ] Unmounted /var/lib/docker/…63c55b66636b13c700df78/merged.

	2022-05-09T08:55:24.971831772Z  [  OK  ] Unmounted /var/lib/docker/…9a93d5503632eea0bd/mounts/shm.

	2022-05-09T08:55:24.973331139Z  [  OK  ] Unmounted /var/lib/docker/…fb16684640e9f42e2d6fa8/merged.

	2022-05-09T08:55:24.981349077Z  [  OK  ] Unmounted /var/lib/docker/…1995469e919e04d7a8/mounts/shm.

	2022-05-09T08:55:24.981464910Z  [  OK  ] Unmounted /var/lib/docker/…484bcb070061b068af436c/merged.

	2022-05-09T08:55:24.981636453Z  [  OK  ] Unmounted /var/lib/docker/…ecd58c34f93cbafa82/mounts/shm.

	2022-05-09T08:55:24.984855002Z  [  OK  ] Unmounted /var/lib/docker/…9550b71290b8c9796e0e98/merged.

	2022-05-09T08:55:27.946224275Z  [*     ] A stop job is running for Docker Ap…n Container Engine (1s / 1min 28s)

	2022-05-09T08:55:28.446217891Z  M
[**    ] A stop job is running for Docker Ap…n Container Engine (2s / 1min 28s)

	2022-05-09T08:55:28.946206312Z  M
[***   ] A stop job is running for Docker Ap…n Container Engine (2s / 1min 28s)

	2022-05-09T08:55:29.446197101Z  M
[ ***  ] A stop job is running for Docker Ap…n Container Engine (3s / 1min 28s)

	2022-05-09T08:55:29.946174641Z  M
[  *** ] A stop job is running for Docker Ap…n Container Engine (3s / 1min 28s)

	2022-05-09T08:55:30.446202226Z  M
[   ***] A stop job is running for Docker Ap…n Container Engine (4s / 1min 28s)

	2022-05-09T08:55:30.946343866Z  M
[    **] A stop job is running for Docker Ap…n Container Engine (4s / 1min 28s)

	2022-05-09T08:55:31.446240569Z  M
[     *] A stop job is running for Docker Ap…n Container Engine (5s / 1min 28s)

	2022-05-09T08:55:31.946210252Z  M
[    **] A stop job is running for Docker Ap…n Container Engine (5s / 1min 28s)

	2022-05-09T08:55:32.446244845Z  M
[   ***] A stop job is running for Docker Ap…n Container Engine (6s / 1min 28s)

	2022-05-09T08:55:32.946266274Z  M
[  *** ] A stop job is running for Docker Ap…n Container Engine (6s / 1min 28s)

	2022-05-09T08:55:33.446269782Z  M
[ ***  ] A stop job is running for Docker Ap…n Container Engine (7s / 1min 28s)

	2022-05-09T08:55:33.946217519Z  M
[***   ] A stop job is running for Docker Ap…n Container Engine (7s / 1min 28s)

	2022-05-09T08:55:34.446221269Z  M
[**    ] A stop job is running for Docker Ap…n Container Engine (8s / 1min 28s)

	2022-05-09T08:55:34.741819053Z  M
[  OK  ] Unmounted /var/lib/docker/…4d90fcc19c9dd2185e8206/merged.

	2022-05-09T08:55:34.762903828Z  [  OK  ] Stopped Docker Application Container Engine.

	2022-05-09T08:55:34.763006369Z  [  OK  ] Stopped target Network is Online.

	2022-05-09T08:55:34.763073811Z           Stopping containerd container runtime...

	2022-05-09T08:55:34.763801528Z  [  OK  ] Stopped minikube automount.

	2022-05-09T08:55:34.767383402Z  [  OK  ] Stopped containerd container runtime.

	2022-05-09T08:55:34.767535024Z  [  OK  ] Stopped target Basic System.

	2022-05-09T08:55:34.767551301Z  [  OK  ] Stopped target Paths.

	2022-05-09T08:55:34.767613735Z  [  OK  ] Stopped target Slices.

	2022-05-09T08:55:34.767641754Z  [  OK  ] Stopped target Sockets.

	2022-05-09T08:55:34.768262704Z  [  OK  ] Closed BuildKit.

	2022-05-09T08:55:34.768843514Z  [  OK  ] Closed D-Bus System Message Bus Socket.

	2022-05-09T08:55:34.769371617Z  [  OK  ] Closed Docker Socket for the API.

	2022-05-09T08:55:34.769908808Z  [  OK  ] Closed Podman API Socket.

	2022-05-09T08:55:34.769915903Z  [  OK  ] Stopped target System Initialization.

	2022-05-09T08:55:34.769948889Z  [  OK  ] Stopped target Local Encrypted Volumes.

	2022-05-09T08:55:34.785642278Z  [  OK  ] Stopped Dispatch Password …ts to Console Directory Watch.

	2022-05-09T08:55:34.785987158Z  [  OK  ] Stopped target Local File Systems.

	2022-05-09T08:55:34.787006032Z           Unmounting /data...

	2022-05-09T08:55:34.790417016Z           Unmounting /etc/hostname...

	2022-05-09T08:55:34.790441045Z           Unmounting /etc/hosts...

	2022-05-09T08:55:34.790445391Z           Unmounting /etc/resolv.conf...

	2022-05-09T08:55:34.790640208Z           Unmounting /kind/product_uuid...

	2022-05-09T08:55:34.792699462Z           Unmounting /run/docker/netns/default...

	2022-05-09T08:55:34.794912239Z           Unmounting /tmp/hostpath-provisioner...

	2022-05-09T08:55:34.797678077Z           Unmounting /tmp/hostpath_pv...

	2022-05-09T08:55:34.798619944Z           Unmounting /usr/lib/modules...

	2022-05-09T08:55:34.800275815Z           Unmounting /var/lib/kubele…cret/kube-proxy-token-cgwjt...

	2022-05-09T08:55:34.802011240Z           Unmounting /var/lib/kubele…~secret/coredns-token-6fhnf...

	2022-05-09T08:55:34.803417213Z           Unmounting /var/lib/kubele…age-provisioner-token-p8vbs...

	2022-05-09T08:55:34.804104710Z  [  OK  ] Stopped Apply Kernel Variables.

	2022-05-09T08:55:34.804963727Z           Stopping Update UTMP about System Boot/Shutdown...

	2022-05-09T08:55:34.808097022Z  [  OK  ] Unmounted /data.

	2022-05-09T08:55:34.808887823Z  [  OK  ] Unmounted /etc/hostname.

	2022-05-09T08:55:34.809561466Z  [  OK  ] Unmounted /etc/hosts.

	2022-05-09T08:55:34.810423733Z  [  OK  ] Unmounted /etc/resolv.conf.

	2022-05-09T08:55:34.811154862Z  [  OK  ] Unmounted /kind/product_uuid.

	2022-05-09T08:55:34.811897053Z  [  OK  ] Unmounted /run/docker/netns/default.

	2022-05-09T08:55:34.812589174Z  [  OK  ] Unmounted /tmp/hostpath-provisioner.

	2022-05-09T08:55:34.813609878Z  [  OK  ] Unmounted /tmp/hostpath_pv.

	2022-05-09T08:55:34.814478125Z  [  OK  ] Unmounted /usr/lib/modules.

	2022-05-09T08:55:34.815328236Z  [  OK  ] Unmounted /var/lib/kubelet…secret/kube-proxy-token-cgwjt.

	2022-05-09T08:55:34.816365714Z  [  OK  ] Unmounted /var/lib/kubelet…io~secret/coredns-token-6fhnf.

	2022-05-09T08:55:34.817679811Z  [  OK  ] Unmounted /var/lib/kubelet…orage-provisioner-token-p8vbs.

	2022-05-09T08:55:34.820457428Z           Unmounting /tmp...

	2022-05-09T08:55:34.824128102Z  [  OK  ] Stopped Update UTMP about System Boot/Shutdown.

	2022-05-09T08:55:34.825867452Z  [  OK  ] Unmounted /tmp.

	2022-05-09T08:55:34.826089373Z  [  OK  ] Stopped target Swap.

	2022-05-09T08:55:34.826902988Z           Unmounting /var...

	2022-05-09T08:55:34.831108502Z  [  OK  ] Unmounted /var.

	2022-05-09T08:55:34.831294727Z  [  OK  ] Stopped target Local File Systems (Pre).

	2022-05-09T08:55:34.831375743Z  [  OK  ] Reached target Unmount All Filesystems.

	2022-05-09T08:55:34.832107670Z  [  OK  ] Stopped Create Static Device Nodes in /dev.

	2022-05-09T08:55:34.832891870Z  [  OK  ] Stopped Create System Users.

	2022-05-09T08:55:34.833667869Z  [  OK  ] Stopped Remount Root and Kernel File Systems.

	2022-05-09T08:55:34.833743159Z  [  OK  ] Reached target Shutdown.

	2022-05-09T08:55:34.833751217Z  [  OK  ] Reached target Final Step.

	2022-05-09T08:55:34.838833342Z           Starting Halt...

	2022-05-09T08:55:34.838855197Z  [  OK  ] Finished Power-Off.

	2022-05-09T08:55:34.838861739Z  [  OK  ] Reached target Power-Off.

	-- /stdout --

	I0509 08:55:47.825621  195809 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0509 08:55:47.943524  195809 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:60 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:60 SystemTime:2022-05-09 08:55:47.855898781 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.13.0-1024-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexSer

verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662799872 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-14 Labels:[] ExperimentalBuild:false ServerVersion:20.10.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Clie

ntInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}

	I0509 08:55:47.943645  195809 errors.go:98] postmortem docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:60 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:56 OomKillDisable:true NGoroutines:60 SystemTime:2022-05-09 08:55:47.855898781 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.13.0-1024-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86

_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662799872 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-14 Labels:[] ExperimentalBuild:false ServerVersion:20.10.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerEr

rors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}

	I0509 08:55:47.943734  195809 network_create.go:272] running [docker network inspect kubernetes-upgrade-20220509085441-6723] to gather additional debugging logs...

	I0509 08:55:47.943763  195809 cli_runner.go:164] Run: docker network inspect kubernetes-upgrade-20220509085441-6723

	W0509 08:55:47.981416  195809 cli_runner.go:211] docker network inspect kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:47.981462  195809 network_create.go:275] error running [docker network inspect kubernetes-upgrade-20220509085441-6723]: docker network inspect kubernetes-upgrade-20220509085441-6723: exit status 1

	stdout:

	[]

	stderr:

	Error: No such network: kubernetes-upgrade-20220509085441-6723

	I0509 08:55:47.981484  195809 network_create.go:277] output of [docker network inspect kubernetes-upgrade-20220509085441-6723]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error: No such network: kubernetes-upgrade-20220509085441-6723

	** /stderr **

	I0509 08:55:47.981626  195809 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I0509 08:55:48.091808  195809 info.go:265] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:4 ContainersRunning:2 ContainersPaused:0 ContainersStopped:2 Images:60 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:58 OomKillDisable:true NGoroutines:64 SystemTime:2022-05-09 08:55:48.012202948 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.13.0-1024-gcp OperatingSystem:Ubuntu 20.04.4 LTS OSType:linux Architecture:x86_64 IndexSer

verAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33662799872 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-14 Labels:[] ExperimentalBuild:false ServerVersion:20.10.15 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16 Expected:212e8b6fa2f44b9c21b2798135fc6fb7c53efc16} RuncCommit:{ID:v1.1.1-0-g52de29d Expected:v1.1.1-0-g52de29d} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:<nil> ServerErrors:[] Clie

ntInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.0] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:<nil>}}

	I0509 08:55:48.092477  195809 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" kubernetes-upgrade-20220509085441-6723

	I0509 08:55:48.129447  195809 profile.go:148] Saving config to /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/profiles/kubernetes-upgrade-20220509085441-6723/config.json ...

	I0509 08:55:48.129662  195809 machine.go:88] provisioning docker machine ...

	I0509 08:55:48.129691  195809 ubuntu.go:169] provisioning hostname "kubernetes-upgrade-20220509085441-6723"

	I0509 08:55:48.129729  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:48.171025  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:48.171091  195809 machine.go:91] provisioned docker machine in 41.409078ms

	I0509 08:55:48.171154  195809 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0509 08:55:48.171198  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:48.215411  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:48.215538  195809 retry.go:31] will retry after 200.227965ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:48.416851  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:48.453221  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:48.453351  195809 retry.go:31] will retry after 380.704736ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:48.834989  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:48.898286  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:48.898412  195809 retry.go:31] will retry after 738.922478ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:49.637796  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:49.673946  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	W0509 08:55:49.674049  195809 start.go:281] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	W0509 08:55:49.674064  195809 start.go:248] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:49.674103  195809 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I0509 08:55:49.674132  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:49.708247  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:49.708398  195809 retry.go:31] will retry after 220.164297ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:49.928786  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:49.961605  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:49.961736  195809 retry.go:31] will retry after 306.771815ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:50.269309  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:50.314402  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:50.314510  195809 retry.go:31] will retry after 545.000538ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:50.860350  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:50.900331  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	I0509 08:55:50.900466  195809 retry.go:31] will retry after 660.685065ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:51.561867  195809 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723

	W0509 08:55:51.597102  195809 cli_runner.go:211] docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" kubernetes-upgrade-20220509085441-6723 returned with exit code 1

	W0509 08:55:51.597259  195809 start.go:296] error running df -BG /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	W0509 08:55:51.597283  195809 start.go:253] error getting GiB of /var that is available: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:51.597299  195809 fix.go:57] fixHost completed within 6.364361969s

	I0509 08:55:51.597314  195809 start.go:81] releasing machines lock for "kubernetes-upgrade-20220509085441-6723", held for 6.364396864s

	W0509 08:55:51.597584  195809 out.go:239] * Failed to start docker container. Running "minikube delete -p kubernetes-upgrade-20220509085441-6723" may fix it: provision: get ssh host-port: unable to inspect a not running container to get SSH port

	* Failed to start docker container. Running "minikube delete -p kubernetes-upgrade-20220509085441-6723" may fix it: provision: get ssh host-port: unable to inspect a not running container to get SSH port

	I0509 08:55:51.600201  195809 out.go:177] 

	W0509 08:55:51.601977  195809 out.go:239] X Exiting due to GUEST_PROVISION_CONTAINER_EXITED: Docker container exited prematurely after it was created, consider investigating Docker's performance/health.

	X Exiting due to GUEST_PROVISION_CONTAINER_EXITED: Docker container exited prematurely after it was created, consider investigating Docker's performance/health.

	I0509 08:55:51.603713  195809 out.go:177] 

** /stderr **

version_upgrade_test.go:252: failed to upgrade with newest k8s version. args: out/minikube-linux-amd64 start -p kubernetes-upgrade-20220509085441-6723 --memory=2200 --kubernetes-version=v1.24.1-rc.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=docker : exit status 80

version_upgrade_test.go:255: (dbg) Run:  kubectl --context kubernetes-upgrade-20220509085441-6723 version --output=json

version_upgrade_test.go:255: (dbg) Non-zero exit: kubectl --context kubernetes-upgrade-20220509085441-6723 version --output=json: exit status 1 (58.754877ms)

** stderr ** 

	error: context "kubernetes-upgrade-20220509085441-6723" does not exist

** /stderr **

version_upgrade_test.go:257: error running kubectl: exit status 1

panic.go:482: *** TestKubernetesUpgrade FAILED at 2022-05-09 08:55:51.743109186 +0000 UTC m=+1877.186689802

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestKubernetesUpgrade]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect kubernetes-upgrade-20220509085441-6723

helpers_test.go:235: (dbg) docker inspect kubernetes-upgrade-20220509085441-6723:

-- stdout --

	[

	    {

	        "Id": "9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55",

	        "Created": "2022-05-09T08:54:48.053286897Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "exited",

	            "Running": false,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 0,

	            "ExitCode": 130,

	            "Error": "network ab3dc0e987463e0d1919f0f30610dba9f36f6956dd59c0979fddc98d5b653e0f not found",

	            "StartedAt": "2022-05-09T08:54:48.472807369Z",

	            "FinishedAt": "2022-05-09T08:55:34.933426699Z"

	        },

	        "Image": "sha256:44d43b69f3d5ba7f801dca891b535f23f9839671e82277938ec7dc42a22c50d6",

	        "ResolvConfPath": "/var/lib/docker/containers/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55/hostname",

	        "HostsPath": "/var/lib/docker/containers/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55/hosts",

	        "LogPath": "/var/lib/docker/containers/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55/9eeef2af4bd83a3b8abf5b3e39a735900dfb44e46340fb8cb4634c5469472a55-json.log",

	        "Name": "/kubernetes-upgrade-20220509085441-6723",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "unconfined",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "kubernetes-upgrade-20220509085441-6723:/var",

	                "/lib/modules:/lib/modules:ro"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "kubernetes-upgrade-20220509085441-6723",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 0,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": null,

	            "BlkioDeviceWriteBps": null,

	            "BlkioDeviceReadIOps": null,

	            "BlkioDeviceWriteIOps": null,

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "KernelMemory": 0,

	            "KernelMemoryTCP": 0,

	            "MemoryReservation": 0,

	            "MemorySwap": 0,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/4c80c52a664c1dfd1bf7928b1d2ccd53938fa6eb9de02e184ba37e8eb872a866-init/diff:/var/lib/docker/overlay2/beaaca4c58fe6ff4bdb88567c3d78ab7a23955eafaa5637df03ee2e0482d2aa6/diff:/var/lib/docker/overlay2/7c16b810bbfa3a2abff75078fa37b4cba0b2f101ff43d49beaabc3fd2602b1c9/diff:/var/lib/docker/overlay2/60f04c0e4baa8ad1c02ae5e34e6f505db0d740e2d7dc0833b2ff3b8037c1a9b6/diff:/var/lib/docker/overlay2/a12543300ae4ff803b2f0493a60a04a921312ec5a7b6ed493e66acadf998daef/diff:/var/lib/docker/overlay2/2d68f658a64cd8b7255bce93547db5d1b20b119ef6da8b9ce06614134661f235/diff:/var/lib/docker/overlay2/0f968f210c1565f6e8c4e444c650502c06a120d8767c9fefb7b6b2a09f4af83b/diff:/var/lib/docker/overlay2/987a67893acdccd514357a50db6c11680ae1899ec07a36085367a241ba1f0545/diff:/var/lib/docker/overlay2/d5446d1adc007f4390aa6173ef257b0bf52a9c9cc6533f16dd6c577fde5334b3/diff:/var/lib/docker/overlay2/265dd0cde77d578f6412ad48596c75c3548b5e077059c0fa835e4f22775fab83/diff:/var/lib/docker/overlay2/e6b98b

08dd64e06639e2a321169f84a89e8d21cea02d673819156eeb7a4747c3/diff:/var/lib/docker/overlay2/acf7117613a840e97b7a1101bfdce3a154a335ee0ffcaf74bd7f1b27b00cdaab/diff:/var/lib/docker/overlay2/9e88fa64aa800dac6e01eddc9cfd525a0dcd906c1adf98de066be87f87a6b52c/diff:/var/lib/docker/overlay2/6c539edead197cd449ca81fd34e3c534a6ca25446a52141d0ae4484aaac05482/diff:/var/lib/docker/overlay2/866719c52f41a692b94f42071d314de55b290912f946f4ec5f3785a7a5ae40df/diff:/var/lib/docker/overlay2/1c488a9b3bad141652873f4085ce1a466e1f1e8ccbd086d03a492b45179a6064/diff:/var/lib/docker/overlay2/bce5b942da09326e5a5c8595077544ced08031b1cd9b22ff8bff0a4458540139/diff:/var/lib/docker/overlay2/ffe34c3764a4eeac791f4672d47389ec3f399f716ab6e5531d7c5e587f3ace00/diff:/var/lib/docker/overlay2/a377e0779d03467b09a26898ae35b12f325d62984304817f49c693b2146c08f4/diff:/var/lib/docker/overlay2/6092380f07b29488cf0a30cb486638d86eaa8e00ff356a7985c6ac6f2fae5c1d/diff:/var/lib/docker/overlay2/1bc014cc0cf0a91c61f131c06b0194709f853dec23defe9233cbd9cc40030c28/diff:/var/lib/d

ocker/overlay2/0c81c4db7384c48318a800165af7f811348a8081efdd9dbd912e05e55c9eb4e0/diff:/var/lib/docker/overlay2/72b0c515d90bc71e27b766a9be89e315777a5bbe643d8fc508a9ae12557a58ce/diff:/var/lib/docker/overlay2/a4d193bf8c377d4cf1357b9261d3c54d995f17bda3db5abee3ef5caec001d75e/diff:/var/lib/docker/overlay2/763c6d291074b0842ecdeec1f3842fd6a0af0cb86839c82bc38cec0f40d095ca/diff:/var/lib/docker/overlay2/e4156eb2a94ac7136eb674fb8c22ea7f6dff50cd81e4857119d81112dc5ad99d/diff:/var/lib/docker/overlay2/be7effa3bb906b8c48aefab3cc72e657931bccd42c35b03bb52c679c37c70d25/diff:/var/lib/docker/overlay2/ccf8c1a68774cc6129c43490c675e6ba0ff0c88284ad899c9efb4b7492e92a06/diff:/var/lib/docker/overlay2/55f74cddb5c8f2da1131ddd67f7f2a20b8c2be8719b71047d5185fdb4722627d/diff:/var/lib/docker/overlay2/f6c38e83545e9de87d03b1e8e9b0239079acf47784afc11291b2172a11f8296d/diff:/var/lib/docker/overlay2/24604ce83180fcb6b9e1adbaf37db6776e4949ca5e1f4f9050b8fb8dc87d7591/diff:/var/lib/docker/overlay2/b03b1952bea32e53ce88b0d92d09f78ca76ceca0a146b088628be224813

ae87c/diff:/var/lib/docker/overlay2/d7ee02a5ba355c246c3107f286c4130457358aa56e0d8feb3850d953812fe76d/diff:/var/lib/docker/overlay2/1223ae0e5105ae89c78524490f0ccc5fe6dfa373e175fa70474b06c62aad91c7/diff:/var/lib/docker/overlay2/c3209d71eed94ed66b11ba3a7573c347d5c09a5a4fedb00418e52571abb2b5f9/diff:/var/lib/docker/overlay2/d6d32632e36023dec15e643fd41f77168442327cecdead87a47e70683cb0c660/diff:/var/lib/docker/overlay2/fd413b21f1f34027c98a1b4106f7e7db83e910860edd53ef838ac699659cd451/diff:/var/lib/docker/overlay2/9768e3244c157a7a12b8ec31507c1abc0fc806a9f325099262cfeb41e23a5fe1/diff:/var/lib/docker/overlay2/f65dda9d5b79903f5e68f6b9d4a59214d62f304da77faa7e148b90b402d98ca4/diff:/var/lib/docker/overlay2/b663c2dab6b5df7b606daa62e1df5e57f4a2503c2a9a19211f47359fd685dccf/diff:/var/lib/docker/overlay2/bbd620a7e494844db80a2bcd2fd6f170080c5273f1c33a576501214dd4475464/diff:/var/lib/docker/overlay2/23de36667695cec8ea0f4c98fc580213d356d39a3eba5aaab8b6ebeeb2b71596/diff:/var/lib/docker/overlay2/bafb3e8d91e83dcf824b6d5b3f56a67c483c42

723724b009a5aedf578351154f/diff:/var/lib/docker/overlay2/2798e8ce2f51dde257a9cf2dd800492f888fd02515c5f1de4133cc787ee12928/diff:/var/lib/docker/overlay2/e69a88f2dffdd2c7f72c45eaf2e3cd1a8772e0a2af22d6f34d2695bbda62b6e9/diff:/var/lib/docker/overlay2/708816f20892c0e4b94cbe8e80b169fff54ffd870bcde395bd8163dd03b25d0f/diff",

	                "MergedDir": "/var/lib/docker/overlay2/4c80c52a664c1dfd1bf7928b1d2ccd53938fa6eb9de02e184ba37e8eb872a866/merged",

	                "UpperDir": "/var/lib/docker/overlay2/4c80c52a664c1dfd1bf7928b1d2ccd53938fa6eb9de02e184ba37e8eb872a866/diff",

	                "WorkDir": "/var/lib/docker/overlay2/4c80c52a664c1dfd1bf7928b1d2ccd53938fa6eb9de02e184ba37e8eb872a866/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "volume",

	                "Name": "kubernetes-upgrade-20220509085441-6723",

	                "Source": "/var/lib/docker/volumes/kubernetes-upgrade-20220509085441-6723/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            },

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            }

	        ],

	        "Config": {

	            "Hostname": "kubernetes-upgrade-20220509085441-6723",

	            "Domainname": "",

	            "User": "root",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.30-1647797120-13815@sha256:90e8f7ee4065da728c0b80d303827e05ce4421985fe9bd7bdca30a55218347b5",

	            "Volumes": null,

	            "WorkingDir": "",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "kubernetes-upgrade-20220509085441-6723",

	                "name.minikube.sigs.k8s.io": "kubernetes-upgrade-20220509085441-6723",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "4d9bdd6efabd7d19b0c4b1317d302d4bdff4657c9fa9a1027917f2a96a3ba380",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {},

	            "SandboxKey": "/var/run/docker/netns/4d9bdd6efabd",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "kubernetes-upgrade-20220509085441-6723": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.58.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "9eeef2af4bd8",

	                        "kubernetes-upgrade-20220509085441-6723"

	                    ],

	                    "NetworkID": "ab3dc0e987463e0d1919f0f30610dba9f36f6956dd59c0979fddc98d5b653e0f",

	                    "EndpointID": "",

	                    "Gateway": "",

	                    "IPAddress": "",

	                    "IPPrefixLen": 0,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p kubernetes-upgrade-20220509085441-6723 -n kubernetes-upgrade-20220509085441-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p kubernetes-upgrade-20220509085441-6723 -n kubernetes-upgrade-20220509085441-6723: exit status 7 (101.215208ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "kubernetes-upgrade-20220509085441-6723" host is not running, skipping log retrieval (state="Stopped")

helpers_test.go:175: Cleaning up "kubernetes-upgrade-20220509085441-6723" profile ...

helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p kubernetes-upgrade-20220509085441-6723

helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p kubernetes-upgrade-20220509085441-6723: (1.827510971s)

--- FAIL: TestKubernetesUpgrade (71.94s)

=== RUN   TestStartStop/group/no-preload/serial/DeployApp

start_stop_delete_test.go:198: (dbg) Run:  kubectl --context no-preload-20220509085724-6723 create -f testdata/busybox.yaml

start_stop_delete_test.go:198: (dbg) Non-zero exit: kubectl --context no-preload-20220509085724-6723 create -f testdata/busybox.yaml: exit status 1 (40.901308ms)

** stderr ** 

	error: context "no-preload-20220509085724-6723" does not exist

** /stderr **

start_stop_delete_test.go:198: kubectl --context no-preload-20220509085724-6723 create -f testdata/busybox.yaml failed: exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/no-preload/serial/DeployApp]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect no-preload-20220509085724-6723

helpers_test.go:231: (dbg) Non-zero exit: docker inspect no-preload-20220509085724-6723: exit status 1 (43.107257ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: no-preload-20220509085724-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723: exit status 85 (72.322626ms)

-- stdout --

	* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "no-preload-20220509085724-6723" host is not running, skipping log retrieval (state="* Profile \"no-preload-20220509085724-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p no-preload-20220509085724-6723\"")

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/no-preload/serial/DeployApp]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect no-preload-20220509085724-6723

helpers_test.go:231: (dbg) Non-zero exit: docker inspect no-preload-20220509085724-6723: exit status 1 (45.630189ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: no-preload-20220509085724-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723: exit status 85 (68.344414ms)

-- stdout --

	* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "no-preload-20220509085724-6723" host is not running, skipping log retrieval (state="* Profile \"no-preload-20220509085724-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p no-preload-20220509085724-6723\"")

--- FAIL: TestStartStop/group/no-preload/serial/DeployApp (0.27s)

=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive

start_stop_delete_test.go:207: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p no-preload-20220509085724-6723 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain

start_stop_delete_test.go:207: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable metrics-server -p no-preload-20220509085724-6723 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain: exit status 10 (70.477059ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to MK_ADDON_ENABLE: loading profile: cluster "no-preload-20220509085724-6723" does not exist

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│    * Please also attach the following file to the GitHub issue:                             │

	│    * - /tmp/minikube_addons_2bafae6fa40fec163538f94366e390b0317a8b15_0.log                  │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

start_stop_delete_test.go:209: failed to enable an addon post-stop. args "out/minikube-linux-amd64 addons enable metrics-server -p no-preload-20220509085724-6723 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain": exit status 10

start_stop_delete_test.go:217: (dbg) Run:  kubectl --context no-preload-20220509085724-6723 describe deploy/metrics-server -n kube-system

start_stop_delete_test.go:217: (dbg) Non-zero exit: kubectl --context no-preload-20220509085724-6723 describe deploy/metrics-server -n kube-system: exit status 1 (39.543967ms)

** stderr ** 

	error: context "no-preload-20220509085724-6723" does not exist

** /stderr **

start_stop_delete_test.go:219: failed to get info on auto-pause deployments. args "kubectl --context no-preload-20220509085724-6723 describe deploy/metrics-server -n kube-system": exit status 1

start_stop_delete_test.go:223: addon did not load correct image. Expected to contain " fake.domain/k8s.gcr.io/echoserver:1.4". Addon deployment info: 

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/no-preload/serial/EnableAddonWhileActive]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect no-preload-20220509085724-6723

helpers_test.go:231: (dbg) Non-zero exit: docker inspect no-preload-20220509085724-6723: exit status 1 (44.207544ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: no-preload-20220509085724-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723: exit status 85 (67.988919ms)

-- stdout --

	* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "no-preload-20220509085724-6723" host is not running, skipping log retrieval (state="* Profile \"no-preload-20220509085724-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p no-preload-20220509085724-6723\"")

--- FAIL: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.22s)

=== RUN   TestStartStop/group/no-preload/serial/Stop

start_stop_delete_test.go:230: (dbg) Run:  out/minikube-linux-amd64 stop -p no-preload-20220509085724-6723 --alsologtostderr -v=3

start_stop_delete_test.go:230: (dbg) Non-zero exit: out/minikube-linux-amd64 stop -p no-preload-20220509085724-6723 --alsologtostderr -v=3: exit status 85 (68.072732ms)

-- stdout --

	* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

-- /stdout --

** stderr ** 

	I0509 08:57:25.535346  228926 out.go:296] Setting OutFile to fd 1 ...

	I0509 08:57:25.535478  228926 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0509 08:57:25.535489  228926 out.go:309] Setting ErrFile to fd 2...

	I0509 08:57:25.535494  228926 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0509 08:57:25.535632  228926 root.go:322] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/bin

	I0509 08:57:25.535847  228926 out.go:303] Setting JSON to false

	I0509 08:57:25.535884  228926 mustload.go:65] Loading cluster: no-preload-20220509085724-6723

	I0509 08:57:25.538515  228926 out.go:177] * Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	I0509 08:57:25.540384  228926 out.go:177]   To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

** /stderr **

start_stop_delete_test.go:232: failed stopping minikube - first stop-. args "out/minikube-linux-amd64 stop -p no-preload-20220509085724-6723 --alsologtostderr -v=3" : exit status 85

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/no-preload/serial/Stop]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect no-preload-20220509085724-6723

helpers_test.go:231: (dbg) Non-zero exit: docker inspect no-preload-20220509085724-6723: exit status 1 (43.899048ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: no-preload-20220509085724-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723: exit status 85 (68.088404ms)

-- stdout --

	* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "no-preload-20220509085724-6723" host is not running, skipping log retrieval (state="* Profile \"no-preload-20220509085724-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p no-preload-20220509085724-6723\"")

--- FAIL: TestStartStop/group/no-preload/serial/Stop (0.18s)

=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop

start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723

start_stop_delete_test.go:241: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723: exit status 85 (66.340657ms)

-- stdout --

	* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

-- /stdout --

start_stop_delete_test.go:241: status error: exit status 85 (may be ok)

start_stop_delete_test.go:243: expected post-stop host status to be -"Stopped"- but got *"* Profile \"no-preload-20220509085724-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p no-preload-20220509085724-6723\""*

start_stop_delete_test.go:248: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p no-preload-20220509085724-6723 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4

start_stop_delete_test.go:248: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable dashboard -p no-preload-20220509085724-6723 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4: exit status 10 (72.722531ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to MK_ADDON_ENABLE: loading profile: cluster "no-preload-20220509085724-6723" does not exist

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│    * Please also attach the following file to the GitHub issue:                             │

	│    * - /tmp/minikube_addons_a2d68fa011bbbda55500e636dff79fec124b29e3_0.log                  │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

start_stop_delete_test.go:250: failed to enable an addon post-stop. args "out/minikube-linux-amd64 addons enable dashboard -p no-preload-20220509085724-6723 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4": exit status 10

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/no-preload/serial/EnableAddonAfterStop]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect no-preload-20220509085724-6723

helpers_test.go:231: (dbg) Non-zero exit: docker inspect no-preload-20220509085724-6723: exit status 1 (44.646528ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: no-preload-20220509085724-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723: exit status 85 (69.023522ms)

-- stdout --

	* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "no-preload-20220509085724-6723" host is not running, skipping log retrieval (state="* Profile \"no-preload-20220509085724-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p no-preload-20220509085724-6723\"")

--- FAIL: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.25s)

=== RUN   TestStartStop/group/no-preload/serial/SecondStart

start_stop_delete_test.go:258: (dbg) Run:  out/minikube-linux-amd64

start_stop_delete_test.go:264: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723

start_stop_delete_test.go:264: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723: exit status 85 (68.133551ms)

-- stdout --

	* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

-- /stdout --

start_stop_delete_test.go:264: status error: exit status 85 (may be ok)

start_stop_delete_test.go:266: expected host status after start-stop-start to be -"Running"- but got *"* Profile \"no-preload-20220509085724-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p no-preload-20220509085724-6723\""*

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/no-preload/serial/SecondStart]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect no-preload-20220509085724-6723

helpers_test.go:231: (dbg) Non-zero exit: docker inspect no-preload-20220509085724-6723: exit status 1 (43.866123ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: no-preload-20220509085724-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723: exit status 85 (71.813668ms)

-- stdout --

	* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "no-preload-20220509085724-6723" host is not running, skipping log retrieval (state="* Profile \"no-preload-20220509085724-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p no-preload-20220509085724-6723\"")

--- FAIL: TestStartStop/group/no-preload/serial/SecondStart (0.25s)

=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop

start_stop_delete_test.go:277: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-20220509085724-6723" does not exist

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/no-preload/serial/UserAppExistsAfterStop]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect no-preload-20220509085724-6723

helpers_test.go:231: (dbg) Non-zero exit: docker inspect no-preload-20220509085724-6723: exit status 1 (46.008858ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: no-preload-20220509085724-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723: exit status 85 (69.596402ms)

-- stdout --

	* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "no-preload-20220509085724-6723" host is not running, skipping log retrieval (state="* Profile \"no-preload-20220509085724-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p no-preload-20220509085724-6723\"")

--- FAIL: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.12s)

=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop

start_stop_delete_test.go:290: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-20220509085724-6723" does not exist

start_stop_delete_test.go:293: (dbg) Run:  kubectl --context no-preload-20220509085724-6723 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard

start_stop_delete_test.go:293: (dbg) Non-zero exit: kubectl --context no-preload-20220509085724-6723 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (46.979521ms)

** stderr ** 

	error: context "no-preload-20220509085724-6723" does not exist

** /stderr **

start_stop_delete_test.go:295: failed to get info on kubernetes-dashboard deployments. args "kubectl --context no-preload-20220509085724-6723 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1

start_stop_delete_test.go:299: addon did not load correct image. Expected to contain " k8s.gcr.io/echoserver:1.4". Addon deployment info: 

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/no-preload/serial/AddonExistsAfterStop]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect no-preload-20220509085724-6723

helpers_test.go:231: (dbg) Non-zero exit: docker inspect no-preload-20220509085724-6723: exit status 1 (46.102596ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: no-preload-20220509085724-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723: exit status 85 (70.69359ms)

-- stdout --

	* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "no-preload-20220509085724-6723" host is not running, skipping log retrieval (state="* Profile \"no-preload-20220509085724-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p no-preload-20220509085724-6723\"")

--- FAIL: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.16s)

=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages

start_stop_delete_test.go:306: (dbg) Run:  out/minikube-linux-amd64 ssh -p no-preload-20220509085724-6723 "sudo crictl images -o json"

start_stop_delete_test.go:306: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p no-preload-20220509085724-6723 "sudo crictl images -o json": exit status 85 (67.381998ms)

-- stdout --

	* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

-- /stdout --

start_stop_delete_test.go:306: failed tp get images inside minikube. args "out/minikube-linux-amd64 ssh -p no-preload-20220509085724-6723 \"sudo crictl images -o json\"": exit status 85

start_stop_delete_test.go:306: failed to decode images json invalid character '*' looking for beginning of value. output:

* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

start_stop_delete_test.go:306: v1.24.1-rc.0 images missing (-want +got):

  []string{

- 	"gcr.io/k8s-minikube/storage-provisioner:v5",

- 	"k8s.gcr.io/coredns/coredns:v1.8.6",

- 	"k8s.gcr.io/etcd:3.5.3-0",

- 	"k8s.gcr.io/kube-apiserver:v1.24.1-rc.0",

- 	"k8s.gcr.io/kube-controller-manager:v1.24.1-rc.0",

- 	"k8s.gcr.io/kube-proxy:v1.24.1-rc.0",

- 	"k8s.gcr.io/kube-scheduler:v1.24.1-rc.0",

- 	"k8s.gcr.io/pause:3.7",

  }

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/no-preload/serial/VerifyKubernetesImages]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect no-preload-20220509085724-6723

helpers_test.go:231: (dbg) Non-zero exit: docker inspect no-preload-20220509085724-6723: exit status 1 (43.771502ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: no-preload-20220509085724-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723

=== CONT  TestStartStop/group/no-preload/serial/VerifyKubernetesImages

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723: exit status 85 (79.624701ms)

-- stdout --

	* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "no-preload-20220509085724-6723" host is not running, skipping log retrieval (state="* Profile \"no-preload-20220509085724-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p no-preload-20220509085724-6723\"")

--- FAIL: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.19s)

=== RUN   TestStartStop/group/no-preload/serial/Pause

start_stop_delete_test.go:313: (dbg) Run:  out/minikube-linux-amd64 pause -p no-preload-20220509085724-6723 --alsologtostderr -v=1

=== CONT  TestStartStop/group/no-preload/serial/Pause

start_stop_delete_test.go:313: (dbg) Non-zero exit: out/minikube-linux-amd64 pause -p no-preload-20220509085724-6723 --alsologtostderr -v=1: exit status 85 (73.198224ms)

-- stdout --

	* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

-- /stdout --

** stderr ** 

	I0509 08:57:26.696837  229235 out.go:296] Setting OutFile to fd 1 ...

	I0509 08:57:26.696984  229235 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0509 08:57:26.696996  229235 out.go:309] Setting ErrFile to fd 2...

	I0509 08:57:26.697002  229235 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0509 08:57:26.697136  229235 root.go:322] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/bin

	I0509 08:57:26.697320  229235 out.go:303] Setting JSON to false

	I0509 08:57:26.697340  229235 mustload.go:65] Loading cluster: no-preload-20220509085724-6723

	I0509 08:57:26.699868  229235 out.go:177] * Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	I0509 08:57:26.701615  229235 out.go:177]   To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

** /stderr **

start_stop_delete_test.go:313: out/minikube-linux-amd64 pause -p no-preload-20220509085724-6723 --alsologtostderr -v=1 failed: exit status 85

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/no-preload/serial/Pause]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect no-preload-20220509085724-6723

helpers_test.go:231: (dbg) Non-zero exit: docker inspect no-preload-20220509085724-6723: exit status 1 (44.806072ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: no-preload-20220509085724-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723: exit status 85 (70.359049ms)

-- stdout --

	* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "no-preload-20220509085724-6723" host is not running, skipping log retrieval (state="* Profile \"no-preload-20220509085724-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p no-preload-20220509085724-6723\"")

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/no-preload/serial/Pause]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect no-preload-20220509085724-6723

helpers_test.go:231: (dbg) Non-zero exit: docker inspect no-preload-20220509085724-6723: exit status 1 (45.075448ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: no-preload-20220509085724-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-20220509085724-6723 -n no-preload-20220509085724-6723: exit status 85 (69.443116ms)

-- stdout --

	* Profile "no-preload-20220509085724-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p no-preload-20220509085724-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "no-preload-20220509085724-6723" host is not running, skipping log retrieval (state="* Profile \"no-preload-20220509085724-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p no-preload-20220509085724-6723\"")

--- FAIL: TestStartStop/group/no-preload/serial/Pause (0.30s)

=== RUN   TestStartStop/group/embed-certs/serial/DeployApp

start_stop_delete_test.go:198: (dbg) Run:  kubectl --context embed-certs-20220509085727-6723 create -f testdata/busybox.yaml

start_stop_delete_test.go:198: (dbg) Non-zero exit: kubectl --context embed-certs-20220509085727-6723 create -f testdata/busybox.yaml: exit status 1 (46.523775ms)

** stderr ** 

	error: context "embed-certs-20220509085727-6723" does not exist

** /stderr **

start_stop_delete_test.go:198: kubectl --context embed-certs-20220509085727-6723 create -f testdata/busybox.yaml failed: exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/DeployApp]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-20220509085727-6723

helpers_test.go:231: (dbg) Non-zero exit: docker inspect embed-certs-20220509085727-6723: exit status 1 (53.659392ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: embed-certs-20220509085727-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723: exit status 85 (81.400385ms)

-- stdout --

	* Profile "embed-certs-20220509085727-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p embed-certs-20220509085727-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "embed-certs-20220509085727-6723" host is not running, skipping log retrieval (state="* Profile \"embed-certs-20220509085727-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p embed-certs-20220509085727-6723\"")

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/DeployApp]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-20220509085727-6723

=== CONT  TestStartStop/group/embed-certs/serial/DeployApp

helpers_test.go:231: (dbg) Non-zero exit: docker inspect embed-certs-20220509085727-6723: exit status 1 (51.60948ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: embed-certs-20220509085727-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723

=== CONT  TestStartStop/group/embed-certs/serial/DeployApp

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723: exit status 85 (73.49308ms)

-- stdout --

	* Profile "embed-certs-20220509085727-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p embed-certs-20220509085727-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "embed-certs-20220509085727-6723" host is not running, skipping log retrieval (state="* Profile \"embed-certs-20220509085727-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p embed-certs-20220509085727-6723\"")

--- FAIL: TestStartStop/group/embed-certs/serial/DeployApp (0.31s)

=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive

start_stop_delete_test.go:207: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-20220509085727-6723 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain

start_stop_delete_test.go:207: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-20220509085727-6723 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain: exit status 10 (112.513451ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to MK_ADDON_ENABLE: loading profile: cluster "embed-certs-20220509085727-6723" does not exist

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│    * Please also attach the following file to the GitHub issue:                             │

	│    * - /tmp/minikube_addons_2bafae6fa40fec163538f94366e390b0317a8b15_0.log                  │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

start_stop_delete_test.go:209: failed to enable an addon post-stop. args "out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-20220509085727-6723 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain": exit status 10

start_stop_delete_test.go:217: (dbg) Run:  kubectl --context embed-certs-20220509085727-6723 describe deploy/metrics-server -n kube-system

start_stop_delete_test.go:217: (dbg) Non-zero exit: kubectl --context embed-certs-20220509085727-6723 describe deploy/metrics-server -n kube-system: exit status 1 (42.997002ms)

** stderr ** 

	error: context "embed-certs-20220509085727-6723" does not exist

** /stderr **

start_stop_delete_test.go:219: failed to get info on auto-pause deployments. args "kubectl --context embed-certs-20220509085727-6723 describe deploy/metrics-server -n kube-system": exit status 1

start_stop_delete_test.go:223: addon did not load correct image. Expected to contain " fake.domain/k8s.gcr.io/echoserver:1.4". Addon deployment info: 

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/EnableAddonWhileActive]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-20220509085727-6723

helpers_test.go:231: (dbg) Non-zero exit: docker inspect embed-certs-20220509085727-6723: exit status 1 (58.516593ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: embed-certs-20220509085727-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723: exit status 85 (74.139155ms)

-- stdout --

	* Profile "embed-certs-20220509085727-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p embed-certs-20220509085727-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "embed-certs-20220509085727-6723" host is not running, skipping log retrieval (state="* Profile \"embed-certs-20220509085727-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p embed-certs-20220509085727-6723\"")

--- FAIL: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.29s)

=== RUN   TestStartStop/group/embed-certs/serial/Stop

start_stop_delete_test.go:230: (dbg) Run:  out/minikube-linux-amd64 stop -p embed-certs-20220509085727-6723 --alsologtostderr -v=3

start_stop_delete_test.go:230: (dbg) Non-zero exit: out/minikube-linux-amd64 stop -p embed-certs-20220509085727-6723 --alsologtostderr -v=3: exit status 85 (76.538728ms)

-- stdout --

	* Profile "embed-certs-20220509085727-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p embed-certs-20220509085727-6723"

-- /stdout --

** stderr ** 

	I0509 08:57:27.836323  229767 out.go:296] Setting OutFile to fd 1 ...

	I0509 08:57:27.836505  229767 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0509 08:57:27.836519  229767 out.go:309] Setting ErrFile to fd 2...

	I0509 08:57:27.836525  229767 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I0509 08:57:27.836738  229767 root.go:322] Updating PATH: /home/jenkins/minikube-integration/linux-amd64-docker-docker-14070-3366-00cd5342a55ca888d8306eb2334aa46bcc205630/.minikube/bin

	I0509 08:57:27.836993  229767 out.go:303] Setting JSON to false

	I0509 08:57:27.837031  229767 mustload.go:65] Loading cluster: embed-certs-20220509085727-6723

	I0509 08:57:27.839211  229767 out.go:177] * Profile "embed-certs-20220509085727-6723" not found. Run "minikube profile list" to view all profiles.

	I0509 08:57:27.840751  229767 out.go:177]   To start a cluster, run: "minikube start -p embed-certs-20220509085727-6723"

** /stderr **

start_stop_delete_test.go:232: failed stopping minikube - first stop-. args "out/minikube-linux-amd64 stop -p embed-certs-20220509085727-6723 --alsologtostderr -v=3" : exit status 85

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/Stop]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-20220509085727-6723

=== CONT  TestStartStop/group/embed-certs/serial/Stop

helpers_test.go:231: (dbg) Non-zero exit: docker inspect embed-certs-20220509085727-6723: exit status 1 (46.315586ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: embed-certs-20220509085727-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723: exit status 85 (74.893024ms)

-- stdout --

	* Profile "embed-certs-20220509085727-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p embed-certs-20220509085727-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "embed-certs-20220509085727-6723" host is not running, skipping log retrieval (state="* Profile \"embed-certs-20220509085727-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p embed-certs-20220509085727-6723\"")

--- FAIL: TestStartStop/group/embed-certs/serial/Stop (0.20s)

=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop

start_stop_delete_test.go:241: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723

start_stop_delete_test.go:241: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723: exit status 85 (77.513596ms)

-- stdout --

	* Profile "embed-certs-20220509085727-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p embed-certs-20220509085727-6723"

-- /stdout --

start_stop_delete_test.go:241: status error: exit status 85 (may be ok)

start_stop_delete_test.go:243: expected post-stop host status to be -"Stopped"- but got *"* Profile \"embed-certs-20220509085727-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p embed-certs-20220509085727-6723\""*

start_stop_delete_test.go:248: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p embed-certs-20220509085727-6723 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4

start_stop_delete_test.go:248: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable dashboard -p embed-certs-20220509085727-6723 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4: exit status 10 (91.603074ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to MK_ADDON_ENABLE: loading profile: cluster "embed-certs-20220509085727-6723" does not exist

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│    * Please also attach the following file to the GitHub issue:                             │

	│    * - /tmp/minikube_addons_a2d68fa011bbbda55500e636dff79fec124b29e3_0.log                  │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

start_stop_delete_test.go:250: failed to enable an addon post-stop. args "out/minikube-linux-amd64 addons enable dashboard -p embed-certs-20220509085727-6723 --images=MetricsScraper=k8s.gcr.io/echoserver:1.4": exit status 10

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/EnableAddonAfterStop]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-20220509085727-6723

helpers_test.go:231: (dbg) Non-zero exit: docker inspect embed-certs-20220509085727-6723: exit status 1 (59.411062ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: embed-certs-20220509085727-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723: exit status 85 (80.207359ms)

-- stdout --

	* Profile "embed-certs-20220509085727-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p embed-certs-20220509085727-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "embed-certs-20220509085727-6723" host is not running, skipping log retrieval (state="* Profile \"embed-certs-20220509085727-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p embed-certs-20220509085727-6723\"")

--- FAIL: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.31s)

=== RUN   TestStartStop/group/embed-certs/serial/SecondStart

start_stop_delete_test.go:258: (dbg) Run:  out/minikube-linux-amd64

=== CONT  TestStartStop/group/embed-certs/serial/SecondStart

start_stop_delete_test.go:264: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723

=== CONT  TestStartStop/group/embed-certs/serial/SecondStart

start_stop_delete_test.go:264: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723: exit status 85 (91.265821ms)

-- stdout --

	* Profile "embed-certs-20220509085727-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p embed-certs-20220509085727-6723"

-- /stdout --

start_stop_delete_test.go:264: status error: exit status 85 (may be ok)

start_stop_delete_test.go:266: expected host status after start-stop-start to be -"Running"- but got *"* Profile \"embed-certs-20220509085727-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p embed-certs-20220509085727-6723\""*

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/SecondStart]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-20220509085727-6723

=== CONT  TestStartStop/group/embed-certs/serial/SecondStart

helpers_test.go:231: (dbg) Non-zero exit: docker inspect embed-certs-20220509085727-6723: exit status 1 (45.70847ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: embed-certs-20220509085727-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723

=== CONT  TestStartStop/group/embed-certs/serial/SecondStart

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723: exit status 85 (75.395ms)

-- stdout --

	* Profile "embed-certs-20220509085727-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p embed-certs-20220509085727-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "embed-certs-20220509085727-6723" host is not running, skipping log retrieval (state="* Profile \"embed-certs-20220509085727-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p embed-certs-20220509085727-6723\"")

--- FAIL: TestStartStop/group/embed-certs/serial/SecondStart (0.30s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/DeployApp

start_stop_delete_test.go:198: (dbg) Run:  kubectl --context default-k8s-different-port-20220509085728-6723 create -f testdata/busybox.yaml

=== CONT  TestStartStop/group/default-k8s-different-port/serial/DeployApp

start_stop_delete_test.go:198: (dbg) Non-zero exit: kubectl --context default-k8s-different-port-20220509085728-6723 create -f testdata/busybox.yaml: exit status 1 (46.969288ms)

** stderr ** 

	error: context "default-k8s-different-port-20220509085728-6723" does not exist

** /stderr **

start_stop_delete_test.go:198: kubectl --context default-k8s-different-port-20220509085728-6723 create -f testdata/busybox.yaml failed: exit status 1

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/default-k8s-different-port/serial/DeployApp]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect default-k8s-different-port-20220509085728-6723

=== CONT  TestStartStop/group/default-k8s-different-port/serial/DeployApp

helpers_test.go:231: (dbg) Non-zero exit: docker inspect default-k8s-different-port-20220509085728-6723: exit status 1 (46.033725ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: default-k8s-different-port-20220509085728-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20220509085728-6723 -n default-k8s-different-port-20220509085728-6723

=== CONT  TestStartStop/group/default-k8s-different-port/serial/DeployApp

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20220509085728-6723 -n default-k8s-different-port-20220509085728-6723: exit status 85 (74.613389ms)

-- stdout --

	* Profile "default-k8s-different-port-20220509085728-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p default-k8s-different-port-20220509085728-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "default-k8s-different-port-20220509085728-6723" host is not running, skipping log retrieval (state="* Profile \"default-k8s-different-port-20220509085728-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p default-k8s-different-port-20220509085728-6723\"")

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/default-k8s-different-port/serial/DeployApp]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect default-k8s-different-port-20220509085728-6723

=== CONT  TestStartStop/group/default-k8s-different-port/serial/DeployApp

helpers_test.go:231: (dbg) Non-zero exit: docker inspect default-k8s-different-port-20220509085728-6723: exit status 1 (45.979872ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: default-k8s-different-port-20220509085728-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20220509085728-6723 -n default-k8s-different-port-20220509085728-6723

=== CONT  TestStartStop/group/default-k8s-different-port/serial/DeployApp

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20220509085728-6723 -n default-k8s-different-port-20220509085728-6723: exit status 85 (75.257966ms)

-- stdout --

	* Profile "default-k8s-different-port-20220509085728-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p default-k8s-different-port-20220509085728-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "default-k8s-different-port-20220509085728-6723" host is not running, skipping log retrieval (state="* Profile \"default-k8s-different-port-20220509085728-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p default-k8s-different-port-20220509085728-6723\"")

--- FAIL: TestStartStop/group/default-k8s-different-port/serial/DeployApp (0.29s)

=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop

start_stop_delete_test.go:277: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-20220509085727-6723" does not exist

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-20220509085727-6723

=== CONT  TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop

helpers_test.go:231: (dbg) Non-zero exit: docker inspect embed-certs-20220509085727-6723: exit status 1 (46.627704ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: embed-certs-20220509085727-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723

=== CONT  TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723: exit status 85 (77.789416ms)

-- stdout --

	* Profile "embed-certs-20220509085727-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p embed-certs-20220509085727-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "embed-certs-20220509085727-6723" host is not running, skipping log retrieval (state="* Profile \"embed-certs-20220509085727-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p embed-certs-20220509085727-6723\"")

--- FAIL: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.13s)

=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop

start_stop_delete_test.go:290: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-20220509085727-6723" does not exist

start_stop_delete_test.go:293: (dbg) Run:  kubectl --context embed-certs-20220509085727-6723 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard

=== CONT  TestStartStop/group/embed-certs/serial/AddonExistsAfterStop

start_stop_delete_test.go:293: (dbg) Non-zero exit: kubectl --context embed-certs-20220509085727-6723 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (44.730169ms)

** stderr ** 

	error: context "embed-certs-20220509085727-6723" does not exist

** /stderr **

start_stop_delete_test.go:295: failed to get info on kubernetes-dashboard deployments. args "kubectl --context embed-certs-20220509085727-6723 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1

start_stop_delete_test.go:299: addon did not load correct image. Expected to contain " k8s.gcr.io/echoserver:1.4". Addon deployment info: 

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/embed-certs/serial/AddonExistsAfterStop]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect embed-certs-20220509085727-6723

=== CONT  TestStartStop/group/embed-certs/serial/AddonExistsAfterStop

helpers_test.go:231: (dbg) Non-zero exit: docker inspect embed-certs-20220509085727-6723: exit status 1 (48.610014ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: embed-certs-20220509085727-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723

=== CONT  TestStartStop/group/embed-certs/serial/AddonExistsAfterStop

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-20220509085727-6723 -n embed-certs-20220509085727-6723: exit status 85 (70.719956ms)

-- stdout --

	* Profile "embed-certs-20220509085727-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p embed-certs-20220509085727-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "embed-certs-20220509085727-6723" host is not running, skipping log retrieval (state="* Profile \"embed-certs-20220509085727-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p embed-certs-20220509085727-6723\"")

--- FAIL: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.17s)

=== RUN   TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive

start_stop_delete_test.go:207: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-different-port-20220509085728-6723 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain

=== CONT  TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive

start_stop_delete_test.go:207: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-different-port-20220509085728-6723 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain: exit status 10 (82.196097ms)

-- stdout --

-- /stdout --

** stderr ** 

	X Exiting due to MK_ADDON_ENABLE: loading profile: cluster "default-k8s-different-port-20220509085728-6723" does not exist

	* 

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│    * Please also attach the following file to the GitHub issue:                             │

	│    * - /tmp/minikube_addons_2bafae6fa40fec163538f94366e390b0317a8b15_0.log                  │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

** /stderr **

start_stop_delete_test.go:209: failed to enable an addon post-stop. args "out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-different-port-20220509085728-6723 --images=MetricsServer=k8s.gcr.io/echoserver:1.4 --registries=MetricsServer=fake.domain": exit status 10

start_stop_delete_test.go:217: (dbg) Run:  kubectl --context default-k8s-different-port-20220509085728-6723 describe deploy/metrics-server -n kube-system

=== CONT  TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive

start_stop_delete_test.go:217: (dbg) Non-zero exit: kubectl --context default-k8s-different-port-20220509085728-6723 describe deploy/metrics-server -n kube-system: exit status 1 (46.528701ms)

** stderr ** 

	error: context "default-k8s-different-port-20220509085728-6723" does not exist

** /stderr **

start_stop_delete_test.go:219: failed to get info on auto-pause deployments. args "kubectl --context default-k8s-different-port-20220509085728-6723 describe deploy/metrics-server -n kube-system": exit status 1

start_stop_delete_test.go:223: addon did not load correct image. Expected to contain " fake.domain/k8s.gcr.io/echoserver:1.4". Addon deployment info: 

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect default-k8s-different-port-20220509085728-6723

=== CONT  TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive

helpers_test.go:231: (dbg) Non-zero exit: docker inspect default-k8s-different-port-20220509085728-6723: exit status 1 (48.846638ms)

-- stdout --

	[]

-- /stdout --

** stderr ** 

	Error: No such object: default-k8s-different-port-20220509085728-6723

** /stderr **

helpers_test.go:233: failed to get docker inspect: exit status 1

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20220509085728-6723 -n default-k8s-different-port-20220509085728-6723

=== CONT  TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-different-port-20220509085728-6723 -n default-k8s-different-port-20220509085728-6723: exit status 85 (77.662985ms)

-- stdout --

	* Profile "default-k8s-different-port-20220509085728-6723" not found. Run "minikube profile list" to view all profiles.

	  To start a cluster, run: "minikube start -p default-k8s-different-port-20220509085728-6723"

-- /stdout --

helpers_test.go:239: status error: exit status 85 (may be ok)

helpers_test.go:241: "default-k8s-different-port-20220509085728-6723" host is not running, skipping log retrieval (state="* Profile \"default-k8s-different-port-20220509085728-6723\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p default-k8s-different-port-20220509085728-6723\"")

--- FAIL: TestStartStop/group/default-k8s-different-port/serial/EnableAddonWhileActive (0.26s)